2020-09-29T18:00:01.380Z,1601402401.380 [Supervisor](IMPORTANT): Reading configuration overrides from Data/persisted.cfg 2020-09-29T18:00:06.057Z,1601402406.057 [SBIT](IMPORTANT): git: 2020-08-31-22-g228fdf4 2020-09-29T18:00:06.058Z,1601402406.058 [SBIT](IMPORTANT): Kernel Release: 2.6.27.8 2020-09-29T18:00:06.642Z,1601402406.642 [CommandLine](IMPORTANT): got command ! echo 1 > /dev/loadB2 2020-09-29T18:00:06.843Z,1601402406.843 [DropWeight](CRITICAL): DROP WEIGHT MISSING. 2020-09-29T18:00:06.876Z,1601402406.876 [CommandLine](FAULT): Scheduling is paused 2020-09-29T18:00:06.879Z,1601402406.879 [CBIT](CRITICAL): Hardware Fault in component: DropWeight 2020-09-29T18:00:07.534Z,1601402407.534 [RudderServo](FAULT): Rudder failed to initialize 2020-09-29T18:00:16.207Z,1601402416.207 [CBIT](CRITICAL): Environmental Failure. Press:14.460026 PSI. Humidity:54%. Temp:22 C. ABORTING MISSION 2020-09-29T18:00:36.395Z,1601402436.395 [DAT](FAULT): failed to enter command mode 2020-09-29T18:01:45.494Z,1601402505.494 [SBIT](IMPORTANT): Beginning Startup BIT 2020-09-29T18:01:45.515Z,1601402505.515 [CBIT](IMPORTANT): Beginning ground fault scan 2020-09-29T18:01:56.843Z,1601402516.843 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): 0.012256 CHAN A1 (24V): 0.003151 CHAN A2 (12V): -0.006765 CHAN A3 (5V): -0.002128 CHAN B0 (3.3V): 0.000104 CHAN B1 (3.15aV): -0.000213 CHAN B2 (3.15bV): -0.000663 CHAN B3 (GND): 0.002122 OPEN: 0.005411 Full Scale Calc: 4.765 mA, -1.589 mA 2020-09-29T18:02:39.236Z,1601402559.236 [SBIT](IMPORTANT): SBIT PASSED 2020-09-29T18:02:39.236Z,1601402559.236 [SBIT](IMPORTANT): Listing configuration overrides from Data/persisted.cfg 2020-09-29T18:02:39.237Z,1601402559.237 [SBIT](IMPORTANT): AMEcho.loadAtStartup=0 bool; 2020-09-29T18:02:39.237Z,1601402559.237 [SBIT](IMPORTANT): BPC1.batteryMissingStickThreshold=6 count; 2020-09-29T18:02:39.237Z,1601402559.237 [SBIT](IMPORTANT): BuoyancyServo.loadAtStartup=0 bool; 2020-09-29T18:02:39.237Z,1601402559.237 [SBIT](IMPORTANT): CBIT.gf24Offset=145 microampere; 2020-09-29T18:02:39.237Z,1601402559.237 [SBIT](IMPORTANT): DAT.loadAtStartup=1 bool; 2020-09-29T18:02:39.237Z,1601402559.237 [SBIT](IMPORTANT): DAT.sbdAddress=-1 enum; 2020-09-29T18:02:39.237Z,1601402559.237 [SBIT](IMPORTANT): DAT.surfaceThreshold=100 meter; 2020-09-29T18:02:39.238Z,1601402559.238 [SBIT](IMPORTANT): DAT.verbosity=0 count; 2020-09-29T18:02:39.238Z,1601402559.238 [SBIT](IMPORTANT): ESPComponent.loadAtStartup=1 bool; 2020-09-29T18:02:39.238Z,1601402559.238 [SBIT](IMPORTANT): Express linearApproximation AMEcho.altitude 1.000000 meter; 2020-09-29T18:02:39.250Z,1601402559.250 [SBIT](IMPORTANT): Express none ThrusterServo.component_avgCurrent; 2020-09-29T18:02:39.250Z,1601402559.250 [SBIT](IMPORTANT): Express linearApproximation WetLabsUBAT.flow_rate 1.000000 liter_per_second; 2020-09-29T18:02:39.250Z,1601402559.250 [SBIT](IMPORTANT): Express linearApproximation height_above_sea_floor 5.000000 meter; 2020-09-29T18:02:39.250Z,1601402559.250 [SBIT](IMPORTANT): IBIT.batteryVoltageThreshold=13 volt; 2020-09-29T18:02:39.250Z,1601402559.250 [SBIT](IMPORTANT): RDI_Pathfinder.loadAtStartup=1 bool; 2020-09-29T18:02:39.250Z,1601402559.250 [SBIT](IMPORTANT): VerticalControl.buoyancyNeutral=170 cubic_centimeter; 2020-09-29T18:02:39.251Z,1601402559.251 [SBIT](IMPORTANT): VerticalControl.massDefault=20 millimeter; 2020-09-29T18:02:39.251Z,1601402559.251 [SBIT](IMPORTANT): WetLabsUBAT.loadAtStartup=0 bool; 2020-09-29T18:02:39.628Z,1601402559.628 [MissionManager](IMPORTANT): Started mission Startup 2020-09-29T18:04:40.569Z,1601402680.569 [MissionManager](IMPORTANT): Started mission Default 2020-09-29T18:05:46.891Z,1601402746.891 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2020-09-29T18:08:31.840Z,1601402911.840 [DataOverHttps](IMPORTANT): SBD MTMSN=20200929T180830 2020-09-29T18:08:39.278Z,1601402919.278 [CommandLine](IMPORTANT): got command load ./Missions/Maintenance/sample.xml 2020-09-29T18:08:39.829Z,1601402919.829 [CommandLine](IMPORTANT): Loaded ./Missions/Maintenance/sample.xml 2020-09-29T18:08:46.013Z,1601402926.013 [CommandLine](IMPORTANT): got command set sample.Depth 1.000000 centimeter 2020-09-29T18:08:46.014Z,1601402926.014 [CommandLine](IMPORTANT): got command set sample.NumberOfSamples 2.000000 count 2020-09-29T18:08:46.015Z,1601402926.015 [CommandLine](IMPORTANT): got command set sample.WaitBeforeSample 2.000000 second 2020-09-29T18:08:46.016Z,1601402926.016 [CommandLine](IMPORTANT): got command set sample.Depth 1.000000 centimeter 2020-09-29T18:08:46.016Z,1601402926.016 [CommandLine](IMPORTANT): got command run 2020-09-29T18:08:46.018Z,1601402926.018 [CommandLine](IMPORTANT): Running 2020-09-29T18:08:46.291Z,1601402926.291 [MissionManager](IMPORTANT): Started mission sample 2020-09-29T18:10:46.267Z,1601403046.267 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-09-29T18:14:06.504Z,1601403246.504 [CommandLine](IMPORTANT): got command get ESPComponent.loadAtStartup 2020-09-29T18:14:06.504Z,1601403246.504 [CommandLine](IMPORTANT): ESPComponent.loadAtStartup 1 bool 2020-09-29T18:21:29.840Z,1601403689.840 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-09-29T18:29:21.898Z,1601404161.898 [CommandLine](IMPORTANT): got command maintain sensor Depth_Keller.depth 1.000000 centimeter 2020-09-29T18:29:22.952Z,1601404162.952 [sample:SampleAtDepth:SampleWrapper:B](IMPORTANT): At 0.010000 m , settling for 0.033333 min 2020-09-29T18:29:27.392Z,1601404167.392 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::' 2020-09-29T18:29:37.545Z,1601404177.545 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 134.89.10.51:134.89.10.60 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 134.89.10.32 ms-dns 134.89.10.10 2020-09-29T18:29:37.719Z,1601404177.719 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-09-29T18:30:11.018Z,1601404211.018 [ESPComponent](IMPORTANT): ESP has connected as client 2020-09-29T18:30:11.836Z,1601404211.836 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -4 2020-09-29T18:30:11.837Z,1601404211.837 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-09-29T18:30:12.282Z,1601404212.282 [sample:SampleAtDepth:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 0.010000 m in nan degC water with nan ug/l chlorophyll fluorescence. 2020-09-29T18:30:13.030Z,1601404213.030 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG 2020-09-29T18:30:13.442Z,1601404213.442 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-09-29T18:30:15.115Z,1601404215.115 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE 2020-09-29T18:30:51.020Z,1601404251.020 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PRIMING (@7,archiveHiBiomass_bac) 2020-09-29T18:30:52.649Z,1601404252.649 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PRIMING (@5.0) 2020-09-29T18:30:53.456Z,1601404253.456 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_FILTERING (@5.0) 2020-09-29T18:32:12.612Z,1601404332.612 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-09-29T18:32:38.473Z,1601404358.473 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_FILTERING (@0.0) 2020-09-29T18:32:38.884Z,1601404358.884 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-09-29T18:32:55.857Z,1601404375.857 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PAUSED (@10.0) 2020-09-29T18:32:56.253Z,1601404376.253 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PROCESSING (@10.0) 2020-09-29T18:32:58.670Z,1601404378.670 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PROCESSED (@5,archiveHiBiomass_bac) 2020-09-29T18:36:31.587Z,1601404591.587 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING (@5,archiveHiBiomass_bac) 2020-09-29T18:36:58.276Z,1601404618.276 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-09-29T18:36:58.669Z,1601404618.669 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED 2020-09-29T18:41:58.454Z,1601404918.454 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence completed normally. 2020-09-29T18:41:58.849Z,1601404918.849 [ESPComponent](IMPORTANT): [sample #1] ESP log summary report (8 messages): @11:30:22.00 Selecting Cartridge 7 @11:31:26.31 Cartridge::Sampler::Leak in FILTERING -- Pumped 0.20ml into cartridge without reaching 26psi @11:31:26.32 Retry #1 of 2 @11:31:26.37 Selecting Cartridge 6 @11:32:02.60 Cartridge::Sampler::Leak in FILTERING -- Pumped 0.20ml into cartridge without reaching 26psi @11:32:02.61 Retry #2 of 2 @11:32:02.66 Selecting Cartridge 5 @11:32:53.90 Sampled 10.0ml 2020-09-29T18:42:00.052Z,1601404920.052 [sample:SampleAtDepth:SampleWrapper:B](IMPORTANT): At 0.010000 m , settling for 0.033333 min 2020-09-29T18:42:14.694Z,1601404934.694 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 134.89.10.51:134.89.10.60 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 134.89.10.32 ms-dns 134.89.10.10 2020-09-29T18:42:14.833Z,1601404934.833 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-09-29T18:42:48.130Z,1601404968.130 [ESPComponent](IMPORTANT): ESP has connected as client 2020-09-29T18:42:48.938Z,1601404968.938 [ESPComponent](IMPORTANT): [sample #2] Setting cartridge argument to -4 2020-09-29T18:42:48.938Z,1601404968.938 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-09-29T18:42:49.381Z,1601404969.381 [sample:SampleAtDepth:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 0.010000 m in nan degC water with nan ug/l chlorophyll fluorescence. 2020-09-29T18:42:49.749Z,1601404969.749 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_LOG 2020-09-29T18:42:50.167Z,1601404970.167 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-09-29T18:42:52.169Z,1601404972.169 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_LOADING_CARTRIDGE 2020-09-29T18:42:56.196Z,1601404976.196 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-09-29T18:43:28.113Z,1601405008.113 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PRIMING (@7,archiveHiBiomass_bac) 2020-09-29T18:43:29.740Z,1601405009.740 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PRIMING (@5.0) 2020-09-29T18:43:30.538Z,1601405010.538 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_FILTERING (@5.0) 2020-09-29T18:45:08.299Z,1601405108.299 [DropWeight](CRITICAL): DROP WEIGHT MISSING. 2020-09-29T18:45:08.399Z,1601405108.399 [CBIT](CRITICAL): Hardware Fault in component: DropWeight 2020-09-29T18:45:09.117Z,1601405109.117 [ESPComponent](IMPORTANT): [sample #2] Stop sampling requested. 2020-09-29T18:45:09.123Z,1601405109.123 [MissionManager](IMPORTANT): Started mission Default 2020-09-29T18:45:09.513Z,1601405109.513 [ESPComponent](IMPORTANT): Stop sampling requested. Issuing Cmd.stop 2020-09-29T18:45:09.940Z,1601405109.940 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPING (@5.0) 2020-09-29T18:45:26.098Z,1601405126.098 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-09-29T18:45:26.505Z,1601405126.505 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPED 2020-09-29T18:50:26.301Z,1601405426.301 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence completed normally. 2020-09-29T18:50:26.666Z,1601405426.666 [ESPComponent](IMPORTANT): [sample #2] ESP log summary report (7 messages): @11:42:59.24 Selecting Cartridge 7 @11:44:03.35 Cartridge::Sampler::Leak in FILTERING -- Pumped 0.20ml into cartridge without reaching 26psi @11:44:03.36 Retry #1 of 2 @11:44:03.40 Selecting Cartridge 6 @11:44:39.64 Cartridge::Sampler::Leak in FILTERING -- Pumped 0.20ml into cartridge without reaching 26psi @11:44:39.66 Retry #2 of 2 @11:44:39.70 Selecting Cartridge 5 2020-09-29T18:52:19.531Z,1601405539.531 [CommandLine](IMPORTANT): got command configSet DropWeight.loadAtStartup 0.000000 bool persist 2020-09-29T18:52:19.532Z,1601405539.532 [CommandLine](IMPORTANT): configSet DropWeight.loadAtStartup requires a restart to take effect. 2020-09-29T18:53:39.859Z,1601405619.859 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-09-29T18:53:39.920Z,1601405619.920 [CBIT](CRITICAL): Data Fault in component: NAL9602 2020-09-29T18:56:52.595Z,1601405812.595 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.718019 min 2020-09-29T18:58:14.673Z,1601405894.673 [CommandLine](IMPORTANT): got command restart application