2020-09-29T18:58:27.537Z,1601405907.537 [Supervisor](IMPORTANT): Reading configuration overrides from Data/persisted.cfg
2020-09-29T18:58:32.596Z,1601405912.596 [SBIT](IMPORTANT): git: 2020-08-31-22-g228fdf4
2020-09-29T18:58:32.597Z,1601405912.597 [SBIT](IMPORTANT): Kernel Release: 2.6.27.8
2020-09-29T18:58:33.082Z,1601405913.082 [CommandLine](IMPORTANT): got command ! echo 1 > /dev/loadB2
2020-09-29T18:58:34.082Z,1601405914.082 [RudderServo](FAULT): Rudder failed to initialize
2020-09-29T18:58:42.759Z,1601405922.759 [CBIT](CRITICAL): Environmental Failure. Press:14.439201 PSI. Humidity:55%. Temp:22 C. ABORTING MISSION
2020-09-29T18:58:43.143Z,1601405923.143 [CommandLine](FAULT): Scheduling is paused
2020-09-29T18:59:02.894Z,1601405942.894 [DAT](FAULT): failed to enter command mode
2020-09-29T19:00:12.003Z,1601406012.003 [SBIT](IMPORTANT): Beginning Startup BIT
2020-09-29T19:00:12.007Z,1601406012.007 [CBIT](IMPORTANT): Beginning ground fault scan
2020-09-29T19:00:22.947Z,1601406022.947 [CBIT](IMPORTANT): No ground fault detected
mA:
CHAN A0 (Batt): 0.012382
CHAN A1 (24V): 0.002342
CHAN A2 (12V): -0.006035
CHAN A3 (5V): -0.002172
CHAN B0 (3.3V): -0.000139
CHAN B1 (3.15aV): -0.000567
CHAN B2 (3.15bV): -0.000046
CHAN B3 (GND): 0.002171
OPEN: 0.005559
Full Scale Calc: 4.765 mA, -1.589 mA
2020-09-29T19:01:05.768Z,1601406065.768 [SBIT](IMPORTANT): SBIT PASSED
2020-09-29T19:01:05.769Z,1601406065.769 [SBIT](IMPORTANT): Listing configuration overrides from Data/persisted.cfg
2020-09-29T19:01:05.769Z,1601406065.769 [SBIT](IMPORTANT): AMEcho.loadAtStartup=0 bool;

2020-09-29T19:01:05.778Z,1601406065.778 [SBIT](IMPORTANT): BPC1.batteryMissingStickThreshold=6 count;

2020-09-29T19:01:05.778Z,1601406065.778 [SBIT](IMPORTANT): BuoyancyServo.loadAtStartup=0 bool;

2020-09-29T19:01:05.778Z,1601406065.778 [SBIT](IMPORTANT): CBIT.gf24Offset=145 microampere;

2020-09-29T19:01:05.778Z,1601406065.778 [SBIT](IMPORTANT): DAT.loadAtStartup=1 bool;

2020-09-29T19:01:05.778Z,1601406065.778 [SBIT](IMPORTANT): DAT.sbdAddress=-1 enum;

2020-09-29T19:01:05.778Z,1601406065.778 [SBIT](IMPORTANT): DAT.surfaceThreshold=100 meter;

2020-09-29T19:01:05.779Z,1601406065.779 [SBIT](IMPORTANT): DAT.verbosity=0 count;

2020-09-29T19:01:05.779Z,1601406065.779 [SBIT](IMPORTANT): DropWeight.loadAtStartup=0 bool;

2020-09-29T19:01:05.779Z,1601406065.779 [SBIT](IMPORTANT): ESPComponent.loadAtStartup=1 bool;

2020-09-29T19:01:05.779Z,1601406065.779 [SBIT](IMPORTANT): Express linearApproximation AMEcho.altitude 1.000000 meter;

2020-09-29T19:01:05.779Z,1601406065.779 [SBIT](IMPORTANT): Express none ThrusterServo.component_avgCurrent;

2020-09-29T19:01:05.779Z,1601406065.779 [SBIT](IMPORTANT): Express linearApproximation WetLabsUBAT.flow_rate 1.000000 liter_per_second;

2020-09-29T19:01:05.779Z,1601406065.779 [SBIT](IMPORTANT): Express linearApproximation height_above_sea_floor 5.000000 meter;

2020-09-29T19:01:05.779Z,1601406065.779 [SBIT](IMPORTANT): IBIT.batteryVoltageThreshold=13 volt;

2020-09-29T19:01:05.779Z,1601406065.779 [SBIT](IMPORTANT): RDI_Pathfinder.loadAtStartup=1 bool;

2020-09-29T19:01:05.780Z,1601406065.780 [SBIT](IMPORTANT): VerticalControl.buoyancyNeutral=170 cubic_centimeter;

2020-09-29T19:01:05.780Z,1601406065.780 [SBIT](IMPORTANT): VerticalControl.massDefault=20 millimeter;

2020-09-29T19:01:05.780Z,1601406065.780 [SBIT](IMPORTANT): WetLabsUBAT.loadAtStartup=0 bool;

2020-09-29T19:01:06.119Z,1601406066.119 [MissionManager](IMPORTANT): Started mission Startup
2020-09-29T19:03:06.679Z,1601406186.679 [MissionManager](IMPORTANT): Started mission Default
2020-09-29T19:03:57.387Z,1601406237.387 [DataOverHttps](IMPORTANT): SBD MTMSN=20200929T190356
2020-09-29T19:04:04.738Z,1601406244.738 [CommandLine](IMPORTANT): got command load ./Missions/Maintenance/sample.xml
2020-09-29T19:04:05.340Z,1601406245.340 [CommandLine](IMPORTANT): Loaded ./Missions/Maintenance/sample.xml
2020-09-29T19:04:11.774Z,1601406251.774 [CommandLine](IMPORTANT): got command set sample.Depth 1.000000 centimeter
2020-09-29T19:04:11.775Z,1601406251.775 [CommandLine](IMPORTANT): got command set sample.NumberOfSamples 2.000000 count
2020-09-29T19:04:11.776Z,1601406251.776 [CommandLine](IMPORTANT): got command set sample.WaitBeforeSample 2.000000 second
2020-09-29T19:04:11.776Z,1601406251.776 [CommandLine](IMPORTANT): got command set sample.Depth 1.000000 centimeter
2020-09-29T19:04:11.777Z,1601406251.777 [CommandLine](IMPORTANT): got command run
2020-09-29T19:04:11.783Z,1601406251.783 [CommandLine](IMPORTANT): Running 
2020-09-29T19:04:12.127Z,1601406252.127 [MissionManager](IMPORTANT): Started mission sample
2020-09-29T19:04:13.311Z,1601406253.311 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2020-09-29T19:06:52.629Z,1601406412.629 [CommandLine](IMPORTANT): got command maintain sensor Depth_Keller.depth 1.000000 centimeter
2020-09-29T19:06:53.738Z,1601406413.738 [sample:SampleAtDepth:SampleWrapper:B](IMPORTANT): At 0.010000 m , settling for 0.033333 min 
2020-09-29T19:06:58.173Z,1601406418.173 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::'
2020-09-29T19:07:08.335Z,1601406428.335 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 134.89.10.51:134.89.10.60 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 134.89.10.32 ms-dns 134.89.10.10
2020-09-29T19:07:08.455Z,1601406428.455 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2020-09-29T19:09:13.095Z,1601406553.095 [NAL9602](FAULT): GPS failed to acquire within timeout.
2020-09-29T19:09:38.560Z,1601406578.560 [ESPComponent](FAULT): Timeout while waiting for ESP to connect (elapsed=150.1053)
2020-09-29T19:09:50.371Z,1601406590.371 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 134.89.10.51:134.89.10.60 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 134.89.10.32 ms-dns 134.89.10.10
2020-09-29T19:09:50.513Z,1601406590.513 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2020-09-29T19:12:20.600Z,1601406740.600 [ESPComponent](FAULT): Timeout while waiting for ESP to connect (elapsed=150.0870)
2020-09-29T19:12:32.394Z,1601406752.394 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 134.89.10.51:134.89.10.60 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 134.89.10.32 ms-dns 134.89.10.10
2020-09-29T19:12:32.554Z,1601406752.554 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2020-09-29T19:15:02.590Z,1601406902.590 [ESPComponent](FAULT): Timeout while waiting for ESP to connect (elapsed=150.0343)
2020-09-29T19:15:02.609Z,1601406902.609 [CBIT](CRITICAL): Communications Fault in component: ESPComponent
2020-09-29T19:15:03.821Z,1601406903.821 [MissionManager](IMPORTANT): Started mission Default
2020-09-29T19:19:56.685Z,1601407196.685 [NAL9602](FAULT): GPS failed to acquire within timeout.
2020-09-29T19:23:11.983Z,1601407391.983 [DataOverHttps](IMPORTANT): SBD MTMSN=20200929T192310
2020-09-29T19:23:19.310Z,1601407399.310 [CommandLine](IMPORTANT): got command load ./Missions/Maintenance/sample.xml
2020-09-29T19:23:19.795Z,1601407399.795 [CommandLine](IMPORTANT): Loaded ./Missions/Maintenance/sample.xml
2020-09-29T19:23:23.336Z,1601407403.336 [CommandLine](IMPORTANT): got command set sample.Depth 1.000000 centimeter
2020-09-29T19:23:23.336Z,1601407403.336 [CommandLine](IMPORTANT): got command set sample.NumberOfSamples 2.000000 count
2020-09-29T19:23:23.337Z,1601407403.337 [CommandLine](IMPORTANT): got command set sample.WaitBeforeSample 2.000000 second
2020-09-29T19:23:23.337Z,1601407403.337 [CommandLine](IMPORTANT): got command run
2020-09-29T19:23:23.341Z,1601407403.341 [CommandLine](IMPORTANT): Running 
2020-09-29T19:23:23.590Z,1601407403.590 [MissionManager](IMPORTANT): Started mission sample
2020-09-29T19:23:25.604Z,1601407405.604 [sample:SampleAtDepth:SampleWrapper:B](IMPORTANT): At 0.010000 m , settling for 0.033333 min 
2020-09-29T19:23:40.239Z,1601407420.239 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 134.89.10.51:134.89.10.60 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 134.89.10.32 ms-dns 134.89.10.10
2020-09-29T19:23:40.367Z,1601407420.367 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2020-09-29T19:26:10.424Z,1601407570.424 [ESPComponent](FAULT): Timeout while waiting for ESP to connect (elapsed=150.0570)
2020-09-29T19:26:22.250Z,1601407582.250 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 134.89.10.51:134.89.10.60 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 134.89.10.32 ms-dns 134.89.10.10
2020-09-29T19:26:22.379Z,1601407582.379 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2020-09-29T19:27:17.092Z,1601407637.092 [ESPComponent](IMPORTANT): ESP has connected as client
2020-09-29T19:27:17.912Z,1601407637.912 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -4
2020-09-29T19:27:17.913Z,1601407637.913 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2020-09-29T19:27:18.304Z,1601407638.304 [sample:SampleAtDepth:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 0.010000 m in nan degC water with nan ug/l chlorophyll fluorescence.
2020-09-29T19:27:19.134Z,1601407639.134 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG
2020-09-29T19:27:19.516Z,1601407639.516 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS
2020-09-29T19:27:21.122Z,1601407641.122 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE
2020-09-29T19:27:57.088Z,1601407677.088 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PRIMING (@7,archiveHiBiomass_bac)
2020-09-29T19:27:58.705Z,1601407678.705 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PRIMING (@5.0)
2020-09-29T19:27:59.561Z,1601407679.561 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_FILTERING (@5.0)
2020-09-29T19:29:08.194Z,1601407748.194 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_FILTERING (@0.0)
2020-09-29T19:29:08.601Z,1601407748.601 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2020-09-29T19:29:25.953Z,1601407765.953 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PAUSED (@10.0)
2020-09-29T19:29:26.369Z,1601407766.369 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PROCESSING (@10.0)
2020-09-29T19:29:28.799Z,1601407768.799 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PROCESSED (@6,archiveHiBiomass_bac)
2020-09-29T19:30:41.508Z,1601407841.508 [NAL9602](FAULT): GPS failed to acquire within timeout.
2020-09-29T19:33:01.690Z,1601407981.690 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING (@6,archiveHiBiomass_bac)
2020-09-29T19:33:28.370Z,1601408008.370 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs &
2020-09-29T19:33:28.768Z,1601408008.768 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED
2020-09-29T19:38:28.589Z,1601408308.589 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence completed normally.
2020-09-29T19:38:28.973Z,1601408308.973 [ESPComponent](IMPORTANT): [sample #1] ESP log summary report (5 messages):
@12:27:28.07 Selecting Cartridge 7
@12:28:32.29 Cartridge::Sampler::Leak in FILTERING -- Pumped 0.20ml into cartridge without reaching 26psi
@12:28:32.30 Retry #1 of 2
@12:28:32.35 Selecting Cartridge 6
@12:29:23.88 Sampled  10.0ml

2020-09-29T19:38:30.176Z,1601408310.176 [sample:SampleAtDepth:SampleWrapper:B](IMPORTANT): At 0.010000 m , settling for 0.033333 min 
2020-09-29T19:38:44.851Z,1601408324.851 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 134.89.10.51:134.89.10.60 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 134.89.10.32 ms-dns 134.89.10.10
2020-09-29T19:38:45.029Z,1601408325.029 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2020-09-29T19:39:17.059Z,1601408357.059 [ESPComponent](IMPORTANT): ESP has connected as client
2020-09-29T19:39:17.887Z,1601408357.887 [ESPComponent](IMPORTANT): [sample #2] Setting cartridge argument to -4
2020-09-29T19:39:17.887Z,1601408357.887 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2020-09-29T19:39:18.264Z,1601408358.264 [sample:SampleAtDepth:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 0.010000 m in nan degC water with nan ug/l chlorophyll fluorescence.
2020-09-29T19:39:18.650Z,1601408358.650 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_LOG
2020-09-29T19:39:19.078Z,1601408359.078 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_STATUS
2020-09-29T19:39:21.096Z,1601408361.096 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_LOADING_CARTRIDGE
2020-09-29T19:39:57.040Z,1601408397.040 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PRIMING (@7,archiveHiBiomass_bac)
2020-09-29T19:39:58.660Z,1601408398.660 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PRIMING (@5.0)
2020-09-29T19:40:00.263Z,1601408400.263 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_FILTERING (@5.0)
2020-09-29T19:40:32.202Z,1601408432.202 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_FILTERING (@0.0)
2020-09-29T19:40:32.622Z,1601408432.622 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2020-09-29T19:40:49.171Z,1601408449.171 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PAUSED (@10.0)
2020-09-29T19:40:49.568Z,1601408449.568 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PROCESSING (@10.0)
2020-09-29T19:40:51.978Z,1601408451.978 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PROCESSED (@7,archiveHiBiomass_bac)
2020-09-29T19:41:25.135Z,1601408485.135 [NAL9602](FAULT): GPS failed to acquire within timeout.
2020-09-29T19:44:24.950Z,1601408664.950 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPING (@7,archiveHiBiomass_bac)
2020-09-29T19:44:51.587Z,1601408691.587 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs &
2020-09-29T19:44:52.033Z,1601408692.033 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPED
2020-09-29T19:49:51.777Z,1601408991.777 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence completed normally.
2020-09-29T19:49:52.163Z,1601408992.163 [ESPComponent](IMPORTANT): [sample #2] ESP log summary report (2 messages):
@12:39:28.19 Selecting Cartridge 7
@12:40:47.29 Sampled  10.0ml

2020-09-29T19:49:52.583Z,1601408992.583 [MissionManager](IMPORTANT): Started mission Default
2020-09-29T19:52:07.899Z,1601409127.899 [NAL9602](FAULT): GPS failed to acquire within timeout.
2020-09-29T19:52:07.924Z,1601409127.924 [CBIT](CRITICAL): Data Fault in component: NAL9602