2019-08-26T19:43:34.602Z,1566848614.602 [CommandLine](IMPORTANT): got command restart logs 2019-08-26T19:43:34.919Z,1566848614.919 [MissionManager](IMPORTANT): Started mission Default 2019-08-26T19:44:29.584Z,1566848669.584 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=33696, MT Status=1, MTMSN=2283 2019-08-26T19:44:30.371Z,1566848670.371 [CommandLine](IMPORTANT): got command schedule "load Science/sci2_flat_and_level.xml;set sci2_flat_and_level.MissionTimeout 3 hour;set sci2_flat_and_level.NeedCommsTime 30 minute;set sci2_flat_and_level.Depth 2 meter;set sci2_flat_and_level.Lat1 41.7473 degree" 1sgq1 1 4.000000 2019-08-26T19:44:30.372Z,1566848670.372 [CommandLine](IMPORTANT): Scheduling command #1 of 4 with id=1sgq1 2019-08-26T19:44:30.373Z,1566848670.373 [CommandLine](IMPORTANT): Scheduled #224 (#1 of 4 with id='1sgq1'): "load Science/sci2_flat_and_level.xml;set sci2_flat_and_level.MissionTimeout 3 hour;set sci2_flat_and_level.NeedCommsTime 30 minute;set sci2_flat_and_level.Depth 2 meter;set sci2_flat_and_level.Lat1 41.7473 degree" 2019-08-26T19:44:43.085Z,1566848683.085 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=33697, MT Status=1, MTMSN=2284 2019-08-26T19:44:43.878Z,1566848683.878 [CommandLine](IMPORTANT): got command schedule "set sci2_flat_and_level.Lon1 -83.1343 degree;set sci2_flat_and_level.Speed 0 meter_per_second;set sci2_flat_and_level.ApproachSpeed 0.9 meter_per_second;set sci2_flat_and_level.ApproachPitchLimit 10 degree" 1sgq1 2 4.000000 2019-08-26T19:44:43.879Z,1566848683.879 [CommandLine](IMPORTANT): Scheduling command #2 of 4 with id=1sgq1 2019-08-26T19:44:43.880Z,1566848683.880 [CommandLine](IMPORTANT): Scheduled #225 (#2 of 4 with id='1sgq1'): "set sci2_flat_and_level.Lon1 -83.1343 degree;set sci2_flat_and_level.Speed 0 meter_per_second;set sci2_flat_and_level.ApproachSpeed 0.9 meter_per_second;set sci2_flat_and_level.ApproachPitchLimit 10 degree" 2019-08-26T19:44:57.997Z,1566848697.997 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=33698, MT Status=1, MTMSN=2285 2019-08-26T19:44:58.791Z,1566848698.791 [CommandLine](IMPORTANT): got command schedule "set sci2_flat_and_level.ApproachDepthTimeout 10 minute;set sci2_flat_and_level.ApproachSettleTimePreDive 1.5 minute;set sci2_flat_and_level.ApproachSettleTimePostDive 1 minute;set sci2_flat_and_level.MinAltitude 0.01 meter" 1sgq1 3 4.000000 2019-08-26T19:44:58.791Z,1566848698.791 [CommandLine](IMPORTANT): Scheduling command #3 of 4 with id=1sgq1 2019-08-26T19:44:58.792Z,1566848698.792 [CommandLine](IMPORTANT): Scheduled #226 (#3 of 4 with id='1sgq1'): "set sci2_flat_and_level.ApproachDepthTimeout 10 minute;set sci2_flat_and_level.ApproachSettleTimePreDive 1.5 minute;set sci2_flat_and_level.ApproachSettleTimePostDive 1 minute;set sci2_flat_and_level.MinAltitude 0.01 meter" 2019-08-26T19:45:12.139Z,1566848712.139 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=33699, MT Status=1, MTMSN=2286 2019-08-26T19:45:12.839Z,1566848712.839 [CommandLine](IMPORTANT): got command schedule "set sci2_flat_and_level.MaxDepth 4.5 meter;set sci2_flat_and_level.MinOffshore 0.01 kilometer;run " 1sgq1 4 4.000000 2019-08-26T19:45:12.839Z,1566848712.839 [CommandLine](IMPORTANT): Scheduling command #4 of 4 with id=1sgq1 2019-08-26T19:45:12.840Z,1566848712.840 [CommandLine](IMPORTANT): Scheduled #227 (#4 of 4 with id='1sgq1'): "set sci2_flat_and_level.MaxDepth 4.5 meter;set sci2_flat_and_level.MinOffshore 0.01 kilometer;run " 2019-08-26T19:45:12.909Z,1566848712.909 [CommandLine](IMPORTANT): got command load ./Missions/Science/sci2_flat_and_level.xml 2019-08-26T19:45:14.720Z,1566848714.720 [CommandLine](IMPORTANT): Loaded ./Missions/Science/sci2_flat_and_level.xml 2019-08-26T19:45:27.367Z,1566848727.367 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.MissionTimeout 3.000000 hour 2019-08-26T19:45:27.368Z,1566848727.368 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.NeedCommsTime 30.000000 minute 2019-08-26T19:45:27.369Z,1566848727.369 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.Depth 2.000000 meter 2019-08-26T19:45:27.370Z,1566848727.370 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.Lat1 41.747299 degree 2019-08-26T19:45:40.081Z,1566848740.081 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.Lon1 -83.134300 degree 2019-08-26T19:45:40.082Z,1566848740.082 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.Speed 0.000000 meter_per_second 2019-08-26T19:45:40.082Z,1566848740.082 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.ApproachSpeed 0.900000 meter_per_second 2019-08-26T19:45:40.083Z,1566848740.083 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.ApproachPitchLimit 10.000000 degree 2019-08-26T19:45:55.176Z,1566848755.176 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.ApproachDepthTimeout 10.000000 minute 2019-08-26T19:45:55.177Z,1566848755.177 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.ApproachSettleTimePreDive 1.500000 minute 2019-08-26T19:45:55.178Z,1566848755.178 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.ApproachSettleTimePostDive 1.000000 minute 2019-08-26T19:45:55.178Z,1566848755.178 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.MinAltitude 0.010000 meter 2019-08-26T19:46:00.638Z,1566848760.638 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.MaxDepth 4.500000 meter 2019-08-26T19:46:00.639Z,1566848760.639 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.MinOffshore 0.010000 kilometer 2019-08-26T19:46:00.639Z,1566848760.639 [CommandLine](IMPORTANT): got command run 2019-08-26T19:46:00.641Z,1566848760.641 [CommandLine](IMPORTANT): Running 2019-08-26T19:46:00.828Z,1566848760.828 [MissionManager](IMPORTANT): Started mission sci2_flat_and_level 2019-08-26T19:49:07.840Z,1566848947.840 [NAL9602](FAULT): Verify xmit timeout failure. 2019-08-26T21:32:58.420Z,1566855178.420 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=33734, MT Status=1, MTMSN=2287 2019-08-26T21:32:59.219Z,1566855179.219 [CommandLine](IMPORTANT): got command schedule asap "load Science/sci2_flat_and_level.xml;set sci2_flat_and_level.MissionTimeout 1 hour;set sci2_flat_and_level.NeedCommsTime 30 minute;set sci2_flat_and_level.Depth 2 meter;set sci2_flat_and_level.Lat1 41.742400 degree" 1sl2m 1 4.000000 2019-08-26T21:32:59.219Z,1566855179.219 [CommandLine](IMPORTANT): Scheduling command #1 of 4 with id=1sl2m 2019-08-26T21:32:59.220Z,1566855179.220 [CommandLine](IMPORTANT): Scheduled #228 (#1 of 4 with id='1sl2m'): "load Science/sci2_flat_and_level.xml;set sci2_flat_and_level.MissionTimeout 1 hour;set sci2_flat_and_level.NeedCommsTime 30 minute;set sci2_flat_and_level.Depth 2 meter;set sci2_flat_and_level.Lat1 41.742400 degree" ASAP 2019-08-26T21:33:20.250Z,1566855200.250 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=33735, MT Status=1, MTMSN=2288 2019-08-26T21:33:21.034Z,1566855201.034 [CommandLine](IMPORTANT): got command schedule asap "set sci2_flat_and_level.Lon1 -83.13660 degree;set sci2_flat_and_level.ApproachSpeed 0.9 meter_per_second;set sci2_flat_and_level.ApproachPitchLimit 10 degree;set sci2_flat_and_level.ApproachDepthTimeout 10 minute" 1sl2m 2 4.000000 2019-08-26T21:33:21.035Z,1566855201.035 [CommandLine](IMPORTANT): Scheduling command #2 of 4 with id=1sl2m 2019-08-26T21:33:21.036Z,1566855201.036 [CommandLine](IMPORTANT): Scheduled #229 (#2 of 4 with id='1sl2m'): "set sci2_flat_and_level.Lon1 -83.13660 degree;set sci2_flat_and_level.ApproachSpeed 0.9 meter_per_second;set sci2_flat_and_level.ApproachPitchLimit 10 degree;set sci2_flat_and_level.ApproachDepthTimeout 10 minute" ASAP 2019-08-26T21:33:47.912Z,1566855227.912 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=33736, MT Status=1, MTMSN=2289 2019-08-26T21:33:48.694Z,1566855228.694 [CommandLine](IMPORTANT): got command schedule asap "set sci2_flat_and_level.ApproachSettleTimePreDive 1.5 minute;set sci2_flat_and_level.ApproachSettleTimePostDive 1 minute;set sci2_flat_and_level.MinAltitude 0.01 meter;set sci2_flat_and_level.MaxDepth 4.5 meter" 1sl2m 3 4.000000 2019-08-26T21:33:48.695Z,1566855228.695 [CommandLine](IMPORTANT): Scheduling command #3 of 4 with id=1sl2m 2019-08-26T21:33:48.696Z,1566855228.696 [CommandLine](IMPORTANT): Scheduled #230 (#3 of 4 with id='1sl2m'): "set sci2_flat_and_level.ApproachSettleTimePreDive 1.5 minute;set sci2_flat_and_level.ApproachSettleTimePostDive 1 minute;set sci2_flat_and_level.MinAltitude 0.01 meter;set sci2_flat_and_level.MaxDepth 4.5 meter" ASAP 2019-08-26T21:34:04.594Z,1566855244.594 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=33737, MT Status=1, MTMSN=2290 2019-08-26T21:34:05.183Z,1566855245.183 [CommandLine](IMPORTANT): got command schedule asap "set sci2_flat_and_level.MinOffshore 0.01 kilometer;run " 1sl2m 4 4.000000 2019-08-26T21:34:05.183Z,1566855245.183 [CommandLine](IMPORTANT): Scheduling command #4 of 4 with id=1sl2m 2019-08-26T21:34:05.184Z,1566855245.184 [CommandLine](IMPORTANT): Scheduled #231 (#4 of 4 with id='1sl2m'): "set sci2_flat_and_level.MinOffshore 0.01 kilometer;run " ASAP 2019-08-26T21:34:05.341Z,1566855245.341 [CommandLine](IMPORTANT): got command load ./Missions/Science/sci2_flat_and_level.xml 2019-08-26T21:34:07.362Z,1566855247.362 [CommandLine](IMPORTANT): Loaded ./Missions/Science/sci2_flat_and_level.xml 2019-08-26T21:34:07.452Z,1566855247.452 [MissionManager](IMPORTANT): Started mission Default 2019-08-26T21:34:18.471Z,1566855258.471 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.MissionTimeout 1.000000 hour 2019-08-26T21:34:18.472Z,1566855258.472 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.NeedCommsTime 30.000000 minute 2019-08-26T21:34:18.474Z,1566855258.474 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.Depth 2.000000 meter 2019-08-26T21:34:18.475Z,1566855258.475 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.Lat1 41.742401 degree 2019-08-26T21:34:32.798Z,1566855272.798 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.Lon1 -83.136597 degree 2019-08-26T21:34:32.799Z,1566855272.799 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.ApproachSpeed 0.900000 meter_per_second 2019-08-26T21:34:32.800Z,1566855272.800 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.ApproachPitchLimit 10.000000 degree 2019-08-26T21:34:32.801Z,1566855272.801 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.ApproachDepthTimeout 10.000000 minute 2019-08-26T21:34:46.039Z,1566855286.039 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=33738, MT Status=1, MTMSN=2291 2019-08-26T21:34:46.477Z,1566855286.477 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.ApproachSettleTimePreDive 1.500000 minute 2019-08-26T21:34:46.478Z,1566855286.478 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.ApproachSettleTimePostDive 1.000000 minute 2019-08-26T21:34:46.479Z,1566855286.479 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.MinAltitude 0.010000 meter 2019-08-26T21:34:46.479Z,1566855286.479 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.MaxDepth 4.500000 meter 2019-08-26T21:34:48.978Z,1566855288.978 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.MinOffshore 0.010000 kilometer 2019-08-26T21:34:48.979Z,1566855288.979 [CommandLine](IMPORTANT): got command run 2019-08-26T21:34:48.981Z,1566855288.981 [CommandLine](IMPORTANT): Running 2019-08-26T21:34:49.016Z,1566855289.016 [CommandLine](IMPORTANT): got command schedule "load Science/esp_kiss.xml;set esp_kiss.TargetDepth 2 meter;set esp_kiss.ESPCartridgeType_2 -15 count;set esp_kiss.SettleTime 10 minute;set esp_kiss.ApproachDepth 1.5 meter;set esp_kiss.ApproachSpeed 0.9 meter_per_second" 1sl54 1 2.000000 2019-08-26T21:34:49.018Z,1566855289.018 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=1sl54 2019-08-26T21:34:49.019Z,1566855289.019 [CommandLine](IMPORTANT): Scheduled #232 (#1 of 2 with id='1sl54'): "load Science/esp_kiss.xml;set esp_kiss.TargetDepth 2 meter;set esp_kiss.ESPCartridgeType_2 -15 count;set esp_kiss.SettleTime 10 minute;set esp_kiss.ApproachDepth 1.5 meter;set esp_kiss.ApproachSpeed 0.9 meter_per_second" 2019-08-26T21:34:49.043Z,1566855289.043 [MissionManager](IMPORTANT): Started mission sci2_flat_and_level 2019-08-26T21:35:20.602Z,1566855320.602 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=33739, MT Status=1, MTMSN=2292 2019-08-26T21:35:21.298Z,1566855321.298 [CommandLine](IMPORTANT): got command schedule "set esp_kiss.ApproachSettleTimePreDive 1.5 minute;set esp_kiss.MinAltitude 0.001 meter;set esp_kiss.MinOffshore 0.5 kilometer;run " 1sl54 2 2.000000 2019-08-26T21:35:21.299Z,1566855321.299 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=1sl54 2019-08-26T21:35:21.299Z,1566855321.299 [CommandLine](IMPORTANT): Scheduled #233 (#2 of 2 with id='1sl54'): "set esp_kiss.ApproachSettleTimePreDive 1.5 minute;set esp_kiss.MinAltitude 0.001 meter;set esp_kiss.MinOffshore 0.5 kilometer;run " 2019-08-26T21:53:32.670Z,1566856412.670 [sci2_flat_and_level:Lap:Wpt1:A.Waypoint](IMPORTANT): Reached Waypoint: 41.742401,-83.136598 2019-08-26T21:55:04.164Z,1566856504.164 [CommandLine](IMPORTANT): got command load ./Missions/Science/esp_kiss.xml 2019-08-26T21:55:05.129Z,1566856505.129 [Aanderaa_O2](FAULT): LCB fault: Software Overcurrent. 2019-08-26T21:55:05.953Z,1566856505.953 [CommandLine](IMPORTANT): Loaded ./Missions/Science/esp_kiss.xml 2019-08-26T21:55:05.991Z,1566856505.991 [MissionManager](IMPORTANT): Started mission Default 2019-08-26T21:55:18.187Z,1566856518.187 [CommandLine](IMPORTANT): got command set esp_kiss.TargetDepth 2.000000 meter 2019-08-26T21:55:18.188Z,1566856518.188 [CommandLine](IMPORTANT): got command set esp_kiss.ESPCartridgeType_2 -15.000000 count 2019-08-26T21:55:18.189Z,1566856518.189 [CommandLine](IMPORTANT): got command set esp_kiss.SettleTime 10.000000 minute 2019-08-26T21:55:18.190Z,1566856518.190 [CommandLine](IMPORTANT): got command set esp_kiss.ApproachDepth 1.500000 meter 2019-08-26T21:55:18.190Z,1566856518.190 [CommandLine](IMPORTANT): got command set esp_kiss.ApproachSpeed 0.900000 meter_per_second 2019-08-26T21:55:25.918Z,1566856525.918 [CommandLine](IMPORTANT): got command set esp_kiss.ApproachSettleTimePreDive 1.500000 minute 2019-08-26T21:55:25.919Z,1566856525.919 [CommandLine](IMPORTANT): got command set esp_kiss.MinAltitude 0.001000 meter 2019-08-26T21:55:25.920Z,1566856525.920 [CommandLine](IMPORTANT): got command set esp_kiss.MinOffshore 0.500000 kilometer 2019-08-26T21:55:25.920Z,1566856525.920 [CommandLine](IMPORTANT): got command run 2019-08-26T21:55:25.923Z,1566856525.923 [CommandLine](IMPORTANT): Running 2019-08-26T21:55:25.967Z,1566856525.967 [MissionManager](IMPORTANT): Started mission esp_kiss 2019-08-26T22:01:49.733Z,1566856909.733 [esp_kiss:SampleESP:sample:A](IMPORTANT): At 1.196918 m , settling for 10.000000 min 2019-08-26T22:11:50.667Z,1566857510.667 [esp_kiss:SampleESP:sample:C](IMPORTANT): Requesting ESP cartridge type: -4.000000 count 2019-08-26T22:11:52.745Z,1566857512.745 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2019-08-26T22:11:53.034Z,1566857513.034 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2019-08-26T22:11:53.941Z,1566857513.941 [BuoyancyServo](FAULT): Buoyancy getPosition uart error.serial timeout 2019-08-26T22:12:27.187Z,1566857547.187 [ESPComponent](IMPORTANT): ESP has connected as client 2019-08-26T22:12:28.004Z,1566857548.004 [ESPComponent](IMPORTANT): [sample #23] Setting cartridge argument to -4 2019-08-26T22:12:28.004Z,1566857548.004 [ESPComponent](IMPORTANT): [sample #23] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2019-08-26T22:12:28.456Z,1566857548.456 [esp_kiss:SampleESP:sample:F](IMPORTANT): ESP sampling at 2.325945 m inwater with 3.089400 ug/l chlorophyll fluorescence. 2019-08-26T22:12:28.798Z,1566857548.798 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_PREPARING_SHOW_LOG 2019-08-26T22:12:29.209Z,1566857549.209 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_PREPARING_SHOW_STATUS 2019-08-26T22:12:31.293Z,1566857551.293 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_LOADING_CARTRIDGE 2019-08-26T22:13:09.802Z,1566857589.802 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_WAITING_FOR_PRIMING (@11,archiveHiBiomass_bac) 2019-08-26T22:13:11.414Z,1566857591.414 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_PRIMING (@100.0) 2019-08-26T22:13:13.038Z,1566857593.038 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2019-08-26T22:15:54.141Z,1566857754.141 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_FILTERING (@0.0) 2019-08-26T22:15:54.543Z,1566857754.543 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2019-08-26T22:19:24.385Z,1566857964.385 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_PAUSED (@57.697) 2019-08-26T22:19:24.786Z,1566857964.786 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_PROCESSING (@57.697) 2019-08-26T22:19:27.393Z,1566857967.393 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_WAITING_FOR_PROCESSED (@11,archiveHiBiomass_bac) 2019-08-26T22:32:15.778Z,1566858735.778 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_STOPPING (@11,archiveHiBiomass_bac) 2019-08-26T22:32:42.482Z,1566858762.482 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2019-08-26T22:32:42.891Z,1566858762.891 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_STOPPED 2019-08-26T22:37:42.893Z,1566859062.893 [ESPComponent](IMPORTANT): [sample #23] ESP sampling sequence completed normally. 2019-08-26T22:37:43.295Z,1566859063.295 [ESPComponent](IMPORTANT): [sample #23] ESP log summary report (3 messages): @18:12:42.43 Selecting Cartridge 11 @18:19:21.36 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @18:19:21.56 Sampled 57.7ml 2019-08-26T22:37:44.157Z,1566859064.157 [esp_kiss:SampleESP:sample:A](IMPORTANT): At 1.984143 m , settling for 10.000000 min 2019-08-26T22:47:45.203Z,1566859665.203 [esp_kiss:SampleESP:sample:C](IMPORTANT): Requesting ESP cartridge type: -15.000000 count 2019-08-26T22:47:47.352Z,1566859667.352 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2019-08-26T22:47:47.476Z,1566859667.476 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2019-08-26T22:48:21.341Z,1566859701.341 [ESPComponent](IMPORTANT): ESP has connected as client 2019-08-26T22:48:22.154Z,1566859702.154 [ESPComponent](IMPORTANT): [sample #24] Setting cartridge argument to -15 2019-08-26T22:48:22.154Z,1566859702.154 [ESPComponent](IMPORTANT): [sample #24] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2019-08-26T22:48:22.607Z,1566859702.607 [esp_kiss:SampleESP:sample:F](IMPORTANT): ESP sampling at 1.540965 m inwater with 3.142980 ug/l chlorophyll fluorescence. 2019-08-26T22:48:22.954Z,1566859702.954 [ESPComponent](IMPORTANT): [sample #24] ESP sampling state: S_PREPARING_SHOW_LOG 2019-08-26T22:48:23.361Z,1566859703.361 [ESPComponent](IMPORTANT): [sample #24] ESP sampling state: S_PREPARING_SHOW_STATUS 2019-08-26T22:48:25.381Z,1566859705.381 [ESPComponent](IMPORTANT): [sample #24] ESP sampling state: S_LOADING_CARTRIDGE 2019-08-26T22:49:04.530Z,1566859744.530 [ESPComponent](IMPORTANT): [sample #24] ESP sampling state: S_WAITING_FOR_PRIMING (@8,microSPR_bac) 2019-08-26T22:49:06.150Z,1566859746.150 [ESPComponent](IMPORTANT): [sample #24] ESP sampling state: S_PRIMING (@100.0) 2019-08-26T22:49:07.043Z,1566859747.043 [ESPComponent](IMPORTANT): [sample #24] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2019-08-26T22:51:48.983Z,1566859908.983 [ESPComponent](IMPORTANT): [sample #24] ESP sampling state: S_FILTERING (@0.0) 2019-08-26T22:51:49.389Z,1566859909.389 [ESPComponent](IMPORTANT): [sample #24] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2019-08-26T23:04:13.791Z,1566860653.791 [ESPComponent](IMPORTANT): [sample #24] ESP sampling state: S_PAUSED (@239.818) 2019-08-26T23:04:14.366Z,1566860654.366 [ESPComponent](IMPORTANT): [sample #24] ESP sampling state: S_PROCESSING (@239.818) 2019-08-26T23:04:16.782Z,1566860656.782 [ESPComponent](IMPORTANT): [sample #24] ESP sampling state: S_WAITING_FOR_PROCESSED (@8,microSPR_bac) 2019-08-26T23:38:05.125Z,1566862685.125 [ESPComponent](IMPORTANT): [sample #24] ESP sampling state: S_STOPPING (@8,microSPR_bac) 2019-08-26T23:38:36.542Z,1566862716.542 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2019-08-26T23:38:36.942Z,1566862716.942 [ESPComponent](IMPORTANT): [sample #24] ESP sampling state: S_STOPPED 2019-08-26T23:43:36.863Z,1566863016.863 [ESPComponent](IMPORTANT): [sample #24] ESP sampling sequence completed normally. 2019-08-26T23:43:37.267Z,1566863017.267 [ESPComponent](IMPORTANT): [sample #24] ESP log summary report (4 messages): @18:48:36.50 Selecting Cartridge 8 @19:04:09.76 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @19:04:09.96 Sampled 239.8ml @19:37:55.72 Syringe::Underpressure in pump -- Reached only 14.3 of 21.0psi after pumping 15575ul 2019-08-26T23:43:38.676Z,1566863018.676 [MissionManager](IMPORTANT): Started mission Default 2019-08-26T23:43:39.414Z,1566863019.414 [Aanderaa_O2](FAULT): LCB fault: Software Overcurrent. 2019-08-26T23:45:47.095Z,1566863147.095 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=33763, MT Status=1, MTMSN=2293 2019-08-26T23:45:47.894Z,1566863147.894 [CommandLine](IMPORTANT): got command schedule "load Science/sci2_flat_and_level.xml;set sci2_flat_and_level.MissionTimeout 8 hour;set sci2_flat_and_level.NeedCommsTime 45 minute;set sci2_flat_and_level.Depth 2 meter;set sci2_flat_and_level.Lat1 41.756645 degree" 1spdk 1 4.000000 2019-08-26T23:45:47.895Z,1566863147.895 [CommandLine](IMPORTANT): Scheduling command #1 of 4 with id=1spdk 2019-08-26T23:45:47.896Z,1566863147.896 [CommandLine](IMPORTANT): Scheduled #234 (#1 of 4 with id='1spdk'): "load Science/sci2_flat_and_level.xml;set sci2_flat_and_level.MissionTimeout 8 hour;set sci2_flat_and_level.NeedCommsTime 45 minute;set sci2_flat_and_level.Depth 2 meter;set sci2_flat_and_level.Lat1 41.756645 degree" 2019-08-26T23:47:38.402Z,1566863258.402 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=33764, MT Status=1, MTMSN=2294 2019-08-26T23:47:39.207Z,1566863259.207 [CommandLine](IMPORTANT): got command schedule "set sci2_flat_and_level.Lon1 -83.313873 degree;set sci2_flat_and_level.ApproachSpeed 0.9 meter_per_second;set sci2_flat_and_level.ApproachPitchLimit 10 degree;set sci2_flat_and_level.ApproachDepthTimeout 10 minute" 1spdk 2 4.000000 2019-08-26T23:47:39.207Z,1566863259.207 [CommandLine](IMPORTANT): Scheduling command #2 of 4 with id=1spdk 2019-08-26T23:47:39.208Z,1566863259.208 [CommandLine](IMPORTANT): Scheduled #235 (#2 of 4 with id='1spdk'): "set sci2_flat_and_level.Lon1 -83.313873 degree;set sci2_flat_and_level.ApproachSpeed 0.9 meter_per_second;set sci2_flat_and_level.ApproachPitchLimit 10 degree;set sci2_flat_and_level.ApproachDepthTimeout 10 minute" 2019-08-26T23:48:45.963Z,1566863325.963 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=33765, MT Status=1, MTMSN=2295 2019-08-26T23:48:46.790Z,1566863326.790 [CommandLine](IMPORTANT): got command schedule "set sci2_flat_and_level.ApproachSettleTimePreDive 1.5 minute;set sci2_flat_and_level.ApproachSettleTimePostDive 1 minute;set sci2_flat_and_level.MinAltitude 0.01 meter;set sci2_flat_and_level.MaxDepth 4.5 meter" 1spdk 3 4.000000 2019-08-26T23:48:46.791Z,1566863326.791 [CommandLine](IMPORTANT): Scheduling command #3 of 4 with id=1spdk 2019-08-26T23:48:46.791Z,1566863326.791 [CommandLine](IMPORTANT): Scheduled #236 (#3 of 4 with id='1spdk'): "set sci2_flat_and_level.ApproachSettleTimePreDive 1.5 minute;set sci2_flat_and_level.ApproachSettleTimePostDive 1 minute;set sci2_flat_and_level.MinAltitude 0.01 meter;set sci2_flat_and_level.MaxDepth 4.5 meter" 2019-08-26T23:49:01.299Z,1566863341.299 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=33766, MT Status=1, MTMSN=2296 2019-08-26T23:49:01.898Z,1566863341.898 [CommandLine](IMPORTANT): got command schedule "set sci2_flat_and_level.MinOffshore 0.01 kilometer;run " 1spdk 4 4.000000 2019-08-26T23:49:01.898Z,1566863341.898 [CommandLine](IMPORTANT): Scheduling command #4 of 4 with id=1spdk 2019-08-26T23:49:01.899Z,1566863341.899 [CommandLine](IMPORTANT): Scheduled #237 (#4 of 4 with id='1spdk'): "set sci2_flat_and_level.MinOffshore 0.01 kilometer;run " 2019-08-26T23:49:02.027Z,1566863342.027 [CommandLine](IMPORTANT): got command load ./Missions/Science/sci2_flat_and_level.xml 2019-08-26T23:49:03.804Z,1566863343.804 [CommandLine](IMPORTANT): Loaded ./Missions/Science/sci2_flat_and_level.xml 2019-08-26T23:49:15.756Z,1566863355.756 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.MissionTimeout 8.000000 hour 2019-08-26T23:49:15.757Z,1566863355.757 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.NeedCommsTime 45.000000 minute 2019-08-26T23:49:15.758Z,1566863355.758 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.Depth 2.000000 meter 2019-08-26T23:49:15.759Z,1566863355.759 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.Lat1 41.756645 degree 2019-08-26T23:49:28.291Z,1566863368.291 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.Lon1 -83.313873 degree 2019-08-26T23:49:28.292Z,1566863368.292 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.ApproachSpeed 0.900000 meter_per_second 2019-08-26T23:49:28.293Z,1566863368.293 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.ApproachPitchLimit 10.000000 degree 2019-08-26T23:49:28.294Z,1566863368.294 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.ApproachDepthTimeout 10.000000 minute 2019-08-26T23:49:42.376Z,1566863382.376 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.ApproachSettleTimePreDive 1.500000 minute 2019-08-26T23:49:42.376Z,1566863382.376 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.ApproachSettleTimePostDive 1.000000 minute 2019-08-26T23:49:42.377Z,1566863382.377 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.MinAltitude 0.010000 meter 2019-08-26T23:49:42.378Z,1566863382.378 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.MaxDepth 4.500000 meter 2019-08-26T23:49:46.701Z,1566863386.701 [CommandLine](IMPORTANT): got command set sci2_flat_and_level.MinOffshore 0.010000 kilometer 2019-08-26T23:49:46.701Z,1566863386.701 [CommandLine](IMPORTANT): got command run 2019-08-26T23:49:46.703Z,1566863386.703 [CommandLine](IMPORTANT): Running 2019-08-26T23:49:47.478Z,1566863387.478 [MissionManager](IMPORTANT): Started mission sci2_flat_and_level 2019-08-26T23:50:05.441Z,1566863405.441 [BuoyancyServo](FAULT): Reading outside of valid range:0.000000 2019-08-26T23:50:05.441Z,1566863405.441 [BuoyancyServo](FAULT): Buoyancy engine reporting null position 2019-08-26T23:51:37.921Z,1566863497.921 [BuoyancyServo](FAULT): Reading outside of valid range:0.000000 2019-08-26T23:51:37.922Z,1566863497.922 [BuoyancyServo](FAULT): Buoyancy engine reporting null position 2019-08-26T23:54:09.684Z,1566863649.684 [NAL9602](FAULT): Verify xmit timeout failure. 2019-08-27T00:53:49.861Z,1566867229.861 [Radio_Surface](FAULT): LCB fault: Invalid Command. 2019-08-27T00:55:46.253Z,1566867346.253 [Radio_Surface](FAULT): LCB fault: LCB Watchdog Reset. 2019-08-27T00:55:46.359Z,1566867346.359 [CBIT](CRITICAL): Hardware Fault in component: Radio_Surface 2019-08-27T00:55:46.614Z,1566867346.614 [CommandLine](FAULT): Scheduling is paused 2019-08-27T00:55:47.360Z,1566867347.360 [MissionManager](IMPORTANT): Started mission Default 2019-08-27T01:05:55.559Z,1566867955.559 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 10.129932 min 2019-08-27T01:13:24.761Z,1566868404.761 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 17.616648 min 2019-08-27T01:17:07.086Z,1566868627.086 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=33813, MT Status=1, MTMSN=2297 2019-08-27T01:17:07.580Z,1566868627.580 [CommandLine](IMPORTANT): got command restart system