2021-08-15T23:27:18.053Z,1629070038.053 [CommandLine](IMPORTANT): got command restart logs 2021-08-15T23:27:20.462Z,1629070040.462 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 23.041248 min 2021-08-15T23:27:53.100Z,1629070073.100 [DataOverHttps](IMPORTANT): SBD MOMSN=15887120, MTMSN=20210815T232749 2021-08-15T23:28:02.942Z,1629070082.942 [CommandLine](IMPORTANT): got command schedule asap "load Science/sci2.xml;set sci2.MissionTimeout 3 h;set sci2.NeedCommsTime 30 min;set sci2.Lat1 42.3439 degree;set sci2.Lon1 -87.0246 degree;set sci2.YoYoMinDepth 5 m;set sci2.YoYoMaxDepth 10 m;set sci2.MaxDepth 25 m" 2tt65 1 2.000000 2021-08-15T23:28:02.943Z,1629070082.943 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=2tt65 2021-08-15T23:28:02.944Z,1629070082.944 [CommandLine](IMPORTANT): Scheduled #1 (#1 of 2 with id='2tt65'): "load Science/sci2.xml;set sci2.MissionTimeout 3 h;set sci2.NeedCommsTime 30 min;set sci2.Lat1 42.3439 degree;set sci2.Lon1 -87.0246 degree;set sci2.YoYoMinDepth 5 m;set sci2.YoYoMaxDepth 10 m;set sci2.MaxDepth 25 m" ASAP 2021-08-15T23:28:03.914Z,1629070083.914 [DataOverHttps](IMPORTANT): SBD MTMSN=20210815T232800 2021-08-15T23:28:11.481Z,1629070091.481 [CommandLine](IMPORTANT): got command schedule asap "set sci2.MinOffshore 1 km;run" 2tt65 2 2.000000 2021-08-15T23:28:11.482Z,1629070091.482 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=2tt65 2021-08-15T23:28:11.483Z,1629070091.483 [CommandLine](IMPORTANT): Scheduled #2 (#2 of 2 with id='2tt65'): "set sci2.MinOffshore 1 km;run" ASAP 2021-08-15T23:28:11.624Z,1629070091.624 [CommandLine](IMPORTANT): got command load ./Missions/Science/sci2.xml 2021-08-15T23:28:13.369Z,1629070093.369 [CommandLine](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2021-08-15T23:28:22.735Z,1629070102.735 [CommandLine](IMPORTANT): got command set sci2.MissionTimeout 3.000000 hour 2021-08-15T23:28:22.736Z,1629070102.736 [CommandLine](IMPORTANT): got command set sci2.NeedCommsTime 30.000000 minute 2021-08-15T23:28:22.744Z,1629070102.744 [CommandLine](IMPORTANT): got command set sci2.Lat1 42.343899 degree 2021-08-15T23:28:22.745Z,1629070102.745 [CommandLine](IMPORTANT): got command set sci2.Lon1 -87.024597 degree 2021-08-15T23:28:22.746Z,1629070102.746 [CommandLine](IMPORTANT): got command set sci2.YoYoMinDepth 5.000000 meter 2021-08-15T23:28:22.748Z,1629070102.748 [CommandLine](IMPORTANT): got command set sci2.YoYoMaxDepth 10.000000 meter 2021-08-15T23:28:22.749Z,1629070102.749 [CommandLine](IMPORTANT): got command set sci2.MaxDepth 25.000000 meter 2021-08-15T23:28:24.468Z,1629070104.468 [CommandLine](IMPORTANT): got command set sci2.MinOffshore 1.000000 kilometer 2021-08-15T23:28:24.468Z,1629070104.468 [CommandLine](IMPORTANT): got command run 2021-08-15T23:28:24.470Z,1629070104.470 [CommandLine](IMPORTANT): Running 2021-08-15T23:28:24.731Z,1629070104.731 [MissionManager](IMPORTANT): Started mission sci2 2021-08-15T23:34:28.190Z,1629070468.190 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2021-08-16T01:40:47.599Z,1629078047.599 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45648, MT Status=1, MTMSN=3243 2021-08-16T01:40:48.382Z,1629078048.382 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2tyhb 1 3.000000 2021-08-16T01:40:48.382Z,1629078048.382 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2tyhb 2021-08-16T01:40:48.383Z,1629078048.383 [CommandLine](IMPORTANT): Scheduled #3 (#1 of 3 with id='2tyhb'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" ASAP 2021-08-16T01:41:00.818Z,1629078060.818 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45649, MT Status=1, MTMSN=3244 2021-08-16T01:41:01.590Z,1629078061.590 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 42.34395 degree;set Smear.SamplingEndLongitude -87.024553 degree;set Smear.YoYoUpPitch 12 degree" 2tyhb 2 3.000000 2021-08-16T01:41:01.591Z,1629078061.591 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2tyhb 2021-08-16T01:41:01.592Z,1629078061.592 [CommandLine](IMPORTANT): Scheduled #4 (#2 of 3 with id='2tyhb'): "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 42.34395 degree;set Smear.SamplingEndLongitude -87.024553 degree;set Smear.YoYoUpPitch 12 degree" ASAP 2021-08-16T01:41:28.749Z,1629078088.749 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45650, MT Status=1, MTMSN=3245 2021-08-16T01:41:29.438Z,1629078089.438 [CommandLine](IMPORTANT): got command schedule asap "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2tyhb 3 3.000000 2021-08-16T01:41:29.438Z,1629078089.438 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2tyhb 2021-08-16T01:41:29.439Z,1629078089.439 [CommandLine](IMPORTANT): Scheduled #5 (#3 of 3 with id='2tyhb'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-16T01:41:29.674Z,1629078089.674 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-16T01:41:30.477Z,1629078090.477 [WetLabsBB2FL](FAULT): LCB fault: Software Overcurrent. 2021-08-16T01:41:32.948Z,1629078092.948 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-16T01:41:33.216Z,1629078093.216 [MissionManager](IMPORTANT): Started mission Default 2021-08-16T01:41:45.871Z,1629078105.871 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-16T01:41:45.872Z,1629078105.872 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-16T01:41:45.872Z,1629078105.872 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-16T01:41:45.873Z,1629078105.873 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-16T01:41:45.874Z,1629078105.874 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-16T01:41:58.868Z,1629078118.868 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 5.000000 meter 2021-08-16T01:41:58.869Z,1629078118.869 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 15.000000 meter 2021-08-16T01:41:58.870Z,1629078118.870 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.343948 degree 2021-08-16T01:41:58.871Z,1629078118.871 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.024551 degree 2021-08-16T01:41:58.872Z,1629078118.872 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-16T01:42:03.969Z,1629078123.969 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-16T01:42:03.970Z,1629078123.970 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-16T01:42:03.971Z,1629078123.971 [CommandLine](IMPORTANT): got command run 2021-08-16T01:42:03.973Z,1629078123.973 [CommandLine](IMPORTANT): Running 2021-08-16T01:42:04.076Z,1629078124.076 [MissionManager](IMPORTANT): Started mission Smear 2021-08-16T01:47:29.888Z,1629078449.888 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-16T01:47:30.700Z,1629078450.700 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-16T02:02:33.288Z,1629079353.288 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 4.331481 m , 23.807306 degC , 0.530400 ug/l . 2021-08-16T02:02:34.862Z,1629079354.862 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::' 2021-08-16T02:02:45.001Z,1629079365.001 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-16T02:02:45.293Z,1629079365.293 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-16T02:03:33.127Z,1629079413.127 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-16T02:03:33.945Z,1629079413.945 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -1 2021-08-16T02:03:33.946Z,1629079413.946 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-16T02:03:34.386Z,1629079414.386 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-16T02:03:35.146Z,1629079415.146 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-16T02:03:35.551Z,1629079415.551 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-16T02:03:37.167Z,1629079417.167 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-16T02:04:11.511Z,1629079451.511 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PRIMING (@25,aRNAl_bac) 2021-08-16T02:04:13.127Z,1629079453.127 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PRIMING (@100.0) 2021-08-16T02:04:13.531Z,1629079453.531 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-16T02:04:13.935Z,1629079453.935 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-16T02:06:39.383Z,1629079599.383 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_FILTERING (@0.0) 2021-08-16T02:06:39.787Z,1629079599.787 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-16T02:29:00.805Z,1629080940.805 [ElevatorServo](FAULT): Reading outside of valid range:0.000000 2021-08-16T02:29:01.445Z,1629080941.445 [ElevatorServo](FAULT): Elevator uart error - getPosition.serial timeout 2021-08-16T02:41:23.319Z,1629081683.319 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PAUSED (@696.8) 2021-08-16T02:41:23.723Z,1629081683.723 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PROCESSING (@696.8) 2021-08-16T02:41:25.743Z,1629081685.743 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-16T02:41:26.146Z,1629081686.146 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PROCESSED (@25,aRNAl_bac) 2021-08-16T02:43:00.688Z,1629081780.688 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING (@25,aRNAl_bac) 2021-08-16T02:43:07.963Z,1629081787.963 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-16T02:43:08.371Z,1629081788.371 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED 2021-08-16T02:48:08.159Z,1629082088.159 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence completed normally. 2021-08-16T02:48:08.563Z,1629082088.563 [ESPComponent](IMPORTANT): [sample #1] ESP log summary report (3 messages): @22:03:47.07 Selecting Cartridge 25 @22:41:20.13 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @22:41:20.32 Sampled 696.8ml 2021-08-16T02:48:09.424Z,1629082089.424 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-16T02:49:50.058Z,1629082190.058 [RudderServo](FAULT): Invalid EZ Servo response:"3" 2021-08-16T02:54:31.529Z,1629082471.529 [MissionManager](IMPORTANT): Started mission Default 2021-08-16T03:00:30.639Z,1629082830.639 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 5.978225 min 2021-08-16T03:07:20.172Z,1629083240.172 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 12.803689 min 2021-08-16T03:14:08.423Z,1629083648.423 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 19.607939 min 2021-08-16T03:19:45.467Z,1629083985.467 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 25.226021 min 2021-08-16T03:25:30.659Z,1629084330.659 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 30.978215 min 2021-08-16T03:28:06.657Z,1629084486.657 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45692, MT Status=1, MTMSN=3246 2021-08-16T03:28:07.445Z,1629084487.445 [CommandLine](IMPORTANT): got command schedule asap "load Science/sci2.xml;set sci2.MissionTimeout 3 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 42.3439 degree;set sci2.Lon1 -87.0246 degree;set sci2.YoYoMinDepth 5 m;set sci2.YoYoMaxDepth 10 m;set sci2.MaxDepth 25 m" 2u3xc 1 2.000000 2021-08-16T03:28:07.445Z,1629084487.445 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=2u3xc 2021-08-16T03:28:07.446Z,1629084487.446 [CommandLine](IMPORTANT): Scheduled #6 (#1 of 2 with id='2u3xc'): "load Science/sci2.xml;set sci2.MissionTimeout 3 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 42.3439 degree;set sci2.Lon1 -87.0246 degree;set sci2.YoYoMinDepth 5 m;set sci2.YoYoMaxDepth 10 m;set sci2.MaxDepth 25 m" ASAP 2021-08-16T03:29:01.555Z,1629084541.555 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45693, MT Status=1, MTMSN=3247 2021-08-16T03:29:02.154Z,1629084542.154 [CommandLine](IMPORTANT): got command schedule asap "set sci2.MinOffshore 1 km;run" 2u3xc 2 2.000000 2021-08-16T03:29:02.155Z,1629084542.155 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=2u3xc 2021-08-16T03:29:02.156Z,1629084542.156 [CommandLine](IMPORTANT): Scheduled #7 (#2 of 2 with id='2u3xc'): "set sci2.MinOffshore 1 km;run" ASAP 2021-08-16T03:29:02.268Z,1629084542.268 [CommandLine](IMPORTANT): got command load ./Missions/Science/sci2.xml 2021-08-16T03:29:04.166Z,1629084544.166 [CommandLine](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2021-08-16T03:29:14.612Z,1629084554.612 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45694, MT Status=1, MTMSN=3248 2021-08-16T03:29:15.962Z,1629084555.962 [CommandLine](IMPORTANT): got command set sci2.MissionTimeout 3.000000 hour 2021-08-16T03:29:15.963Z,1629084555.963 [CommandLine](IMPORTANT): got command set sci2.NeedCommsTime 45.000000 minute 2021-08-16T03:29:15.964Z,1629084555.964 [CommandLine](IMPORTANT): got command set sci2.Lat1 42.343899 degree 2021-08-16T03:29:15.964Z,1629084555.964 [CommandLine](IMPORTANT): got command set sci2.Lon1 -87.024597 degree 2021-08-16T03:29:15.965Z,1629084555.965 [CommandLine](IMPORTANT): got command set sci2.YoYoMinDepth 5.000000 meter 2021-08-16T03:29:15.966Z,1629084555.966 [CommandLine](IMPORTANT): got command set sci2.YoYoMaxDepth 10.000000 meter 2021-08-16T03:29:15.967Z,1629084555.967 [CommandLine](IMPORTANT): got command set sci2.MaxDepth 25.000000 meter 2021-08-16T03:29:15.994Z,1629084555.994 [CommandLine](IMPORTANT): got command schedule asap 2021-08-16T03:29:15.994Z,1629084555.994 [CommandLine](FAULT): Incomplete syntax. Try: help schedule 2021-08-16T03:29:17.889Z,1629084557.889 [CommandLine](IMPORTANT): got command set sci2.MinOffshore 1.000000 kilometer 2021-08-16T03:29:17.890Z,1629084557.890 [CommandLine](IMPORTANT): got command run 2021-08-16T03:29:17.892Z,1629084557.892 [CommandLine](IMPORTANT): Running 2021-08-16T03:29:18.114Z,1629084558.114 [MissionManager](IMPORTANT): Started mission sci2 2021-08-16T03:29:26.564Z,1629084566.564 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45695, MT Status=1, MTMSN=3249 2021-08-16T03:29:27.222Z,1629084567.222 [CommandLine](IMPORTANT): got command schedule asap "set sci2.YoYoDownPitch -12 degree;set sci2.MaxDepth 25 m;set sci2.MinOffshore 1 km;run" 2u42o 2 2.000000 2021-08-16T03:29:27.223Z,1629084567.223 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=2u42o 2021-08-16T03:29:27.223Z,1629084567.223 [CommandLine](IMPORTANT): Scheduled #8 (#2 of 2 with id='2u42o'): "set sci2.YoYoDownPitch -12 degree;set sci2.MaxDepth 25 m;set sci2.MinOffshore 1 km;run" ASAP 2021-08-16T04:17:12.824Z,1629087432.824 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45704, MT Status=1, MTMSN=3250 2021-08-16T04:17:13.393Z,1629087433.393 [CommandLine](IMPORTANT): got command stop 2021-08-16T04:17:14.052Z,1629087434.052 [MissionManager](IMPORTANT): Started mission Default 2021-08-16T04:17:45.211Z,1629087465.211 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45705, MT Status=1, MTMSN=3251 2021-08-16T04:17:45.765Z,1629087465.765 [CommandLine](IMPORTANT): got command schedule clear 2021-08-16T04:17:45.765Z,1629087465.765 [CommandLine](IMPORTANT): #Cleared scheduled commands:1 2021-08-16T04:17:45.765Z,1629087465.765 [CommandLine](IMPORTANT): got command schedule resume 2021-08-16T04:17:45.766Z,1629087465.766 [CommandLine](IMPORTANT): Scheduling is resumed 2021-08-16T04:18:41.089Z,1629087521.089 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45707, MT Status=1, MTMSN=3252 2021-08-16T04:18:41.724Z,1629087521.724 [CommandLine](IMPORTANT): got command load ./Missions/Maintenance/calibrate_sparton_compass.xml 2021-08-16T04:18:43.546Z,1629087523.546 [CommandLine](IMPORTANT): Loaded ./Missions/Maintenance/calibrate_sparton_compass.xml 2021-08-16T04:18:49.199Z,1629087529.199 [CommandLine](IMPORTANT): got command set SpartonCompassCal.YoYoMaxDepth 15.000000 meter 2021-08-16T04:18:49.199Z,1629087529.199 [CommandLine](IMPORTANT): got command set SpartonCompassCal.YoYoPitch 12.000000 degree 2021-08-16T04:18:49.200Z,1629087529.200 [CommandLine](IMPORTANT): got command run 2021-08-16T04:18:49.203Z,1629087529.203 [CommandLine](IMPORTANT): Running 2021-08-16T04:18:49.213Z,1629087529.213 [MissionManager](IMPORTANT): Started mission SpartonCompassCal 2021-08-16T04:58:47.933Z,1629089927.933 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-16T04:58:58.833Z,1629089938.833 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.004705 CHAN A1 (24V): 0.002382 CHAN A2 (12V): -0.005925 CHAN A3 (5V): -0.003458 CHAN B0 (3.3V): -0.002628 CHAN B1 (3.15aV): -0.001461 CHAN B2 (3.15bV): -0.000572 CHAN B3 (GND): -0.000860 OPEN: 0.012075 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-16T05:18:49.850Z,1629091129.850 [AHRS_M2](IMPORTANT): Acquired 4 calibration points. 2021-08-16T05:18:49.887Z,1629091129.887 [MissionManager](IMPORTANT): Started mission Default 2021-08-16T05:18:50.626Z,1629091130.626 [AHRS_M2](IMPORTANT): Magnetic calibration quality (0[best] to 10000) is 0.000002. 2021-08-16T05:19:55.671Z,1629091195.671 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45721, MT Status=1, MTMSN=3253 2021-08-16T05:19:56.420Z,1629091196.420 [CommandLine](IMPORTANT): got command schedule "load Science/sci2.xml;set sci2.MissionTimeout 8 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 42.3439 degree;set sci2.Lon1 -87.0246 degree;set sci2.YoYoMinDepth 5 m;set sci2.YoYoMaxDepth 50 m;set sci2.YoYoMinAltitude 12 m" 2u6zu 1 2.000000 2021-08-16T05:19:56.421Z,1629091196.421 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=2u6zu 2021-08-16T05:19:56.422Z,1629091196.422 [CommandLine](IMPORTANT): Scheduled #9 (#1 of 2 with id='2u6zu'): "load Science/sci2.xml;set sci2.MissionTimeout 8 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 42.3439 degree;set sci2.Lon1 -87.0246 degree;set sci2.YoYoMinDepth 5 m;set sci2.YoYoMaxDepth 50 m;set sci2.YoYoMinAltitude 12 m" 2021-08-16T05:21:06.611Z,1629091266.611 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45722, MT Status=1, MTMSN=3254 2021-08-16T05:21:07.298Z,1629091267.298 [CommandLine](IMPORTANT): got command schedule "set sci2.YoYoUpPitch 12 degree;set sci2.YoYoDownPitch -12 degree;set sci2.MaxDepth 60 m;set sci2.MinOffshore 2 km;run" 2u6zu 2 2.000000 2021-08-16T05:21:07.298Z,1629091267.298 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=2u6zu 2021-08-16T05:21:07.299Z,1629091267.299 [CommandLine](IMPORTANT): Scheduled #10 (#2 of 2 with id='2u6zu'): "set sci2.YoYoUpPitch 12 degree;set sci2.YoYoDownPitch -12 degree;set sci2.MaxDepth 60 m;set sci2.MinOffshore 2 km;run" 2021-08-16T05:21:07.364Z,1629091267.364 [CommandLine](IMPORTANT): got command load ./Missions/Science/sci2.xml 2021-08-16T05:21:09.268Z,1629091269.268 [CommandLine](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2021-08-16T05:21:23.435Z,1629091283.435 [CommandLine](IMPORTANT): got command set sci2.MissionTimeout 8.000000 hour 2021-08-16T05:21:23.436Z,1629091283.436 [CommandLine](IMPORTANT): got command set sci2.NeedCommsTime 45.000000 minute 2021-08-16T05:21:23.437Z,1629091283.437 [CommandLine](IMPORTANT): got command set sci2.Lat1 42.343899 degree 2021-08-16T05:21:23.438Z,1629091283.438 [CommandLine](IMPORTANT): got command set sci2.Lon1 -87.024597 degree 2021-08-16T05:21:23.438Z,1629091283.438 [CommandLine](IMPORTANT): got command set sci2.YoYoMinDepth 5.000000 meter 2021-08-16T05:21:23.439Z,1629091283.439 [CommandLine](IMPORTANT): got command set sci2.YoYoMaxDepth 50.000000 meter 2021-08-16T05:21:23.440Z,1629091283.440 [CommandLine](IMPORTANT): got command set sci2.YoYoMinAltitude 12.000000 meter 2021-08-16T05:21:31.136Z,1629091291.136 [CommandLine](IMPORTANT): got command set sci2.YoYoUpPitch 12.000000 degree 2021-08-16T05:21:31.137Z,1629091291.137 [CommandLine](IMPORTANT): got command set sci2.YoYoDownPitch -12.000000 degree 2021-08-16T05:21:31.138Z,1629091291.138 [CommandLine](IMPORTANT): got command set sci2.MaxDepth 60.000000 meter 2021-08-16T05:21:31.139Z,1629091291.139 [CommandLine](IMPORTANT): got command set sci2.MinOffshore 2.000000 kilometer 2021-08-16T05:21:31.139Z,1629091291.139 [CommandLine](IMPORTANT): got command run 2021-08-16T05:21:31.141Z,1629091291.141 [CommandLine](IMPORTANT): Running 2021-08-16T05:21:31.274Z,1629091291.274 [MissionManager](IMPORTANT): Started mission sci2 2021-08-16T05:21:32.093Z,1629091292.093 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45723, MT Status=1, MTMSN=3255 2021-08-16T05:21:32.643Z,1629091292.643 [CommandLine](IMPORTANT): got command schedule list 2021-08-16T05:55:57.537Z,1629093357.537 [ElevatorServo](FAULT): Invalid EZ Servo response:"" 2021-08-16T05:55:58.228Z,1629093358.228 [ElevatorServo](FAULT): LCB fault: Software Overcurrent. 2021-08-16T06:02:54.297Z,1629093774.297 [RudderServo](FAULT): Rudder uart error - getPosition..serial timeout 2021-08-16T10:58:59.020Z,1629111539.020 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-16T10:59:09.900Z,1629111549.900 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): 0.011153 CHAN A1 (24V): 0.001905 CHAN A2 (12V): -0.007092 CHAN A3 (5V): -0.005783 CHAN B0 (3.3V): -0.002855 CHAN B1 (3.15aV): -0.001421 CHAN B2 (3.15bV): -0.001178 CHAN B3 (GND): -0.012242 OPEN: 0.012068 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-16T13:21:31.825Z,1629120091.825 [MissionManager](IMPORTANT): Started mission Default 2021-08-16T13:32:15.647Z,1629120735.647 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 10.723901 min 2021-08-16T13:38:22.939Z,1629121102.939 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 16.844955 min 2021-08-16T13:38:40.578Z,1629121120.578 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45825, MT Status=1, MTMSN=3256 2021-08-16T13:38:41.389Z,1629121121.389 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2uwhi 1 3.000000 2021-08-16T13:38:41.390Z,1629121121.390 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2uwhi 2021-08-16T13:38:41.391Z,1629121121.391 [CommandLine](IMPORTANT): Scheduled #11 (#1 of 3 with id='2uwhi'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" ASAP 2021-08-16T13:38:53.912Z,1629121133.912 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45826, MT Status=1, MTMSN=3257 2021-08-16T13:38:54.610Z,1629121134.610 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 42.34395 degree;set Smear.SamplingEndLongitude -87.024553 degree;set Smear.YoYoUpPitch 12 degree" 2uwhi 2 3.000000 2021-08-16T13:38:54.610Z,1629121134.610 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2uwhi 2021-08-16T13:38:54.614Z,1629121134.614 [CommandLine](IMPORTANT): Scheduled #12 (#2 of 3 with id='2uwhi'): "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 42.34395 degree;set Smear.SamplingEndLongitude -87.024553 degree;set Smear.YoYoUpPitch 12 degree" ASAP 2021-08-16T13:39:10.327Z,1629121150.327 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45827, MT Status=1, MTMSN=3258 2021-08-16T13:39:10.952Z,1629121150.952 [CommandLine](IMPORTANT): got command schedule asap "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2uwhi 3 3.000000 2021-08-16T13:39:10.953Z,1629121150.953 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2uwhi 2021-08-16T13:39:10.954Z,1629121150.954 [CommandLine](IMPORTANT): Scheduled #13 (#3 of 3 with id='2uwhi'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-16T13:39:11.130Z,1629121151.130 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-16T13:39:13.361Z,1629121153.361 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-16T13:39:26.815Z,1629121166.815 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-16T13:39:26.816Z,1629121166.816 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-16T13:39:26.817Z,1629121166.817 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-16T13:39:26.818Z,1629121166.818 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-16T13:39:26.819Z,1629121166.819 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-16T13:39:41.224Z,1629121181.224 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 5.000000 meter 2021-08-16T13:39:41.225Z,1629121181.225 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 15.000000 meter 2021-08-16T13:39:41.226Z,1629121181.226 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.343948 degree 2021-08-16T13:39:41.227Z,1629121181.227 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.024551 degree 2021-08-16T13:39:41.228Z,1629121181.228 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-16T13:39:47.819Z,1629121187.819 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-16T13:39:47.820Z,1629121187.820 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-16T13:39:47.821Z,1629121187.821 [CommandLine](IMPORTANT): got command run 2021-08-16T13:39:47.823Z,1629121187.823 [CommandLine](IMPORTANT): Running 2021-08-16T13:39:47.966Z,1629121187.966 [MissionManager](IMPORTANT): Started mission Smear 2021-08-16T13:42:21.552Z,1629121341.552 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-16T13:42:22.370Z,1629121342.370 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-16T13:57:24.931Z,1629122244.931 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 8.936067 m , 22.878809 degC , 0.312000 ug/l . 2021-08-16T13:57:36.709Z,1629122256.709 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-16T13:57:37.002Z,1629122257.002 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-16T13:58:23.594Z,1629122303.594 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-16T13:58:24.409Z,1629122304.409 [ESPComponent](IMPORTANT): [sample #2] Setting cartridge argument to -1 2021-08-16T13:58:24.409Z,1629122304.409 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-16T13:58:24.847Z,1629122304.847 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-16T13:58:25.210Z,1629122305.210 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-16T13:58:25.617Z,1629122305.617 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-16T13:58:27.636Z,1629122307.636 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-16T13:59:01.975Z,1629122341.975 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PRIMING (@24,aRNAl_bac) 2021-08-16T13:59:03.594Z,1629122343.594 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PRIMING (@100.0) 2021-08-16T13:59:03.995Z,1629122343.995 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-16T13:59:04.399Z,1629122344.399 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-16T14:01:27.416Z,1629122487.416 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_FILTERING (@0.0) 2021-08-16T14:01:27.819Z,1629122487.819 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-16T14:41:49.906Z,1629124909.906 [DVL_micro](FAULT): Failed to initialize within timeout. 2021-08-16T14:51:56.301Z,1629125516.301 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PAUSED (@947.9) 2021-08-16T14:51:56.707Z,1629125516.707 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PROCESSING (@947.9) 2021-08-16T14:51:58.724Z,1629125518.724 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-16T14:51:59.127Z,1629125519.127 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PROCESSED (@24,aRNAl_bac) 2021-08-16T14:53:33.666Z,1629125613.666 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPING (@24,aRNAl_bac) 2021-08-16T14:53:40.936Z,1629125620.936 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-16T14:53:41.341Z,1629125621.341 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPED 2021-08-16T14:58:41.122Z,1629125921.122 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence completed normally. 2021-08-16T14:58:41.523Z,1629125921.523 [ESPComponent](IMPORTANT): [sample #2] ESP log summary report (3 messages): @09:58:37.81 Selecting Cartridge 24 @10:51:53.60 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @10:51:53.80 Sampled 947.9ml 2021-08-16T14:58:42.357Z,1629125922.357 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-16T14:59:19.115Z,1629125959.115 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45836, MT Status=1, MTMSN=3259 2021-08-16T14:59:19.741Z,1629125959.741 [CommandLine](IMPORTANT): got command schedule clear 2021-08-16T14:59:19.742Z,1629125959.742 [CommandLine](IMPORTANT): #Cleared scheduled commands:0 2021-08-16T14:59:19.742Z,1629125959.742 [CommandLine](IMPORTANT): got command schedule resume 2021-08-16T15:02:54.905Z,1629126174.905 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45837, MT Status=1, MTMSN=3260 2021-08-16T15:02:56.230Z,1629126176.230 [CommandLine](IMPORTANT): got command schedule "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2uwra 1 3.000000 2021-08-16T15:02:56.230Z,1629126176.230 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2uwra 2021-08-16T15:02:56.231Z,1629126176.231 [CommandLine](IMPORTANT): Scheduled #14 (#1 of 3 with id='2uwra'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2021-08-16T15:03:20.696Z,1629126200.696 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45838, MT Status=1, MTMSN=3261 2021-08-16T15:03:21.486Z,1629126201.486 [CommandLine](IMPORTANT): got command schedule "set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 42.34395 degree;set Smear.SamplingEndLongitude -87.024553 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2uwra 2 3.000000 2021-08-16T15:03:21.486Z,1629126201.486 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2uwra 2021-08-16T15:03:21.487Z,1629126201.487 [CommandLine](IMPORTANT): Scheduled #15 (#2 of 3 with id='2uwra'): "set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 42.34395 degree;set Smear.SamplingEndLongitude -87.024553 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2021-08-16T15:03:43.130Z,1629126223.130 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45839, MT Status=1, MTMSN=3262 2021-08-16T15:03:43.745Z,1629126223.745 [CommandLine](IMPORTANT): got command schedule "set Smear.NeedCommsTimeVeryLong 8 h;run" 2uwra 3 3.000000 2021-08-16T15:03:43.746Z,1629126223.746 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2uwra 2021-08-16T15:03:43.748Z,1629126223.748 [CommandLine](IMPORTANT): Scheduled #16 (#3 of 3 with id='2uwra'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-16T15:03:56.627Z,1629126236.627 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45840, MT Status=1, MTMSN=3263 2021-08-16T15:03:57.410Z,1629126237.410 [CommandLine](IMPORTANT): got command schedule "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2uxb2 1 3.000000 2021-08-16T15:03:57.410Z,1629126237.410 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2uxb2 2021-08-16T15:03:57.411Z,1629126237.411 [CommandLine](IMPORTANT): Scheduled #17 (#1 of 3 with id='2uxb2'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2021-08-16T15:04:10.431Z,1629126250.431 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45841, MT Status=1, MTMSN=3264 2021-08-16T15:04:11.203Z,1629126251.203 [CommandLine](IMPORTANT): got command schedule "set Smear.SamplingYoYoMinDepth 40 m;set Smear.SamplingYoYoMaxDepth 70 m;set Smear.SamplingEndLatitude 42.34395 degree;set Smear.SamplingEndLongitude -87.024553 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2uxb2 2 3.000000 2021-08-16T15:04:11.204Z,1629126251.204 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2uxb2 2021-08-16T15:04:11.205Z,1629126251.205 [CommandLine](IMPORTANT): Scheduled #18 (#2 of 3 with id='2uxb2'): "set Smear.SamplingYoYoMinDepth 40 m;set Smear.SamplingYoYoMaxDepth 70 m;set Smear.SamplingEndLatitude 42.34395 degree;set Smear.SamplingEndLongitude -87.024553 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2021-08-16T15:04:33.163Z,1629126273.163 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45842, MT Status=1, MTMSN=3265 2021-08-16T15:04:33.741Z,1629126273.741 [CommandLine](IMPORTANT): got command schedule "set Smear.NeedCommsTimeVeryLong 8 h;run" 2uxb2 3 3.000000 2021-08-16T15:04:33.741Z,1629126273.741 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2uxb2 2021-08-16T15:04:33.742Z,1629126273.742 [CommandLine](IMPORTANT): Scheduled #19 (#3 of 3 with id='2uxb2'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-16T15:06:50.876Z,1629126410.876 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-16T15:06:51.225Z,1629126411.225 [WetLabsBB2FL](FAULT): LCB fault: Software Overcurrent. 2021-08-16T15:06:53.616Z,1629126413.616 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-16T15:06:53.938Z,1629126413.938 [MissionManager](IMPORTANT): Started mission Default 2021-08-16T15:07:05.883Z,1629126425.883 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-16T15:07:05.884Z,1629126425.884 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-16T15:07:05.884Z,1629126425.884 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-16T15:07:05.885Z,1629126425.885 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-16T15:07:05.886Z,1629126425.886 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-16T15:07:23.001Z,1629126443.001 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 15.000000 meter 2021-08-16T15:07:23.002Z,1629126443.002 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 30.000000 meter 2021-08-16T15:07:23.003Z,1629126443.003 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.343948 degree 2021-08-16T15:07:23.004Z,1629126443.004 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.024551 degree 2021-08-16T15:07:23.005Z,1629126443.005 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-16T15:07:23.005Z,1629126443.005 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-16T15:07:26.215Z,1629126446.215 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-16T15:07:26.215Z,1629126446.215 [CommandLine](IMPORTANT): got command run 2021-08-16T15:07:26.227Z,1629126446.227 [CommandLine](IMPORTANT): Running 2021-08-16T15:07:26.292Z,1629126446.292 [MissionManager](IMPORTANT): Started mission Smear 2021-08-16T15:10:45.339Z,1629126645.339 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-16T15:10:46.143Z,1629126646.143 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-16T15:25:48.734Z,1629127548.734 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 23.486774 m , 8.945398 degC , 0.405600 ug/l . 2021-08-16T15:26:00.509Z,1629127560.509 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-16T15:26:00.612Z,1629127560.612 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-16T15:26:48.078Z,1629127608.078 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-16T15:26:48.899Z,1629127608.899 [ESPComponent](IMPORTANT): [sample #3] Setting cartridge argument to -1 2021-08-16T15:26:48.900Z,1629127608.900 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-16T15:26:49.339Z,1629127609.339 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-16T15:26:49.695Z,1629127609.695 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-16T15:26:50.098Z,1629127610.098 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-16T15:26:52.119Z,1629127612.119 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-16T15:27:26.461Z,1629127646.461 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PRIMING (@23,aRNAl_bac) 2021-08-16T15:27:28.079Z,1629127648.079 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PRIMING (@100.0) 2021-08-16T15:27:28.486Z,1629127648.486 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-16T15:27:28.887Z,1629127648.887 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-16T15:29:58.373Z,1629127798.373 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_FILTERING (@0.0) 2021-08-16T15:29:58.775Z,1629127798.775 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-16T16:11:43.226Z,1629130303.226 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PAUSED (@751.6) 2021-08-16T16:11:43.631Z,1629130303.631 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PROCESSING (@751.6) 2021-08-16T16:11:45.651Z,1629130305.651 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-16T16:11:46.054Z,1629130306.054 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PROCESSED (@23,aRNAl_bac) 2021-08-16T16:13:20.995Z,1629130400.995 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPING (@23,aRNAl_bac) 2021-08-16T16:13:28.275Z,1629130408.275 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-16T16:13:28.675Z,1629130408.675 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPED 2021-08-16T16:18:28.446Z,1629130708.446 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence completed normally. 2021-08-16T16:18:28.851Z,1629130708.851 [ESPComponent](IMPORTANT): [sample #3] ESP log summary report (5 messages): @11:27:02.87 Selecting Cartridge 23 @11:27:37.53 Cartridge::Sampler::PossibleLeak in FILTERING -- Retained only 39.3psia @11:27:37.54 Retry #1 of 2 @12:11:40.91 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @12:11:41.11 Sampled 751.6ml 2021-08-16T16:18:29.714Z,1629130709.714 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-16T16:24:48.128Z,1629131088.128 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-16T16:24:50.829Z,1629131090.829 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-16T16:24:51.161Z,1629131091.161 [MissionManager](IMPORTANT): Started mission Default 2021-08-16T16:25:03.105Z,1629131103.105 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-16T16:25:03.106Z,1629131103.106 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-16T16:25:03.108Z,1629131103.108 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-16T16:25:03.108Z,1629131103.108 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-16T16:25:03.132Z,1629131103.132 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-16T16:25:20.288Z,1629131120.288 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 40.000000 meter 2021-08-16T16:25:20.288Z,1629131120.288 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 70.000000 meter 2021-08-16T16:25:20.289Z,1629131120.289 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.343948 degree 2021-08-16T16:25:20.290Z,1629131120.290 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.024551 degree 2021-08-16T16:25:20.291Z,1629131120.291 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-16T16:25:20.292Z,1629131120.292 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-16T16:25:23.438Z,1629131123.438 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-16T16:25:23.438Z,1629131123.438 [CommandLine](IMPORTANT): got command run 2021-08-16T16:25:23.461Z,1629131123.461 [CommandLine](IMPORTANT): Running 2021-08-16T16:25:24.406Z,1629131124.406 [MissionManager](IMPORTANT): Started mission Smear 2021-08-16T16:31:33.624Z,1629131493.624 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-16T16:31:34.433Z,1629131494.433 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-16T16:46:37.024Z,1629132397.024 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 41.131638 m , 4.830194 degC , 0.551200 ug/l . 2021-08-16T16:46:48.817Z,1629132408.817 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-16T16:46:48.955Z,1629132408.955 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-16T16:47:36.774Z,1629132456.774 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-16T16:47:37.586Z,1629132457.586 [ESPComponent](IMPORTANT): [sample #4] Setting cartridge argument to -1 2021-08-16T16:47:37.586Z,1629132457.586 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-16T16:47:38.027Z,1629132458.027 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-16T16:47:38.391Z,1629132458.391 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-16T16:47:38.795Z,1629132458.795 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-16T16:47:40.815Z,1629132460.815 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-16T16:48:15.159Z,1629132495.159 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PRIMING (@22,aRNAl_bac) 2021-08-16T16:48:16.775Z,1629132496.775 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PRIMING (@100.0) 2021-08-16T16:48:17.179Z,1629132497.179 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-16T16:48:17.583Z,1629132497.583 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-16T16:50:39.391Z,1629132639.391 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_FILTERING (@0.0) 2021-08-16T16:50:39.811Z,1629132639.811 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-16T16:59:10.241Z,1629133150.241 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-16T16:59:21.080Z,1629133161.080 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.003906 CHAN A1 (24V): 0.002560 CHAN A2 (12V): -0.007039 CHAN A3 (5V): -0.007083 CHAN B0 (3.3V): -0.002943 CHAN B1 (3.15aV): -0.001986 CHAN B2 (3.15bV): -0.001962 CHAN B3 (GND): -0.002566 OPEN: 0.012475 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-16T18:48:14.227Z,1629139694.227 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PAUSED (@2000.0) 2021-08-16T18:48:14.631Z,1629139694.631 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PROCESSING (@2000.0) 2021-08-16T18:48:16.652Z,1629139696.652 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-16T18:48:17.059Z,1629139697.059 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PROCESSED (@22,aRNAl_bac) 2021-08-16T18:49:51.994Z,1629139791.994 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPING (@22,aRNAl_bac) 2021-08-16T18:49:59.270Z,1629139799.270 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-16T18:49:59.673Z,1629139799.673 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPED 2021-08-16T18:54:59.446Z,1629140099.446 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence completed normally. 2021-08-16T18:54:59.851Z,1629140099.851 [ESPComponent](IMPORTANT): [sample #4] ESP log summary report (2 messages): @12:47:51.33 Selecting Cartridge 22 @14:48:12.44 Sampled 2000.0ml 2021-08-16T18:55:00.707Z,1629140100.707 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-16T19:04:10.859Z,1629140650.859 [MissionManager](IMPORTANT): Started mission Default 2021-08-16T19:04:11.393Z,1629140651.393 [WetLabsBB2FL](FAULT): LCB fault: Software Overcurrent. 2021-08-16T19:12:23.232Z,1629141143.232 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 8.199164 min 2021-08-16T19:21:25.409Z,1629141685.409 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 17.235722 min 2021-08-16T19:25:36.093Z,1629141936.093 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45910, MT Status=1, MTMSN=3266 2021-08-16T19:25:36.884Z,1629141936.884 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 195 m;set Smear.SamplingYoYoMinDepth 80 m" 2vcle 1 3.000000 2021-08-16T19:25:36.884Z,1629141936.884 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2vcle 2021-08-16T19:25:36.885Z,1629141936.885 [CommandLine](IMPORTANT): Scheduled #20 (#1 of 3 with id='2vcle'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 195 m;set Smear.SamplingYoYoMinDepth 80 m" ASAP 2021-08-16T19:25:54.551Z,1629141954.551 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45911, MT Status=1, MTMSN=3267 2021-08-16T19:25:55.410Z,1629141955.410 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SamplingYoYoMaxDepth 190 m;set Smear.SamplingEndLatitude 42.3439 degree;set Smear.SamplingEndLongitude -87.0245 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h" 2vcle 2 3.000000 2021-08-16T19:25:55.410Z,1629141955.410 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2vcle 2021-08-16T19:25:55.411Z,1629141955.411 [CommandLine](IMPORTANT): Scheduled #21 (#2 of 3 with id='2vcle'): "set Smear.SamplingYoYoMaxDepth 190 m;set Smear.SamplingEndLatitude 42.3439 degree;set Smear.SamplingEndLongitude -87.0245 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h" ASAP 2021-08-16T19:27:04.707Z,1629142024.707 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45913, MT Status=1, MTMSN=3268 2021-08-16T19:27:05.326Z,1629142025.326 [CommandLine](IMPORTANT): got command schedule asap "run" 2vcle 3 3.000000 2021-08-16T19:27:05.327Z,1629142025.327 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2vcle 2021-08-16T19:27:05.328Z,1629142025.328 [CommandLine](IMPORTANT): Scheduled #22 (#3 of 3 with id='2vcle'): "run" ASAP 2021-08-16T19:27:05.445Z,1629142025.445 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-16T19:27:07.714Z,1629142027.714 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-16T19:27:22.592Z,1629142042.592 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-16T19:27:22.593Z,1629142042.593 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-16T19:27:22.594Z,1629142042.594 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-16T19:27:22.594Z,1629142042.594 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-16T19:27:22.595Z,1629142042.595 [CommandLine](IMPORTANT): got command set Smear.MaxDepth 195.000000 meter 2021-08-16T19:27:22.596Z,1629142042.596 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 80.000000 meter 2021-08-16T19:27:39.282Z,1629142059.282 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 190.000000 meter 2021-08-16T19:27:39.283Z,1629142059.283 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.343899 degree 2021-08-16T19:27:39.283Z,1629142059.283 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.024498 degree 2021-08-16T19:27:39.284Z,1629142059.284 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-16T19:27:39.297Z,1629142059.297 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-16T19:27:39.297Z,1629142059.297 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-16T19:27:39.501Z,1629142059.501 [CommandLine](IMPORTANT): got command run 2021-08-16T19:27:39.503Z,1629142059.503 [CommandLine](IMPORTANT): Running 2021-08-16T19:27:39.645Z,1629142059.645 [MissionManager](IMPORTANT): Started mission Smear 2021-08-16T19:37:19.884Z,1629142639.884 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-16T19:37:20.675Z,1629142640.675 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-16T19:52:23.251Z,1629143543.251 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 82.810654 m , 4.536096 degC , 0.072800 ug/l . 2021-08-16T19:52:35.025Z,1629143555.025 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-16T19:52:35.158Z,1629143555.158 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-16T19:53:22.994Z,1629143602.994 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-16T19:53:23.808Z,1629143603.808 [ESPComponent](IMPORTANT): [sample #5] Setting cartridge argument to -1 2021-08-16T19:53:23.809Z,1629143603.809 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-16T19:53:24.253Z,1629143604.253 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-16T19:53:24.610Z,1629143604.610 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-16T19:53:25.014Z,1629143605.014 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-16T19:53:27.035Z,1629143607.035 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-16T19:54:01.375Z,1629143641.375 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PRIMING (@21,aRNAl_bac) 2021-08-16T19:54:02.991Z,1629143642.991 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PRIMING (@100.0) 2021-08-16T19:54:03.396Z,1629143643.396 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-16T19:54:03.799Z,1629143643.799 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-16T19:56:25.206Z,1629143785.206 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_FILTERING (@0.0) 2021-08-16T19:56:25.606Z,1629143785.606 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-16T21:46:02.943Z,1629150362.943 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PAUSED (@2000.0) 2021-08-16T21:46:03.347Z,1629150363.347 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PROCESSING (@2000.0) 2021-08-16T21:46:05.368Z,1629150365.368 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-16T21:46:05.771Z,1629150365.771 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PROCESSED (@21,aRNAl_bac) 2021-08-16T21:47:40.719Z,1629150460.719 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPING (@21,aRNAl_bac) 2021-08-16T21:47:47.991Z,1629150467.991 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-16T21:47:48.395Z,1629150468.395 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPED 2021-08-16T21:52:48.186Z,1629150768.186 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence completed normally. 2021-08-16T21:52:48.591Z,1629150768.591 [ESPComponent](IMPORTANT): [sample #5] ESP log summary report (2 messages): @15:53:37.35 Selecting Cartridge 21 @17:46:01.08 Sampled 2000.0ml 2021-08-16T21:52:49.441Z,1629150769.441 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-16T22:00:25.564Z,1629151225.564 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45922, MT Status=1, MTMSN=3269 2021-08-16T22:00:26.331Z,1629151226.331 [CommandLine](IMPORTANT): got command schedule "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 42.34395 degree;set Smear.SamplingEndLongitude -87.024553 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2vgk1 2 3.000000 2021-08-16T22:00:26.332Z,1629151226.332 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2vgk1 2021-08-16T22:00:26.333Z,1629151226.333 [CommandLine](IMPORTANT): Scheduled #23 (#2 of 3 with id='2vgk1'): "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 42.34395 degree;set Smear.SamplingEndLongitude -87.024553 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2021-08-16T22:01:05.226Z,1629151265.226 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45923, MT Status=1, MTMSN=3270 2021-08-16T22:01:06.230Z,1629151266.230 [CommandLine](IMPORTANT): got command schedule "set Smear.NeedCommsTimeVeryLong 8 h;run" 2vgk1 3 3.000000 2021-08-16T22:01:06.230Z,1629151266.230 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2vgk1 2021-08-16T22:01:06.231Z,1629151266.231 [CommandLine](IMPORTANT): Scheduled #24 (#3 of 3 with id='2vgk1'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-16T22:02:02.730Z,1629151322.730 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45924, MT Status=1, MTMSN=3271 2021-08-16T22:02:03.464Z,1629151323.464 [CommandLine](IMPORTANT): got command schedule "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2vgla 1 3.000000 2021-08-16T22:02:03.464Z,1629151323.464 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2vgla 2021-08-16T22:02:03.465Z,1629151323.465 [CommandLine](IMPORTANT): Scheduled #25 (#1 of 3 with id='2vgla'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2021-08-16T22:02:27.473Z,1629151347.473 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45925, MT Status=1, MTMSN=3272 2021-08-16T22:02:28.226Z,1629151348.226 [CommandLine](IMPORTANT): got command schedule "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2vgk1 1 3.000000 2021-08-16T22:02:28.227Z,1629151348.227 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2vgk1 2021-08-16T22:02:28.228Z,1629151348.228 [CommandLine](IMPORTANT): Scheduled #24 (#1 of 3 with id='2vgk1'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-16T22:02:50.139Z,1629151370.139 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45926, MT Status=1, MTMSN=3273 2021-08-16T22:02:50.934Z,1629151370.934 [CommandLine](IMPORTANT): got command schedule "set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 42.34395 degree;set Smear.SamplingEndLongitude -87.024553 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2vgla 2 3.000000 2021-08-16T22:02:50.934Z,1629151370.934 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2vgla 2021-08-16T22:02:50.935Z,1629151370.935 [CommandLine](IMPORTANT): Scheduled #27 (#2 of 3 with id='2vgla'): "set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 42.34395 degree;set Smear.SamplingEndLongitude -87.024553 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2021-08-16T22:03:06.845Z,1629151386.845 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45927, MT Status=1, MTMSN=3274 2021-08-16T22:03:07.410Z,1629151387.410 [CommandLine](IMPORTANT): got command schedule "set Smear.NeedCommsTimeVeryLong 8 h;run" 2vgla 3 3.000000 2021-08-16T22:03:07.411Z,1629151387.411 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2vgla 2021-08-16T22:03:07.415Z,1629151387.415 [CommandLine](IMPORTANT): Scheduled #28 (#3 of 3 with id='2vgla'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-16T22:03:28.017Z,1629151408.017 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45928, MT Status=1, MTMSN=3275 2021-08-16T22:03:28.766Z,1629151408.766 [CommandLine](IMPORTANT): got command schedule "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2vgm7 1 3.000000 2021-08-16T22:03:28.766Z,1629151408.766 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2vgm7 2021-08-16T22:03:28.767Z,1629151408.767 [CommandLine](IMPORTANT): Scheduled #29 (#1 of 3 with id='2vgm7'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2021-08-16T22:03:44.262Z,1629151424.262 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45929, MT Status=1, MTMSN=3276 2021-08-16T22:03:45.039Z,1629151425.039 [CommandLine](IMPORTANT): got command schedule "set Smear.SamplingYoYoMinDepth 40 m;set Smear.SamplingYoYoMaxDepth 70 m;set Smear.SamplingEndLatitude 42.34395 degree;set Smear.SamplingEndLongitude -87.024553 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2vgm7 2 3.000000 2021-08-16T22:03:45.039Z,1629151425.039 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2vgm7 2021-08-16T22:03:45.040Z,1629151425.040 [CommandLine](IMPORTANT): Scheduled #30 (#2 of 3 with id='2vgm7'): "set Smear.SamplingYoYoMinDepth 40 m;set Smear.SamplingYoYoMaxDepth 70 m;set Smear.SamplingEndLatitude 42.34395 degree;set Smear.SamplingEndLongitude -87.024553 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2021-08-16T22:04:10.465Z,1629151450.465 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45930, MT Status=1, MTMSN=3277 2021-08-16T22:04:11.002Z,1629151451.002 [CommandLine](IMPORTANT): got command schedule "set Smear.NeedCommsTimeVeryLong 8 h;run" 2vgm7 3 3.000000 2021-08-16T22:04:11.003Z,1629151451.003 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2vgm7 2021-08-16T22:04:11.004Z,1629151451.004 [CommandLine](IMPORTANT): Scheduled #31 (#3 of 3 with id='2vgm7'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-16T22:04:39.415Z,1629151479.415 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45931, MT Status=1, MTMSN=3278 2021-08-16T22:04:40.001Z,1629151480.001 [CommandLine](IMPORTANT): got command schedule resume 2021-08-16T22:08:48.376Z,1629151728.376 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-16T22:08:51.109Z,1629151731.109 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-16T22:08:51.429Z,1629151731.429 [MissionManager](IMPORTANT): Started mission Default 2021-08-16T22:09:03.530Z,1629151743.530 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-16T22:09:03.531Z,1629151743.531 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-16T22:09:03.531Z,1629151743.531 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-16T22:09:03.537Z,1629151743.537 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-16T22:09:03.538Z,1629151743.538 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-16T22:09:20.369Z,1629151760.369 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 5.000000 meter 2021-08-16T22:09:20.370Z,1629151760.370 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 15.000000 meter 2021-08-16T22:09:20.371Z,1629151760.371 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.343948 degree 2021-08-16T22:09:20.371Z,1629151760.371 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.024551 degree 2021-08-16T22:09:20.372Z,1629151760.372 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-16T22:09:20.373Z,1629151760.373 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-16T22:09:20.613Z,1629151760.613 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-16T22:09:22.655Z,1629151762.655 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-16T22:09:35.714Z,1629151775.714 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-16T22:09:35.715Z,1629151775.715 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-16T22:09:35.716Z,1629151775.716 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-16T22:09:35.721Z,1629151775.721 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-16T22:09:35.722Z,1629151775.722 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-16T22:09:39.004Z,1629151779.004 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-16T22:09:39.004Z,1629151779.004 [CommandLine](IMPORTANT): got command run 2021-08-16T22:09:39.006Z,1629151779.006 [CommandLine](IMPORTANT): Running 2021-08-16T22:09:40.074Z,1629151780.074 [MissionManager](IMPORTANT): Started mission Smear 2021-08-16T22:11:16.564Z,1629151876.564 [MissionManager](IMPORTANT): Started mission Default 2021-08-16T22:11:33.503Z,1629151893.503 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 15.000000 meter 2021-08-16T22:11:33.506Z,1629151893.506 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 30.000000 meter 2021-08-16T22:11:33.509Z,1629151893.509 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.343948 degree 2021-08-16T22:11:33.512Z,1629151893.512 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.024551 degree 2021-08-16T22:11:33.514Z,1629151893.514 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-16T22:11:33.538Z,1629151893.538 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-16T22:11:36.738Z,1629151896.738 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-16T22:11:36.740Z,1629151896.740 [CommandLine](IMPORTANT): got command run 2021-08-16T22:11:36.740Z,1629151896.740 [CommandLine](CRITICAL): Could not run 2021-08-16T22:11:36.843Z,1629151896.843 [CommandLine](FAULT): Scheduling is paused for 3 commands 2021-08-16T22:17:26.096Z,1629152246.096 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 6.152032 min 2021-08-16T22:25:33.030Z,1629152733.030 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 14.267579 min 2021-08-16T22:26:20.083Z,1629152780.083 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45955, MT Status=1, MTMSN=3279 2021-08-16T22:26:20.669Z,1629152780.669 [CommandLine](IMPORTANT): got command schedule clear 2021-08-16T22:26:20.670Z,1629152780.670 [CommandLine](IMPORTANT): #Cleared scheduled commands:3 2021-08-16T22:26:20.670Z,1629152780.670 [CommandLine](IMPORTANT): got command schedule resume 2021-08-16T22:26:20.670Z,1629152780.670 [CommandLine](IMPORTANT): Scheduling is resumed 2021-08-16T22:28:06.673Z,1629152886.673 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45959, MT Status=1, MTMSN=3280 2021-08-16T22:28:07.502Z,1629152887.502 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2vl29 1 3.000000 2021-08-16T22:28:07.503Z,1629152887.503 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2vl29 2021-08-16T22:28:07.504Z,1629152887.504 [CommandLine](IMPORTANT): Scheduled #32 (#1 of 3 with id='2vl29'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" ASAP 2021-08-16T22:28:35.903Z,1629152915.903 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45960, MT Status=1, MTMSN=3281 2021-08-16T22:28:36.694Z,1629152916.694 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 42.34395 degree;set Smear.SamplingEndLongitude -87.024553 degree;set Smear.YoYoUpPitch 12 degree" 2vl29 2 3.000000 2021-08-16T22:28:36.694Z,1629152916.694 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2vl29 2021-08-16T22:28:36.695Z,1629152916.695 [CommandLine](IMPORTANT): Scheduled #33 (#2 of 3 with id='2vl29'): "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 42.34395 degree;set Smear.SamplingEndLongitude -87.024553 degree;set Smear.YoYoUpPitch 12 degree" ASAP 2021-08-16T22:29:13.341Z,1629152953.341 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45962, MT Status=1, MTMSN=3282 2021-08-16T22:29:13.946Z,1629152953.946 [CommandLine](IMPORTANT): got command schedule asap "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2vl29 3 3.000000 2021-08-16T22:29:13.947Z,1629152953.947 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2vl29 2021-08-16T22:29:13.948Z,1629152953.948 [CommandLine](IMPORTANT): Scheduled #34 (#3 of 3 with id='2vl29'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-16T22:29:14.066Z,1629152954.066 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-16T22:29:16.371Z,1629152956.371 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-16T22:29:29.132Z,1629152969.132 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-16T22:29:29.133Z,1629152969.133 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-16T22:29:29.134Z,1629152969.134 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-16T22:29:29.134Z,1629152969.134 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-16T22:29:29.135Z,1629152969.135 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-16T22:29:44.408Z,1629152984.408 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 5.000000 meter 2021-08-16T22:29:44.409Z,1629152984.409 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 15.000000 meter 2021-08-16T22:29:44.410Z,1629152984.410 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.343948 degree 2021-08-16T22:29:44.411Z,1629152984.411 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.024551 degree 2021-08-16T22:29:44.411Z,1629152984.411 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-16T22:29:50.857Z,1629152990.857 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-16T22:29:50.858Z,1629152990.858 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-16T22:29:50.858Z,1629152990.858 [CommandLine](IMPORTANT): got command run 2021-08-16T22:29:50.860Z,1629152990.860 [CommandLine](IMPORTANT): Running 2021-08-16T22:29:51.007Z,1629152991.007 [MissionManager](IMPORTANT): Started mission Smear 2021-08-16T22:32:55.355Z,1629153175.355 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-16T22:32:56.183Z,1629153176.183 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-16T22:47:58.758Z,1629154078.758 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 4.552421 m , 22.969598 degC , 0.291200 ug/l . 2021-08-16T22:48:10.541Z,1629154090.541 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-16T22:48:10.649Z,1629154090.649 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-16T22:48:58.927Z,1629154138.927 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-16T22:48:59.737Z,1629154139.737 [ESPComponent](IMPORTANT): [sample #6] Setting cartridge argument to -1 2021-08-16T22:48:59.737Z,1629154139.737 [ESPComponent](IMPORTANT): [sample #6] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-16T22:49:00.177Z,1629154140.177 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-16T22:49:00.543Z,1629154140.543 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-16T22:49:00.946Z,1629154140.946 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-16T22:49:02.967Z,1629154142.967 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-16T22:49:37.307Z,1629154177.307 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PRIMING (@20,aRNAl_bac) 2021-08-16T22:49:38.924Z,1629154178.924 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PRIMING (@100.0) 2021-08-16T22:49:39.328Z,1629154179.328 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-16T22:49:39.732Z,1629154179.732 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-16T22:52:02.751Z,1629154322.751 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_FILTERING (@0.0) 2021-08-16T22:52:03.151Z,1629154323.151 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-16T22:59:21.202Z,1629154761.202 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-16T22:59:32.148Z,1629154772.148 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): -0.004529 CHAN A1 (24V): 0.002875 CHAN A2 (12V): 0.000174 CHAN A3 (5V): -0.003594 CHAN B0 (3.3V): -0.073541 CHAN B1 (3.15aV): -0.000579 CHAN B2 (3.15bV): -0.001108 CHAN B3 (GND): -0.000881 OPEN: 0.012219 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-16T23:55:09.923Z,1629158109.923 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PAUSED (@1161.2) 2021-08-16T23:55:10.327Z,1629158110.327 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PROCESSING (@1161.2) 2021-08-16T23:55:12.347Z,1629158112.347 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-16T23:55:12.751Z,1629158112.751 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PROCESSED (@20,aRNAl_bac) 2021-08-16T23:56:47.691Z,1629158207.691 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_STOPPING (@20,aRNAl_bac) 2021-08-16T23:56:54.965Z,1629158214.965 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-16T23:56:55.367Z,1629158215.367 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_STOPPED 2021-08-17T00:01:55.151Z,1629158515.151 [ESPComponent](IMPORTANT): [sample #6] ESP sampling sequence completed normally. 2021-08-17T00:01:55.555Z,1629158515.555 [ESPComponent](IMPORTANT): [sample #6] ESP log summary report (3 messages): @18:49:12.88 Selecting Cartridge 20 @19:55:06.88 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @19:55:07.07 Sampled 1161.2ml 2021-08-17T00:01:56.402Z,1629158516.402 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-17T00:09:53.441Z,1629158993.441 [MissionManager](IMPORTANT): Started mission Default 2021-08-17T00:09:53.919Z,1629158993.919 [WetLabsBB2FL](FAULT): LCB fault: Software Overcurrent. 2021-08-17T00:15:51.140Z,1629159351.140 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 5.954792 min 2021-08-17T00:17:12.188Z,1629159432.188 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45991, MT Status=1, MTMSN=3283 2021-08-17T00:17:12.943Z,1629159432.943 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2vpvu 1 3.000000 2021-08-17T00:17:12.943Z,1629159432.943 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2vpvu 2021-08-17T00:17:12.945Z,1629159432.945 [CommandLine](IMPORTANT): Scheduled #35 (#1 of 3 with id='2vpvu'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" ASAP 2021-08-17T00:17:33.231Z,1629159453.231 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45992, MT Status=1, MTMSN=3284 2021-08-17T00:17:34.070Z,1629159454.070 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 42.34395 degree;set Smear.SamplingEndLongitude -87.024553 degree;set Smear.YoYoUpPitch 12 degree" 2vpvu 2 3.000000 2021-08-17T00:17:34.071Z,1629159454.071 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2vpvu 2021-08-17T00:17:34.072Z,1629159454.072 [CommandLine](IMPORTANT): Scheduled #36 (#2 of 3 with id='2vpvu'): "set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 42.34395 degree;set Smear.SamplingEndLongitude -87.024553 degree;set Smear.YoYoUpPitch 12 degree" ASAP 2021-08-17T00:17:44.132Z,1629159464.132 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45993, MT Status=1, MTMSN=3285 2021-08-17T00:17:44.777Z,1629159464.777 [CommandLine](IMPORTANT): got command schedule asap "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2vpvu 3 3.000000 2021-08-17T00:17:44.778Z,1629159464.778 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2vpvu 2021-08-17T00:17:44.779Z,1629159464.779 [CommandLine](IMPORTANT): Scheduled #37 (#3 of 3 with id='2vpvu'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-17T00:17:45.011Z,1629159465.011 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-17T00:17:47.882Z,1629159467.882 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-17T00:18:00.828Z,1629159480.828 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-17T00:18:00.829Z,1629159480.829 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-17T00:18:00.830Z,1629159480.830 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-17T00:18:00.830Z,1629159480.830 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-17T00:18:00.831Z,1629159480.831 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-17T00:18:15.335Z,1629159495.335 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 15.000000 meter 2021-08-17T00:18:15.336Z,1629159495.336 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 30.000000 meter 2021-08-17T00:18:15.337Z,1629159495.337 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.343948 degree 2021-08-17T00:18:15.338Z,1629159495.338 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.024551 degree 2021-08-17T00:18:15.338Z,1629159495.338 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-17T00:18:20.763Z,1629159500.763 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-17T00:18:20.764Z,1629159500.764 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-17T00:18:20.764Z,1629159500.764 [CommandLine](IMPORTANT): got command run 2021-08-17T00:18:20.766Z,1629159500.766 [CommandLine](IMPORTANT): Running 2021-08-17T00:18:20.893Z,1629159500.893 [MissionManager](IMPORTANT): Started mission Smear 2021-08-17T00:22:51.141Z,1629159771.141 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-17T00:22:51.971Z,1629159771.971 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-17T00:37:54.559Z,1629160674.559 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 19.200459 m , 10.118097 degC , 0.343200 ug/l . 2021-08-17T00:38:06.301Z,1629160686.301 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-17T00:38:06.388Z,1629160686.388 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-17T00:38:54.274Z,1629160734.274 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-17T00:38:55.090Z,1629160735.090 [ESPComponent](IMPORTANT): [sample #7] Setting cartridge argument to -1 2021-08-17T00:38:55.090Z,1629160735.090 [ESPComponent](IMPORTANT): [sample #7] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-17T00:38:55.542Z,1629160735.542 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-17T00:38:55.892Z,1629160735.892 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-17T00:38:56.295Z,1629160736.295 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-17T00:38:58.314Z,1629160738.314 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-17T00:39:32.654Z,1629160772.654 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PRIMING (@19,aRNAl_bac) 2021-08-17T00:39:34.270Z,1629160774.270 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PRIMING (@100.0) 2021-08-17T00:39:34.676Z,1629160774.676 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-17T00:39:35.079Z,1629160775.079 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-17T00:41:56.883Z,1629160916.883 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_FILTERING (@0.0) 2021-08-17T00:41:57.287Z,1629160917.287 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-17T01:37:30.394Z,1629164250.394 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PAUSED (@969.4) 2021-08-17T01:37:30.800Z,1629164250.800 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PROCESSING (@969.4) 2021-08-17T01:37:32.820Z,1629164252.820 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-17T01:37:33.223Z,1629164253.223 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PROCESSED (@19,aRNAl_bac) 2021-08-17T01:39:08.164Z,1629164348.164 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_STOPPING (@19,aRNAl_bac) 2021-08-17T01:39:15.435Z,1629164355.435 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-17T01:39:15.839Z,1629164355.839 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_STOPPED 2021-08-17T01:42:38.697Z,1629164558.697 [Smear:SamplingToWaypoint:E.Waypoint](IMPORTANT): Reached Waypoint: 42.343949,-87.024554 2021-08-17T01:42:39.087Z,1629164559.087 [MissionManager](IMPORTANT): Started mission Default 2021-08-17T01:44:15.547Z,1629164655.547 [ESPComponent](IMPORTANT): [sample #7] ESP sampling sequence completed normally. 2021-08-17T01:44:15.950Z,1629164655.950 [ESPComponent](IMPORTANT): [sample #7] ESP log summary report (3 messages): @20:39:09.13 Selecting Cartridge 19 @21:37:28.34 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @21:37:28.54 Sampled 969.4ml 2021-08-17T01:54:00.016Z,1629165240.016 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.342099 min 2021-08-17T01:54:28.159Z,1629165268.159 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46019, MT Status=1, MTMSN=3286 2021-08-17T01:54:28.745Z,1629165268.745 [CommandLine](IMPORTANT): got command schedule clear 2021-08-17T01:54:28.745Z,1629165268.745 [CommandLine](IMPORTANT): #Cleared scheduled commands:0 2021-08-17T01:54:28.745Z,1629165268.745 [CommandLine](IMPORTANT): got command schedule resume 2021-08-17T01:57:01.923Z,1629165421.923 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=46025, MT Status=1, MTMSN=3287 2021-08-17T01:57:02.694Z,1629165422.694 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 195 m;set Smear.SamplingYoYoMinDepth 80 m" 2vupj 1 3.000000 2021-08-17T01:57:02.695Z,1629165422.695 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2vupj 2021-08-17T01:57:02.696Z,1629165422.696 [CommandLine](IMPORTANT): Scheduled #38 (#1 of 3 with id='2vupj'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 195 m;set Smear.SamplingYoYoMinDepth 80 m" ASAP 2021-08-17T01:57:43.324Z,1629165463.324 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=46026, MT Status=1, MTMSN=3288 2021-08-17T01:57:44.051Z,1629165464.051 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SamplingYoYoMaxDepth 190 m;set Smear.SamplingEndLatitude 42.153916 degree;set Smear.SamplingEndLongitude -86.532776 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2vupj 2 3.000000 2021-08-17T01:57:44.052Z,1629165464.052 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2vupj 2021-08-17T01:57:44.053Z,1629165464.053 [CommandLine](IMPORTANT): Scheduled #39 (#2 of 3 with id='2vupj'): "set Smear.SamplingYoYoMaxDepth 190 m;set Smear.SamplingEndLatitude 42.153916 degree;set Smear.SamplingEndLongitude -86.532776 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" ASAP 2021-08-17T01:58:41.859Z,1629165521.859 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46029, MT Status=1, MTMSN=3289 2021-08-17T01:58:42.402Z,1629165522.402 [CommandLine](IMPORTANT): got command schedule asap "set Smear.NeedCommsTimeVeryLong 8 h;run" 2vupj 3 3.000000 2021-08-17T01:58:42.402Z,1629165522.402 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2vupj 2021-08-17T01:58:42.403Z,1629165522.403 [CommandLine](IMPORTANT): Scheduled #40 (#3 of 3 with id='2vupj'): "set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-17T01:58:42.537Z,1629165522.537 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-17T01:58:44.830Z,1629165524.830 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-17T01:58:59.231Z,1629165539.231 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-17T01:58:59.232Z,1629165539.232 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-17T01:58:59.234Z,1629165539.234 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-17T01:58:59.234Z,1629165539.234 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-17T01:58:59.236Z,1629165539.236 [CommandLine](IMPORTANT): got command set Smear.MaxDepth 195.000000 meter 2021-08-17T01:58:59.249Z,1629165539.249 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 80.000000 meter 2021-08-17T01:59:02.358Z,1629165542.358 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46030, MT Status=1, MTMSN=3290 2021-08-17T01:59:11.364Z,1629165551.364 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 190.000000 meter 2021-08-17T01:59:11.365Z,1629165551.365 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.153915 degree 2021-08-17T01:59:11.366Z,1629165551.366 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -86.532776 degree 2021-08-17T01:59:11.367Z,1629165551.367 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-17T01:59:11.367Z,1629165551.367 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-17T01:59:11.373Z,1629165551.373 [CommandLine](IMPORTANT): got command schedule 2021-08-17T01:59:11.373Z,1629165551.373 [CommandLine](FAULT): Incomplete syntax. Try: help schedule 2021-08-17T01:59:14.886Z,1629165554.886 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-17T01:59:14.887Z,1629165554.887 [CommandLine](IMPORTANT): got command run 2021-08-17T01:59:14.888Z,1629165554.888 [CommandLine](IMPORTANT): Running 2021-08-17T01:59:15.092Z,1629165555.092 [MissionManager](IMPORTANT): Started mission Smear 2021-08-17T01:59:24.729Z,1629165564.729 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=46031, MT Status=1, MTMSN=3291 2021-08-17T01:59:25.522Z,1629165565.522 [CommandLine](IMPORTANT): got command schedule "set Smear.SamplingYoYoMinDepth 40 m;set Smear.SamplingYoYoMaxDepth 70 m;set Smear.SamplingEndLatitude 42.153916 degree;set Smear.SamplingEndLongitude -86.532776 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2vut3 2 3.000000 2021-08-17T01:59:25.523Z,1629165565.523 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2vut3 2021-08-17T01:59:25.524Z,1629165565.524 [CommandLine](IMPORTANT): Scheduled #41 (#2 of 3 with id='2vut3'): "set Smear.SamplingYoYoMinDepth 40 m;set Smear.SamplingYoYoMaxDepth 70 m;set Smear.SamplingEndLatitude 42.153916 degree;set Smear.SamplingEndLongitude -86.532776 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2021-08-17T01:59:59.299Z,1629165599.299 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46034, MT Status=1, MTMSN=3292 2021-08-17T01:59:59.886Z,1629165599.886 [CommandLine](IMPORTANT): got command schedule "set Smear.NeedCommsTimeVeryLong 8 h;run" 2vut3 3 3.000000 2021-08-17T01:59:59.886Z,1629165599.886 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2vut3 2021-08-17T01:59:59.887Z,1629165599.887 [CommandLine](IMPORTANT): Scheduled #42 (#3 of 3 with id='2vut3'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-17T02:09:54.449Z,1629166194.449 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-17T02:09:55.234Z,1629166195.234 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-17T02:24:57.805Z,1629167097.805 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 106.042168 m , 4.262292 degC , 0.114400 ug/l . 2021-08-17T02:25:09.593Z,1629167109.593 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-17T02:25:09.695Z,1629167109.695 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-17T02:25:57.977Z,1629167157.977 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-17T02:25:58.785Z,1629167158.785 [ESPComponent](IMPORTANT): [sample #8] Setting cartridge argument to -1 2021-08-17T02:25:58.786Z,1629167158.786 [ESPComponent](IMPORTANT): [sample #8] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-17T02:25:59.234Z,1629167159.234 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-17T02:25:59.591Z,1629167159.591 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-17T02:25:59.996Z,1629167159.996 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-17T02:26:02.015Z,1629167162.015 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-17T02:26:36.355Z,1629167196.355 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PRIMING (@18,aRNAl_bac) 2021-08-17T02:26:37.971Z,1629167197.971 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PRIMING (@100.0) 2021-08-17T02:26:38.376Z,1629167198.376 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-17T02:26:38.779Z,1629167198.779 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-17T02:29:00.178Z,1629167340.178 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_FILTERING (@0.0) 2021-08-17T02:29:00.584Z,1629167340.584 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-17T04:15:50.152Z,1629173750.152 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PAUSED (@2000.0) 2021-08-17T04:15:50.555Z,1629173750.555 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PROCESSING (@2000.0) 2021-08-17T04:15:52.579Z,1629173752.579 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-17T04:15:52.979Z,1629173752.979 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PROCESSED (@18,aRNAl_bac) 2021-08-17T04:17:27.920Z,1629173847.920 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_STOPPING (@18,aRNAl_bac) 2021-08-17T04:17:35.194Z,1629173855.194 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-17T04:17:35.595Z,1629173855.595 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_STOPPED 2021-08-17T04:22:21.676Z,1629174141.676 [BPC1](FAULT): Battery stick #38 (s/n: 0139) reported TERMINATE_DISCHARGE_ALARM. Status code: 0x4AD0. 2021-08-17T04:22:35.380Z,1629174155.380 [ESPComponent](IMPORTANT): [sample #8] ESP sampling sequence completed normally. 2021-08-17T04:22:35.784Z,1629174155.784 [ESPComponent](IMPORTANT): [sample #8] ESP log summary report (2 messages): @22:26:12.87 Selecting Cartridge 18 @00:15:48.68 Sampled 2000.0ml 2021-08-17T04:22:36.624Z,1629174156.624 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-17T04:29:38.891Z,1629174578.891 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=46040, MT Status=1, MTMSN=3293 2021-08-17T04:29:39.679Z,1629174579.679 [CommandLine](IMPORTANT): got command schedule "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2vux5 1 3.000000 2021-08-17T04:29:39.679Z,1629174579.679 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2vux5 2021-08-17T04:29:39.700Z,1629174579.700 [CommandLine](IMPORTANT): Scheduled #43 (#1 of 3 with id='2vux5'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2021-08-17T04:32:17.106Z,1629174737.106 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46041, MT Status=1, MTMSN=3294 2021-08-17T04:32:17.930Z,1629174737.930 [CommandLine](IMPORTANT): got command schedule "set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 42.153916 degree;set Smear.SamplingEndLongitude -86.532776 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2vux5 2 3.000000 2021-08-17T04:32:17.930Z,1629174737.930 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2vux5 2021-08-17T04:32:17.931Z,1629174737.931 [CommandLine](IMPORTANT): Scheduled #44 (#2 of 3 with id='2vux5'): "set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 42.153916 degree;set Smear.SamplingEndLongitude -86.532776 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2021-08-17T04:32:37.735Z,1629174757.735 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46042, MT Status=1, MTMSN=3295 2021-08-17T04:32:38.306Z,1629174758.306 [CommandLine](IMPORTANT): got command schedule "set Smear.NeedCommsTimeVeryLong 8 h;run" 2vux5 3 3.000000 2021-08-17T04:32:38.306Z,1629174758.306 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2vux5 2021-08-17T04:32:38.307Z,1629174758.307 [CommandLine](IMPORTANT): Scheduled #45 (#3 of 3 with id='2vux5'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-17T04:35:48.742Z,1629174948.742 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-17T04:35:51.365Z,1629174951.365 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-17T04:35:51.730Z,1629174951.730 [MissionManager](IMPORTANT): Started mission Default 2021-08-17T04:36:03.575Z,1629174963.575 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-17T04:36:03.577Z,1629174963.577 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-17T04:36:03.578Z,1629174963.578 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-17T04:36:03.578Z,1629174963.578 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-17T04:36:03.579Z,1629174963.579 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-17T04:36:21.160Z,1629174981.160 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 15.000000 meter 2021-08-17T04:36:21.161Z,1629174981.161 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 30.000000 meter 2021-08-17T04:36:21.162Z,1629174981.162 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.153915 degree 2021-08-17T04:36:21.163Z,1629174981.163 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -86.532776 degree 2021-08-17T04:36:21.164Z,1629174981.164 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-17T04:36:21.165Z,1629174981.165 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-17T04:36:24.527Z,1629174984.527 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-17T04:36:24.528Z,1629174984.528 [CommandLine](IMPORTANT): got command run 2021-08-17T04:36:24.530Z,1629174984.530 [CommandLine](IMPORTANT): Running 2021-08-17T04:36:25.737Z,1629174985.737 [MissionManager](IMPORTANT): Started mission Smear 2021-08-17T04:40:09.861Z,1629175209.861 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-17T04:40:10.709Z,1629175210.709 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-17T04:55:13.259Z,1629176113.259 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 19.797874 m , 9.984796 degC , 0.374400 ug/l . 2021-08-17T04:55:25.029Z,1629176125.029 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-17T04:55:25.161Z,1629176125.161 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-17T04:56:13.042Z,1629176173.042 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-17T04:56:13.842Z,1629176173.842 [ESPComponent](IMPORTANT): [sample #9] Setting cartridge argument to -1 2021-08-17T04:56:13.842Z,1629176173.842 [ESPComponent](IMPORTANT): [sample #9] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-17T04:56:14.300Z,1629176174.300 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-17T04:56:14.647Z,1629176174.647 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-17T04:56:15.050Z,1629176175.050 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-17T04:56:17.071Z,1629176177.071 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-17T04:56:51.411Z,1629176211.411 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_PRIMING (@17,aRNAl_bac) 2021-08-17T04:56:53.027Z,1629176213.027 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PRIMING (@100.0) 2021-08-17T04:56:53.432Z,1629176213.432 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-17T04:56:53.835Z,1629176213.835 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-17T04:59:15.236Z,1629176355.236 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_FILTERING (@0.0) 2021-08-17T04:59:15.639Z,1629176355.639 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-17T04:59:32.289Z,1629176372.289 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-17T04:59:43.208Z,1629176383.208 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.001671 CHAN A1 (24V): 0.002809 CHAN A2 (12V): -0.005903 CHAN A3 (5V): -0.005774 CHAN B0 (3.3V): -0.001732 CHAN B1 (3.15aV): -0.001520 CHAN B2 (3.15bV): -0.001573 CHAN B3 (GND): 0.033283 OPEN: 0.012174 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-17T05:53:38.431Z,1629179618.431 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PAUSED (@930.0) 2021-08-17T05:53:38.835Z,1629179618.835 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PROCESSING (@930.0) 2021-08-17T05:53:40.856Z,1629179620.856 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-17T05:53:41.259Z,1629179621.259 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_PROCESSED (@17,aRNAl_bac) 2021-08-17T05:55:16.200Z,1629179716.200 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_STOPPING (@17,aRNAl_bac) 2021-08-17T05:55:23.480Z,1629179723.480 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-17T05:55:23.879Z,1629179723.879 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_STOPPED 2021-08-17T06:00:23.646Z,1629180023.646 [ESPComponent](IMPORTANT): [sample #9] ESP sampling sequence completed normally. 2021-08-17T06:00:24.051Z,1629180024.051 [ESPComponent](IMPORTANT): [sample #9] ESP log summary report (3 messages): @00:56:27.38 Selecting Cartridge 17 @01:53:35.51 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @01:53:35.72 Sampled 930.0ml 2021-08-17T06:00:24.889Z,1629180024.889 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-17T06:01:56.215Z,1629180116.215 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=46064, MT Status=1, MTMSN=3296 2021-08-17T06:01:56.754Z,1629180116.754 [CommandLine](IMPORTANT): got command stop 2021-08-17T06:01:56.755Z,1629180116.755 [CommandLine](IMPORTANT): Scheduling is paused for 2 commands 2021-08-17T06:01:57.459Z,1629180117.459 [MissionManager](IMPORTANT): Started mission Default 2021-08-17T06:07:41.530Z,1629180461.530 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46065, MT Status=1, MTMSN=3297 2021-08-17T06:07:42.110Z,1629180462.110 [CommandLine](IMPORTANT): got command schedule clear 2021-08-17T06:07:42.110Z,1629180462.110 [CommandLine](IMPORTANT): #Cleared scheduled commands:2 2021-08-17T06:07:42.110Z,1629180462.110 [CommandLine](IMPORTANT): got command schedule resume 2021-08-17T06:07:42.110Z,1629180462.110 [CommandLine](IMPORTANT): Scheduling is resumed 2021-08-17T06:09:47.033Z,1629180587.033 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46066, MT Status=1, MTMSN=3298 2021-08-17T06:09:47.738Z,1629180587.738 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2w47n 1 3.000000 2021-08-17T06:09:47.739Z,1629180587.739 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2w47n 2021-08-17T06:09:47.740Z,1629180587.740 [CommandLine](IMPORTANT): Scheduled #46 (#1 of 3 with id='2w47n'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" ASAP 2021-08-17T06:10:20.162Z,1629180620.162 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46067, MT Status=1, MTMSN=3299 2021-08-17T06:10:20.962Z,1629180620.962 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SpeedSampling 0.8 m/s;set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 42.153916 degree;set Smear.SamplingEndLongitude -86.532776 degree;set Smear.YoYoUpPitch 12 degree" 2w47n 2 3.000000 2021-08-17T06:10:20.963Z,1629180620.963 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2w47n 2021-08-17T06:10:20.964Z,1629180620.964 [CommandLine](IMPORTANT): Scheduled #47 (#2 of 3 with id='2w47n'): "set Smear.SpeedSampling 0.8 m/s;set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 42.153916 degree;set Smear.SamplingEndLongitude -86.532776 degree;set Smear.YoYoUpPitch 12 degree" ASAP 2021-08-17T06:10:33.943Z,1629180633.943 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46068, MT Status=1, MTMSN=3300 2021-08-17T06:10:34.578Z,1629180634.578 [CommandLine](IMPORTANT): got command schedule asap "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2w47n 3 3.000000 2021-08-17T06:10:34.579Z,1629180634.579 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2w47n 2021-08-17T06:10:34.580Z,1629180634.580 [CommandLine](IMPORTANT): Scheduled #48 (#3 of 3 with id='2w47n'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-17T06:10:34.671Z,1629180634.671 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-17T06:10:36.895Z,1629180636.895 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-17T06:10:49.642Z,1629180649.642 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-17T06:10:49.642Z,1629180649.642 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-17T06:10:49.643Z,1629180649.643 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-17T06:10:49.644Z,1629180649.644 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-17T06:10:49.645Z,1629180649.645 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-17T06:10:55.410Z,1629180655.410 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46069, MT Status=1, MTMSN=3301 2021-08-17T06:11:03.658Z,1629180663.658 [CommandLine](IMPORTANT): got command set Smear.SpeedSampling 0.800000 meter_per_second 2021-08-17T06:11:03.659Z,1629180663.659 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 15.000000 meter 2021-08-17T06:11:03.660Z,1629180663.660 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 30.000000 meter 2021-08-17T06:11:03.662Z,1629180663.662 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.153915 degree 2021-08-17T06:11:03.663Z,1629180663.663 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -86.532776 degree 2021-08-17T06:11:03.664Z,1629180663.664 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-17T06:11:03.765Z,1629180663.765 [CommandLine](IMPORTANT): got command schedule "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2w4b9 1 3.000000 2021-08-17T06:11:03.766Z,1629180663.766 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2w4b9 2021-08-17T06:11:03.767Z,1629180663.767 [CommandLine](IMPORTANT): Scheduled #49 (#1 of 3 with id='2w4b9'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2021-08-17T06:11:09.151Z,1629180669.151 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-17T06:11:09.152Z,1629180669.152 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-17T06:11:09.152Z,1629180669.152 [CommandLine](IMPORTANT): got command run 2021-08-17T06:11:09.155Z,1629180669.155 [CommandLine](IMPORTANT): Running 2021-08-17T06:11:09.414Z,1629180669.414 [MissionManager](IMPORTANT): Started mission Smear 2021-08-17T06:11:33.635Z,1629180693.635 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46070, MT Status=1, MTMSN=3302 2021-08-17T06:11:34.434Z,1629180694.434 [CommandLine](IMPORTANT): got command schedule "set Smear.SpeedSampling 0.8 m/s;set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 42.153916 degree;set Smear.SamplingEndLongitude -86.5327 degree;set Smear.YoYoUpPitch 12 degree" 2w4b9 2 3.000000 2021-08-17T06:11:34.435Z,1629180694.435 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2w4b9 2021-08-17T06:11:34.436Z,1629180694.436 [CommandLine](IMPORTANT): Scheduled #50 (#2 of 3 with id='2w4b9'): "set Smear.SpeedSampling 0.8 m/s;set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 42.153916 degree;set Smear.SamplingEndLongitude -86.5327 degree;set Smear.YoYoUpPitch 12 degree" 2021-08-17T06:11:37.313Z,1629180697.313 [NAL9602](FAULT): GPS failed to acquire within timeout. 2021-08-17T06:18:11.649Z,1629181091.649 [Smear:NeedComms:C:A_Timeout:A](IMPORTANT): first GPS update timeout 2021-08-17T06:18:24.560Z,1629181104.560 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46071, MT Status=1, MTMSN=3303 2021-08-17T06:18:25.169Z,1629181105.169 [CommandLine](IMPORTANT): got command schedule "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2w4b9 3 3.000000 2021-08-17T06:18:25.170Z,1629181105.170 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2w4b9 2021-08-17T06:18:25.171Z,1629181105.171 [CommandLine](IMPORTANT): Scheduled #51 (#3 of 3 with id='2w4b9'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-17T06:18:39.164Z,1629181119.164 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46072, MT Status=1, MTMSN=3304 2021-08-17T06:18:39.971Z,1629181119.971 [CommandLine](IMPORTANT): got command schedule "load Science/sci2.xml;set sci2.MissionTimeout 4 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 42.1539 degree;set sci2.Lon1 -86.5327 degree;set sci2.Speed 0.8 m/s;set sci2.YoYoMinDepth 5 m;set sci2.YoYoMaxDepth 20 m" 2w4q5 1 2.000000 2021-08-17T06:18:39.971Z,1629181119.971 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=2w4q5 2021-08-17T06:18:39.977Z,1629181119.977 [CommandLine](IMPORTANT): Scheduled #52 (#1 of 2 with id='2w4q5'): "load Science/sci2.xml;set sci2.MissionTimeout 4 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 42.1539 degree;set sci2.Lon1 -86.5327 degree;set sci2.Speed 0.8 m/s;set sci2.YoYoMinDepth 5 m;set sci2.YoYoMaxDepth 20 m" 2021-08-17T06:18:51.924Z,1629181131.924 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46073, MT Status=1, MTMSN=3305 2021-08-17T06:18:52.507Z,1629181132.507 [CommandLine](IMPORTANT): got command schedule "set sci2.MaxDepth 130 m;run" 2w4q5 2 2.000000 2021-08-17T06:18:52.510Z,1629181132.510 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=2w4q5 2021-08-17T06:18:52.514Z,1629181132.514 [CommandLine](IMPORTANT): Scheduled #53 (#2 of 2 with id='2w4q5'): "set sci2.MaxDepth 130 m;run" 2021-08-17T06:23:01.623Z,1629181381.623 [NAL9602](FAULT): GPS failed to acquire within timeout. 2021-08-17T06:29:59.762Z,1629181799.762 [Smear:NeedComms:E:A_Timeout:A](IMPORTANT): second GPS update timeout 2021-08-17T06:32:36.131Z,1629181956.131 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-17T06:32:36.926Z,1629181956.926 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-17T06:47:39.487Z,1629182859.487 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 26.657589 m , 8.567804 degC , 0.322400 ug/l . 2021-08-17T06:47:51.273Z,1629182871.273 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-17T06:47:51.397Z,1629182871.397 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-17T06:48:38.830Z,1629182918.830 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-17T06:48:39.646Z,1629182919.646 [ESPComponent](IMPORTANT): [sample #10] Setting cartridge argument to -1 2021-08-17T06:48:39.646Z,1629182919.646 [ESPComponent](IMPORTANT): [sample #10] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-17T06:48:40.080Z,1629182920.080 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-17T06:48:40.461Z,1629182920.461 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-17T06:48:40.859Z,1629182920.859 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-17T06:48:42.874Z,1629182922.874 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-17T06:49:17.215Z,1629182957.215 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PRIMING (@16,aRNAl_bac) 2021-08-17T06:49:18.834Z,1629182958.834 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PRIMING (@100.0) 2021-08-17T06:49:19.236Z,1629182959.236 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-17T06:49:19.639Z,1629182959.639 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-17T06:51:41.545Z,1629183101.545 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_FILTERING (@0.0) 2021-08-17T06:51:41.947Z,1629183101.947 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-17T07:38:11.623Z,1629185891.623 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PAUSED (@824.5) 2021-08-17T07:38:12.027Z,1629185892.027 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PROCESSING (@824.5) 2021-08-17T07:38:14.052Z,1629185894.052 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-17T07:38:14.457Z,1629185894.457 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PROCESSED (@16,aRNAl_bac) 2021-08-17T07:39:49.393Z,1629185989.393 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_STOPPING (@16,aRNAl_bac) 2021-08-17T07:39:56.664Z,1629185996.664 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-17T07:39:57.068Z,1629185997.068 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_STOPPED 2021-08-17T07:44:56.839Z,1629186296.839 [ESPComponent](IMPORTANT): [sample #10] ESP sampling sequence completed normally. 2021-08-17T07:44:57.243Z,1629186297.243 [ESPComponent](IMPORTANT): [sample #10] ESP log summary report (3 messages): @02:48:53.49 Selecting Cartridge 16 @03:38:09.36 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @03:38:09.56 Sampled 824.5ml 2021-08-17T07:44:58.109Z,1629186298.109 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-17T07:46:43.928Z,1629186403.928 [NAL9602](FAULT): GPS failed to acquire within timeout. 2021-08-17T07:59:19.629Z,1629187159.629 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-17T07:59:20.233Z,1629187160.233 [WetLabsBB2FL](FAULT): LCB fault: Software Overcurrent. 2021-08-17T07:59:22.400Z,1629187162.400 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-17T07:59:22.586Z,1629187162.586 [MissionManager](IMPORTANT): Started mission Default 2021-08-17T07:59:34.913Z,1629187174.913 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-17T07:59:34.913Z,1629187174.913 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-17T07:59:34.914Z,1629187174.914 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-17T07:59:34.915Z,1629187174.915 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-17T07:59:34.925Z,1629187174.925 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-17T07:59:52.095Z,1629187192.095 [CommandLine](IMPORTANT): got command set Smear.SpeedSampling 0.800000 meter_per_second 2021-08-17T07:59:52.096Z,1629187192.096 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 5.000000 meter 2021-08-17T07:59:52.122Z,1629187192.122 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 15.000000 meter 2021-08-17T07:59:52.122Z,1629187192.122 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.153915 degree 2021-08-17T07:59:52.123Z,1629187192.123 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -86.532700 degree 2021-08-17T07:59:52.124Z,1629187192.124 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-17T07:59:57.570Z,1629187197.570 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-17T07:59:57.571Z,1629187197.571 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-17T07:59:57.571Z,1629187197.571 [CommandLine](IMPORTANT): got command run 2021-08-17T07:59:57.574Z,1629187197.574 [CommandLine](IMPORTANT): Running 2021-08-17T07:59:57.698Z,1629187197.698 [MissionManager](IMPORTANT): Started mission Smear 2021-08-17T08:02:38.163Z,1629187358.163 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-17T08:02:38.981Z,1629187358.981 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-17T08:17:41.552Z,1629188261.552 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 6.877600 m , 22.941492 degC , 0.322400 ug/l . 2021-08-17T08:17:53.289Z,1629188273.289 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-17T08:17:53.416Z,1629188273.416 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-17T08:18:40.854Z,1629188320.854 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-17T08:18:41.666Z,1629188321.666 [ESPComponent](IMPORTANT): [sample #11] Setting cartridge argument to -1 2021-08-17T08:18:41.667Z,1629188321.667 [ESPComponent](IMPORTANT): [sample #11] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-17T08:18:42.115Z,1629188322.115 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-17T08:18:42.470Z,1629188322.470 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-17T08:18:42.876Z,1629188322.876 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-17T08:18:44.894Z,1629188324.894 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-17T08:19:19.236Z,1629188359.236 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PRIMING (@15,aRNAl_bac) 2021-08-17T08:19:20.851Z,1629188360.851 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PRIMING (@100.0) 2021-08-17T08:19:21.255Z,1629188361.255 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-17T08:19:21.666Z,1629188361.666 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-17T08:21:53.593Z,1629188513.593 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_FILTERING (@0.0) 2021-08-17T08:21:53.983Z,1629188513.983 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-17T09:33:56.487Z,1629192836.487 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PAUSED (@1334.8) 2021-08-17T09:33:56.891Z,1629192836.891 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PROCESSING (@1334.8) 2021-08-17T09:33:58.911Z,1629192838.911 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-17T09:33:59.314Z,1629192839.314 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PROCESSED (@15,aRNAl_bac) 2021-08-17T09:35:33.851Z,1629192933.851 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_STOPPING (@15,aRNAl_bac) 2021-08-17T09:35:41.124Z,1629192941.124 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-17T09:35:41.528Z,1629192941.528 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_STOPPED 2021-08-17T09:40:41.299Z,1629193241.299 [ESPComponent](IMPORTANT): [sample #11] ESP sampling sequence completed normally. 2021-08-17T09:40:41.703Z,1629193241.703 [ESPComponent](IMPORTANT): [sample #11] ESP log summary report (3 messages): @04:18:55.77 Selecting Cartridge 15 @05:33:54.20 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @05:33:54.40 Sampled 1334.8ml 2021-08-17T09:40:42.571Z,1629193242.571 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-17T09:50:32.459Z,1629193832.459 [CommandLine](IMPORTANT): got command load ./Missions/Science/sci2.xml 2021-08-17T09:50:33.301Z,1629193833.301 [WetLabsBB2FL](FAULT): LCB fault: Software Overcurrent. 2021-08-17T09:50:34.977Z,1629193834.977 [CommandLine](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2021-08-17T09:50:35.231Z,1629193835.231 [MissionManager](IMPORTANT): Started mission Default 2021-08-17T09:50:46.729Z,1629193846.729 [CommandLine](IMPORTANT): got command set sci2.MissionTimeout 4.000000 hour 2021-08-17T09:50:46.730Z,1629193846.730 [CommandLine](IMPORTANT): got command set sci2.NeedCommsTime 45.000000 minute 2021-08-17T09:50:46.730Z,1629193846.730 [CommandLine](IMPORTANT): got command set sci2.Lat1 42.153900 degree 2021-08-17T09:50:46.731Z,1629193846.731 [CommandLine](IMPORTANT): got command set sci2.Lon1 -86.532700 degree 2021-08-17T09:50:46.732Z,1629193846.732 [CommandLine](IMPORTANT): got command set sci2.Speed 0.800000 meter_per_second 2021-08-17T09:50:46.733Z,1629193846.733 [CommandLine](IMPORTANT): got command set sci2.YoYoMinDepth 5.000000 meter 2021-08-17T09:50:46.734Z,1629193846.734 [CommandLine](IMPORTANT): got command set sci2.YoYoMaxDepth 20.000000 meter 2021-08-17T09:50:48.418Z,1629193848.418 [CommandLine](IMPORTANT): got command set sci2.MaxDepth 130.000000 meter 2021-08-17T09:50:48.419Z,1629193848.419 [CommandLine](IMPORTANT): got command run 2021-08-17T09:50:48.421Z,1629193848.421 [CommandLine](IMPORTANT): Running 2021-08-17T09:50:48.518Z,1629193848.518 [MissionManager](IMPORTANT): Started mission sci2 2021-08-17T10:59:43.488Z,1629197983.488 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-17T10:59:54.316Z,1629197994.316 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.004171 CHAN A1 (24V): 0.002061 CHAN A2 (12V): -0.005958 CHAN A3 (5V): -0.002336 CHAN B0 (3.3V): -0.001552 CHAN B1 (3.15aV): 0.029387 CHAN B2 (3.15bV): 0.000022 CHAN B3 (GND): -0.000806 OPEN: 0.009641 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-17T11:58:29.877Z,1629201509.877 [ElevatorServo](FAULT): Elevator uart error - getPosition.serial timeout 2021-08-17T13:50:48.988Z,1629208248.988 [MissionManager](IMPORTANT): Started mission Default 2021-08-17T14:03:31.814Z,1629209011.814 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 12.706383 min 2021-08-17T14:12:11.859Z,1629209531.859 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 21.374717 min 2021-08-17T14:21:06.894Z,1629210066.894 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 30.292159 min 2021-08-17T14:24:55.477Z,1629210295.477 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=46211, MT Status=1, MTMSN=3306 2021-08-17T14:24:56.244Z,1629210296.244 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2wtcr 1 3.000000 2021-08-17T14:24:56.247Z,1629210296.247 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2wtcr 2021-08-17T14:24:56.248Z,1629210296.248 [CommandLine](IMPORTANT): Scheduled #54 (#1 of 3 with id='2wtcr'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" ASAP 2021-08-17T14:25:41.550Z,1629210341.550 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46213, MT Status=1, MTMSN=3307 2021-08-17T14:25:42.358Z,1629210342.358 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SpeedSampling 0.8 m/s;set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 42.153916 degree;set Smear.SamplingEndLongitude -86.5327 degree;set Smear.YoYoUpPitch 12 degree" 2wtcr 2 3.000000 2021-08-17T14:25:42.358Z,1629210342.358 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2wtcr 2021-08-17T14:25:42.359Z,1629210342.359 [CommandLine](IMPORTANT): Scheduled #55 (#2 of 3 with id='2wtcr'): "set Smear.SpeedSampling 0.8 m/s;set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 42.153916 degree;set Smear.SamplingEndLongitude -86.5327 degree;set Smear.YoYoUpPitch 12 degree" ASAP 2021-08-17T14:26:03.780Z,1629210363.780 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46214, MT Status=1, MTMSN=3308 2021-08-17T14:26:04.402Z,1629210364.402 [CommandLine](IMPORTANT): got command schedule asap "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2wtcr 3 3.000000 2021-08-17T14:26:04.403Z,1629210364.403 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2wtcr 2021-08-17T14:26:04.404Z,1629210364.404 [CommandLine](IMPORTANT): Scheduled #56 (#3 of 3 with id='2wtcr'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-17T14:26:04.516Z,1629210364.516 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-17T14:26:07.757Z,1629210367.757 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-17T14:26:20.840Z,1629210380.840 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-17T14:26:20.841Z,1629210380.841 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-17T14:26:20.842Z,1629210380.842 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-17T14:26:20.843Z,1629210380.843 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-17T14:26:20.844Z,1629210380.844 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-17T14:26:23.922Z,1629210383.922 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46215, MT Status=1, MTMSN=3309 2021-08-17T14:26:34.388Z,1629210394.388 [CommandLine](IMPORTANT): got command set Smear.SpeedSampling 0.800000 meter_per_second 2021-08-17T14:26:34.389Z,1629210394.389 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 5.000000 meter 2021-08-17T14:26:34.389Z,1629210394.389 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 15.000000 meter 2021-08-17T14:26:34.390Z,1629210394.390 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.153915 degree 2021-08-17T14:26:34.391Z,1629210394.391 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -86.532700 degree 2021-08-17T14:26:34.392Z,1629210394.392 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-17T14:26:34.418Z,1629210394.418 [CommandLine](IMPORTANT): got command schedule clear 2021-08-17T14:26:34.452Z,1629210394.452 [CommandLine](IMPORTANT): #Cleared scheduled commands:1 2021-08-17T14:26:34.453Z,1629210394.453 [CommandLine](IMPORTANT): got command schedule resume 2021-08-17T14:32:37.796Z,1629210757.796 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 41.806681 min 2021-08-17T14:33:42.633Z,1629210822.633 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46222, MT Status=1, MTMSN=3310 2021-08-17T14:33:43.406Z,1629210823.406 [CommandLine](IMPORTANT): got command schedule "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2wto1 1 3.000000 2021-08-17T14:33:43.406Z,1629210823.406 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2wto1 2021-08-17T14:33:43.407Z,1629210823.407 [CommandLine](IMPORTANT): Scheduled #57 (#1 of 3 with id='2wto1'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2021-08-17T14:34:04.837Z,1629210844.837 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46223, MT Status=1, MTMSN=3311 2021-08-17T14:34:05.602Z,1629210845.602 [CommandLine](IMPORTANT): got command schedule "set Smear.SpeedSampling 0.8 m/s;set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 42.153916 degree;set Smear.SamplingEndLongitude -86.532776 degree;set Smear.YoYoUpPitch 12 degree" 2wto1 2 3.000000 2021-08-17T14:34:05.602Z,1629210845.602 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2wto1 2021-08-17T14:34:05.603Z,1629210845.603 [CommandLine](IMPORTANT): Scheduled #58 (#2 of 3 with id='2wto1'): "set Smear.SpeedSampling 0.8 m/s;set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 42.153916 degree;set Smear.SamplingEndLongitude -86.532776 degree;set Smear.YoYoUpPitch 12 degree" 2021-08-17T14:34:14.094Z,1629210854.094 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=46224, MT Status=1, MTMSN=3312 2021-08-17T14:34:14.710Z,1629210854.710 [CommandLine](IMPORTANT): got command schedule "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2wto1 3 3.000000 2021-08-17T14:34:14.711Z,1629210854.711 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2wto1 2021-08-17T14:34:14.712Z,1629210854.712 [CommandLine](IMPORTANT): Scheduled #59 (#3 of 3 with id='2wto1'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-17T14:34:14.935Z,1629210854.935 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-17T14:34:17.282Z,1629210857.282 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-17T14:34:31.290Z,1629210871.290 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-17T14:34:31.291Z,1629210871.291 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-17T14:34:31.291Z,1629210871.291 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-17T14:34:31.292Z,1629210871.292 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-17T14:34:31.293Z,1629210871.293 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-17T14:34:47.800Z,1629210887.800 [CommandLine](IMPORTANT): got command set Smear.SpeedSampling 0.800000 meter_per_second 2021-08-17T14:34:47.801Z,1629210887.801 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 15.000000 meter 2021-08-17T14:34:47.802Z,1629210887.802 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 30.000000 meter 2021-08-17T14:34:47.803Z,1629210887.803 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.153915 degree 2021-08-17T14:34:47.803Z,1629210887.803 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -86.532776 degree 2021-08-17T14:34:47.804Z,1629210887.804 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-17T14:34:54.156Z,1629210894.156 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-17T14:34:54.157Z,1629210894.157 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-17T14:34:54.176Z,1629210894.176 [CommandLine](IMPORTANT): got command run 2021-08-17T14:34:54.178Z,1629210894.178 [CommandLine](IMPORTANT): Running 2021-08-17T14:34:56.194Z,1629210896.194 [MissionManager](IMPORTANT): Started mission Smear 2021-08-17T14:35:54.727Z,1629210954.727 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46231, MT Status=1, MTMSN=3313 2021-08-17T14:35:55.522Z,1629210955.522 [CommandLine](IMPORTANT): got command schedule "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2wtuz 1 3.000000 2021-08-17T14:35:55.522Z,1629210955.522 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2wtuz 2021-08-17T14:35:55.523Z,1629210955.523 [CommandLine](IMPORTANT): Scheduled #60 (#1 of 3 with id='2wtuz'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2021-08-17T14:36:38.096Z,1629210998.096 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46234, MT Status=1, MTMSN=3314 2021-08-17T14:36:38.873Z,1629210998.873 [CommandLine](IMPORTANT): got command schedule "set Smear.SpeedSampling 0.8 m/s;set Smear.SamplingYoYoMinDepth 40 m;set Smear.SamplingYoYoMaxDepth 70 m;set Smear.SamplingEndLatitude 42.153916 degree;set Smear.SamplingEndLongitude -86.532776 degree;set Smear.YoYoUpPitch 12 degree" 2wtuz 2 3.000000 2021-08-17T14:36:38.874Z,1629210998.874 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2wtuz 2021-08-17T14:36:38.876Z,1629210998.876 [CommandLine](IMPORTANT): Scheduled #61 (#2 of 3 with id='2wtuz'): "set Smear.SpeedSampling 0.8 m/s;set Smear.SamplingYoYoMinDepth 40 m;set Smear.SamplingYoYoMaxDepth 70 m;set Smear.SamplingEndLatitude 42.153916 degree;set Smear.SamplingEndLongitude -86.532776 degree;set Smear.YoYoUpPitch 12 degree" 2021-08-17T14:37:28.878Z,1629211048.878 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46238, MT Status=1, MTMSN=3315 2021-08-17T14:37:29.522Z,1629211049.522 [CommandLine](IMPORTANT): got command schedule "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2wtuz 3 3.000000 2021-08-17T14:37:29.523Z,1629211049.523 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2wtuz 2021-08-17T14:37:29.524Z,1629211049.524 [CommandLine](IMPORTANT): Scheduled #62 (#3 of 3 with id='2wtuz'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-17T14:39:36.381Z,1629211176.381 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46241, MT Status=1, MTMSN=3316 2021-08-17T14:39:36.897Z,1629211176.897 [CommandLine](IMPORTANT): got command schedule list 2021-08-17T14:39:36.898Z,1629211176.898 [CommandLine](IMPORTANT): Scheduled #60 (#1 of 3 with id='2wtuz'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2021-08-17T14:39:36.899Z,1629211176.899 [CommandLine](IMPORTANT): Scheduled #61 (#2 of 3 with id='2wtuz'): "set Smear.SpeedSampling 0.8 m/s;set Smear.SamplingYoYoMinDepth 40 m;set Smear.SamplingYoYoMaxDepth 70 m;set Smear.SamplingEndLatitude 42.153916 degree;set Smear.SamplingEndLongitude -86.532776 degree;set Smear.YoYoUpPitch 12 degree" 2021-08-17T14:39:36.900Z,1629211176.900 [CommandLine](IMPORTANT): Scheduled #62 (#3 of 3 with id='2wtuz'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-17T14:45:05.315Z,1629211505.315 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-17T14:45:06.134Z,1629211506.134 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-17T15:00:08.690Z,1629212408.690 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 24.544447 m , 7.522302 degC , 0.416000 ug/l . 2021-08-17T15:00:20.473Z,1629212420.473 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-17T15:00:20.600Z,1629212420.600 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-17T15:01:08.038Z,1629212468.038 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-17T15:01:08.850Z,1629212468.850 [ESPComponent](IMPORTANT): [sample #12] Setting cartridge argument to -1 2021-08-17T15:01:08.850Z,1629212468.850 [ESPComponent](IMPORTANT): [sample #12] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-17T15:01:09.284Z,1629212469.284 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-17T15:01:09.655Z,1629212469.655 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-17T15:01:10.061Z,1629212470.061 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-17T15:01:12.082Z,1629212472.082 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-17T15:01:46.419Z,1629212506.419 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PRIMING (@14,aRNAl_bac) 2021-08-17T15:01:48.035Z,1629212508.035 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PRIMING (@100.0) 2021-08-17T15:01:48.440Z,1629212508.440 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-17T15:01:48.843Z,1629212508.843 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-17T15:04:19.539Z,1629212659.539 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_FILTERING (@0.0) 2021-08-17T15:04:19.943Z,1629212659.943 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-17T15:35:55.159Z,1629214555.159 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PAUSED (@609.3) 2021-08-17T15:35:55.563Z,1629214555.563 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PROCESSING (@609.3) 2021-08-17T15:35:57.584Z,1629214557.584 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-17T15:35:57.987Z,1629214557.987 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PROCESSED (@14,aRNAl_bac) 2021-08-17T15:37:32.931Z,1629214652.931 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_STOPPING (@14,aRNAl_bac) 2021-08-17T15:37:40.204Z,1629214660.204 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-17T15:37:40.615Z,1629214660.615 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_STOPPED 2021-08-17T15:42:40.387Z,1629214960.387 [ESPComponent](IMPORTANT): [sample #12] ESP sampling sequence completed normally. 2021-08-17T15:42:40.792Z,1629214960.792 [ESPComponent](IMPORTANT): [sample #12] ESP log summary report (5 messages): @11:01:22.74 Selecting Cartridge 14 @11:01:58.51 Cartridge::Sampler::PossibleLeak in FILTERING -- Retained only 29.5psia @11:01:58.53 Retry #1 of 2 @11:35:52.90 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @11:35:53.10 Sampled 609.3ml 2021-08-17T15:42:41.638Z,1629214961.638 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-17T15:55:25.101Z,1629215725.101 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-17T15:55:27.776Z,1629215727.776 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-17T15:55:28.118Z,1629215728.118 [MissionManager](IMPORTANT): Started mission Default 2021-08-17T15:55:40.053Z,1629215740.053 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-17T15:55:40.054Z,1629215740.054 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-17T15:55:40.054Z,1629215740.054 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-17T15:55:40.055Z,1629215740.055 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-17T15:55:40.056Z,1629215740.056 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-17T15:55:57.549Z,1629215757.549 [CommandLine](IMPORTANT): got command set Smear.SpeedSampling 0.800000 meter_per_second 2021-08-17T15:55:57.550Z,1629215757.550 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 40.000000 meter 2021-08-17T15:55:57.551Z,1629215757.551 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 70.000000 meter 2021-08-17T15:55:57.552Z,1629215757.552 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.153915 degree 2021-08-17T15:55:57.553Z,1629215757.553 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -86.532776 degree 2021-08-17T15:55:57.553Z,1629215757.553 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-17T15:56:03.010Z,1629215763.010 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-17T15:56:03.010Z,1629215763.010 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-17T15:56:03.011Z,1629215763.011 [CommandLine](IMPORTANT): got command run 2021-08-17T15:56:03.013Z,1629215763.013 [CommandLine](IMPORTANT): Running 2021-08-17T15:56:03.114Z,1629215763.114 [MissionManager](IMPORTANT): Started mission Smear 2021-08-17T16:00:57.007Z,1629216057.007 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46263, MT Status=1, MTMSN=3317 2021-08-17T16:00:58.965Z,1629216058.965 [CommandLine](IMPORTANT): got command configSet Express linearApproximation height_above_sea_floor 10.000000 meter persist 2021-08-17T16:00:58.978Z,1629216058.978 [CommandLine](IMPORTANT): got command configSet Express linearApproximation depth 5.000000 meter persist 2021-08-17T16:08:59.622Z,1629216539.622 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-17T16:09:00.446Z,1629216540.446 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-17T16:24:03.022Z,1629217443.022 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 43.913895 m , 4.909387 degC , 0.208000 ug/l . 2021-08-17T16:24:14.769Z,1629217454.769 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-17T16:24:14.892Z,1629217454.892 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-17T16:25:03.138Z,1629217503.138 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-17T16:25:03.954Z,1629217503.954 [ESPComponent](IMPORTANT): [sample #13] Setting cartridge argument to -1 2021-08-17T16:25:03.957Z,1629217503.957 [ESPComponent](IMPORTANT): [sample #13] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-17T16:25:04.386Z,1629217504.386 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-17T16:25:04.755Z,1629217504.755 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-17T16:25:05.159Z,1629217505.159 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-17T16:25:07.178Z,1629217507.178 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-17T16:25:41.521Z,1629217541.521 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_PRIMING (@13,aRNAl_bac) 2021-08-17T16:25:43.135Z,1629217543.135 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PRIMING (@100.0) 2021-08-17T16:25:43.540Z,1629217543.540 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-17T16:25:43.943Z,1629217543.943 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-17T16:28:05.347Z,1629217685.347 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_FILTERING (@0.0) 2021-08-17T16:28:05.751Z,1629217685.751 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-17T16:59:54.373Z,1629219594.373 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-17T17:00:05.276Z,1629219605.276 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.004852 CHAN A1 (24V): 0.001742 CHAN A2 (12V): -0.007100 CHAN A3 (5V): -0.005679 CHAN B0 (3.3V): -0.003479 CHAN B1 (3.15aV): 0.011599 CHAN B2 (3.15bV): -0.001194 CHAN B3 (GND): -0.003063 OPEN: 0.011919 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-17T18:31:28.792Z,1629225088.792 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PAUSED (@2000.0) 2021-08-17T18:31:29.195Z,1629225089.195 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PROCESSING (@2000.0) 2021-08-17T18:31:31.216Z,1629225091.216 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-17T18:31:31.618Z,1629225091.618 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_PROCESSED (@13,aRNAl_bac) 2021-08-17T18:33:06.558Z,1629225186.558 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_STOPPING (@13,aRNAl_bac) 2021-08-17T18:33:13.831Z,1629225193.831 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-17T18:33:14.236Z,1629225194.236 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_STOPPED 2021-08-17T18:38:14.014Z,1629225494.014 [ESPComponent](IMPORTANT): [sample #13] ESP sampling sequence completed normally. 2021-08-17T18:38:14.423Z,1629225494.423 [ESPComponent](IMPORTANT): [sample #13] ESP log summary report (2 messages): @12:25:17.89 Selecting Cartridge 13 @14:31:27.05 Sampled 2000.0ml 2021-08-17T18:38:15.273Z,1629225495.273 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-17T18:47:11.099Z,1629226031.099 [MissionManager](IMPORTANT): Started mission Default 2021-08-17T18:53:02.355Z,1629226382.355 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 5.847605 min 2021-08-17T18:54:33.831Z,1629226473.831 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=46291, MT Status=1, MTMSN=3318 2021-08-17T18:54:34.421Z,1629226474.421 [CommandLine](IMPORTANT): got command restart logs