2023-08-06T13:19:46.117Z,1691327986.117 [CommandExec](IMPORTANT): got command restart logs 2023-08-06T13:19:56.940Z,1691327996.940 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=7557, MT Status=1, MTMSN=2881 2023-08-06T13:19:57.590Z,1691327997.590 [CommandExec](IMPORTANT): got command ! echo d > /dev/loadA6;echo d > /dev/loadA7 2023-08-06T13:20:13.468Z,1691328013.468 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=7558, MT Status=1, MTMSN=2882 2023-08-06T13:20:15.744Z,1691328015.744 [CommandExec](IMPORTANT): got command gfscan 2023-08-06T13:20:15.809Z,1691328015.809 [CBIT](IMPORTANT): Beginning ground fault scan 2023-08-06T13:20:29.112Z,1691328029.112 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.004267 CHAN A1 (24V): 0.003288 CHAN A2 (12V): -0.000099 CHAN A3 (5V): -0.004593 CHAN B0 (3.3V): 0.004261 CHAN B1 (3.15aV): -0.001328 CHAN B2 (3.15bV): -0.002318 CHAN B3 (GND): -0.001113 OPEN: 0.012197 Full Scale: +/- 1 mA 2023-08-06T13:20:34.316Z,1691328034.316 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=7559, MT Status=1, MTMSN=2883 2023-08-06T13:20:35.108Z,1691328035.108 [CommandExec](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set smear_waypoint_sampling.CartridgeType -1 count;set smear_waypoint_sampling.MissionTimeout 2 h;set smear_waypoint_sampling.NeedCommsTimeInTransit 45 min" 3vw6x 1 3.000000 2023-08-06T13:20:35.109Z,1691328035.109 [CommandExec](IMPORTANT): Scheduling command #1 of 3 with id=3vw6x 2023-08-06T13:20:35.110Z,1691328035.110 [CommandExec](IMPORTANT): Scheduled #41 (#1 of 3 with id='3vw6x'): "load Science/smear_waypoint_sampling.xml;set smear_waypoint_sampling.CartridgeType -1 count;set smear_waypoint_sampling.MissionTimeout 2 h;set smear_waypoint_sampling.NeedCommsTimeInTransit 45 min", ASAP 2023-08-06T13:20:57.180Z,1691328057.180 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=7560, MT Status=1, MTMSN=2884 2023-08-06T13:20:58.019Z,1691328058.019 [CommandExec](IMPORTANT): got command schedule asap "set smear_waypoint_sampling.ReachEndWaypoint 0 bool;set smear_waypoint_sampling.Speed .8 m/s;set smear_waypoint_sampling.MaxDepth 17 m;set smear_waypoint_sampling.SamplingYoYoMinDepth 3 m" 3vw6x 2 3.000000 2023-08-06T13:20:58.020Z,1691328058.020 [CommandExec](IMPORTANT): Scheduling command #2 of 3 with id=3vw6x 2023-08-06T13:20:58.022Z,1691328058.022 [CommandExec](IMPORTANT): Scheduled #42 (#2 of 3 with id='3vw6x'): "set smear_waypoint_sampling.ReachEndWaypoint 0 bool;set smear_waypoint_sampling.Speed .8 m/s;set smear_waypoint_sampling.MaxDepth 17 m;set smear_waypoint_sampling.SamplingYoYoMinDepth 3 m", ASAP 2023-08-06T13:21:08.517Z,1691328068.517 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=7561, MT Status=1, MTMSN=2885 2023-08-06T13:21:09.471Z,1691328069.471 [CommandExec](IMPORTANT): got command schedule asap "set smear_waypoint_sampling.SamplingEndLatitude 45.278804 degree;set smear_waypoint_sampling.SamplingEndLongitude -86.238556 degree;set smear_waypoint_sampling.MinOffshore .75 km;run" 3vw6x 3 3.000000 2023-08-06T13:21:09.472Z,1691328069.472 [CommandExec](IMPORTANT): Scheduling command #3 of 3 with id=3vw6x 2023-08-06T13:21:09.473Z,1691328069.473 [CommandExec](IMPORTANT): Scheduled #43 (#3 of 3 with id='3vw6x'): "set smear_waypoint_sampling.SamplingEndLatitude 45.278804 degree;set smear_waypoint_sampling.SamplingEndLongitude -86.238556 degree;set smear_waypoint_sampling.MinOffshore .75 km;run", ASAP 2023-08-06T13:21:09.630Z,1691328069.630 [CommandExec](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2023-08-06T13:21:10.365Z,1691328070.365 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file Missions/Insert/NeedComms.tx 2023-08-06T13:21:10.570Z,1691328070.570 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file Missions/Insert/StandardEnvelopes.tx 2023-08-06T13:21:10.651Z,1691328070.651 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file Missions/Insert/Science.tx 2023-08-06T13:21:12.382Z,1691328072.382 [CommandExec](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2023-08-06T13:21:12.745Z,1691328072.745 [MissionManager](IMPORTANT): Started mission Default 2023-08-06T13:21:25.087Z,1691328085.087 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.CartridgeType -1 count 2023-08-06T13:21:25.088Z,1691328085.088 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.MissionTimeout 2 hour 2023-08-06T13:21:25.089Z,1691328085.089 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.NeedCommsTimeInTransit 45 minute 2023-08-06T13:21:42.311Z,1691328102.311 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.ReachEndWaypoint 0 bool 2023-08-06T13:21:42.311Z,1691328102.311 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.Speed .8 meter_per_second 2023-08-06T13:21:42.312Z,1691328102.312 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.MaxDepth 17 meter 2023-08-06T13:21:42.313Z,1691328102.313 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.SamplingYoYoMinDepth 3 meter 2023-08-06T13:21:49.459Z,1691328109.459 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=7562, MT Status=1, MTMSN=2886 2023-08-06T13:21:55.371Z,1691328115.371 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.SamplingEndLatitude 45.278804 degree 2023-08-06T13:21:55.371Z,1691328115.371 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.SamplingEndLongitude -86.238556 degree 2023-08-06T13:21:55.372Z,1691328115.372 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.MinOffshore .75 kilometer 2023-08-06T13:21:55.373Z,1691328115.373 [CommandExec](IMPORTANT): got command run 2023-08-06T13:21:55.374Z,1691328115.374 [CommandExec](IMPORTANT): Running 2023-08-06T13:21:55.434Z,1691328115.434 [CommandExec](IMPORTANT): got command schedule "load Science/smear_waypoint_sampling.xml;set smear_waypoint_sampling.CartridgeType -1 count;set smear_waypoint_sampling.MissionTimeout 2 h;set smear_waypoint_sampling.NeedCommsTimeInTransit 45 min" 3vwam 1 3.000000 2023-08-06T13:21:55.434Z,1691328115.434 [CommandExec](IMPORTANT): Scheduling command #1 of 3 with id=3vwam 2023-08-06T13:21:55.439Z,1691328115.439 [CommandExec](IMPORTANT): Scheduled #44 (#1 of 3 with id='3vwam'): "load Science/smear_waypoint_sampling.xml;set smear_waypoint_sampling.CartridgeType -1 count;set smear_waypoint_sampling.MissionTimeout 2 h;set smear_waypoint_sampling.NeedCommsTimeInTransit 45 min", AFTER MISSION 2023-08-06T13:21:56.293Z,1691328116.293 [MissionManager](IMPORTANT): Started mission smear_waypoint_sampling 2023-08-06T13:22:13.880Z,1691328133.880 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=7563, MT Status=1, MTMSN=2887 2023-08-06T13:22:14.728Z,1691328134.728 [CommandExec](IMPORTANT): got command schedule "set smear_waypoint_sampling.ReachEndWaypoint 0 bool;set smear_waypoint_sampling.Speed .8 m/s;set smear_waypoint_sampling.MaxDepth 40 m;set smear_waypoint_sampling.SamplingYoYoMinDepth 17 m" 3vwam 2 3.000000 2023-08-06T13:22:14.729Z,1691328134.729 [CommandExec](IMPORTANT): Scheduling command #2 of 3 with id=3vwam 2023-08-06T13:22:14.730Z,1691328134.730 [CommandExec](IMPORTANT): Scheduled #45 (#2 of 3 with id='3vwam'): "set smear_waypoint_sampling.ReachEndWaypoint 0 bool;set smear_waypoint_sampling.Speed .8 m/s;set smear_waypoint_sampling.MaxDepth 40 m;set smear_waypoint_sampling.SamplingYoYoMinDepth 17 m", AFTER MISSION 2023-08-06T13:22:39.698Z,1691328159.698 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=7564, MT Status=1, MTMSN=2888 2023-08-06T13:22:40.680Z,1691328160.680 [CommandExec](IMPORTANT): got command schedule "set smear_waypoint_sampling.SamplingYoYoMaxDepth 45 m;set smear_waypoint_sampling.SamplingEndLatitude 45.278804 degree;set smear_waypoint_sampling.SamplingEndLongitude -86.238556 degree;set smear_waypoint_sampling.MinOffshore .75 km;run" 3vwam 3 3.000000 2023-08-06T13:22:40.682Z,1691328160.682 [CommandExec](IMPORTANT): Scheduling command #3 of 3 with id=3vwam 2023-08-06T13:22:40.688Z,1691328160.688 [CommandExec](IMPORTANT): Scheduled #46 (#3 of 3 with id='3vwam'): "set smear_waypoint_sampling.SamplingYoYoMaxDepth 45 m;set smear_waypoint_sampling.SamplingEndLatitude 45.278804 degree;set smear_waypoint_sampling.SamplingEndLongitude -86.238556 degree;set smear_waypoint_sampling.MinOffshore .75 km;run", AFTER MISSION 2023-08-06T13:22:59.050Z,1691328179.050 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=7565, MT Status=1, MTMSN=2889 2023-08-06T13:23:00.069Z,1691328180.069 [CommandExec](IMPORTANT): got command schedule "load Science/smear_waypoint_sampling.xml;set smear_waypoint_sampling.CartridgeType -1 count;set smear_waypoint_sampling.MissionTimeout 2 h;set smear_waypoint_sampling.NeedCommsTimeInTransit 45 min" 3vwgf 1 4.000000 2023-08-06T13:23:00.069Z,1691328180.069 [CommandExec](IMPORTANT): Scheduling command #1 of 4 with id=3vwgf 2023-08-06T13:23:00.070Z,1691328180.070 [CommandExec](IMPORTANT): Scheduled #47 (#1 of 4 with id='3vwgf'): "load Science/smear_waypoint_sampling.xml;set smear_waypoint_sampling.CartridgeType -1 count;set smear_waypoint_sampling.MissionTimeout 2 h;set smear_waypoint_sampling.NeedCommsTimeInTransit 45 min", AFTER MISSION 2023-08-06T13:23:13.460Z,1691328193.460 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=7566, MT Status=1, MTMSN=2890 2023-08-06T13:23:14.356Z,1691328194.356 [CommandExec](IMPORTANT): got command schedule "set smear_waypoint_sampling.Speed .8 m/s;set smear_waypoint_sampling.MaxDepth 70 m;set smear_waypoint_sampling.SamplingYoYoMinDepth 40 m;set smear_waypoint_sampling.SamplingYoYoMaxDepth 70 m" 3vwgf 2 4.000000 2023-08-06T13:23:14.357Z,1691328194.357 [CommandExec](IMPORTANT): Scheduling command #2 of 4 with id=3vwgf 2023-08-06T13:23:14.368Z,1691328194.368 [CommandExec](IMPORTANT): Scheduled #48 (#2 of 4 with id='3vwgf'): "set smear_waypoint_sampling.Speed .8 m/s;set smear_waypoint_sampling.MaxDepth 70 m;set smear_waypoint_sampling.SamplingYoYoMinDepth 40 m;set smear_waypoint_sampling.SamplingYoYoMaxDepth 70 m", AFTER MISSION 2023-08-06T13:23:46.743Z,1691328226.743 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=7567, MT Status=1, MTMSN=2891 2023-08-06T13:23:47.584Z,1691328227.584 [CommandExec](IMPORTANT): got command schedule "set smear_waypoint_sampling.SamplingEndLatitude 45.278401 degree;set smear_waypoint_sampling.SamplingEndLongitude -86.300988 degree;set smear_waypoint_sampling.MinOffshore .75 km" 3vwgf 3 4.000000 2023-08-06T13:23:47.584Z,1691328227.584 [CommandExec](IMPORTANT): Scheduling command #3 of 4 with id=3vwgf 2023-08-06T13:23:47.585Z,1691328227.585 [CommandExec](IMPORTANT): Scheduled #49 (#3 of 4 with id='3vwgf'): "set smear_waypoint_sampling.SamplingEndLatitude 45.278401 degree;set smear_waypoint_sampling.SamplingEndLongitude -86.300988 degree;set smear_waypoint_sampling.MinOffshore .75 km", AFTER MISSION 2023-08-06T13:24:17.930Z,1691328257.930 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=7568, MT Status=1, MTMSN=2892 2023-08-06T13:24:18.816Z,1691328258.816 [CommandExec](IMPORTANT): got command schedule "set smear_waypoint_sampling:StandardEnvelopes.MaxDepth 90 m;run" 3vwgf 4 4.000000 2023-08-06T13:24:18.817Z,1691328258.817 [CommandExec](IMPORTANT): Scheduling command #4 of 4 with id=3vwgf 2023-08-06T13:24:18.818Z,1691328258.818 [CommandExec](IMPORTANT): Scheduled #50 (#4 of 4 with id='3vwgf'): "set smear_waypoint_sampling:StandardEnvelopes.MaxDepth 90 m;run", AFTER MISSION 2023-08-06T13:25:01.129Z,1691328301.129 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=7569, MT Status=1, MTMSN=2893 2023-08-06T13:25:01.873Z,1691328301.873 [CommandExec](IMPORTANT): got command schedule "load Transport/keepstation.tl;set keepstation.MissionTimeout 9 h;set keepstation.NeedCommsTime 60 min;set keepstation.Latitude 45.278804 degree;set keepstation.Longitude -86.238556 degree;run" 2023-08-06T13:25:01.874Z,1691328301.874 [CommandExec](IMPORTANT): Scheduled #51: "load Transport/keepstation.tl;set keepstation.MissionTimeout 9 h;set keepstation.NeedCommsTime 60 min;set keepstation.Latitude 45.278804 degree;set keepstation.Longitude -86.238556 degree;run", AFTER MISSION 2023-08-06T13:28:03.023Z,1691328483.023 [smear_waypoint_sampling:SamplingToWaypoint:E.Waypoint](IMPORTANT): Navigating to waypoint: 45.278805,-86.238556 2023-08-06T13:29:04.956Z,1691328544.956 [smear_waypoint_sampling:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2023-08-06T13:29:08.200Z,1691328548.200 [smear_waypoint_sampling:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 3.636569 m , 21.028406 degC , 0.124800 ug/l . 2023-08-06T13:29:20.009Z,1691328560.009 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-08-06T13:29:20.373Z,1691328560.373 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-08-06T13:30:10.690Z,1691328610.690 [ESPComponent](IMPORTANT): ESP has connected as client 2023-08-06T13:30:11.499Z,1691328611.499 [ESPComponent](IMPORTANT): [sample #4] Setting cartridge argument to -1 2023-08-06T13:30:11.499Z,1691328611.499 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-08-06T13:30:11.962Z,1691328611.962 [smear_waypoint_sampling:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2023-08-06T13:30:12.301Z,1691328612.301 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_LOG 2023-08-06T13:30:12.710Z,1691328612.710 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-08-06T13:30:14.725Z,1691328614.725 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_LOADING_CARTRIDGE 2023-08-06T13:30:46.644Z,1691328646.644 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PRIMING (@54,aRNAl_bac) 2023-08-06T13:30:49.469Z,1691328649.469 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PRIMING (@100.0) 2023-08-06T13:30:49.470Z,1691328649.470 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=175.399994 issuedCmd_=Cmd.startFiltering 2023-08-06T13:30:49.872Z,1691328649.872 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-08-06T13:33:16.213Z,1691328796.213 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_FILTERING (@0.0) 2023-08-06T13:33:16.616Z,1691328796.616 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-08-06T14:44:49.157Z,1691333089.157 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PAUSED (@2000.0) 2023-08-06T14:44:49.561Z,1691333089.561 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PROCESSING (@2000.0) 2023-08-06T14:44:51.583Z,1691333091.583 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2023-08-06T14:44:51.989Z,1691333091.989 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PROCESSED (@54,aRNAl_bac) 2023-08-06T14:46:26.933Z,1691333186.933 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPING (@54,aRNAl_bac) 2023-08-06T14:46:34.609Z,1691333194.609 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-08-06T14:46:35.034Z,1691333195.034 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPED 2023-08-06T14:51:34.846Z,1691333494.846 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence completed normally. 2023-08-06T14:51:36.131Z,1691333496.131 [smear_waypoint_sampling:SamplingToWaypoint:TakeSamples:Firing:G](IMPORTANT): Sample No. 1.000000 count completed. 2023-08-06T14:58:27.714Z,1691333907.714 [CommandExec](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2023-08-06T14:58:28.586Z,1691333908.586 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file Missions/Insert/NeedComms.tx 2023-08-06T14:58:29.097Z,1691333909.097 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file Missions/Insert/StandardEnvelopes.tx 2023-08-06T14:58:29.579Z,1691333909.579 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file Missions/Insert/Science.tx 2023-08-06T14:58:31.622Z,1691333911.622 [CommandExec](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2023-08-06T14:58:31.922Z,1691333911.922 [MissionManager](IMPORTANT): Started mission Default 2023-08-06T14:58:44.357Z,1691333924.357 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.CartridgeType -1 count 2023-08-06T14:58:44.358Z,1691333924.358 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.MissionTimeout 2 hour 2023-08-06T14:58:44.358Z,1691333924.358 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.NeedCommsTimeInTransit 45 minute 2023-08-06T14:59:00.093Z,1691333940.093 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.ReachEndWaypoint 0 bool 2023-08-06T14:59:00.094Z,1691333940.094 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.Speed .8 meter_per_second 2023-08-06T14:59:00.095Z,1691333940.095 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.MaxDepth 40 meter 2023-08-06T14:59:00.096Z,1691333940.096 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.SamplingYoYoMinDepth 17 meter 2023-08-06T14:59:20.054Z,1691333960.054 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.SamplingYoYoMaxDepth 45 meter 2023-08-06T14:59:20.056Z,1691333960.056 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.SamplingEndLatitude 45.278804 degree 2023-08-06T14:59:20.057Z,1691333960.057 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.SamplingEndLongitude -86.238556 degree 2023-08-06T14:59:20.058Z,1691333960.058 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.MinOffshore .75 kilometer 2023-08-06T14:59:20.102Z,1691333960.102 [CommandExec](IMPORTANT): got command run 2023-08-06T14:59:20.105Z,1691333960.105 [CommandExec](IMPORTANT): Running 2023-08-06T14:59:20.828Z,1691333960.828 [MissionManager](IMPORTANT): Started mission smear_waypoint_sampling 2023-08-06T15:05:25.805Z,1691334325.805 [smear_waypoint_sampling:SamplingToWaypoint:E.Waypoint](IMPORTANT): Navigating to waypoint: 45.278805,-86.238556 2023-08-06T15:07:04.047Z,1691334424.047 [Radio_Surface](FAULT): LCB fault: LCB Watchdog Reset. Hardware Overcurrent Shutdown. 2023-08-06T15:07:37.545Z,1691334457.545 [smear_waypoint_sampling:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2023-08-06T15:07:40.740Z,1691334460.740 [smear_waypoint_sampling:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 17.398293 m , 11.305414 degC , 0.176800 ug/l . 2023-08-06T15:07:52.519Z,1691334472.519 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-08-06T15:07:52.680Z,1691334472.680 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-08-06T15:08:43.073Z,1691334523.073 [ESPComponent](IMPORTANT): ESP has connected as client 2023-08-06T15:08:43.884Z,1691334523.884 [ESPComponent](IMPORTANT): [sample #5] Setting cartridge argument to -1 2023-08-06T15:08:43.884Z,1691334523.884 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-08-06T15:08:44.343Z,1691334524.343 [smear_waypoint_sampling:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2023-08-06T15:08:44.688Z,1691334524.688 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_LOG 2023-08-06T15:08:45.099Z,1691334525.099 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-08-06T15:08:47.114Z,1691334527.114 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_LOADING_CARTRIDGE 2023-08-06T15:09:19.031Z,1691334559.031 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PRIMING (@53,aRNAl_bac) 2023-08-06T15:09:21.453Z,1691334561.453 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PRIMING (@100.0) 2023-08-06T15:09:21.454Z,1691334561.454 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=175.399994 issuedCmd_=Cmd.startFiltering 2023-08-06T15:09:21.857Z,1691334561.857 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-08-06T15:12:21.659Z,1691334741.659 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_FILTERING (@0.0) 2023-08-06T15:12:22.057Z,1691334742.057 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-08-06T15:32:26.056Z,1691335946.056 [smear_waypoint_sampling:SamplingToWaypoint:E.Waypoint](IMPORTANT): Reached waypoint: 45.278805,-86.238556 2023-08-06T15:32:26.260Z,1691335946.260 [CommandExec](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2023-08-06T15:32:26.409Z,1691335946.409 [ESPComponent](IMPORTANT): [sample #5] Stop sampling requested. 2023-08-06T15:32:26.805Z,1691335946.805 [ESPComponent](IMPORTANT): Stop sampling requested. Issuing Cmd.pauseFiltering 2023-08-06T15:32:27.134Z,1691335947.134 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file Missions/Insert/NeedComms.tx 2023-08-06T15:32:27.467Z,1691335947.467 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file Missions/Insert/StandardEnvelopes.tx 2023-08-06T15:32:27.692Z,1691335947.692 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file Missions/Insert/Science.tx 2023-08-06T15:32:29.454Z,1691335949.454 [CommandExec](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2023-08-06T15:32:29.713Z,1691335949.713 [MissionManager](IMPORTANT): Started mission Default 2023-08-06T15:32:32.461Z,1691335952.461 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PAUSED (@509.5) 2023-08-06T15:32:32.866Z,1691335952.866 [ESPComponent](IMPORTANT): In S_PAUSED received result: 509.5 2023-08-06T15:32:33.269Z,1691335953.269 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PROCESSING (@509.5) 2023-08-06T15:32:35.290Z,1691335955.290 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2023-08-06T15:32:35.693Z,1691335955.693 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PROCESSED (@52,aRNAl_bac) 2023-08-06T15:32:45.261Z,1691335965.261 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.CartridgeType -1 count 2023-08-06T15:32:45.262Z,1691335965.262 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.MissionTimeout 2 hour 2023-08-06T15:32:45.263Z,1691335965.263 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.NeedCommsTimeInTransit 45 minute 2023-08-06T15:33:04.768Z,1691335984.768 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.Speed .8 meter_per_second 2023-08-06T15:33:04.769Z,1691335984.769 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.MaxDepth 70 meter 2023-08-06T15:33:04.770Z,1691335984.770 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.SamplingYoYoMinDepth 40 meter 2023-08-06T15:33:04.770Z,1691335984.770 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.SamplingYoYoMaxDepth 70 meter 2023-08-06T15:33:20.046Z,1691336000.046 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.SamplingEndLatitude 45.278401 degree 2023-08-06T15:33:20.046Z,1691336000.046 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.SamplingEndLongitude -86.300988 degree 2023-08-06T15:33:20.047Z,1691336000.047 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling.MinOffshore .75 kilometer 2023-08-06T15:33:26.094Z,1691336006.094 [CommandExec](IMPORTANT): got command set smear_waypoint_sampling:StandardEnvelopes.MaxDepth 90 meter 2023-08-06T15:33:26.095Z,1691336006.095 [CommandExec](IMPORTANT): got command run 2023-08-06T15:33:26.097Z,1691336006.097 [CommandExec](IMPORTANT): Running 2023-08-06T15:33:26.225Z,1691336006.225 [MissionManager](IMPORTANT): Started mission smear_waypoint_sampling 2023-08-06T15:34:10.513Z,1691336050.513 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPING (@52,aRNAl_bac) 2023-08-06T15:34:18.190Z,1691336058.190 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-08-06T15:34:18.618Z,1691336058.618 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPED 2023-08-06T15:36:20.797Z,1691336180.797 [smear_waypoint_sampling:SamplingToWaypoint:E.Waypoint](IMPORTANT): Navigating to waypoint: 45.278400,-86.300987 2023-08-06T15:39:18.508Z,1691336358.508 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence completed normally. 2023-08-06T15:40:19.593Z,1691336419.593 [smear_waypoint_sampling:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2023-08-06T15:40:22.842Z,1691336422.842 [smear_waypoint_sampling:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 40.459438 m , 4.901605 degC , 1.102400 ug/l . 2023-08-06T15:40:34.588Z,1691336434.588 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-08-06T15:40:34.716Z,1691336434.716 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-08-06T15:41:25.814Z,1691336485.814 [ESPComponent](IMPORTANT): ESP has connected as client 2023-08-06T15:41:26.624Z,1691336486.624 [ESPComponent](IMPORTANT): [sample #6] Setting cartridge argument to -1 2023-08-06T15:41:26.624Z,1691336486.624 [ESPComponent](IMPORTANT): [sample #6] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-08-06T15:41:27.120Z,1691336487.120 [smear_waypoint_sampling:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2023-08-06T15:41:27.428Z,1691336487.428 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PREPARING_SHOW_LOG 2023-08-06T15:41:27.833Z,1691336487.833 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-08-06T15:41:29.853Z,1691336489.853 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_LOADING_CARTRIDGE 2023-08-06T15:42:01.775Z,1691336521.775 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PRIMING (@51,aRNAl_bac) 2023-08-06T15:42:04.601Z,1691336524.601 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PRIMING (@100.0) 2023-08-06T15:42:04.602Z,1691336524.602 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=175.399994 issuedCmd_=Cmd.startFiltering 2023-08-06T15:42:05.009Z,1691336525.009 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-08-06T15:44:32.104Z,1691336672.104 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_FILTERING (@0.0) 2023-08-06T15:44:32.513Z,1691336672.513 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-08-06T16:27:19.244Z,1691339239.244 [RudderServo](FAULT): Reading outside of valid range:0.000000 2023-08-06T16:27:19.920Z,1691339239.920 [RudderServo](FAULT): Rudder uart error - getPosition..serial timeout 2023-08-06T17:25:10.201Z,1691342710.201 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PAUSED (@2000.0) 2023-08-06T17:25:10.604Z,1691342710.604 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PROCESSING (@2000.0) 2023-08-06T17:25:12.626Z,1691342712.626 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2023-08-06T17:25:13.029Z,1691342713.029 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PROCESSED (@51,aRNAl_bac) 2023-08-06T17:26:24.974Z,1691342784.974 [smear_waypoint_sampling:SamplingToWaypoint:E.Waypoint](IMPORTANT): Reached waypoint: 45.278400,-86.300987 2023-08-06T17:26:25.057Z,1691342785.057 [CommandExec](IMPORTANT): got command load ./Missions/Transport/keepstation.tl 2023-08-06T17:26:25.129Z,1691342785.129 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file ./Missions/Transport/keepstation.tx 2023-08-06T17:26:25.332Z,1691342785.332 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file Missions/Insert/NeedComms.tx 2023-08-06T17:26:25.345Z,1691342785.345 [ESPComponent](IMPORTANT): [sample #6] Stop sampling requested. 2023-08-06T17:26:25.656Z,1691342785.656 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file Missions/Insert/StandardEnvelopes.tx 2023-08-06T17:26:25.947Z,1691342785.947 [CommandExec](IMPORTANT): Loaded ./Missions/Transport/keepstation.tl 2023-08-06T17:26:26.183Z,1691342786.183 [MissionManager](IMPORTANT): Started mission Default 2023-08-06T17:26:37.768Z,1691342797.768 [CommandExec](IMPORTANT): got command set keepstation.MissionTimeout 9 hour 2023-08-06T17:26:37.769Z,1691342797.769 [CommandExec](IMPORTANT): got command set keepstation.NeedCommsTime 60 minute 2023-08-06T17:26:37.769Z,1691342797.769 [CommandExec](IMPORTANT): got command set keepstation.Latitude 45.278804 degree 2023-08-06T17:26:37.770Z,1691342797.770 [CommandExec](IMPORTANT): got command set keepstation.Longitude -86.238556 degree 2023-08-06T17:26:37.771Z,1691342797.771 [CommandExec](IMPORTANT): got command run 2023-08-06T17:26:37.773Z,1691342797.773 [CommandExec](IMPORTANT): Running 2023-08-06T17:26:37.906Z,1691342797.906 [MissionManager](IMPORTANT): Started mission keepstation 2023-08-06T17:26:47.970Z,1691342807.970 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_STOPPING (@51,aRNAl_bac) 2023-08-06T17:26:55.646Z,1691342815.646 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-08-06T17:26:56.053Z,1691342816.053 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_STOPPED 2023-08-06T17:31:56.097Z,1691343116.097 [ESPComponent](IMPORTANT): [sample #6] ESP sampling sequence completed normally. 2023-08-06T17:36:32.160Z,1691343392.160 [keepstation:TransitToStation:Wpt1.Waypoint](IMPORTANT): Navigating to waypoint: 45.278805,-86.238556 2023-08-06T19:20:29.146Z,1691349629.146 [CBIT](IMPORTANT): Beginning ground fault scan 2023-08-06T19:20:40.082Z,1691349640.082 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): 0.000795 CHAN A1 (24V): 0.007224 CHAN A2 (12V): -0.004640 CHAN A3 (5V): -0.005792 CHAN B0 (3.3V): -0.002058 CHAN B1 (3.15aV): -0.001359 CHAN B2 (3.15bV): -0.001312 CHAN B3 (GND): -0.002363 OPEN: 0.012159 Full Scale: +/- 1 mA 2023-08-06T19:27:53.425Z,1691350073.425 [keepstation:TransitToStation:Wpt1.Waypoint](IMPORTANT): Reached waypoint: 45.278805,-86.238556 2023-08-06T20:38:56.649Z,1691354336.649 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=7638, MT Status=1, MTMSN=2894 2023-08-06T20:38:57.728Z,1691354337.728 [CommandExec](IMPORTANT): got command stop 2023-08-06T20:38:57.728Z,1691354337.728 [CommandExec](IMPORTANT): Scheduling is paused 2023-08-06T20:38:57.729Z,1691354337.729 [CommandExec](IMPORTANT): got command configSet ESPComponent.filterCompleteTimeout 135 minute persist 2023-08-06T20:38:57.736Z,1691354337.736 [CommandExec](IMPORTANT): got command restart application 2023-08-06T20:38:58.276Z,1691354338.276 [MissionManager](IMPORTANT): Started mission Default