2022-06-05T19:41:15.664Z,1654458075.664 [CommandExec](IMPORTANT): got command restart logs 2022-06-05T19:49:36.466Z,1654458576.466 [CBIT](IMPORTANT): Beginning ground fault scan 2022-06-05T19:49:47.660Z,1654458587.660 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.002911 CHAN A1 (24V): -0.001109 CHAN A2 (12V): 0.000046 CHAN A3 (5V): -0.000448 CHAN B0 (3.3V): 0.006346 CHAN B1 (3.15aV): 0.000415 CHAN B2 (3.15bV): 0.000901 CHAN B3 (GND): -0.000062 OPEN: 0.007505 Full Scale: +/- 1 mA 2022-06-05T20:52:03.852Z,1654462323.852 [DataOverHttps](IMPORTANT): SBD MTMSN=20220605T205151 2022-06-05T20:52:15.105Z,1654462335.105 [CommandExec](IMPORTANT): got command configSet ShortestDistanceToPolygonSidesCalculator.latVertex2 34.40 degree persist 2022-06-05T20:52:15.536Z,1654462335.536 [DataOverHttps](IMPORTANT): SBD MTMSN=20220605T205202 2022-06-05T20:52:23.459Z,1654462343.459 [CommandExec](IMPORTANT): got command stop 2022-06-05T20:52:24.194Z,1654462344.194 [MissionManager](IMPORTANT): Started mission Default 2022-06-05T20:52:24.439Z,1654462344.439 [DataOverHttps](IMPORTANT): SBD MTMSN=20220605T205211 2022-06-05T20:52:35.494Z,1654462355.494 [CommandExec](IMPORTANT): got command schedule clear 2022-06-05T20:52:35.494Z,1654462355.494 [CommandExec](IMPORTANT): Cleared 0 scheduled commands. 2022-06-05T20:52:35.495Z,1654462355.495 [CommandExec](IMPORTANT): got command schedule resume 2022-06-05T20:52:35.495Z,1654462355.495 [CommandExec](IMPORTANT): Scheduling is resumed 2022-06-05T20:53:19.140Z,1654462399.140 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-05T20:55:02.836Z,1654462502.836 [DataOverHttps](IMPORTANT): SBD MTMSN=20220605T205450 2022-06-05T20:55:10.394Z,1654462510.394 [CommandExec](IMPORTANT): got command schedule asap "load Science/profile_station.xml;set profile_station.MissionTimeout 8 h;set profile_station.Lat 34.390 degree;set profile_station.Lon -119.841 degree;set profile_station.YoYoMaxDepth 40 m;set profile_station.Speed 1 m/s" 2ii33 1 2.000000 2022-06-05T20:55:10.395Z,1654462510.395 [CommandExec](IMPORTANT): Scheduling command #1 of 2 with id=2ii33 2022-06-05T20:55:10.396Z,1654462510.396 [CommandExec](IMPORTANT): Scheduled #12 (#1 of 2 with id='2ii33'): "load Science/profile_station.xml;set profile_station.MissionTimeout 8 h;set profile_station.Lat 34.390 degree;set profile_station.Lon -119.841 degree;set profile_station.YoYoMaxDepth 40 m;set profile_station.Speed 1 m/s", ASAP 2022-06-05T20:55:11.332Z,1654462511.332 [DataOverHttps](IMPORTANT): SBD MTMSN=20220605T205458 2022-06-05T20:55:18.937Z,1654462518.937 [CommandExec](IMPORTANT): got command schedule asap "set profile_station.MaxDepth 60 m;set profile_station.MinOffshore 1.5 km;run" 2ii33 2 2.000000 2022-06-05T20:55:18.939Z,1654462518.939 [CommandExec](IMPORTANT): Scheduling command #2 of 2 with id=2ii33 2022-06-05T20:55:18.940Z,1654462518.940 [CommandExec](IMPORTANT): Scheduled #13 (#2 of 2 with id='2ii33'): "set profile_station.MaxDepth 60 m;set profile_station.MinOffshore 1.5 km;run", ASAP 2022-06-05T20:55:19.069Z,1654462519.069 [CommandExec](IMPORTANT): got command load ./Missions/Science/profile_station.xml 2022-06-05T20:55:20.725Z,1654462520.725 [CommandExec](IMPORTANT): Loaded ./Missions/Science/profile_station.xml 2022-06-05T20:55:30.603Z,1654462530.603 [CommandExec](IMPORTANT): got command set profile_station.MissionTimeout 8 hour 2022-06-05T20:55:30.604Z,1654462530.604 [CommandExec](IMPORTANT): got command set profile_station.Lat 34.390 degree 2022-06-05T20:55:30.605Z,1654462530.605 [CommandExec](IMPORTANT): got command set profile_station.Lon -119.841 degree 2022-06-05T20:55:30.606Z,1654462530.606 [CommandExec](IMPORTANT): got command set profile_station.YoYoMaxDepth 40 meter 2022-06-05T20:55:30.606Z,1654462530.606 [CommandExec](IMPORTANT): got command set profile_station.Speed 1 meter_per_second 2022-06-05T20:55:34.816Z,1654462534.816 [CommandExec](IMPORTANT): got command set profile_station.MaxDepth 60 meter 2022-06-05T20:55:34.817Z,1654462534.817 [CommandExec](IMPORTANT): got command set profile_station.MinOffshore 1.5 kilometer 2022-06-05T20:55:34.817Z,1654462534.817 [CommandExec](IMPORTANT): got command run 2022-06-05T20:55:34.819Z,1654462534.819 [CommandExec](IMPORTANT): Running 2022-06-05T20:55:34.968Z,1654462534.968 [MissionManager](IMPORTANT): Started mission profile_station 2022-06-05T22:09:54.205Z,1654466994.205 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-05T22:48:41.543Z,1654469321.543 [Radio_Surface](FAULT): LCB fault: Invalid Command. 2022-06-06T00:21:05.323Z,1654474865.323 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T01:49:48.066Z,1654480188.066 [CBIT](IMPORTANT): Beginning ground fault scan 2022-06-06T01:49:58.985Z,1654480198.985 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.003351 CHAN A1 (24V): -0.001862 CHAN A2 (12V): -0.000169 CHAN A3 (5V): 0.000614 CHAN B0 (3.3V): 0.000231 CHAN B1 (3.15aV): 0.000266 CHAN B2 (3.15bV): 0.000291 CHAN B3 (GND): 0.014437 OPEN: 0.007390 Full Scale: +/- 1 mA 2022-06-06T02:35:30.941Z,1654482930.941 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T02:36:13.735Z,1654482973.735 [CommandExec](IMPORTANT): got command stop 2022-06-06T02:36:13.735Z,1654482973.735 [CommandExec](IMPORTANT): Scheduling is paused 2022-06-06T02:36:14.209Z,1654482974.209 [MissionManager](IMPORTANT): Started mission Default 2022-06-06T02:42:04.969Z,1654483324.969 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 5.839240 min 2022-06-06T02:47:09.355Z,1654483629.355 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T02:47:37.234Z,1654483657.234 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.376848 min 2022-06-06T02:47:44.963Z,1654483664.963 [CommandExec](IMPORTANT): got command ibit 2022-06-06T02:47:45.063Z,1654483665.063 [IBIT](IMPORTANT): Beginning Initiated BIT 2022-06-06T02:47:45.063Z,1654483665.063 [IBIT](IMPORTANT): Beginning control surface checks. 2022-06-06T02:47:45.075Z,1654483665.075 [CBIT](IMPORTANT): Beginning ground fault scan 2022-06-06T02:47:55.874Z,1654483675.874 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.078968 CHAN A1 (24V): -0.001399 CHAN A2 (12V): -0.000113 CHAN A3 (5V): -0.000237 CHAN B0 (3.3V): -0.000540 CHAN B1 (3.15aV): 0.000047 CHAN B2 (3.15bV): 0.000347 CHAN B3 (GND): 0.000616 OPEN: 0.007684 Full Scale: +/- 1 mA 2022-06-06T02:49:35.824Z,1654483775.824 [IBIT](FAULT): Error acquiring IBIT communications status. Timeout expired. 2022-06-06T02:49:36.243Z,1654483776.243 [IBIT](FAULT): Warning: Battery Data not active. Expected only when running primaries. Threshold checking not active. 2022-06-06T02:49:36.660Z,1654483776.660 [IBIT](IMPORTANT): bitHumidityThreshold: 55.000000 % 2022-06-06T02:49:36.660Z,1654483776.660 [IBIT](IMPORTANT): bitPressureThreshold: 0.750000 psi 2022-06-06T02:49:36.665Z,1654483776.665 [IBIT](IMPORTANT): Pressure:8.714373 PSI 2022-06-06T02:49:36.665Z,1654483776.665 [IBIT](IMPORTANT): Humidity:8.106459 % 2022-06-06T02:49:37.075Z,1654483777.075 [IBIT](IMPORTANT): Vehicle Pitch:-5.691432 degrees 2022-06-06T02:49:37.075Z,1654483777.075 [IBIT](IMPORTANT): Vehicle Roll:2.148605 degrees 2022-06-06T02:49:37.075Z,1654483777.075 [IBIT](IMPORTANT): Vehicle Heading:274.962646 degrees 2022-06-06T02:49:37.452Z,1654483777.452 [IBIT](IMPORTANT): surfaceThreshold: 1.000000 m 2022-06-06T02:49:37.453Z,1654483777.453 [IBIT](IMPORTANT): buoyancyNeutral: 633.000000 cc 2022-06-06T02:49:37.453Z,1654483777.453 [IBIT](IMPORTANT): massDefault: -0.700000 cm 2022-06-06T02:49:37.453Z,1654483777.453 [IBIT](IMPORTANT): stopDepth: 265.000000 m 2022-06-06T02:49:37.453Z,1654483777.453 [IBIT](IMPORTANT): abortDepth: 300.000000 m 2022-06-06T02:49:37.453Z,1654483777.453 [IBIT](IMPORTANT): IBIT FAILED 2022-06-06T02:50:39.940Z,1654483839.940 [CommandExec](IMPORTANT): got command get NAL9602.sigQuality 2022-06-06T02:50:39.940Z,1654483839.940 [CommandExec](IMPORTANT): NAL9602.sigQuality 0 count 2022-06-06T02:50:50.701Z,1654483850.701 [CommandExec](IMPORTANT): got command failComponent hardware NAL9602 2022-06-06T02:50:50.702Z,1654483850.702 [CommandExec](IMPORTANT): NAL9602 failureMode is Hardware Fault 2022-06-06T02:51:14.013Z,1654483874.013 [CommandExec](IMPORTANT): got command failComponent 2022-06-06T02:51:14.013Z,1654483874.013 [CommandExec](IMPORTANT): Failed components: 2022-06-06T02:51:14.013Z,1654483874.013 [CommandExec](IMPORTANT): No failed Components. 2022-06-06T02:52:13.844Z,1654483933.844 [CommandExec](IMPORTANT): got command report touch NAL9602.sigQuality 2022-06-06T02:52:35.519Z,1654483955.519 [CommandExec](IMPORTANT): got command report clear 2022-06-06T02:52:44.482Z,1654483964.482 [CommandExec](IMPORTANT): got command ibit 2022-06-06T02:52:44.509Z,1654483964.509 [IBIT](IMPORTANT): Beginning Initiated BIT 2022-06-06T02:52:44.509Z,1654483964.509 [IBIT](IMPORTANT): Beginning control surface checks. 2022-06-06T02:52:44.513Z,1654483964.513 [CBIT](IMPORTANT): Beginning ground fault scan 2022-06-06T02:52:55.386Z,1654483975.386 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): 0.029430 CHAN A1 (24V): -0.002005 CHAN A2 (12V): -0.000611 CHAN A3 (5V): 0.000872 CHAN B0 (3.3V): 0.000146 CHAN B1 (3.15aV): 0.000185 CHAN B2 (3.15bV): -0.000064 CHAN B3 (GND): 0.000155 OPEN: 0.007593 Full Scale: +/- 1 mA 2022-06-06T02:54:35.618Z,1654484075.618 [IBIT](FAULT): Error acquiring IBIT communications status. Timeout expired. 2022-06-06T02:54:36.030Z,1654484076.030 [IBIT](FAULT): Warning: Battery Data not active. Expected only when running primaries. Threshold checking not active. 2022-06-06T02:54:36.452Z,1654484076.452 [IBIT](IMPORTANT): bitHumidityThreshold: 55.000000 % 2022-06-06T02:54:36.453Z,1654484076.453 [IBIT](IMPORTANT): bitPressureThreshold: 0.750000 psi 2022-06-06T02:54:36.453Z,1654484076.453 [IBIT](IMPORTANT): Pressure:8.659699 PSI 2022-06-06T02:54:36.453Z,1654484076.453 [IBIT](IMPORTANT): Humidity:8.088145 % 2022-06-06T02:54:36.835Z,1654484076.835 [IBIT](IMPORTANT): Vehicle Pitch:-8.278797 degrees 2022-06-06T02:54:36.835Z,1654484076.835 [IBIT](IMPORTANT): Vehicle Roll:-4.648873 degrees 2022-06-06T02:54:36.836Z,1654484076.836 [IBIT](IMPORTANT): Vehicle Heading:288.797394 degrees 2022-06-06T02:54:37.241Z,1654484077.241 [IBIT](IMPORTANT): surfaceThreshold: 1.000000 m 2022-06-06T02:54:37.241Z,1654484077.241 [IBIT](IMPORTANT): buoyancyNeutral: 633.000000 cc 2022-06-06T02:54:37.241Z,1654484077.241 [IBIT](IMPORTANT): massDefault: -0.700000 cm 2022-06-06T02:54:37.242Z,1654484077.242 [IBIT](IMPORTANT): stopDepth: 265.000000 m 2022-06-06T02:54:37.242Z,1654484077.242 [IBIT](IMPORTANT): abortDepth: 300.000000 m 2022-06-06T02:54:37.242Z,1654484077.242 [IBIT](IMPORTANT): IBIT FAILED 2022-06-06T02:54:39.256Z,1654484079.256 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 18.410663 min 2022-06-06T02:55:10.720Z,1654484110.720 [CommandExec](IMPORTANT): got command get NAL9602.sigQuality 2022-06-06T02:55:10.720Z,1654484110.720 [CommandExec](IMPORTANT): NAL9602.sigQuality 0 count 2022-06-06T02:57:31.420Z,1654484251.420 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T025718 2022-06-06T02:57:38.931Z,1654484258.931 [CommandExec](IMPORTANT): got command schedule asap "load Science/canon_esp_trianguloid.xml;set canon_esp_trianguloid.FirstSampleTimeOffset 0.1 min;set canon_esp_trianguloid.Lat1 NaN degree;set canon_esp_trianguloid.Lon1 NaN degree;set canon_esp_trianguloid.Lat2 NaN degree" 2iyun 1 6.000000 2022-06-06T02:57:38.931Z,1654484258.931 [CommandExec](IMPORTANT): Scheduling command #1 of 6 with id=2iyun 2022-06-06T02:57:38.932Z,1654484258.932 [CommandExec](IMPORTANT): Scheduled #14 (#1 of 6 with id='2iyun'): "load Science/canon_esp_trianguloid.xml;set canon_esp_trianguloid.FirstSampleTimeOffset 0.1 min;set canon_esp_trianguloid.Lat1 NaN degree;set canon_esp_trianguloid.Lon1 NaN degree;set canon_esp_trianguloid.Lat2 NaN degree", ASAP 2022-06-06T02:57:39.892Z,1654484259.892 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T025727 2022-06-06T02:57:47.467Z,1654484267.467 [CommandExec](IMPORTANT): got command schedule asap "set canon_esp_trianguloid.Lon2 NaN degree;set canon_esp_trianguloid.Lat3 34.39784 degree;set canon_esp_trianguloid.Lon3 -119.786 degree;set canon_esp_trianguloid.Lat4 34.38085 degree;set canon_esp_trianguloid.Lon4 -119.73398 degree" 2iyun 2 6.000000 2022-06-06T02:57:47.467Z,1654484267.467 [CommandExec](IMPORTANT): Scheduling command #2 of 6 with id=2iyun 2022-06-06T02:57:47.468Z,1654484267.468 [CommandExec](IMPORTANT): Scheduled #15 (#2 of 6 with id='2iyun'): "set canon_esp_trianguloid.Lon2 NaN degree;set canon_esp_trianguloid.Lat3 34.39784 degree;set canon_esp_trianguloid.Lon3 -119.786 degree;set canon_esp_trianguloid.Lat4 34.38085 degree;set canon_esp_trianguloid.Lon4 -119.73398 degree", ASAP 2022-06-06T02:57:48.306Z,1654484268.306 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T02:57:48.429Z,1654484268.429 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T025735 2022-06-06T02:57:56.215Z,1654484276.215 [CommandExec](IMPORTANT): got command schedule asap "set canon_esp_trianguloid.Lat5 34.37971 degree;set canon_esp_trianguloid.Lon5 -119.70634 degree;set canon_esp_trianguloid.Lat6 34.40181 degree;set canon_esp_trianguloid.Lon6 -119.62944 degree" 2iyun 3 6.000000 2022-06-06T02:57:56.215Z,1654484276.215 [CommandExec](IMPORTANT): Scheduling command #3 of 6 with id=2iyun 2022-06-06T02:57:56.216Z,1654484276.216 [CommandExec](IMPORTANT): Scheduled #16 (#3 of 6 with id='2iyun'): "set canon_esp_trianguloid.Lat5 34.37971 degree;set canon_esp_trianguloid.Lon5 -119.70634 degree;set canon_esp_trianguloid.Lat6 34.40181 degree;set canon_esp_trianguloid.Lon6 -119.62944 degree", ASAP 2022-06-06T02:57:57.144Z,1654484277.144 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T025744 2022-06-06T02:58:09.508Z,1654484289.508 [CommandExec](IMPORTANT): got command schedule asap "set canon_esp_trianguloid.Lat7 34.39615 degree;set canon_esp_trianguloid.Lon7 -119.56696 degree;set canon_esp_trianguloid.Lat8 34.37603 degree;set canon_esp_trianguloid.Lon8 -119.53022 degree" 2iyun 4 6.000000 2022-06-06T02:58:09.509Z,1654484289.509 [CommandExec](IMPORTANT): Scheduling command #4 of 6 with id=2iyun 2022-06-06T02:58:09.510Z,1654484289.510 [CommandExec](IMPORTANT): Scheduled #17 (#4 of 6 with id='2iyun'): "set canon_esp_trianguloid.Lat7 34.39615 degree;set canon_esp_trianguloid.Lon7 -119.56696 degree;set canon_esp_trianguloid.Lat8 34.37603 degree;set canon_esp_trianguloid.Lon8 -119.53022 degree", ASAP 2022-06-06T02:58:10.577Z,1654484290.577 [DataOverHttps](IMPORTANT): SBD MOMSN=16859411, MTMSN=20220606T025757 2022-06-06T02:58:17.961Z,1654484297.961 [CommandExec](IMPORTANT): got command schedule asap "set canon_esp_trianguloid.YoYoMinDepth 2 m;set canon_esp_trianguloid.YoYoMaxDepth3 15 m;set canon_esp_trianguloid.YoYoMaxDepth4 15 m;set canon_esp_trianguloid.YoYoMaxDepth5 15 m;set canon_esp_trianguloid.YoYoMaxDepth6 15 m" 2iyun 5 6.000000 2022-06-06T02:58:17.961Z,1654484297.961 [CommandExec](IMPORTANT): Scheduling command #5 of 6 with id=2iyun 2022-06-06T02:58:17.962Z,1654484297.962 [CommandExec](IMPORTANT): Scheduled #18 (#5 of 6 with id='2iyun'): "set canon_esp_trianguloid.YoYoMinDepth 2 m;set canon_esp_trianguloid.YoYoMaxDepth3 15 m;set canon_esp_trianguloid.YoYoMaxDepth4 15 m;set canon_esp_trianguloid.YoYoMaxDepth5 15 m;set canon_esp_trianguloid.YoYoMaxDepth6 15 m", ASAP 2022-06-06T02:58:19.085Z,1654484299.085 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T025806 2022-06-06T02:58:26.492Z,1654484306.492 [CommandExec](IMPORTANT): got command schedule asap "set canon_esp_trianguloid.YoYoMaxDepth7 15 m;set canon_esp_trianguloid.YoYoMaxDepth8 15 m;set canon_esp_trianguloid.MaxDepth 25 m;set canon_esp_trianguloid.MinOffshore 1.5 km;run" 2iyun 6 6.000000 2022-06-06T02:58:26.492Z,1654484306.492 [CommandExec](IMPORTANT): Scheduling command #6 of 6 with id=2iyun 2022-06-06T02:58:26.493Z,1654484306.493 [CommandExec](IMPORTANT): Scheduled #19 (#6 of 6 with id='2iyun'): "set canon_esp_trianguloid.YoYoMaxDepth7 15 m;set canon_esp_trianguloid.YoYoMaxDepth8 15 m;set canon_esp_trianguloid.MaxDepth 25 m;set canon_esp_trianguloid.MinOffshore 1.5 km;run", ASAP 2022-06-06T02:58:26.640Z,1654484306.640 [CommandExec](IMPORTANT): got command load ./Missions/Science/canon_esp_trianguloid.xml 2022-06-06T02:58:32.758Z,1654484312.758 [CommandExec](IMPORTANT): Loaded ./Missions/Science/canon_esp_trianguloid.xml 2022-06-06T02:58:54.653Z,1654484334.653 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.FirstSampleTimeOffset 0.1 minute 2022-06-06T02:58:54.654Z,1654484334.654 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lat1 NaN degree 2022-06-06T02:58:54.655Z,1654484334.655 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lon1 NaN degree 2022-06-06T02:58:54.655Z,1654484334.655 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lat2 NaN degree 2022-06-06T02:59:12.088Z,1654484352.088 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lon2 NaN degree 2022-06-06T02:59:12.089Z,1654484352.089 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lat3 34.39784 degree 2022-06-06T02:59:12.094Z,1654484352.094 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lon3 -119.786 degree 2022-06-06T02:59:12.095Z,1654484352.095 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lat4 34.38085 degree 2022-06-06T02:59:12.095Z,1654484352.095 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lon4 -119.73398 degree 2022-06-06T02:59:28.053Z,1654484368.053 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lat5 34.37971 degree 2022-06-06T02:59:28.058Z,1654484368.058 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lon5 -119.70634 degree 2022-06-06T02:59:28.059Z,1654484368.059 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lat6 34.40181 degree 2022-06-06T02:59:28.060Z,1654484368.060 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lon6 -119.62944 degree 2022-06-06T02:59:44.814Z,1654484384.814 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lat7 34.39615 degree 2022-06-06T02:59:44.815Z,1654484384.815 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lon7 -119.56696 degree 2022-06-06T02:59:44.816Z,1654484384.816 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lat8 34.37603 degree 2022-06-06T02:59:44.816Z,1654484384.816 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lon8 -119.53022 degree 2022-06-06T03:00:12.837Z,1654484412.837 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.YoYoMinDepth 2 meter 2022-06-06T03:00:12.838Z,1654484412.838 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.YoYoMaxDepth3 15 meter 2022-06-06T03:00:12.851Z,1654484412.851 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.YoYoMaxDepth4 15 meter 2022-06-06T03:00:12.851Z,1654484412.851 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.YoYoMaxDepth5 15 meter 2022-06-06T03:00:12.852Z,1654484412.852 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.YoYoMaxDepth6 15 meter 2022-06-06T03:00:37.426Z,1654484437.426 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.YoYoMaxDepth7 15 meter 2022-06-06T03:00:37.426Z,1654484437.426 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.YoYoMaxDepth8 15 meter 2022-06-06T03:00:37.427Z,1654484437.427 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.MaxDepth 25 meter 2022-06-06T03:00:37.428Z,1654484437.428 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.MinOffshore 1.5 kilometer 2022-06-06T03:00:37.428Z,1654484437.428 [CommandExec](IMPORTANT): got command run 2022-06-06T03:00:37.432Z,1654484437.432 [CommandExec](IMPORTANT): Running 2022-06-06T03:00:37.577Z,1654484437.577 [MissionManager](IMPORTANT): Started mission canon_esp_trianguloid 2022-06-06T03:05:45.084Z,1654484745.084 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T03:05:54.399Z,1654484754.399 [canon_esp_trianguloid:Lap:SampleOnStart:A](IMPORTANT): Acquiring first sample. 2022-06-06T03:05:54.400Z,1654484754.400 [canon_esp_trianguloid:Lap:A](IMPORTANT): Starting Lap 2022-06-06T03:05:54.822Z,1654484754.822 [canon_esp_trianguloid:Lap:B](IMPORTANT): Lat[1] = nan arcdeg Lon[1] = nan arcdeg 2022-06-06T03:05:55.197Z,1654484755.197 [canon_esp_trianguloid:Lap:C](IMPORTANT): Lat[2] = nan arcdeg Lon[2] = nan arcdeg 2022-06-06T03:05:55.618Z,1654484755.618 [canon_esp_trianguloid:Lap:D](IMPORTANT): Lat[3] = 34.397839 arcdeg Lon[3] = -119.786003 arcdeg 2022-06-06T03:05:56.008Z,1654484756.008 [canon_esp_trianguloid:Lap:E](IMPORTANT): Lat[4] = 34.380852 arcdeg Lon[4] = -119.733978 arcdeg 2022-06-06T03:05:56.011Z,1654484756.011 [canon_esp_trianguloid:SampleTimer:AcquireSample:B](IMPORTANT): Pre-sample comms. Elapsed time since last water sample: 0.124430 h 2022-06-06T03:05:56.406Z,1654484756.406 [canon_esp_trianguloid:Lap:F](IMPORTANT): Lat[5] = 34.379711 arcdeg Lon[5] = -119.706337 arcdeg 2022-06-06T03:05:56.835Z,1654484756.835 [canon_esp_trianguloid:Lap:G](IMPORTANT): Lat[6] = 34.401810 arcdeg Lon[6] = -119.629440 arcdeg 2022-06-06T03:05:57.214Z,1654484757.214 [canon_esp_trianguloid:Lap:H](IMPORTANT): Lat[7] = 34.396149 arcdeg Lon[7] = -119.566963 arcdeg 2022-06-06T03:05:57.624Z,1654484757.624 [canon_esp_trianguloid:Lap:I](IMPORTANT): Lat[8] = 34.376030 arcdeg Lon[8] = -119.530220 arcdeg 2022-06-06T03:05:58.041Z,1654484758.041 [canon_esp_trianguloid:Lap:Wpt1:A](IMPORTANT): Navigating to box start WP. YoYoMaxDepth: 40.000000 m 2022-06-06T03:05:58.879Z,1654484758.879 [canon_esp_trianguloid:Lap:Wpt2:A](IMPORTANT): Navigating to WP2. YoYoMaxDepth: 50.000000 m 2022-06-06T03:05:59.684Z,1654484759.684 [canon_esp_trianguloid:Lap:Wpt3:A](IMPORTANT): Navigating to WP3. YoYoMaxDepth: 15.000000 m 2022-06-06T03:06:56.746Z,1654484816.746 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:SelectESPCartridge:A](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 2022-06-06T03:06:58.337Z,1654484818.337 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::|summary:' 2022-06-06T03:07:08.482Z,1654484828.482 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-06-06T03:07:08.769Z,1654484828.769 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-06-06T03:08:08.783Z,1654484888.783 [ESPComponent](IMPORTANT): ESP has connected as client 2022-06-06T03:08:09.671Z,1654484889.671 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -6 2022-06-06T03:08:09.672Z,1654484889.672 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-06-06T03:08:10.035Z,1654484890.035 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:C](IMPORTANT): ESP sampling at 15.669639 m in 14.463587 degC water with 0.870000 ug/l chlorophyll fluorescence. 2022-06-06T03:08:10.771Z,1654484890.771 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG 2022-06-06T03:08:11.195Z,1654484891.195 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-06-06T03:08:12.793Z,1654484892.793 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE 2022-06-06T03:08:47.137Z,1654484927.137 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PRIMING (@41,archive_bac) 2022-06-06T03:08:49.965Z,1654484929.965 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PRIMING (@100.0) 2022-06-06T03:08:49.967Z,1654484929.967 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-06-06T03:08:50.371Z,1654484930.371 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-06-06T03:11:06.521Z,1654485066.521 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_FILTERING (@0.0) 2022-06-06T03:11:06.946Z,1654485066.946 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-06-06T03:11:35.224Z,1654485095.224 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T03:57:16.034Z,1654487836.034 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PAUSED (@1000.0) 2022-06-06T03:57:16.495Z,1654487836.495 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PROCESSING (@1000.0) 2022-06-06T03:57:18.474Z,1654487838.474 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2022-06-06T03:57:18.863Z,1654487838.863 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PROCESSED (@41,archive_bac) 2022-06-06T04:09:22.444Z,1654488562.444 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING (@41,archive_bac) 2022-06-06T04:09:31.743Z,1654488571.743 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-06-06T04:09:32.160Z,1654488572.160 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED 2022-06-06T04:14:31.910Z,1654488871.910 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence completed normally. 2022-06-06T04:20:56.270Z,1654489256.270 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T04:27:10.002Z,1654489630.002 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T05:06:54.994Z,1654492014.994 [canon_esp_trianguloid:SampleTimer:AcquireSample:B](IMPORTANT): Pre-sample comms. Elapsed time since last water sample: 2.000075 h 2022-06-06T05:08:16.593Z,1654492096.593 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=7932, MT Status=1, MTMSN=635 2022-06-06T05:08:17.209Z,1654492097.209 [CommandExec](IMPORTANT): got command stop 2022-06-06T05:08:17.211Z,1654492097.211 [CommandExec](IMPORTANT): got command schedule clear 2022-06-06T05:08:17.211Z,1654492097.211 [CommandExec](IMPORTANT): Cleared 0 scheduled commands. 2022-06-06T05:08:17.855Z,1654492097.855 [MissionManager](IMPORTANT): Started mission Default 2022-06-06T05:16:10.327Z,1654492570.327 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 7.867809 min 2022-06-06T05:19:59.296Z,1654492799.296 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T051946 2022-06-06T05:20:07.014Z,1654492807.014 [CommandExec](IMPORTANT): got command schedule asap "load Science/canon_esp_trianguloid.xml;set canon_esp_trianguloid.FirstSampleTimeOffset 0.1 min;set canon_esp_trianguloid.Lat1 NaN degree;set canon_esp_trianguloid.Lon1 NaN degree;set canon_esp_trianguloid.Lat2 NaN degree" 2j5gh 1 6.000000 2022-06-06T05:20:07.015Z,1654492807.015 [CommandExec](IMPORTANT): Scheduling command #1 of 6 with id=2j5gh 2022-06-06T05:20:07.016Z,1654492807.016 [CommandExec](IMPORTANT): Scheduled #20 (#1 of 6 with id='2j5gh'): "load Science/canon_esp_trianguloid.xml;set canon_esp_trianguloid.FirstSampleTimeOffset 0.1 min;set canon_esp_trianguloid.Lat1 NaN degree;set canon_esp_trianguloid.Lon1 NaN degree;set canon_esp_trianguloid.Lat2 NaN degree", ASAP 2022-06-06T05:20:07.976Z,1654492807.976 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T051955 2022-06-06T05:20:15.570Z,1654492815.570 [CommandExec](IMPORTANT): got command schedule asap "set canon_esp_trianguloid.Lon2 NaN degree;set canon_esp_trianguloid.Lat3 34.39784 degree;set canon_esp_trianguloid.Lon3 -119.786 degree;set canon_esp_trianguloid.Lat4 34.38085 degree;set canon_esp_trianguloid.Lon4 -119.73398 degree" 2j5gh 2 6.000000 2022-06-06T05:20:15.571Z,1654492815.571 [CommandExec](IMPORTANT): Scheduling command #2 of 6 with id=2j5gh 2022-06-06T05:20:15.572Z,1654492815.572 [CommandExec](IMPORTANT): Scheduled #21 (#2 of 6 with id='2j5gh'): "set canon_esp_trianguloid.Lon2 NaN degree;set canon_esp_trianguloid.Lat3 34.39784 degree;set canon_esp_trianguloid.Lon3 -119.786 degree;set canon_esp_trianguloid.Lat4 34.38085 degree;set canon_esp_trianguloid.Lon4 -119.73398 degree", ASAP 2022-06-06T05:20:16.492Z,1654492816.492 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T052003 2022-06-06T05:20:24.111Z,1654492824.111 [CommandExec](IMPORTANT): got command schedule asap "set canon_esp_trianguloid.Lat5 34.37971 degree;set canon_esp_trianguloid.Lon5 -119.70634 degree;set canon_esp_trianguloid.Lat6 34.40181 degree;set canon_esp_trianguloid.Lon6 -119.62944 degree" 2j5gh 3 6.000000 2022-06-06T05:20:24.112Z,1654492824.112 [CommandExec](IMPORTANT): Scheduling command #3 of 6 with id=2j5gh 2022-06-06T05:20:24.113Z,1654492824.113 [CommandExec](IMPORTANT): Scheduled #22 (#3 of 6 with id='2j5gh'): "set canon_esp_trianguloid.Lat5 34.37971 degree;set canon_esp_trianguloid.Lon5 -119.70634 degree;set canon_esp_trianguloid.Lat6 34.40181 degree;set canon_esp_trianguloid.Lon6 -119.62944 degree", ASAP 2022-06-06T05:20:25.068Z,1654492825.068 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T052012 2022-06-06T05:20:35.239Z,1654492835.239 [CommandExec](IMPORTANT): got command schedule asap "set canon_esp_trianguloid.Lat7 34.39615 degree;set canon_esp_trianguloid.Lon7 -119.56696 degree;set canon_esp_trianguloid.Lat8 34.37603 degree;set canon_esp_trianguloid.Lon8 -119.53022 degree" 2j5gh 4 6.000000 2022-06-06T05:20:35.240Z,1654492835.240 [CommandExec](IMPORTANT): Scheduling command #4 of 6 with id=2j5gh 2022-06-06T05:20:35.241Z,1654492835.241 [CommandExec](IMPORTANT): Scheduled #23 (#4 of 6 with id='2j5gh'): "set canon_esp_trianguloid.Lat7 34.39615 degree;set canon_esp_trianguloid.Lon7 -119.56696 degree;set canon_esp_trianguloid.Lat8 34.37603 degree;set canon_esp_trianguloid.Lon8 -119.53022 degree", ASAP 2022-06-06T05:20:36.153Z,1654492836.153 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T052023 2022-06-06T05:20:44.739Z,1654492844.739 [CommandExec](IMPORTANT): got command schedule asap "set canon_esp_trianguloid.YoYoMinDepth 2 m;set canon_esp_trianguloid.YoYoMaxDepth3 15 m;set canon_esp_trianguloid.YoYoMaxDepth4 15 m;set canon_esp_trianguloid.YoYoMaxDepth5 15 m;set canon_esp_trianguloid.YoYoMaxDepth6 15 m" 2j5gh 5 6.000000 2022-06-06T05:20:44.739Z,1654492844.739 [CommandExec](IMPORTANT): Scheduling command #5 of 6 with id=2j5gh 2022-06-06T05:20:44.740Z,1654492844.740 [CommandExec](IMPORTANT): Scheduled #24 (#5 of 6 with id='2j5gh'): "set canon_esp_trianguloid.YoYoMinDepth 2 m;set canon_esp_trianguloid.YoYoMaxDepth3 15 m;set canon_esp_trianguloid.YoYoMaxDepth4 15 m;set canon_esp_trianguloid.YoYoMaxDepth5 15 m;set canon_esp_trianguloid.YoYoMaxDepth6 15 m", ASAP 2022-06-06T05:20:45.716Z,1654492845.716 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T052033 2022-06-06T05:21:00.595Z,1654492860.595 [CommandExec](IMPORTANT): got command schedule asap "set canon_esp_trianguloid.YoYoMaxDepth7 15 m;set canon_esp_trianguloid.YoYoMaxDepth8 15 m;set canon_esp_trianguloid.MaxDepth 25 m;set canon_esp_trianguloid.MinOffshore 1.5 km;run" 2j5gh 6 6.000000 2022-06-06T05:21:00.595Z,1654492860.595 [CommandExec](IMPORTANT): Scheduling command #6 of 6 with id=2j5gh 2022-06-06T05:21:00.596Z,1654492860.596 [CommandExec](IMPORTANT): Scheduled #25 (#6 of 6 with id='2j5gh'): "set canon_esp_trianguloid.YoYoMaxDepth7 15 m;set canon_esp_trianguloid.YoYoMaxDepth8 15 m;set canon_esp_trianguloid.MaxDepth 25 m;set canon_esp_trianguloid.MinOffshore 1.5 km;run", ASAP 2022-06-06T05:21:00.728Z,1654492860.728 [CommandExec](IMPORTANT): got command load ./Missions/Science/canon_esp_trianguloid.xml 2022-06-06T05:21:03.735Z,1654492863.735 [CommandExec](IMPORTANT): Loaded ./Missions/Science/canon_esp_trianguloid.xml 2022-06-06T05:21:14.200Z,1654492874.200 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T05:21:15.752Z,1654492875.752 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.FirstSampleTimeOffset 0.1 minute 2022-06-06T05:21:15.752Z,1654492875.752 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lat1 NaN degree 2022-06-06T05:21:15.753Z,1654492875.753 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lon1 NaN degree 2022-06-06T05:21:15.754Z,1654492875.754 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lat2 NaN degree 2022-06-06T05:21:32.200Z,1654492892.200 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lon2 NaN degree 2022-06-06T05:21:32.201Z,1654492892.201 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lat3 34.39784 degree 2022-06-06T05:21:32.201Z,1654492892.201 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lon3 -119.786 degree 2022-06-06T05:21:32.202Z,1654492892.202 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lat4 34.38085 degree 2022-06-06T05:21:32.203Z,1654492892.203 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lon4 -119.73398 degree 2022-06-06T05:21:42.520Z,1654492902.520 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lat5 34.37971 degree 2022-06-06T05:21:42.521Z,1654492902.521 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lon5 -119.70634 degree 2022-06-06T05:21:42.542Z,1654492902.542 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lat6 34.40181 degree 2022-06-06T05:21:42.543Z,1654492902.543 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lon6 -119.62944 degree 2022-06-06T05:21:46.151Z,1654492906.151 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 13.464861 min 2022-06-06T05:21:56.040Z,1654492916.040 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lat7 34.39615 degree 2022-06-06T05:21:56.041Z,1654492916.041 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lon7 -119.56696 degree 2022-06-06T05:21:56.041Z,1654492916.041 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lat8 34.37603 degree 2022-06-06T05:21:56.047Z,1654492916.047 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.Lon8 -119.53022 degree 2022-06-06T05:22:21.783Z,1654492941.783 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.YoYoMinDepth 2 meter 2022-06-06T05:22:21.784Z,1654492941.784 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.YoYoMaxDepth3 15 meter 2022-06-06T05:22:21.785Z,1654492941.785 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.YoYoMaxDepth4 15 meter 2022-06-06T05:22:21.790Z,1654492941.790 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.YoYoMaxDepth5 15 meter 2022-06-06T05:22:21.791Z,1654492941.791 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.YoYoMaxDepth6 15 meter 2022-06-06T05:22:52.252Z,1654492972.252 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.YoYoMaxDepth7 15 meter 2022-06-06T05:22:52.252Z,1654492972.252 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.YoYoMaxDepth8 15 meter 2022-06-06T05:22:52.253Z,1654492972.253 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.MaxDepth 25 meter 2022-06-06T05:22:52.254Z,1654492972.254 [CommandExec](IMPORTANT): got command set canon_esp_trianguloid.MinOffshore 1.5 kilometer 2022-06-06T05:22:52.254Z,1654492972.254 [CommandExec](IMPORTANT): got command run 2022-06-06T05:22:52.257Z,1654492972.257 [CommandExec](IMPORTANT): Running 2022-06-06T05:22:52.543Z,1654492972.543 [MissionManager](IMPORTANT): Started mission canon_esp_trianguloid 2022-06-06T05:26:05.669Z,1654493165.669 [canon_esp_trianguloid:Lap:SampleOnStart:A](IMPORTANT): Acquiring first sample. 2022-06-06T05:26:05.669Z,1654493165.669 [canon_esp_trianguloid:Lap:A](IMPORTANT): Starting Lap 2022-06-06T05:26:06.097Z,1654493166.097 [canon_esp_trianguloid:Lap:B](IMPORTANT): Lat[1] = nan arcdeg Lon[1] = nan arcdeg 2022-06-06T05:26:06.499Z,1654493166.499 [canon_esp_trianguloid:Lap:C](IMPORTANT): Lat[2] = nan arcdeg Lon[2] = nan arcdeg 2022-06-06T05:26:06.887Z,1654493166.887 [canon_esp_trianguloid:Lap:D](IMPORTANT): Lat[3] = 34.397839 arcdeg Lon[3] = -119.786003 arcdeg 2022-06-06T05:26:07.274Z,1654493167.274 [canon_esp_trianguloid:Lap:E](IMPORTANT): Lat[4] = 34.380852 arcdeg Lon[4] = -119.733978 arcdeg 2022-06-06T05:26:07.278Z,1654493167.278 [canon_esp_trianguloid:SampleTimer:AcquireSample:B](IMPORTANT): Pre-sample comms. Elapsed time since last water sample: 0.084846 h 2022-06-06T05:26:07.669Z,1654493167.669 [canon_esp_trianguloid:Lap:F](IMPORTANT): Lat[5] = 34.379711 arcdeg Lon[5] = -119.706337 arcdeg 2022-06-06T05:26:08.086Z,1654493168.086 [canon_esp_trianguloid:Lap:G](IMPORTANT): Lat[6] = 34.401810 arcdeg Lon[6] = -119.629440 arcdeg 2022-06-06T05:26:08.494Z,1654493168.494 [canon_esp_trianguloid:Lap:H](IMPORTANT): Lat[7] = 34.396149 arcdeg Lon[7] = -119.566963 arcdeg 2022-06-06T05:26:08.912Z,1654493168.912 [canon_esp_trianguloid:Lap:I](IMPORTANT): Lat[8] = 34.376030 arcdeg Lon[8] = -119.530220 arcdeg 2022-06-06T05:26:09.288Z,1654493169.288 [canon_esp_trianguloid:Lap:Wpt1:A](IMPORTANT): Navigating to box start WP. YoYoMaxDepth: 40.000000 m 2022-06-06T05:26:10.528Z,1654493170.528 [canon_esp_trianguloid:Lap:Wpt2:A](IMPORTANT): Navigating to WP2. YoYoMaxDepth: 50.000000 m 2022-06-06T05:27:14.646Z,1654493234.646 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:SelectESPCartridge:A](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 2022-06-06T05:27:26.442Z,1654493246.442 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-06-06T05:27:26.571Z,1654493246.571 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-06-06T05:28:26.916Z,1654493306.916 [ESPComponent](IMPORTANT): ESP has connected as client 2022-06-06T05:28:27.761Z,1654493307.761 [ESPComponent](IMPORTANT): [sample #2] Setting cartridge argument to -6 2022-06-06T05:28:27.761Z,1654493307.761 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-06-06T05:28:28.160Z,1654493308.160 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:C](IMPORTANT): ESP sampling at 18.097107 m in 14.319788 degC water with 0.603200 ug/l chlorophyll fluorescence. 2022-06-06T05:28:28.524Z,1654493308.524 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_LOG 2022-06-06T05:28:28.947Z,1654493308.947 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-06-06T05:28:30.954Z,1654493310.954 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_LOADING_CARTRIDGE 2022-06-06T05:29:05.289Z,1654493345.289 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PRIMING (@40,archive_bac) 2022-06-06T05:29:08.125Z,1654493348.125 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PRIMING (@100.0) 2022-06-06T05:29:08.130Z,1654493348.130 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-06-06T05:29:08.521Z,1654493348.521 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-06-06T05:29:08.536Z,1654493348.536 [canon_esp_trianguloid:Lap:Wpt3:A](IMPORTANT): Navigating to WP3. YoYoMaxDepth: 15.000000 m 2022-06-06T05:31:31.946Z,1654493491.946 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_FILTERING (@0.0) 2022-06-06T05:31:32.379Z,1654493492.379 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-06-06T05:31:48.940Z,1654493508.940 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T06:14:40.425Z,1654496080.425 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PAUSED (@1000.0) 2022-06-06T06:14:40.822Z,1654496080.822 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PROCESSING (@1000.0) 2022-06-06T06:14:42.849Z,1654496082.849 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2022-06-06T06:14:43.253Z,1654496083.253 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PROCESSED (@40,archive_bac) 2022-06-06T06:26:46.820Z,1654496806.820 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPING (@40,archive_bac) 2022-06-06T06:26:56.139Z,1654496816.139 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-06-06T06:26:56.521Z,1654496816.521 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPED 2022-06-06T06:31:56.311Z,1654497116.311 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence completed normally. 2022-06-06T06:37:57.980Z,1654497477.980 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T06:43:48.013Z,1654497828.013 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T06:56:42.513Z,1654498602.513 [canon_esp_trianguloid:Lap:Wpt3:C.Waypoint](IMPORTANT): Reached Waypoint: 34.397839,-119.786003 2022-06-06T06:56:42.902Z,1654498602.902 [canon_esp_trianguloid:Lap:Wpt4:A](IMPORTANT): Navigating to WP4. YoYoMaxDepth: 15.000000 m 2022-06-06T07:27:12.655Z,1654500432.655 [canon_esp_trianguloid:SampleTimer:AcquireSample:B](IMPORTANT): Pre-sample comms. Elapsed time since last water sample: 2.000017 h 2022-06-06T07:32:58.384Z,1654500778.384 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:SelectESPCartridge:A](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 2022-06-06T07:33:10.203Z,1654500790.203 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-06-06T07:33:10.335Z,1654500790.335 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-06-06T07:34:10.725Z,1654500850.725 [ESPComponent](IMPORTANT): ESP has connected as client 2022-06-06T07:34:11.544Z,1654500851.544 [ESPComponent](IMPORTANT): [sample #3] Setting cartridge argument to -6 2022-06-06T07:34:11.544Z,1654500851.544 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-06-06T07:34:11.963Z,1654500851.963 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:C](IMPORTANT): ESP sampling at 10.741962 m in 16.330408 degC water with 0.730800 ug/l chlorophyll fluorescence. 2022-06-06T07:34:12.343Z,1654500852.343 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_LOG 2022-06-06T07:34:12.749Z,1654500852.749 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-06-06T07:34:14.766Z,1654500854.766 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_LOADING_CARTRIDGE 2022-06-06T07:34:49.116Z,1654500889.116 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PRIMING (@39,archive_bac) 2022-06-06T07:34:51.530Z,1654500891.530 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PRIMING (@100.0) 2022-06-06T07:34:51.531Z,1654500891.531 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-06-06T07:34:51.934Z,1654500891.934 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-06-06T07:37:10.125Z,1654501030.125 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_FILTERING (@0.0) 2022-06-06T07:37:10.507Z,1654501030.507 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-06-06T07:59:07.588Z,1654502347.588 [canon_esp_trianguloid:StandardEnvelopes:C.OffshoreEnvelope](IMPORTANT): ACTIVE 2022-06-06T08:07:02.683Z,1654502822.683 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PAUSED (@561.6) 2022-06-06T08:07:03.092Z,1654502823.092 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PROCESSING (@561.6) 2022-06-06T08:07:05.109Z,1654502825.109 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2022-06-06T08:07:05.510Z,1654502825.510 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PROCESSED (@39,archive_bac) 2022-06-06T08:19:09.100Z,1654503549.100 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPING (@39,archive_bac) 2022-06-06T08:19:18.383Z,1654503558.383 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-06-06T08:19:18.790Z,1654503558.790 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPED 2022-06-06T08:24:18.592Z,1654503858.592 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence completed normally. 2022-06-06T08:30:19.984Z,1654504219.984 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T08:33:51.112Z,1654504431.112 [canon_esp_trianguloid:StandardEnvelopes:C.OffshoreEnvelope](IMPORTANT): ACTIVE 2022-06-06T08:36:11.316Z,1654504571.316 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T08:52:55.421Z,1654505575.421 [CBIT](IMPORTANT): Beginning ground fault scan 2022-06-06T08:53:06.721Z,1654505586.721 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.003060 CHAN A1 (24V): -0.001393 CHAN A2 (12V): -0.000922 CHAN A3 (5V): -0.000063 CHAN B0 (3.3V): 0.000799 CHAN B1 (3.15aV): 0.000236 CHAN B2 (3.15bV): 0.000172 CHAN B3 (GND): 0.000311 OPEN: 0.007442 Full Scale: +/- 1 mA 2022-06-06T09:03:51.372Z,1654506231.372 [canon_esp_trianguloid:StandardEnvelopes:C.OffshoreEnvelope](IMPORTANT): ACTIVE 2022-06-06T09:16:11.484Z,1654506971.484 [DVL_micro](FAULT): Failed to initialize within timeout. 2022-06-06T09:32:56.385Z,1654507976.385 [canon_esp_trianguloid:SampleTimer:AcquireSample:B](IMPORTANT): Pre-sample comms. Elapsed time since last water sample: 2.000004 h 2022-06-06T09:37:19.618Z,1654508239.618 [RudderServo](FAULT): Rudder uart error - getPosition..serial timeout 2022-06-06T09:38:04.597Z,1654508284.597 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:SelectESPCartridge:A](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 2022-06-06T09:38:16.398Z,1654508296.398 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-06-06T09:38:16.541Z,1654508296.541 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-06-06T09:39:16.564Z,1654508356.564 [ESPComponent](IMPORTANT): ESP has connected as client 2022-06-06T09:39:17.374Z,1654508357.374 [ESPComponent](IMPORTANT): [sample #4] Setting cartridge argument to -6 2022-06-06T09:39:17.374Z,1654508357.374 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-06-06T09:39:17.813Z,1654508357.813 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:C](IMPORTANT): ESP sampling at 12.274750 m in 14.825403 degC water with 1.832800 ug/l chlorophyll fluorescence. 2022-06-06T09:39:18.179Z,1654508358.179 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_LOG 2022-06-06T09:39:18.582Z,1654508358.582 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-06-06T09:39:20.598Z,1654508360.598 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_LOADING_CARTRIDGE 2022-06-06T09:39:54.941Z,1654508394.941 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PRIMING (@38,archive_bac) 2022-06-06T09:39:57.390Z,1654508397.390 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PRIMING (@100.0) 2022-06-06T09:39:57.391Z,1654508397.391 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-06-06T09:39:57.767Z,1654508397.767 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-06-06T09:42:15.148Z,1654508535.148 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_FILTERING (@0.0) 2022-06-06T09:42:15.545Z,1654508535.545 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-06-06T09:59:43.560Z,1654509583.560 [canon_esp_trianguloid:Lap:Wpt4:C.Waypoint](IMPORTANT): Reached Waypoint: 34.380852,-119.733978 2022-06-06T09:59:43.957Z,1654509583.957 [canon_esp_trianguloid:Lap:Wpt5:A](IMPORTANT): Navigating to WP5. YoYoMaxDepth: 15.000000 m 2022-06-06T10:19:20.810Z,1654510760.810 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PAUSED (@672.5) 2022-06-06T10:19:21.225Z,1654510761.225 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PROCESSING (@672.5) 2022-06-06T10:19:23.238Z,1654510763.238 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2022-06-06T10:19:23.683Z,1654510763.683 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PROCESSED (@38,archive_bac) 2022-06-06T10:31:27.242Z,1654511487.242 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPING (@38,archive_bac) 2022-06-06T10:31:36.535Z,1654511496.535 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-06-06T10:31:36.930Z,1654511496.930 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPED 2022-06-06T10:36:36.701Z,1654511796.701 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence completed normally. 2022-06-06T10:42:03.244Z,1654512123.244 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T10:47:51.068Z,1654512471.068 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T11:35:20.179Z,1654515320.179 [canon_esp_trianguloid:Lap:Wpt5:C.Waypoint](IMPORTANT): Reached Waypoint: 34.379711,-119.706337 2022-06-06T11:35:20.556Z,1654515320.556 [canon_esp_trianguloid:Lap:Wpt6:A](IMPORTANT): Navigating to WP6. YoYoMaxDepth: 15.000000 m 2022-06-06T11:38:02.965Z,1654515482.965 [canon_esp_trianguloid:SampleTimer:AcquireSample:B](IMPORTANT): Pre-sample comms. Elapsed time since last water sample: 2.000104 h 2022-06-06T11:43:49.224Z,1654515829.224 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T11:45:10.515Z,1654515910.515 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:SelectESPCartridge:A](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 2022-06-06T11:45:22.310Z,1654515922.310 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-06-06T11:45:22.435Z,1654515922.435 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-06-06T11:46:23.227Z,1654515983.227 [ESPComponent](IMPORTANT): ESP has connected as client 2022-06-06T11:46:24.039Z,1654515984.039 [ESPComponent](IMPORTANT): [sample #5] Setting cartridge argument to -6 2022-06-06T11:46:24.040Z,1654515984.040 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-06-06T11:46:24.481Z,1654515984.481 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:C](IMPORTANT): ESP sampling at 11.301748 m in 14.365290 degC water with 1.740000 ug/l chlorophyll fluorescence. 2022-06-06T11:46:24.822Z,1654515984.822 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_LOG 2022-06-06T11:46:25.234Z,1654515985.234 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-06-06T11:46:27.259Z,1654515987.259 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_LOADING_CARTRIDGE 2022-06-06T11:47:01.600Z,1654516021.600 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PRIMING (@37,archive_bac) 2022-06-06T11:47:04.031Z,1654516024.031 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PRIMING (@100.0) 2022-06-06T11:47:04.032Z,1654516024.032 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-06-06T11:47:04.443Z,1654516024.443 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-06-06T11:49:22.583Z,1654516162.583 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_FILTERING (@0.0) 2022-06-06T11:49:22.993Z,1654516162.993 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-06-06T11:49:34.319Z,1654516174.319 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T12:16:00.946Z,1654517760.946 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PAUSED (@464.8) 2022-06-06T12:16:01.354Z,1654517761.354 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PROCESSING (@464.8) 2022-06-06T12:16:03.382Z,1654517763.382 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2022-06-06T12:16:03.778Z,1654517763.778 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PROCESSED (@37,archive_bac) 2022-06-06T12:28:07.347Z,1654518487.347 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPING (@37,archive_bac) 2022-06-06T12:28:16.647Z,1654518496.647 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-06-06T12:28:17.045Z,1654518497.045 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPED 2022-06-06T12:33:16.853Z,1654518796.853 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence completed normally. 2022-06-06T12:39:24.225Z,1654519164.225 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T13:45:08.608Z,1654523108.608 [canon_esp_trianguloid:SampleTimer:AcquireSample:B](IMPORTANT): Pre-sample comms. Elapsed time since last water sample: 2.000034 h 2022-06-06T13:51:42.182Z,1654523502.182 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:SelectESPCartridge:A](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 2022-06-06T13:51:53.975Z,1654523513.975 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-06-06T13:51:54.111Z,1654523514.111 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-06-06T13:52:54.958Z,1654523574.958 [ESPComponent](IMPORTANT): ESP has connected as client 2022-06-06T13:52:55.753Z,1654523575.753 [ESPComponent](IMPORTANT): [sample #6] Setting cartridge argument to -6 2022-06-06T13:52:55.754Z,1654523575.754 [ESPComponent](IMPORTANT): [sample #6] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-06-06T13:52:56.183Z,1654523576.183 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:C](IMPORTANT): ESP sampling at 13.557663 m in 14.928003 degC water with 3.190000 ug/l chlorophyll fluorescence. 2022-06-06T13:52:56.565Z,1654523576.565 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PREPARING_SHOW_LOG 2022-06-06T13:52:57.007Z,1654523577.007 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-06-06T13:52:58.993Z,1654523578.993 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_LOADING_CARTRIDGE 2022-06-06T13:53:33.329Z,1654523613.329 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PRIMING (@36,archive_bac) 2022-06-06T13:53:36.160Z,1654523616.160 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PRIMING (@100.0) 2022-06-06T13:53:36.161Z,1654523616.161 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-06-06T13:53:36.560Z,1654523616.560 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-06-06T13:55:53.113Z,1654523753.113 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_FILTERING (@0.0) 2022-06-06T13:55:53.517Z,1654523753.517 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-06-06T14:01:27.773Z,1654524087.773 [ThrusterHE](FAULT): Could not get status:serial timeout 2022-06-06T14:32:50.694Z,1654525970.694 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PAUSED (@669.1) 2022-06-06T14:32:51.118Z,1654525971.118 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PROCESSING (@669.1) 2022-06-06T14:32:53.169Z,1654525973.169 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2022-06-06T14:32:53.527Z,1654525973.527 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PROCESSED (@36,archive_bac) 2022-06-06T14:44:57.109Z,1654526697.109 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_STOPPING (@36,archive_bac) 2022-06-06T14:45:06.397Z,1654526706.397 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-06-06T14:45:06.805Z,1654526706.805 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_STOPPED 2022-06-06T14:50:06.582Z,1654527006.582 [ESPComponent](IMPORTANT): [sample #6] ESP sampling sequence completed normally. 2022-06-06T14:51:32.715Z,1654527092.715 [RudderServo](FAULT): Reading outside of valid range:0.000000 2022-06-06T14:51:33.410Z,1654527093.410 [RudderServo](FAULT): Rudder uart error - getPosition..serial timeout 2022-06-06T14:53:06.830Z,1654527186.830 [CBIT](IMPORTANT): Beginning ground fault scan 2022-06-06T14:53:17.744Z,1654527197.744 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.004463 CHAN A1 (24V): -0.001480 CHAN A2 (12V): -0.000564 CHAN A3 (5V): -0.000048 CHAN B0 (3.3V): 0.000362 CHAN B1 (3.15aV): 0.000026 CHAN B2 (3.15bV): -0.000677 CHAN B3 (GND): 0.000219 OPEN: 0.007866 Full Scale: +/- 1 mA 2022-06-06T15:27:21.512Z,1654529241.512 [canon_esp_trianguloid:Lap:Wpt6:C.Waypoint](IMPORTANT): Reached Waypoint: 34.401810,-119.629440 2022-06-06T15:27:21.927Z,1654529241.927 [canon_esp_trianguloid:Lap:Wpt7:A](IMPORTANT): Navigating to WP7. YoYoMaxDepth: 15.000000 m 2022-06-06T15:51:40.403Z,1654530700.403 [canon_esp_trianguloid:SampleTimer:AcquireSample:B](IMPORTANT): Pre-sample comms. Elapsed time since last water sample: 2.000067 h 2022-06-06T15:58:30.773Z,1654531110.773 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:SelectESPCartridge:A](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 2022-06-06T15:58:42.583Z,1654531122.583 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-06-06T15:58:42.719Z,1654531122.719 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-06-06T15:59:42.740Z,1654531182.740 [ESPComponent](IMPORTANT): ESP has connected as client 2022-06-06T15:59:43.553Z,1654531183.553 [ESPComponent](IMPORTANT): [sample #7] Setting cartridge argument to -6 2022-06-06T15:59:43.570Z,1654531183.570 [ESPComponent](IMPORTANT): [sample #7] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-06-06T15:59:43.964Z,1654531183.964 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:C](IMPORTANT): ESP sampling at 12.623990 m in 16.443201 degC water with 2.111200 ug/l chlorophyll fluorescence. 2022-06-06T15:59:44.352Z,1654531184.352 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PREPARING_SHOW_LOG 2022-06-06T15:59:44.761Z,1654531184.761 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-06-06T15:59:46.774Z,1654531186.774 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_LOADING_CARTRIDGE 2022-06-06T16:00:21.119Z,1654531221.119 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PRIMING (@35,archive_bac) 2022-06-06T16:00:23.953Z,1654531223.953 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PRIMING (@100.0) 2022-06-06T16:00:23.954Z,1654531223.954 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-06-06T16:00:24.356Z,1654531224.356 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-06-06T16:02:40.911Z,1654531360.911 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_FILTERING (@0.0) 2022-06-06T16:02:41.322Z,1654531361.322 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-06-06T16:25:05.929Z,1654532705.929 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PAUSED (@399.9) 2022-06-06T16:25:06.348Z,1654532706.348 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PROCESSING (@399.9) 2022-06-06T16:25:08.361Z,1654532708.361 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2022-06-06T16:25:08.756Z,1654532708.756 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PROCESSED (@35,archive_bac) 2022-06-06T16:37:12.329Z,1654533432.329 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_STOPPING (@35,archive_bac) 2022-06-06T16:37:21.615Z,1654533441.615 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-06-06T16:37:22.022Z,1654533442.022 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_STOPPED 2022-06-06T16:42:21.793Z,1654533741.793 [ESPComponent](IMPORTANT): [sample #7] ESP sampling sequence completed normally. 2022-06-06T17:55:58.783Z,1654538158.783 [canon_esp_trianguloid:StandardEnvelopes:C.OffshoreEnvelope](IMPORTANT): ACTIVE 2022-06-06T17:58:29.066Z,1654538309.066 [canon_esp_trianguloid:SampleTimer:AcquireSample:B](IMPORTANT): Pre-sample comms. Elapsed time since last water sample: 2.000084 h 2022-06-06T18:00:16.523Z,1654538416.523 [canon_esp_trianguloid:Lap:Wpt7:C.Waypoint](IMPORTANT): Reached Waypoint: 34.396149,-119.566963 2022-06-06T18:00:16.930Z,1654538416.930 [canon_esp_trianguloid:Lap:Wpt8:A](IMPORTANT): Navigating to WP8. YoYoMaxDepth: 15.000000 m 2022-06-06T18:03:25.060Z,1654538605.060 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:SelectESPCartridge:A](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 2022-06-06T18:03:36.854Z,1654538616.854 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-06-06T18:03:37.011Z,1654538617.011 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-06-06T18:04:36.561Z,1654538676.561 [ESPComponent](IMPORTANT): ESP has connected as client 2022-06-06T18:04:37.382Z,1654538677.382 [ESPComponent](IMPORTANT): [sample #8] Setting cartridge argument to -6 2022-06-06T18:04:37.382Z,1654538677.382 [ESPComponent](IMPORTANT): [sample #8] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-06-06T18:04:37.829Z,1654538677.829 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:C](IMPORTANT): ESP sampling at 5.942997 m in 17.143213 degC water with 2.285200 ug/l chlorophyll fluorescence. 2022-06-06T18:04:38.184Z,1654538678.184 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PREPARING_SHOW_LOG 2022-06-06T18:04:38.596Z,1654538678.596 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-06-06T18:04:40.612Z,1654538680.612 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_LOADING_CARTRIDGE 2022-06-06T18:05:14.949Z,1654538714.949 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PRIMING (@34,archive_bac) 2022-06-06T18:05:17.793Z,1654538717.793 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PRIMING (@100.0) 2022-06-06T18:05:17.794Z,1654538717.794 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-06-06T18:05:18.187Z,1654538718.187 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-06-06T18:07:36.358Z,1654538856.358 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_FILTERING (@0.0) 2022-06-06T18:07:36.762Z,1654538856.762 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-06-06T18:26:09.404Z,1654539969.404 [canon_esp_trianguloid:StandardEnvelopes:C.OffshoreEnvelope](IMPORTANT): ACTIVE 2022-06-06T18:26:18.681Z,1654539978.681 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PAUSED (@335.8) 2022-06-06T18:26:19.084Z,1654539979.084 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PROCESSING (@335.8) 2022-06-06T18:26:21.105Z,1654539981.105 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2022-06-06T18:26:21.509Z,1654539981.509 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PROCESSED (@34,archive_bac) 2022-06-06T18:38:25.079Z,1654540705.079 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_STOPPING (@34,archive_bac) 2022-06-06T18:38:34.371Z,1654540714.371 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-06-06T18:38:34.781Z,1654540714.781 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_STOPPED 2022-06-06T18:43:34.557Z,1654541014.557 [ESPComponent](IMPORTANT): [sample #8] ESP sampling sequence completed normally. 2022-06-06T18:49:07.118Z,1654541347.118 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T18:56:09.564Z,1654541769.564 [canon_esp_trianguloid:StandardEnvelopes:C.OffshoreEnvelope](IMPORTANT): ACTIVE 2022-06-06T19:43:31.738Z,1654544611.738 [canon_esp_trianguloid:StandardEnvelopes:C.OffshoreEnvelope](IMPORTANT): ACTIVE 2022-06-06T19:53:59.955Z,1654545239.955 [canon_esp_trianguloid:Lap:Wpt8:C.Waypoint](IMPORTANT): Reached Waypoint: 34.376030,-119.530220 2022-06-06T19:54:00.763Z,1654545240.763 [MissionManager](IMPORTANT): Started mission Default 2022-06-06T19:59:19.112Z,1654545559.112 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T20:04:45.668Z,1654545885.668 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 10.741683 min 2022-06-06T20:04:47.280Z,1654545887.280 [NAL9602](FAULT): GPS failed to acquire within timeout. 2022-06-06T20:13:44.640Z,1654546424.640 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T201331 2022-06-06T20:13:52.143Z,1654546432.143 [CommandExec](IMPORTANT): got command schedule asap "load Science/sci2.xml;set sci2.MissionTimeout 6 h;set sci2.Lat1 34.396 degree;set sci2.Lon1 -119.567 degree;set sci2.Lat2 34.405 degree;set sci2.Lon2 -119.618 degree;set sci2.YoYoMaxDepth 10 m;set sci2.MaxDepth 60 m" 2kau8 1 2.000000 2022-06-06T20:13:52.143Z,1654546432.143 [CommandExec](IMPORTANT): Scheduling command #1 of 2 with id=2kau8 2022-06-06T20:13:52.144Z,1654546432.144 [CommandExec](IMPORTANT): Scheduled #26 (#1 of 2 with id='2kau8'): "load Science/sci2.xml;set sci2.MissionTimeout 6 h;set sci2.Lat1 34.396 degree;set sci2.Lon1 -119.567 degree;set sci2.Lat2 34.405 degree;set sci2.Lon2 -119.618 degree;set sci2.YoYoMaxDepth 10 m;set sci2.MaxDepth 60 m", ASAP 2022-06-06T20:13:53.112Z,1654546433.112 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T201340 2022-06-06T20:14:00.589Z,1654546440.589 [CommandExec](IMPORTANT): got command schedule asap "set sci2.MinOffshore 1.2 km;run" 2kau8 2 2.000000 2022-06-06T20:14:00.590Z,1654546440.590 [CommandExec](IMPORTANT): Scheduling command #2 of 2 with id=2kau8 2022-06-06T20:14:00.591Z,1654546440.591 [CommandExec](IMPORTANT): Scheduled #27 (#2 of 2 with id='2kau8'): "set sci2.MinOffshore 1.2 km;run", ASAP 2022-06-06T20:14:00.708Z,1654546440.708 [CommandExec](IMPORTANT): got command load ./Missions/Science/sci2.xml 2022-06-06T20:14:02.620Z,1654546442.620 [CommandExec](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2022-06-06T20:14:17.782Z,1654546457.782 [CommandExec](IMPORTANT): got command set sci2.MissionTimeout 6 hour 2022-06-06T20:14:17.783Z,1654546457.783 [CommandExec](IMPORTANT): got command set sci2.Lat1 34.396 degree 2022-06-06T20:14:17.784Z,1654546457.784 [CommandExec](IMPORTANT): got command set sci2.Lon1 -119.567 degree 2022-06-06T20:14:17.784Z,1654546457.784 [CommandExec](IMPORTANT): got command set sci2.Lat2 34.405 degree 2022-06-06T20:14:17.785Z,1654546457.785 [CommandExec](IMPORTANT): got command set sci2.Lon2 -119.618 degree 2022-06-06T20:14:17.814Z,1654546457.814 [CommandExec](IMPORTANT): got command set sci2.YoYoMaxDepth 10 meter 2022-06-06T20:14:17.815Z,1654546457.815 [CommandExec](IMPORTANT): got command set sci2.MaxDepth 60 meter 2022-06-06T20:14:20.884Z,1654546460.884 [CommandExec](IMPORTANT): got command set sci2.MinOffshore 1.2 kilometer 2022-06-06T20:14:20.885Z,1654546460.885 [CommandExec](IMPORTANT): got command run 2022-06-06T20:14:20.936Z,1654546460.936 [CommandExec](IMPORTANT): Running 2022-06-06T20:14:20.948Z,1654546460.948 [MissionManager](IMPORTANT): Started mission sci2 2022-06-06T20:44:26.146Z,1654548266.146 [ElevatorServo](FAULT): Elevator uart error - getPosition.serial timeout 2022-06-06T20:53:18.054Z,1654548798.054 [CBIT](IMPORTANT): Beginning ground fault scan 2022-06-06T20:53:28.953Z,1654548808.953 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.004351 CHAN A1 (24V): -0.001539 CHAN A2 (12V): -0.001066 CHAN A3 (5V): -0.000640 CHAN B0 (3.3V): -0.000032 CHAN B1 (3.15aV): -0.000152 CHAN B2 (3.15bV): 0.004000 CHAN B3 (GND): 0.000959 OPEN: 0.007881 Full Scale: +/- 1 mA 2022-06-06T21:05:10.782Z,1654549510.782 [Radio_Surface](FAULT): LCB fault: LCB Watchdog Reset. Invalid Command. Hardware Overcurrent Shutdown. Current Limiter Activated. 2022-06-06T21:11:44.962Z,1654549904.962 [sci2:StandardEnvelopes:C.OffshoreEnvelope](IMPORTANT): ACTIVE 2022-06-06T21:35:27.550Z,1654551327.550 [sci2:Lap:Wpt1:A.Waypoint](IMPORTANT): Reached Waypoint: 34.396000,-119.567001 2022-06-06T22:27:00.684Z,1654554420.684 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T222647