2022-05-29T17:22:32.495Z,1653844952.495 [CommandExec](IMPORTANT): got command restart logs 2022-05-29T17:23:44.503Z,1653845024.503 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 10.953711 min 2022-05-29T17:23:46.121Z,1653845026.121 [NAL9602](FAULT): GPS failed to acquire within timeout. 2022-05-29T17:25:06.899Z,1653845106.899 [DataOverHttps](IMPORTANT): SBD MTMSN=20220529T172506 2022-05-29T17:25:19.990Z,1653845119.990 [CommandExec](IMPORTANT): got command configSet Express linearApproximation WetLabsBB2FL.BackscatteringCoeff650nm 0.1 reciprocal_meter persist 2022-05-29T17:25:19.996Z,1653845119.996 [CommandExec](IMPORTANT): got command configSet Express linearApproximation WetLabsBB2FL.BackscatteringCoeff470nm 0.1 reciprocal_meter persist 2022-05-29T17:29:31.694Z,1653845371.694 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-29T17:31:19.123Z,1653845479.123 [DataOverHttps](IMPORTANT): SBD MTMSN=20220529T173118 2022-05-29T17:31:26.766Z,1653845486.766 [CommandExec](IMPORTANT): got command load ./Missions/Maintenance/ballast_and_trim.xml 2022-05-29T17:31:29.800Z,1653845489.800 [CommandExec](IMPORTANT): Loaded ./Missions/Maintenance/ballast_and_trim.xml 2022-05-29T17:31:55.766Z,1653845515.766 [CommandExec](IMPORTANT): got command set ballast_and_trim.ApproachSpeed 0.75 meter_per_second 2022-05-29T17:31:55.767Z,1653845515.767 [CommandExec](IMPORTANT): got command set ballast_and_trim.ApproachPitchLimit 15 degree 2022-05-29T17:31:55.768Z,1653845515.768 [CommandExec](IMPORTANT): got command set ballast_and_trim.SettleTime 15 minute 2022-05-29T17:31:55.768Z,1653845515.768 [CommandExec](IMPORTANT): got command run 2022-05-29T17:31:55.776Z,1653845515.776 [CommandExec](IMPORTANT): Running 2022-05-29T17:31:55.883Z,1653845515.883 [MissionManager](IMPORTANT): Started mission ballast_and_trim 2022-05-29T17:34:55.681Z,1653845695.681 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=47171, MT Status=1, MTMSN=3474 2022-05-29T17:34:56.402Z,1653845696.402 [CommandExec](IMPORTANT): got command schedule "set IsothermDepthSampling.MinOffshore 4 km;set IsothermDepthSampling.ShallowBoundChl 2 m;set IsothermDepthSampling.DeepBoundChl 27 m;set IsothermDepthSampling.CartridgeTypeCommon NaN count" 23gb9 4 6.000000 2022-05-29T17:34:56.403Z,1653845696.403 [CommandExec](IMPORTANT): Scheduling command #4 of 6 with id=23gb9 2022-05-29T17:34:56.404Z,1653845696.404 [CommandExec](IMPORTANT): Scheduled #28 (#4 of 6 with id='23gb9'): "set IsothermDepthSampling.MinOffshore 4 km;set IsothermDepthSampling.ShallowBoundChl 2 m;set IsothermDepthSampling.DeepBoundChl 27 m;set IsothermDepthSampling.CartridgeTypeCommon NaN count", AFTER MISSION 2022-05-29T17:34:56.406Z,1653845696.406 [CommandExec](FAULT): Scheduling was paused by a command at 2022-05-29T00:06:16Z 2022-05-29T17:36:00.540Z,1653845760.540 [CBIT](IMPORTANT): Beginning ground fault scan 2022-05-29T17:36:12.275Z,1653845772.275 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.008593 CHAN A1 (24V): 0.001764 CHAN A2 (12V): -0.006068 CHAN A3 (5V): -0.003755 CHAN B0 (3.3V): -0.002223 CHAN B1 (3.15aV): -0.001650 CHAN B2 (3.15bV): 0.001079 CHAN B3 (GND): 0.001483 OPEN: 0.012431 Full Scale: +/- 1 mA 2022-05-29T18:42:31.351Z,1653849751.351 [ballast_and_trim:RunBallastAndTrim:BallastAndTrim:BallastAndTrimAtTargetDepth:F.](FAULT): BallastAndTrim completed. Values did not meet error bound requirements requested by user. Will NOT write estimation values to config! Estimation time: 45.01 minutes (time-out limit reached). 2022-05-29T18:42:31.352Z,1653849751.352 [ballast_and_trim:RunBallastAndTrim:BallastAndTrim:BallastAndTrimAtTargetDepth:F.](IMPORTANT): Estimated buoyancyNeutral: 443.747915 +/- 17.371414 cc (conf. level 99.90%, sigma: 36.669498 cc). 2022-05-29T18:42:31.370Z,1653849751.370 [ballast_and_trim:RunBallastAndTrim:BallastAndTrim:BallastAndTrimAtTargetDepth:F.](IMPORTANT): Estimated massDefault: -27.808317 +/- 0.000000 mm (conf. level 99.90%, sigma: 0.000000 mm). 2022-05-29T18:49:29.523Z,1653850169.523 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-29T18:50:05.606Z,1653850205.606 [MissionManager](IMPORTANT): Started mission Default 2022-05-29T18:55:06.657Z,1653850506.657 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-29T18:55:16.255Z,1653850516.255 [DataOverHttps](IMPORTANT): SBD MOMSN=16840661, MTMSN=20220529T185516 2022-05-29T18:55:24.346Z,1653850524.346 [CommandExec](IMPORTANT): got command ibit 2022-05-29T18:55:24.458Z,1653850524.458 [IBIT](IMPORTANT): Beginning Initiated BIT 2022-05-29T18:55:24.458Z,1653850524.458 [IBIT](IMPORTANT): Beginning control surface checks. 2022-05-29T18:55:24.465Z,1653850524.465 [CBIT](IMPORTANT): Beginning ground fault scan 2022-05-29T18:55:35.474Z,1653850535.474 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.003611 CHAN A1 (24V): 0.001271 CHAN A2 (12V): -0.005561 CHAN A3 (5V): -0.003443 CHAN B0 (3.3V): -0.002003 CHAN B1 (3.15aV): -0.001718 CHAN B2 (3.15bV): -0.001767 CHAN B3 (GND): -0.000745 OPEN: 0.012472 Full Scale: +/- 1 mA 2022-05-29T18:57:15.373Z,1653850635.373 [IBIT](FAULT): Error acquiring IBIT communications status. Timeout expired. 2022-05-29T18:57:15.782Z,1653850635.782 [IBIT](FAULT): Warning: Battery Data not active. Expected only when running primaries. Threshold checking not active. 2022-05-29T18:57:16.160Z,1653850636.160 [IBIT](IMPORTANT): bitHumidityThreshold: 55.000000 % 2022-05-29T18:57:16.161Z,1653850636.161 [IBIT](IMPORTANT): bitPressureThreshold: 0.750000 psi 2022-05-29T18:57:16.161Z,1653850636.161 [IBIT](IMPORTANT): Pressure:9.335272 PSI 2022-05-29T18:57:16.162Z,1653850636.162 [IBIT](IMPORTANT): Humidity:19.881577 % 2022-05-29T18:57:16.640Z,1653850636.640 [IBIT](IMPORTANT): Vehicle Pitch:-9.409814 degrees 2022-05-29T18:57:16.640Z,1653850636.640 [IBIT](IMPORTANT): Vehicle Roll:-1.795084 degrees 2022-05-29T18:57:16.640Z,1653850636.640 [IBIT](IMPORTANT): Vehicle Heading:204.400238 degrees 2022-05-29T18:57:16.983Z,1653850636.983 [IBIT](IMPORTANT): surfaceThreshold: 1.000000 m 2022-05-29T18:57:16.984Z,1653850636.984 [IBIT](IMPORTANT): buoyancyNeutral: 418.268036 cc 2022-05-29T18:57:16.984Z,1653850636.984 [IBIT](IMPORTANT): massDefault: -2.780859 cm 2022-05-29T18:57:16.984Z,1653850636.984 [IBIT](IMPORTANT): stopDepth: 215.000000 m 2022-05-29T18:57:16.984Z,1653850636.984 [IBIT](IMPORTANT): abortDepth: 250.000000 m 2022-05-29T18:57:16.985Z,1653850636.985 [IBIT](IMPORTANT): IBIT FAILED 2022-05-29T18:59:56.786Z,1653850796.786 [DataOverHttps](IMPORTANT): SBD MTMSN=20220529T185956 2022-05-29T19:00:04.820Z,1653850804.820 [CommandExec](IMPORTANT): got command configSet VerticalControl.buoyancyNeutral 443 cubic_centimeter persist 2022-05-29T19:02:18.879Z,1653850938.879 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 12.214331 min 2022-05-29T19:02:28.871Z,1653850948.871 [DataOverHttps](IMPORTANT): SBD MOMSN=16840682, MTMSN=20220529T190228 2022-05-29T19:02:40.630Z,1653850960.630 [CommandExec](IMPORTANT): got command configSet VerticalControl.massDefault -27 millimeter persist 2022-05-29T19:07:23.336Z,1653851243.336 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-29T19:08:28.447Z,1653851308.447 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 18.373623 min 2022-05-29T19:13:32.206Z,1653851612.206 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-29T19:14:02.527Z,1653851642.527 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 23.942462 min 2022-05-29T19:19:06.241Z,1653851946.241 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-29T19:19:32.943Z,1653851972.943 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 29.448547 min 2022-05-29T19:25:05.592Z,1653852305.592 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 34.993001 min 2022-05-29T19:26:13.995Z,1653852373.995 [DataOverHttps](IMPORTANT): SBD MTMSN=20220529T192613 2022-05-29T19:26:21.840Z,1653852381.840 [CommandExec](IMPORTANT): got command schedule asap "load Science/sci2.xml;set sci2.MissionTimeout 2 h;set sci2.NeedCommsTime 30 min;set sci2.Lat1 34.3517 degree;set sci2.Lon1 -119.8583 degree;set sci2.Speed 0.75 m/s;set sci2.YoYoMaxDepth 50 m;set sci2.MaxDepth 60 m" 25fbp 1 2.000000 2022-05-29T19:26:21.840Z,1653852381.840 [CommandExec](IMPORTANT): Scheduling command #1 of 2 with id=25fbp 2022-05-29T19:26:21.841Z,1653852381.841 [CommandExec](IMPORTANT): Scheduled #29 (#1 of 2 with id='25fbp'): "load Science/sci2.xml;set sci2.MissionTimeout 2 h;set sci2.NeedCommsTime 30 min;set sci2.Lat1 34.3517 degree;set sci2.Lon1 -119.8583 degree;set sci2.Speed 0.75 m/s;set sci2.YoYoMaxDepth 50 m;set sci2.MaxDepth 60 m", ASAP 2022-05-29T19:26:22.738Z,1653852382.738 [DataOverHttps](IMPORTANT): SBD MTMSN=20220529T192622 2022-05-29T19:26:30.476Z,1653852390.476 [CommandExec](IMPORTANT): got command schedule asap "set sci2.MinOffshore 2 km;run" 25fbp 2 2.000000 2022-05-29T19:26:30.476Z,1653852390.476 [CommandExec](IMPORTANT): Scheduling command #2 of 2 with id=25fbp 2022-05-29T19:26:30.477Z,1653852390.477 [CommandExec](IMPORTANT): Scheduled #30 (#2 of 2 with id='25fbp'): "set sci2.MinOffshore 2 km;run", ASAP 2022-05-29T19:26:30.600Z,1653852390.600 [CommandExec](IMPORTANT): got command load ./Missions/Science/sci2.xml 2022-05-29T19:26:33.982Z,1653852393.982 [CommandExec](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2022-05-29T19:26:55.959Z,1653852415.959 [CommandExec](IMPORTANT): got command set sci2.MissionTimeout 2 hour 2022-05-29T19:26:55.961Z,1653852415.961 [CommandExec](IMPORTANT): got command set sci2.NeedCommsTime 30 minute 2022-05-29T19:26:55.962Z,1653852415.962 [CommandExec](IMPORTANT): got command set sci2.Lat1 34.3517 degree 2022-05-29T19:26:55.963Z,1653852415.963 [CommandExec](IMPORTANT): got command set sci2.Lon1 -119.8583 degree 2022-05-29T19:26:55.963Z,1653852415.963 [CommandExec](IMPORTANT): got command set sci2.Speed 0.75 meter_per_second 2022-05-29T19:26:55.964Z,1653852415.964 [CommandExec](IMPORTANT): got command set sci2.YoYoMaxDepth 50 meter 2022-05-29T19:26:55.965Z,1653852415.965 [CommandExec](IMPORTANT): got command set sci2.MaxDepth 60 meter 2022-05-29T19:27:00.591Z,1653852420.591 [CommandExec](IMPORTANT): got command set sci2.MinOffshore 2 kilometer 2022-05-29T19:27:00.592Z,1653852420.592 [CommandExec](IMPORTANT): got command run 2022-05-29T19:27:00.601Z,1653852420.601 [CommandExec](IMPORTANT): Running 2022-05-29T19:27:00.967Z,1653852420.967 [MissionManager](IMPORTANT): Started mission sci2 2022-05-29T19:30:09.610Z,1653852609.610 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-29T19:36:09.591Z,1653852969.591 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-29T20:04:27.312Z,1653854667.312 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=47172, MT Status=1, MTMSN=3475 2022-05-29T20:04:28.044Z,1653854668.044 [CommandExec](IMPORTANT): got command schedule "set IsothermDepthSampling.CartridgeType1 -6 count;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.TempDiffFromPeakChl1 0 K;set IsothermDepthSampling.TempDiffFromPeakChl2 0 K" 23gb9 5 6.000000 2022-05-29T20:04:28.044Z,1653854668.044 [CommandExec](IMPORTANT): Scheduling command #5 of 6 with id=23gb9 2022-05-29T20:04:28.053Z,1653854668.053 [CommandExec](IMPORTANT): Scheduled #31 (#5 of 6 with id='23gb9'): "set IsothermDepthSampling.CartridgeType1 -6 count;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.TempDiffFromPeakChl1 0 K;set IsothermDepthSampling.TempDiffFromPeakChl2 0 K", AFTER MISSION 2022-05-29T20:04:28.054Z,1653854668.054 [CommandExec](FAULT): Scheduling was paused by a command at 2022-05-29T00:06:16Z 2022-05-29T20:05:33.749Z,1653854733.749 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=47173, MT Status=1, MTMSN=3476 2022-05-29T20:05:34.436Z,1653854734.436 [CommandExec](IMPORTANT): got command schedule "set IsothermDepthSampling.WaitDepUndulation1 20 min;set IsothermDepthSampling.WaitDepUndulation2 5.0 min;run" 23gb9 6 6.000000 2022-05-29T20:05:34.436Z,1653854734.436 [CommandExec](IMPORTANT): Scheduling command #6 of 6 with id=23gb9 2022-05-29T20:05:34.438Z,1653854734.438 [CommandExec](IMPORTANT): Scheduled #32 (#6 of 6 with id='23gb9'): "set IsothermDepthSampling.WaitDepUndulation1 20 min;set IsothermDepthSampling.WaitDepUndulation2 5.0 min;run", AFTER MISSION 2022-05-29T20:05:34.439Z,1653854734.439 [CommandExec](FAULT): Scheduling was paused by a command at 2022-05-29T00:06:16Z 2022-05-29T20:47:12.736Z,1653857232.736 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-29T20:52:51.394Z,1653857571.394 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-29T20:58:01.609Z,1653857881.609 [ElevatorServo](FAULT): Elevator uart error - getPosition.serial timeout 2022-05-29T21:27:01.426Z,1653859621.426 [MissionManager](IMPORTANT): Started mission Default 2022-05-29T21:29:45.523Z,1653859785.523 [DataOverHttps](IMPORTANT): SBD MTMSN=20220529T212945 2022-05-29T21:29:58.932Z,1653859798.932 [CommandExec](IMPORTANT): got command configSet Express linearApproximation WetLabsBB2FL.BackscatteringCoeff650nm 0.01 reciprocal_meter persist 2022-05-29T21:29:58.936Z,1653859798.936 [CommandExec](IMPORTANT): got command configSet Express linearApproximation WetLabsBB2FL.BackscatteringCoeff470nm 0.01 reciprocal_meter persist 2022-05-29T21:31:06.674Z,1653859866.674 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-29T21:36:42.089Z,1653860202.089 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 9.670934 min 2022-05-29T21:41:46.715Z,1653860506.715 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-29T21:42:12.200Z,1653860532.200 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 15.172855 min 2022-05-29T21:47:42.678Z,1653860862.678 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 20.680290 min 2022-05-29T21:49:50.711Z,1653860990.711 [DataOverHttps](IMPORTANT): SBD MTMSN=20220529T214950 2022-05-29T21:49:58.281Z,1653860998.281 [CommandExec](IMPORTANT): got command schedule asap "load Science/sci2.xml;set sci2.MissionTimeout 2 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 34.34 degree;set sci2.Lon1 -119.84 degree;set sci2.Speed 0.75 m/s;set sci2.YoYoMaxDepth 50 m;set sci2.MaxDepth 60 m" 25lyt 1 2.000000 2022-05-29T21:49:58.282Z,1653860998.282 [CommandExec](IMPORTANT): Scheduling command #1 of 2 with id=25lyt 2022-05-29T21:49:58.283Z,1653860998.283 [CommandExec](IMPORTANT): Scheduled #33 (#1 of 2 with id='25lyt'): "load Science/sci2.xml;set sci2.MissionTimeout 2 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 34.34 degree;set sci2.Lon1 -119.84 degree;set sci2.Speed 0.75 m/s;set sci2.YoYoMaxDepth 50 m;set sci2.MaxDepth 60 m", ASAP 2022-05-29T21:49:59.234Z,1653860999.234 [DataOverHttps](IMPORTANT): SBD MTMSN=20220529T214959 2022-05-29T21:50:07.004Z,1653861007.004 [CommandExec](IMPORTANT): got command schedule asap "set sci2.MinOffshore 2 km;run" 25lyt 2 2.000000 2022-05-29T21:50:07.004Z,1653861007.004 [CommandExec](IMPORTANT): Scheduling command #2 of 2 with id=25lyt 2022-05-29T21:50:07.005Z,1653861007.005 [CommandExec](IMPORTANT): Scheduled #34 (#2 of 2 with id='25lyt'): "set sci2.MinOffshore 2 km;run", ASAP 2022-05-29T21:50:07.127Z,1653861007.127 [CommandExec](IMPORTANT): got command load ./Missions/Science/sci2.xml 2022-05-29T21:50:09.070Z,1653861009.070 [CommandExec](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2022-05-29T21:50:23.637Z,1653861023.637 [CommandExec](IMPORTANT): got command set sci2.MissionTimeout 2 hour 2022-05-29T21:50:23.638Z,1653861023.638 [CommandExec](IMPORTANT): got command set sci2.NeedCommsTime 45 minute 2022-05-29T21:50:23.639Z,1653861023.639 [CommandExec](IMPORTANT): got command set sci2.Lat1 34.34 degree 2022-05-29T21:50:23.639Z,1653861023.639 [CommandExec](IMPORTANT): got command set sci2.Lon1 -119.84 degree 2022-05-29T21:50:23.640Z,1653861023.640 [CommandExec](IMPORTANT): got command set sci2.Speed 0.75 meter_per_second 2022-05-29T21:50:23.641Z,1653861023.641 [CommandExec](IMPORTANT): got command set sci2.YoYoMaxDepth 50 meter 2022-05-29T21:50:23.642Z,1653861023.642 [CommandExec](IMPORTANT): got command set sci2.MaxDepth 60 meter 2022-05-29T21:50:26.203Z,1653861026.203 [CommandExec](IMPORTANT): got command set sci2.MinOffshore 2 kilometer 2022-05-29T21:50:26.203Z,1653861026.203 [CommandExec](IMPORTANT): got command run 2022-05-29T21:50:26.207Z,1653861026.207 [CommandExec](IMPORTANT): Running 2022-05-29T21:50:26.382Z,1653861026.382 [MissionManager](IMPORTANT): Started mission sci2 2022-05-29T21:52:46.629Z,1653861166.629 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-29T21:58:51.514Z,1653861531.514 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-29T22:48:28.718Z,1653864508.718 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-29T22:54:11.644Z,1653864851.644 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-29T23:42:03.186Z,1653867723.186 [DataOverHttps](IMPORTANT): SBD MTMSN=20220529T234203 2022-05-29T23:42:15.606Z,1653867735.606 [CommandExec](IMPORTANT): got command stop 2022-05-29T23:42:16.341Z,1653867736.341 [MissionManager](IMPORTANT): Started mission Default 2022-05-29T23:43:26.640Z,1653867806.640 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-29T23:49:00.117Z,1653868140.117 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 6.723240 min 2022-05-29T23:49:10.232Z,1653868150.232 [DataOverHttps](IMPORTANT): SBD MOMSN=16841028, MTMSN=20220529T234910 2022-05-29T23:49:17.910Z,1653868157.910 [CommandExec](IMPORTANT): got command schedule asap "load Science/sci2.xml;set sci2.MissionTimeout 2 h;set sci2.NeedCommsTime 20 min;set sci2.Lat1 34.34 degree;set sci2.Lon1 -119.854 degree;set sci2.Speed 0.75 m/s;set sci2.YoYoMaxDepth 50 m;set sci2.MaxDepth 60 m" 25rh9 1 2.000000 2022-05-29T23:49:17.911Z,1653868157.911 [CommandExec](IMPORTANT): Scheduling command #1 of 2 with id=25rh9 2022-05-29T23:49:17.912Z,1653868157.912 [CommandExec](IMPORTANT): Scheduled #35 (#1 of 2 with id='25rh9'): "load Science/sci2.xml;set sci2.MissionTimeout 2 h;set sci2.NeedCommsTime 20 min;set sci2.Lat1 34.34 degree;set sci2.Lon1 -119.854 degree;set sci2.Speed 0.75 m/s;set sci2.YoYoMaxDepth 50 m;set sci2.MaxDepth 60 m", ASAP 2022-05-29T23:49:19.014Z,1653868159.014 [DataOverHttps](IMPORTANT): SBD MTMSN=20220529T234918 2022-05-29T23:49:26.420Z,1653868166.420 [CommandExec](IMPORTANT): got command schedule asap "set sci2.MinOffshore 2 km;run" 25rh9 2 2.000000 2022-05-29T23:49:26.421Z,1653868166.421 [CommandExec](IMPORTANT): Scheduling command #2 of 2 with id=25rh9 2022-05-29T23:49:26.422Z,1653868166.422 [CommandExec](IMPORTANT): Scheduled #36 (#2 of 2 with id='25rh9'): "set sci2.MinOffshore 2 km;run", ASAP 2022-05-29T23:49:26.534Z,1653868166.534 [CommandExec](IMPORTANT): got command load ./Missions/Science/sci2.xml 2022-05-29T23:49:28.873Z,1653868168.873 [CommandExec](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2022-05-29T23:50:00.333Z,1653868200.333 [CommandExec](IMPORTANT): got command set sci2.MissionTimeout 2 hour 2022-05-29T23:50:00.334Z,1653868200.334 [CommandExec](IMPORTANT): got command set sci2.NeedCommsTime 20 minute 2022-05-29T23:50:00.335Z,1653868200.335 [CommandExec](IMPORTANT): got command set sci2.Lat1 34.34 degree 2022-05-29T23:50:00.335Z,1653868200.335 [CommandExec](IMPORTANT): got command set sci2.Lon1 -119.854 degree 2022-05-29T23:50:00.336Z,1653868200.336 [CommandExec](IMPORTANT): got command set sci2.Speed 0.75 meter_per_second 2022-05-29T23:50:00.337Z,1653868200.337 [CommandExec](IMPORTANT): got command set sci2.YoYoMaxDepth 50 meter 2022-05-29T23:50:00.338Z,1653868200.338 [CommandExec](IMPORTANT): got command set sci2.MaxDepth 60 meter 2022-05-29T23:50:03.997Z,1653868203.997 [CommandExec](IMPORTANT): got command set sci2.MinOffshore 2 kilometer 2022-05-29T23:50:03.998Z,1653868203.998 [CommandExec](IMPORTANT): got command run 2022-05-29T23:50:03.999Z,1653868203.999 [CommandExec](IMPORTANT): Running 2022-05-29T23:50:04.128Z,1653868204.128 [MissionManager](IMPORTANT): Started mission sci2 2022-05-29T23:54:04.900Z,1653868444.900 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-30T00:00:19.472Z,1653868819.472 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-30T00:12:14.582Z,1653869534.582 [sci2:Lap:Wpt1:A.Waypoint](IMPORTANT): Reached Waypoint: 34.340000,-119.853996 2022-05-30T00:12:17.402Z,1653869537.402 [MissionManager](IMPORTANT): Started mission Default 2022-05-30T00:19:13.525Z,1653869953.525 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-30T00:25:01.291Z,1653870301.291 [DataOverHttps](IMPORTANT): SBD MTMSN=20220530T002501 2022-05-30T00:25:09.211Z,1653870309.211 [CommandExec](IMPORTANT): got command schedule asap "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 3 h" 25t5i 1 7.000000 2022-05-30T00:25:09.211Z,1653870309.211 [CommandExec](IMPORTANT): Scheduling command #1 of 7 with id=25t5i 2022-05-30T00:25:09.212Z,1653870309.212 [CommandExec](IMPORTANT): Scheduled #37 (#1 of 7 with id='25t5i'): "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 3 h", ASAP 2022-05-30T00:25:10.111Z,1653870310.111 [DataOverHttps](IMPORTANT): SBD MTMSN=20220530T002509 2022-05-30T00:25:17.738Z,1653870317.738 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.MaxWaitNotAchievingDepth 0.5 h;set IsothermDepthSampling.SendSampleStatusAndData 1 bool;set IsothermDepthSampling.SampleAtPeakChl 0 bool;set IsothermDepthSampling.InitialDiveDuration 3 min" 25t5i 2 7.000000 2022-05-30T00:25:17.738Z,1653870317.738 [CommandExec](IMPORTANT): Scheduling command #2 of 7 with id=25t5i 2022-05-30T00:25:17.739Z,1653870317.739 [CommandExec](IMPORTANT): Scheduled #38 (#2 of 7 with id='25t5i'): "set IsothermDepthSampling.MaxWaitNotAchievingDepth 0.5 h;set IsothermDepthSampling.SendSampleStatusAndData 1 bool;set IsothermDepthSampling.SampleAtPeakChl 0 bool;set IsothermDepthSampling.InitialDiveDuration 3 min", ASAP 2022-05-30T00:25:18.687Z,1653870318.687 [DataOverHttps](IMPORTANT): SBD MTMSN=20220530T002518 2022-05-30T00:25:26.278Z,1653870326.278 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.SpeedSampling 0 m/s;set IsothermDepthSampling.HeadingLeavingSide0 210 degree;set IsothermDepthSampling.HeadingLeavingSide2 30 degree;set IsothermDepthSampling.HeadingLeavingSide3 120 degree" 25t5i 3 7.000000 2022-05-30T00:25:26.279Z,1653870326.279 [CommandExec](IMPORTANT): Scheduling command #3 of 7 with id=25t5i 2022-05-30T00:25:26.280Z,1653870326.280 [CommandExec](IMPORTANT): Scheduled #39 (#3 of 7 with id='25t5i'): "set IsothermDepthSampling.SpeedSampling 0 m/s;set IsothermDepthSampling.HeadingLeavingSide0 210 degree;set IsothermDepthSampling.HeadingLeavingSide2 30 degree;set IsothermDepthSampling.HeadingLeavingSide3 120 degree", ASAP 2022-05-30T00:25:27.251Z,1653870327.251 [DataOverHttps](IMPORTANT): SBD MTMSN=20220530T002527 2022-05-30T00:25:37.206Z,1653870337.206 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.MaxDepth 70 m;set IsothermDepthSampling.MinOffshore 4 km;set IsothermDepthSampling.DeepBoundSampler 60 m;set IsothermDepthSampling.ShallowBoundChl 2 m;set IsothermDepthSampling.DeepBoundChl 27 m" 25t5i 4 7.000000 2022-05-30T00:25:37.207Z,1653870337.207 [CommandExec](IMPORTANT): Scheduling command #4 of 7 with id=25t5i 2022-05-30T00:25:37.208Z,1653870337.208 [CommandExec](IMPORTANT): Scheduled #40 (#4 of 7 with id='25t5i'): "set IsothermDepthSampling.MaxDepth 70 m;set IsothermDepthSampling.MinOffshore 4 km;set IsothermDepthSampling.DeepBoundSampler 60 m;set IsothermDepthSampling.ShallowBoundChl 2 m;set IsothermDepthSampling.DeepBoundChl 27 m", ASAP 2022-05-30T00:25:38.187Z,1653870338.187 [DataOverHttps](IMPORTANT): SBD MTMSN=20220530T002538 2022-05-30T00:25:47.482Z,1653870347.482 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.CartridgeTypeCommon NaN count;set IsothermDepthSampling.CartridgeType1 -6 count;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.TempDiffFromPeakChl1 NaN K" 25t5i 5 7.000000 2022-05-30T00:25:47.482Z,1653870347.482 [CommandExec](IMPORTANT): Scheduling command #5 of 7 with id=25t5i 2022-05-30T00:25:47.483Z,1653870347.483 [CommandExec](IMPORTANT): Scheduled #41 (#5 of 7 with id='25t5i'): "set IsothermDepthSampling.CartridgeTypeCommon NaN count;set IsothermDepthSampling.CartridgeType1 -6 count;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.TempDiffFromPeakChl1 NaN K", ASAP 2022-05-30T00:25:48.475Z,1653870348.475 [DataOverHttps](IMPORTANT): SBD MTMSN=20220530T002548 2022-05-30T00:25:56.078Z,1653870356.078 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.TempDiffFromPeakChl2 NaN K;set IsothermDepthSampling.Dep1 50 m;set IsothermDepthSampling.Dep2 50 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;set IsothermDepthSampling.WaitDepUndulation2 5.0 min" 25t5i 6 7.000000 2022-05-30T00:25:56.079Z,1653870356.079 [CommandExec](IMPORTANT): Scheduling command #6 of 7 with id=25t5i 2022-05-30T00:25:56.080Z,1653870356.080 [CommandExec](IMPORTANT): Scheduled #42 (#6 of 7 with id='25t5i'): "set IsothermDepthSampling.TempDiffFromPeakChl2 NaN K;set IsothermDepthSampling.Dep1 50 m;set IsothermDepthSampling.Dep2 50 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;set IsothermDepthSampling.WaitDepUndulation2 5.0 min", ASAP 2022-05-30T00:25:57.067Z,1653870357.067 [DataOverHttps](IMPORTANT): SBD MTMSN=20220530T002556 2022-05-30T00:26:04.728Z,1653870364.728 [CommandExec](IMPORTANT): got command schedule asap "run" 25t5i 7 7.000000 2022-05-30T00:26:04.728Z,1653870364.728 [CommandExec](IMPORTANT): Scheduling command #7 of 7 with id=25t5i 2022-05-30T00:26:04.729Z,1653870364.729 [CommandExec](IMPORTANT): Scheduled #43 (#7 of 7 with id='25t5i'): "run", ASAP 2022-05-30T00:26:04.877Z,1653870364.877 [CommandExec](IMPORTANT): got command load ./Missions/Science/isotherm_depth_sampling.xml 2022-05-30T00:26:21.256Z,1653870381.256 [CommandExec](IMPORTANT): Loaded ./Missions/Science/isotherm_depth_sampling.xml 2022-05-30T00:26:48.617Z,1653870408.617 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.NumSamplers 2 count 2022-05-30T00:26:48.618Z,1653870408.618 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MissionTimeout 6 hour 2022-05-30T00:26:48.618Z,1653870408.618 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNoFiring 3 hour 2022-05-30T00:27:19.077Z,1653870439.077 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNotAchievingDepth 0.5 hour 2022-05-30T00:27:19.078Z,1653870439.078 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendSampleStatusAndData 1 bool 2022-05-30T00:27:19.078Z,1653870439.078 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SampleAtPeakChl 0 bool 2022-05-30T00:27:19.080Z,1653870439.080 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.InitialDiveDuration 3 minute 2022-05-30T00:27:56.521Z,1653870476.521 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SpeedSampling 0 meter_per_second 2022-05-30T00:27:56.522Z,1653870476.522 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.HeadingLeavingSide0 210 degree 2022-05-30T00:27:56.522Z,1653870476.522 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.HeadingLeavingSide2 30 degree 2022-05-30T00:27:56.523Z,1653870476.523 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.HeadingLeavingSide3 120 degree 2022-05-30T00:28:27.406Z,1653870507.406 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxDepth 70 meter 2022-05-30T00:28:27.407Z,1653870507.407 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MinOffshore 4 kilometer 2022-05-30T00:28:27.408Z,1653870507.408 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundSampler 60 meter 2022-05-30T00:28:27.409Z,1653870507.409 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 2 meter 2022-05-30T00:28:27.409Z,1653870507.409 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 27 meter 2022-05-30T00:29:04.067Z,1653870544.067 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeTypeCommon NaN count 2022-05-30T00:29:04.067Z,1653870544.067 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType1 -6 count 2022-05-30T00:29:04.068Z,1653870544.068 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType2 -10 count 2022-05-30T00:29:04.069Z,1653870544.069 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.TempDiffFromPeakChl1 NaN kelvin 2022-05-30T00:29:41.445Z,1653870581.445 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.TempDiffFromPeakChl2 NaN kelvin 2022-05-30T00:29:41.446Z,1653870581.446 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.Dep1 50 meter 2022-05-30T00:29:41.446Z,1653870581.446 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.Dep2 50 meter 2022-05-30T00:29:41.447Z,1653870581.447 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 10 minute 2022-05-30T00:29:41.449Z,1653870581.449 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation2 5.0 minute 2022-05-30T00:29:41.535Z,1653870581.535 [CommandExec](IMPORTANT): got command run 2022-05-30T00:29:41.539Z,1653870581.539 [CommandExec](IMPORTANT): Running 2022-05-30T00:29:41.735Z,1653870581.735 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling 2022-05-30T00:29:41.924Z,1653870581.924 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 21.00 hours. 2022-05-30T00:29:44.891Z,1653870584.891 [NAL9602](FAULT): GPS failed to acquire within timeout. 2022-05-30T00:35:29.381Z,1653870929.381 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-30T00:37:23.863Z,1653871043.863 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , nan K , nan m , nan degC , 50.000000 m , 10.000000 min . 2022-05-30T00:37:27.482Z,1653871047.482 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 1.000000 count . Target depth = 50.000000 m . 2022-05-30T00:37:27.909Z,1653871047.909 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -6.000000 count 2022-05-30T00:42:14.692Z,1653871334.692 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-30T00:48:43.390Z,1653871723.390 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 50.057240 m , settling for 10.000000 min 2022-05-30T00:55:35.541Z,1653872135.541 [CBIT](IMPORTANT): Beginning ground fault scan 2022-05-30T00:55:46.501Z,1653872146.501 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.002868 CHAN A1 (24V): 0.001884 CHAN A2 (12V): -0.004481 CHAN A3 (5V): -0.003508 CHAN B0 (3.3V): 0.026489 CHAN B1 (3.15aV): -0.001278 CHAN B2 (3.15bV): -0.001447 CHAN B3 (GND): -0.000513 OPEN: 0.012316 Full Scale: +/- 1 mA 2022-05-30T00:58:56.326Z,1653872336.326 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-05-30T00:58:56.647Z,1653872336.647 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-05-30T00:59:52.213Z,1653872392.213 [ESPComponent](IMPORTANT): ESP has connected as client 2022-05-30T00:59:53.027Z,1653872393.027 [ESPComponent](IMPORTANT): [sample #5] Setting cartridge argument to -6 2022-05-30T00:59:53.028Z,1653872393.028 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-05-30T00:59:53.522Z,1653872393.522 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 49.393990 m in 10.673426 degC water with 0.341120 ug/l chlorophyll fluorescence. 2022-05-30T00:59:53.830Z,1653872393.830 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_LOG 2022-05-30T00:59:54.231Z,1653872394.231 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-05-30T00:59:56.266Z,1653872396.266 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_LOADING_CARTRIDGE 2022-05-30T01:00:35.845Z,1653872435.845 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PRIMING (@36,archive_bac) 2022-05-30T01:00:37.864Z,1653872437.864 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PRIMING (@100.0) 2022-05-30T01:00:38.269Z,1653872438.269 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-05-30T01:00:38.699Z,1653872438.699 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-05-30T01:02:50.391Z,1653872570.391 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_FILTERING (@0.0) 2022-05-30T01:02:50.798Z,1653872570.798 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-05-30T01:42:54.181Z,1653874974.181 [BuoyancyServo](FAULT): Buoyancy pump stop uart error: serial timeout 2022-05-30T01:52:02.186Z,1653875522.186 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PAUSED (@1000.0) 2022-05-30T01:52:02.591Z,1653875522.591 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PROCESSING (@1000.0) 2022-05-30T01:52:04.618Z,1653875524.618 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2022-05-30T01:52:05.015Z,1653875525.015 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PROCESSED (@36,archive_bac) 2022-05-30T02:04:09.434Z,1653876249.434 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPING (@36,archive_bac) 2022-05-30T02:04:18.728Z,1653876258.728 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-05-30T02:04:19.130Z,1653876259.130 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPED 2022-05-30T02:09:18.898Z,1653876558.898 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence completed normally. 2022-05-30T02:09:19.806Z,1653876559.806 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 1.000000 count completed. 2022-05-30T02:09:21.830Z,1653876561.830 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataCntSamples:A](IMPORTANT): CntSamples = 1.000000 count 2022-05-30T02:09:23.030Z,1653876563.030 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleNumber:A](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2022-05-30T02:09:24.215Z,1653876564.215 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPCartridgeType:A](IMPORTANT): Science:ESPComponent.cartridge = -6 count 2022-05-30T02:09:25.415Z,1653876565.415 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleVolume:A](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2022-05-30T02:09:27.048Z,1653876567.048 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleDep:A](IMPORTANT): Universal:depth = 50.117832 m 2022-05-30T02:09:28.669Z,1653876568.669 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleChl:A](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 0.353600 ug/l 2022-05-30T02:09:36.074Z,1653876576.074 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T02:09:45.227Z,1653876585.227 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -10.000000 count , nan K , nan m , nan degC , 50.000000 m , 5.000000 min . 2022-05-30T02:09:48.854Z,1653876588.854 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 2.000000 count . Target depth = 50.000000 m . 2022-05-30T02:09:49.261Z,1653876589.261 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -10.000000 count 2022-05-30T02:09:49.967Z,1653876589.967 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T02:10:00.550Z,1653876600.550 [DAT](FAULT): Buffer send receipt timeout failure. 2022-05-30T02:10:16.174Z,1653876616.174 [DAT](FAULT): failed to enter online mode 2022-05-30T02:10:16.174Z,1653876616.174 [DAT](FAULT): Failure returning to online mode 2022-05-30T02:10:51.882Z,1653876651.882 [DAT](FAULT): failed to set time 2022-05-30T02:11:06.257Z,1653876666.257 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T02:11:12.897Z,1653876672.897 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 50.045586 m , settling for 5.000000 min 2022-05-30T02:11:20.126Z,1653876680.126 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T02:11:44.829Z,1653876704.829 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T02:11:58.701Z,1653876718.701 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T02:12:12.573Z,1653876732.573 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T02:12:26.443Z,1653876746.443 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T02:12:51.425Z,1653876771.425 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T02:13:05.286Z,1653876785.286 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T02:13:41.085Z,1653876821.085 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T02:13:54.962Z,1653876834.962 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T02:14:08.829Z,1653876848.829 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T02:16:25.662Z,1653876985.662 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-05-30T02:16:25.798Z,1653876985.798 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-05-30T02:17:21.310Z,1653877041.310 [ESPComponent](IMPORTANT): ESP has connected as client 2022-05-30T02:17:22.121Z,1653877042.121 [ESPComponent](IMPORTANT): [sample #6] Setting cartridge argument to -10 2022-05-30T02:17:22.122Z,1653877042.122 [ESPComponent](IMPORTANT): [sample #6] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-05-30T02:17:22.595Z,1653877042.595 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 50.291950 m in 10.276331 degC water with 0.345280 ug/l chlorophyll fluorescence. 2022-05-30T02:17:22.926Z,1653877042.926 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PREPARING_SHOW_LOG 2022-05-30T02:17:23.330Z,1653877043.330 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-05-30T02:17:25.350Z,1653877045.350 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_LOADING_CARTRIDGE 2022-05-30T02:18:05.754Z,1653877085.754 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PRIMING (@35,daSPR_phyto) 2022-05-30T02:18:08.579Z,1653877088.579 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PRIMING (@100.0) 2022-05-30T02:18:08.580Z,1653877088.580 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-05-30T02:18:08.982Z,1653877088.982 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-05-30T02:20:21.090Z,1653877221.090 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_FILTERING (@0.0) 2022-05-30T02:20:21.497Z,1653877221.497 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-05-30T03:03:41.402Z,1653879821.402 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PAUSED (@1000.0) 2022-05-30T03:03:41.806Z,1653879821.806 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PROCESSING (@1000.0) 2022-05-30T03:03:43.827Z,1653879823.827 [ESPComponent](IMPORTANT): Processing timeoutMinutes=120.000000 issuedCmd_=Cmd.startProcessing 2022-05-30T03:03:44.232Z,1653879824.232 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PROCESSED (@35,daSPR_phyto) 2022-05-30T04:03:20.928Z,1653883400.928 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_STOPPING (@35,daSPR_phyto) 2022-05-30T04:03:31.836Z,1653883411.836 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-05-30T04:03:32.239Z,1653883412.239 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_STOPPED 2022-05-30T04:08:32.018Z,1653883712.018 [ESPComponent](IMPORTANT): [sample #6] ESP sampling sequence completed normally. 2022-05-30T04:08:32.903Z,1653883712.903 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 2.000000 count completed. 2022-05-30T04:08:34.933Z,1653883714.933 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataCntSamples:A](IMPORTANT): CntSamples = 2.000000 count 2022-05-30T04:08:36.141Z,1653883716.141 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleNumber:A](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2022-05-30T04:08:37.339Z,1653883717.339 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPCartridgeType:A](IMPORTANT): Science:ESPComponent.cartridge = -10 count 2022-05-30T04:08:38.546Z,1653883718.546 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleVolume:A](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2022-05-30T04:08:40.175Z,1653883720.175 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleDep:A](IMPORTANT): Universal:depth = 49.264309 m 2022-05-30T04:08:41.768Z,1653883721.768 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleChl:A](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 0.322400 ug/l 2022-05-30T04:08:44.721Z,1653883724.721 [MissionManager](IMPORTANT): Started mission Default 2022-05-30T04:08:48.941Z,1653883728.941 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T04:09:13.637Z,1653883753.637 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T04:09:27.521Z,1653883767.521 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T04:09:41.385Z,1653883781.385 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T04:10:17.169Z,1653883817.169 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T04:10:31.032Z,1653883831.032 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T04:14:07.087Z,1653884047.087 [DataOverHttps](IMPORTANT): SBD MTMSN=20220530T041406 2022-05-30T04:14:17.570Z,1653884057.570 [CommandExec](IMPORTANT): got command configSet Express none WetLabsBB2FL.BackscatteringCoeff650nm persist 2022-05-30T04:14:46.979Z,1653884086.979 [DataOverHttps](IMPORTANT): SBD MTMSN=20220530T041446 2022-05-30T04:14:57.531Z,1653884097.531 [CommandExec](IMPORTANT): got command configSet Express none WetLabsBB2FL.BackscatteringCoeff470nm persist 2022-05-30T04:15:49.297Z,1653884149.297 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-30T04:21:53.671Z,1653884513.671 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 13.142255 min 2022-05-30T04:21:55.268Z,1653884515.268 [NAL9602](FAULT): GPS failed to acquire within timeout. 2022-05-30T04:21:55.289Z,1653884515.289 [CBIT](CRITICAL): Data Fault in component: NAL9602 2022-05-30T04:21:55.717Z,1653884515.717 [CommandExec](FAULT): Scheduling is paused for 4 commands 2022-05-30T04:21:56.065Z,1653884516.065 [NAL9602](FAULT): LCB fault: Invalid Command. Hardware Overcurrent Shutdown. 2022-05-30T04:24:43.159Z,1653884683.159 [DataOverHttps](IMPORTANT): SBD MTMSN=20220530T042442 2022-05-30T04:24:50.879Z,1653884690.879 [CommandExec](IMPORTANT): got command ! start onESP upsync 2022-05-30T04:24:51.226Z,1653884691.226 [CommandExec](IMPORTANT): /mnt/mmc/started/2022-05-30UTC042451_onESP 2022-05-30T04:29:09.815Z,1653884949.815 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-30T04:32:42.754Z,1653885162.754 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 23.960773 min 2022-05-30T04:32:44.786Z,1653885164.786 [CBIT](CRITICAL): Navigation error has exceeded threshold. Set navErrorCriticalReporting to false to squeltch critical failure. 2022-05-30T04:34:08.433Z,1653885248.433 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=47174, MT Status=1, MTMSN=3477 2022-05-30T04:34:08.967Z,1653885248.967 [CommandExec](IMPORTANT): got command ibit 2022-05-30T04:34:08.978Z,1653885248.978 [IBIT](IMPORTANT): Beginning Initiated BIT 2022-05-30T04:34:08.978Z,1653885248.978 [IBIT](IMPORTANT): Beginning control surface checks. 2022-05-30T04:34:08.985Z,1653885248.985 [CBIT](IMPORTANT): Beginning ground fault scan 2022-05-30T04:34:19.816Z,1653885259.816 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.008808 CHAN A1 (24V): 0.001931 CHAN A2 (12V): -0.005317 CHAN A3 (5V): -0.003435 CHAN B0 (3.3V): -0.002043 CHAN B1 (3.15aV): -0.001535 CHAN B2 (3.15bV): -0.001391 CHAN B3 (GND): -0.000642 OPEN: 0.012251 Full Scale: +/- 1 mA 2022-05-30T04:34:55.311Z,1653885295.311 [IBIT](IMPORTANT): Communications Status: Fix Status: 1 Iridium Signal Strength: 3 Latitude: 34.349426 Longitude: -119.909256 2022-05-30T04:34:55.752Z,1653885295.752 [IBIT](FAULT): Warning: Battery Data not active. Expected only when running primaries. Threshold checking not active. 2022-05-30T04:34:56.135Z,1653885296.135 [IBIT](IMPORTANT): bitHumidityThreshold: 55.000000 % 2022-05-30T04:34:56.135Z,1653885296.135 [IBIT](IMPORTANT): bitPressureThreshold: 0.750000 psi 2022-05-30T04:34:56.135Z,1653885296.135 [IBIT](IMPORTANT): Pressure:9.310611 PSI 2022-05-30T04:34:56.136Z,1653885296.136 [IBIT](IMPORTANT): Humidity:18.947626 % 2022-05-30T04:34:56.551Z,1653885296.551 [IBIT](IMPORTANT): Vehicle Pitch:-6.251148 degrees 2022-05-30T04:34:56.551Z,1653885296.551 [IBIT](IMPORTANT): Vehicle Roll:2.791291 degrees 2022-05-30T04:34:56.551Z,1653885296.551 [IBIT](IMPORTANT): Vehicle Heading:286.920380 degrees 2022-05-30T04:34:56.979Z,1653885296.979 [IBIT](IMPORTANT): surfaceThreshold: 1.000000 m 2022-05-30T04:34:56.980Z,1653885296.980 [IBIT](IMPORTANT): buoyancyNeutral: 443.000000 cc 2022-05-30T04:34:56.980Z,1653885296.980 [IBIT](IMPORTANT): massDefault: -2.700000 cm 2022-05-30T04:34:56.980Z,1653885296.980 [IBIT](IMPORTANT): stopDepth: 215.000000 m 2022-05-30T04:34:56.980Z,1653885296.980 [IBIT](IMPORTANT): abortDepth: 250.000000 m 2022-05-30T04:34:56.981Z,1653885296.981 [IBIT](IMPORTANT): IBIT PASSED 2022-05-30T04:38:13.671Z,1653885493.671 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 29.476099 min 2022-05-30T04:40:56.255Z,1653885656.255 [DataOverHttps](IMPORTANT): SBD MTMSN=20220530T044056 2022-05-30T04:41:04.048Z,1653885664.048 [CommandExec](IMPORTANT): got command schedule asap "load Science/sci2.xml;set sci2.MissionTimeout 12 h;set sci2.NeedCommsTime 60 min;set sci2.Lat1 34.314 degree;set sci2.Lon1 -119.771 degree;set sci2.Lat2 34.349 degree;set sci2.Lon2 -119.86 degree;set sci2.Speed 0.75 m/s" 264zk 1 2.000000 2022-05-30T04:41:04.049Z,1653885664.049 [CommandExec](IMPORTANT): Scheduling command #1 of 2 with id=264zk 2022-05-30T04:41:04.050Z,1653885664.050 [CommandExec](IMPORTANT): Scheduled #44 (#1 of 2 with id='264zk'): "load Science/sci2.xml;set sci2.MissionTimeout 12 h;set sci2.NeedCommsTime 60 min;set sci2.Lat1 34.314 degree;set sci2.Lon1 -119.771 degree;set sci2.Lat2 34.349 degree;set sci2.Lon2 -119.86 degree;set sci2.Speed 0.75 m/s", ASAP 2022-05-30T04:41:04.990Z,1653885664.990 [DataOverHttps](IMPORTANT): SBD MTMSN=20220530T044104 2022-05-30T04:41:12.600Z,1653885672.600 [CommandExec](IMPORTANT): got command schedule asap "set sci2.YoYoMaxDepth 50 m;set sci2.MaxDepth 60 m;set sci2.MinOffshore 2 km;run" 264zk 2 2.000000 2022-05-30T04:41:12.601Z,1653885672.601 [CommandExec](IMPORTANT): Scheduling command #2 of 2 with id=264zk 2022-05-30T04:41:12.602Z,1653885672.602 [CommandExec](IMPORTANT): Scheduled #45 (#2 of 2 with id='264zk'): "set sci2.YoYoMaxDepth 50 m;set sci2.MaxDepth 60 m;set sci2.MinOffshore 2 km;run", ASAP 2022-05-30T04:41:12.724Z,1653885672.724 [CommandExec](IMPORTANT): got command load ./Missions/Science/sci2.xml 2022-05-30T04:41:14.702Z,1653885674.702 [CommandExec](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2022-05-30T04:41:27.429Z,1653885687.429 [CommandExec](IMPORTANT): got command set sci2.MissionTimeout 12 hour 2022-05-30T04:41:27.430Z,1653885687.430 [CommandExec](IMPORTANT): got command set sci2.NeedCommsTime 60 minute 2022-05-30T04:41:27.431Z,1653885687.431 [CommandExec](IMPORTANT): got command set sci2.Lat1 34.314 degree 2022-05-30T04:41:27.431Z,1653885687.431 [CommandExec](IMPORTANT): got command set sci2.Lon1 -119.771 degree 2022-05-30T04:41:27.432Z,1653885687.432 [CommandExec](IMPORTANT): got command set sci2.Lat2 34.349 degree 2022-05-30T04:41:27.437Z,1653885687.437 [CommandExec](IMPORTANT): got command set sci2.Lon2 -119.86 degree 2022-05-30T04:41:27.438Z,1653885687.438 [CommandExec](IMPORTANT): got command set sci2.Speed 0.75 meter_per_second 2022-05-30T04:41:37.760Z,1653885697.760 [CommandExec](IMPORTANT): got command set sci2.YoYoMaxDepth 50 meter 2022-05-30T04:41:37.761Z,1653885697.761 [CommandExec](IMPORTANT): got command set sci2.MaxDepth 60 meter 2022-05-30T04:41:37.762Z,1653885697.762 [CommandExec](IMPORTANT): got command set sci2.MinOffshore 2 kilometer 2022-05-30T04:41:37.762Z,1653885697.762 [CommandExec](IMPORTANT): got command run 2022-05-30T04:41:37.764Z,1653885697.764 [CommandExec](IMPORTANT): Running 2022-05-30T04:41:37.978Z,1653885697.978 [MissionManager](IMPORTANT): Started mission sci2 2022-05-30T04:43:17.841Z,1653885797.841 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-30T04:45:27.418Z,1653885927.418 [DAT](FAULT): Buffer send receipt timeout failure. 2022-05-30T04:45:43.066Z,1653885943.066 [DAT](FAULT): failed to enter online mode 2022-05-30T04:45:43.066Z,1653885943.066 [DAT](FAULT): Failure returning to online mode 2022-05-30T04:46:18.842Z,1653885978.842 [DAT](FAULT): failed to set time 2022-05-30T04:46:33.218Z,1653885993.218 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T04:46:47.082Z,1653886007.082 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T04:47:00.938Z,1653886020.938 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T04:47:14.798Z,1653886034.798 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T04:47:28.918Z,1653886048.918 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T04:47:42.787Z,1653886062.787 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T04:47:56.668Z,1653886076.668 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T04:48:10.534Z,1653886090.534 [DAT](FAULT): Ack receipt timeout failure. 2022-05-30T04:48:30.345Z,1653886110.345 [ThrusterHE](FAULT): Could not get status:serial timeout 2022-05-30T04:48:56.516Z,1653886136.516 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-30T05:54:19.318Z,1653890059.318 [DataOverHttps](IMPORTANT): SBD MTMSN=20220530T055419