2023-05-08T19:20:07.845Z,1683573607.845 [Supervisor](IMPORTANT): Reading configuration overrides from Data/persisted.cfg 2023-05-08T19:20:10.844Z,1683573610.844 [StratificationFrontDetector](IMPORTANT): thresholdVTHI set to: 0.100000 degC 2023-05-08T19:20:11.648Z,1683573611.648 [SBIT](IMPORTANT): git: 2023-04-26-7-g7f279a801 2023-05-08T19:20:11.648Z,1683573611.648 [SBIT](IMPORTANT): Kernel Release: 2.6.27.8 2023-05-08T19:20:12.457Z,1683573612.457 [DropWeight](CRITICAL): DROP WEIGHT MISSING. 2023-05-08T19:20:12.486Z,1683573612.486 [CommandExec](FAULT): Scheduling is paused 2023-05-08T19:20:12.498Z,1683573612.498 [CBIT](CRITICAL): Hardware Fault in component: DropWeight 2023-05-08T19:21:11.980Z,1683573671.980 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-08T19:21:47.386Z,1683573707.386 [CommandExec](IMPORTANT): got command failComponent none DropWeight 2023-05-08T19:21:47.386Z,1683573707.386 [CommandExec](IMPORTANT): DropWeight failureMode is No Fault 2023-05-08T19:21:56.753Z,1683573716.753 [CommandExec](IMPORTANT): got command show stack 2023-05-08T19:21:56.753Z,1683573716.753 [CommandExec](IMPORTANT): Behavior Stack: 2023-05-08T19:21:56.753Z,1683573716.753 [MissionManager](IMPORTANT): Mission loaded, but not running. 2023-05-08T19:22:12.019Z,1683573732.019 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T19:22:15.844Z,1683573735.844 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-08T19:22:26.174Z,1683573746.174 [SBIT](IMPORTANT): Beginning Startup BIT 2023-05-08T19:22:26.178Z,1683573746.178 [CBIT](IMPORTANT): Beginning ground fault scan 2023-05-08T19:22:37.172Z,1683573757.172 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): 0.008145 CHAN A1 (24V): -0.001974 CHAN A2 (12V): -0.000473 CHAN A3 (5V): 0.000192 CHAN B0 (3.3V): 0.000087 CHAN B1 (3.15aV): 0.000089 CHAN B2 (3.15bV): 0.000247 CHAN B3 (GND): 0.001055 OPEN: 0.004761 Full Scale: +/- 1 mA 2023-05-08T19:23:19.712Z,1683573799.712 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-08T19:23:20.301Z,1683573800.301 [SBIT](IMPORTANT): SBIT PASSED 2023-05-08T19:23:20.302Z,1683573800.302 [SBIT](IMPORTANT): Listing configuration overrides from Data/persisted.cfg 2023-05-08T19:23:20.302Z,1683573800.302 [SBIT](IMPORTANT): AHRS_M2.loadAtStartup=0 bool; 2023-05-08T19:23:20.302Z,1683573800.302 [SBIT](IMPORTANT): BPC1.batteryMissingStickThreshold=12 count; 2023-05-08T19:23:20.303Z,1683573800.303 [SBIT](IMPORTANT): CTD_Seabird.loadAtStartup=0 bool; 2023-05-08T19:23:20.303Z,1683573800.303 [SBIT](IMPORTANT): DAT.sbdAddress=-1 enum; 2023-05-08T19:23:20.303Z,1683573800.303 [SBIT](IMPORTANT): DVL_micro.loadAtStartup=0 bool; 2023-05-08T19:23:20.303Z,1683573800.303 [SBIT](IMPORTANT): Depth_Keller.offset=3.6 decibar; 2023-05-08T19:23:20.303Z,1683573800.303 [SBIT](IMPORTANT): Express none CBIT.ampHoursUsed; 2023-05-08T19:23:20.303Z,1683573800.303 [SBIT](IMPORTANT): Express linearApproximation VerticalHomogeneityIndexCalculator.vertical_salinity_homogeneity_index 0.050000 practical_salinity_unit; 2023-05-08T19:23:20.304Z,1683573800.304 [SBIT](IMPORTANT): Express linearApproximation VerticalHomogeneityIndexCalculator.vertical_temperature_homogeneity_index 0.050000 celsius; 2023-05-08T19:23:20.304Z,1683573800.304 [SBIT](IMPORTANT): Express none WetLabsBB2FL.bin_mean_mass_concentration_of_chlorophyll_in_sea_water; 2023-05-08T19:23:20.304Z,1683573800.304 [SBIT](IMPORTANT): Express none height_above_sea_floor; 2023-05-08T19:23:20.304Z,1683573800.304 [SBIT](IMPORTANT): StratificationFrontDetector.loadAtStartup=1 bool; 2023-05-08T19:23:20.304Z,1683573800.304 [SBIT](IMPORTANT): StratificationFrontDetector.threshold_VTHI=0.1 celsius; 2023-05-08T19:23:20.304Z,1683573800.304 [SBIT](IMPORTANT): StratificationFrontDetector.verbosity=1 count; 2023-05-08T19:23:20.304Z,1683573800.304 [SBIT](IMPORTANT): VerticalControl.buoyancyNeutral=208.617815 cubic_centimeter; 2023-05-08T19:23:20.304Z,1683573800.304 [SBIT](IMPORTANT): VerticalControl.massDefault=28.688721 millimeter; 2023-05-08T19:23:20.304Z,1683573800.304 [SBIT](IMPORTANT): VerticalControl.massPositionLimitAft=-28 millimeter; 2023-05-08T19:23:20.305Z,1683573800.305 [SBIT](IMPORTANT): VerticalControl.massPositionLimitFwd=32 millimeter; 2023-05-08T19:23:20.305Z,1683573800.305 [SBIT](IMPORTANT): VerticalControl.surfaceThreshold=1.5 meter; 2023-05-08T19:23:20.305Z,1683573800.305 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth1=3 meter; 2023-05-08T19:23:20.305Z,1683573800.305 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth2=5 meter; 2023-05-08T19:23:20.305Z,1683573800.305 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth3=10 meter; 2023-05-08T19:23:20.305Z,1683573800.305 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth4=15 meter; 2023-05-08T19:23:20.305Z,1683573800.305 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.loadAtStartup=1 bool; 2023-05-08T19:23:20.305Z,1683573800.305 [SBIT](IMPORTANT): WetLabsBB2FL.loadAtStartup=0 bool; 2023-05-08T19:23:20.709Z,1683573800.709 [MissionManager](IMPORTANT): Started mission Startup 2023-05-08T19:24:13.232Z,1683573853.232 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T19:24:15.294Z,1683573855.294 [CommandExec](IMPORTANT): got command run ./Missions/Maintenance/sample_lab.xml 2023-05-08T19:24:15.351Z,1683573855.351 [CommandExec](IMPORTANT): Running ./Missions/Maintenance/sample_lab.xml 2023-05-08T19:24:23.584Z,1683573863.584 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-08T19:25:21.685Z,1683573921.685 [MissionManager](IMPORTANT): Started mission sample_lab 2023-05-08T19:25:21.687Z,1683573921.687 [sample_lab:SampleRepeater:A](IMPORTANT): Sampling ESP cartridge type -4.000000 count 2023-05-08T19:25:23.291Z,1683573923.291 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::|summary:' 2023-05-08T19:25:27.244Z,1683573927.244 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-08T19:25:33.377Z,1683573933.377 [ESPComponent](FAULT): Error opening server socket 2023-05-08T19:25:45.128Z,1683573945.128 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-05-08T19:25:45.285Z,1683573945.285 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-05-08T19:25:55.189Z,1683573955.189 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-05-08T19:26:14.185Z,1683573974.185 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T19:26:30.903Z,1683573990.903 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-08T19:26:37.202Z,1683573997.202 [ESPComponent](IMPORTANT): ESP has connected as client 2023-05-08T19:26:38.015Z,1683573998.015 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -4 2023-05-08T19:26:38.016Z,1683573998.016 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-05-08T19:26:39.241Z,1683573999.241 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG 2023-05-08T19:26:39.627Z,1683573999.627 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-05-08T19:26:41.261Z,1683574001.261 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE 2023-05-08T19:26:43.281Z,1683574003.281 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING 2023-05-08T19:27:12.764Z,1683574032.764 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e & 2023-05-08T19:27:13.158Z,1683574033.158 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED 2023-05-08T19:27:34.783Z,1683574054.783 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-08T19:28:15.404Z,1683574095.404 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T19:28:38.432Z,1683574118.432 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-08T19:28:38.822Z,1683574118.822 [CBIT](FAULT): Communications Fault in component: DAT 2023-05-08T19:30:16.584Z,1683574216.584 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T19:30:54.549Z,1683574254.549 [NAL9602](FAULT): GPS failed to acquire within timeout. 2023-05-08T19:32:12.936Z,1683574332.936 [ESPComponent](CRITICAL): [sample #1] ESP sampling sequence terminated with error: In state S_LOADING_CARTRIDGE got exception while awaiting result for cmd='Cmd.loadCartridge -4' exception=<>. Elapsed time since command issued: 2.0224 2023-05-08T19:32:13.744Z,1683574333.744 [MissionManager](IMPORTANT): Started mission Default 2023-05-08T19:32:17.804Z,1683574337.804 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T19:33:00.530Z,1683574380.530 [CommandExec](IMPORTANT): got command run ./Missions/Maintenance/sample_lab.xml 2023-05-08T19:33:00.609Z,1683574380.609 [CommandExec](IMPORTANT): Running ./Missions/Maintenance/sample_lab.xml 2023-05-08T19:33:00.631Z,1683574380.631 [MissionManager](IMPORTANT): Started mission sample_lab 2023-05-08T19:33:00.633Z,1683574380.633 [sample_lab:SampleRepeater:A](IMPORTANT): Sampling ESP cartridge type -4.000000 count 2023-05-08T19:33:12.424Z,1683574392.424 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-05-08T19:33:12.536Z,1683574392.536 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-05-08T19:34:05.647Z,1683574445.647 [ESPComponent](IMPORTANT): ESP has connected as client 2023-05-08T19:34:06.472Z,1683574446.472 [ESPComponent](IMPORTANT): [sample #2] Setting cartridge argument to -4 2023-05-08T19:34:06.472Z,1683574446.472 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-05-08T19:34:07.260Z,1683574447.260 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_LOG 2023-05-08T19:34:07.663Z,1683574447.663 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-05-08T19:34:09.696Z,1683574449.696 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_LOADING_CARTRIDGE 2023-05-08T19:34:11.707Z,1683574451.707 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPING 2023-05-08T19:34:18.607Z,1683574458.607 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T19:34:41.216Z,1683574481.216 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e & 2023-05-08T19:34:41.616Z,1683574481.616 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPED 2023-05-08T19:34:53.715Z,1683574493.715 [CommandExec](IMPORTANT): got command restart application 2023-05-08T19:34:55.355Z,1683574495.355 [MissionManager](IMPORTANT): Started mission Default