2023-05-08T21:57:40.358Z,1683583060.358 [Supervisor](IMPORTANT): Reading configuration overrides from Data/persisted.cfg 2023-05-08T21:57:43.425Z,1683583063.425 [StratificationFrontDetector](IMPORTANT): thresholdVTHI set to: 0.100000 degC 2023-05-08T21:57:44.268Z,1683583064.268 [SBIT](IMPORTANT): git: 2023-04-26-7-g7f279a801 2023-05-08T21:57:44.268Z,1683583064.268 [SBIT](IMPORTANT): Kernel Release: 2.6.27.8 2023-05-08T21:57:45.110Z,1683583065.110 [DropWeight](CRITICAL): DROP WEIGHT MISSING. 2023-05-08T21:57:45.138Z,1683583065.138 [CommandExec](FAULT): Scheduling is paused 2023-05-08T21:57:45.151Z,1683583065.151 [CBIT](CRITICAL): Hardware Fault in component: DropWeight 2023-05-08T21:58:06.218Z,1683583086.218 [CommandExec](IMPORTANT): got command failComponent none DropWeight 2023-05-08T21:58:06.219Z,1683583086.219 [CommandExec](IMPORTANT): DropWeight failureMode is No Fault 2023-05-08T21:58:44.604Z,1683583124.604 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-08T21:59:44.659Z,1683583184.659 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:59:48.296Z,1683583188.296 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-08T21:59:58.806Z,1683583198.806 [SBIT](IMPORTANT): Beginning Startup BIT 2023-05-08T21:59:58.810Z,1683583198.810 [CBIT](IMPORTANT): Beginning ground fault scan 2023-05-08T22:00:09.808Z,1683583209.808 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): 0.001004 CHAN A1 (24V): -0.002242 CHAN A2 (12V): 0.000007 CHAN A3 (5V): -0.000019 CHAN B0 (3.3V): 0.000037 CHAN B1 (3.15aV): 0.000415 CHAN B2 (3.15bV): 0.000846 CHAN B3 (GND): 0.000340 OPEN: 0.005179 Full Scale: +/- 1 mA 2023-05-08T22:00:51.756Z,1683583251.756 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-08T22:00:52.941Z,1683583252.941 [SBIT](IMPORTANT): SBIT PASSED 2023-05-08T22:00:52.942Z,1683583252.942 [SBIT](IMPORTANT): Listing configuration overrides from Data/persisted.cfg 2023-05-08T22:00:52.943Z,1683583252.943 [SBIT](IMPORTANT): AHRS_M2.loadAtStartup=0 bool; 2023-05-08T22:00:52.943Z,1683583252.943 [SBIT](IMPORTANT): BPC1.batteryMissingStickThreshold=12 count; 2023-05-08T22:00:52.943Z,1683583252.943 [SBIT](IMPORTANT): CTD_Seabird.loadAtStartup=0 bool; 2023-05-08T22:00:52.943Z,1683583252.943 [SBIT](IMPORTANT): DAT.sbdAddress=-1 enum; 2023-05-08T22:00:52.943Z,1683583252.943 [SBIT](IMPORTANT): DVL_micro.loadAtStartup=0 bool; 2023-05-08T22:00:52.943Z,1683583252.943 [SBIT](IMPORTANT): Depth_Keller.offset=3.6 decibar; 2023-05-08T22:00:52.943Z,1683583252.943 [SBIT](IMPORTANT): Express none CBIT.ampHoursUsed; 2023-05-08T22:00:52.944Z,1683583252.944 [SBIT](IMPORTANT): Express linearApproximation VerticalHomogeneityIndexCalculator.vertical_salinity_homogeneity_index 0.050000 practical_salinity_unit; 2023-05-08T22:00:52.944Z,1683583252.944 [SBIT](IMPORTANT): Express linearApproximation VerticalHomogeneityIndexCalculator.vertical_temperature_homogeneity_index 0.050000 celsius; 2023-05-08T22:00:52.944Z,1683583252.944 [SBIT](IMPORTANT): Express none WetLabsBB2FL.bin_mean_mass_concentration_of_chlorophyll_in_sea_water; 2023-05-08T22:00:52.944Z,1683583252.944 [SBIT](IMPORTANT): Express none height_above_sea_floor; 2023-05-08T22:00:52.944Z,1683583252.944 [SBIT](IMPORTANT): StratificationFrontDetector.loadAtStartup=1 bool; 2023-05-08T22:00:52.944Z,1683583252.944 [SBIT](IMPORTANT): StratificationFrontDetector.threshold_VTHI=0.1 celsius; 2023-05-08T22:00:52.944Z,1683583252.944 [SBIT](IMPORTANT): StratificationFrontDetector.verbosity=1 count; 2023-05-08T22:00:52.944Z,1683583252.944 [SBIT](IMPORTANT): VerticalControl.buoyancyNeutral=208.617815 cubic_centimeter; 2023-05-08T22:00:52.945Z,1683583252.945 [SBIT](IMPORTANT): VerticalControl.massDefault=28.688721 millimeter; 2023-05-08T22:00:52.945Z,1683583252.945 [SBIT](IMPORTANT): VerticalControl.massPositionLimitAft=-28 millimeter; 2023-05-08T22:00:52.945Z,1683583252.945 [SBIT](IMPORTANT): VerticalControl.massPositionLimitFwd=32 millimeter; 2023-05-08T22:00:52.945Z,1683583252.945 [SBIT](IMPORTANT): VerticalControl.surfaceThreshold=1.5 meter; 2023-05-08T22:00:52.945Z,1683583252.945 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth1=3 meter; 2023-05-08T22:00:52.945Z,1683583252.945 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth2=5 meter; 2023-05-08T22:00:52.945Z,1683583252.945 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth3=10 meter; 2023-05-08T22:00:52.945Z,1683583252.945 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth4=15 meter; 2023-05-08T22:00:52.945Z,1683583252.945 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.loadAtStartup=1 bool; 2023-05-08T22:00:52.946Z,1683583252.946 [SBIT](IMPORTANT): WetLabsBB2FL.loadAtStartup=0 bool; 2023-05-08T22:00:53.357Z,1683583253.357 [MissionManager](IMPORTANT): Started mission Startup 2023-05-08T22:01:45.883Z,1683583305.883 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T22:01:55.443Z,1683583315.443 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-08T22:02:01.362Z,1683583321.362 [CommandExec](IMPORTANT): got command run ./Missions/Maintenance/sample_lab.xml 2023-05-08T22:02:01.516Z,1683583321.516 [CommandExec](IMPORTANT): Running ./Missions/Maintenance/sample_lab.xml 2023-05-08T22:02:48.614Z,1683583368.614 [MissionManager](IMPORTANT): Started mission sample_lab 2023-05-08T22:02:48.615Z,1683583368.615 [sample_lab:SampleRepeater:A](IMPORTANT): Sampling ESP cartridge type -4.000000 count 2023-05-08T22:02:50.202Z,1683583370.202 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::|summary:' 2023-05-08T22:02:59.147Z,1683583379.147 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-08T22:03:00.344Z,1683583380.344 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-05-08T22:03:00.468Z,1683583380.468 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-05-08T22:03:26.968Z,1683583406.968 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-05-08T22:03:46.773Z,1683583426.773 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T22:03:55.247Z,1683583435.247 [ESPComponent](IMPORTANT): ESP has connected as client 2023-05-08T22:03:56.078Z,1683583436.078 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -4 2023-05-08T22:03:56.078Z,1683583436.078 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-05-08T22:03:57.283Z,1683583437.283 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG 2023-05-08T22:03:57.686Z,1683583437.686 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-05-08T22:03:59.292Z,1683583439.292 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE 2023-05-08T22:04:01.306Z,1683583441.306 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING 2023-05-08T22:04:02.615Z,1683583442.615 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-08T22:04:30.818Z,1683583470.818 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-05-08T22:04:31.217Z,1683583471.217 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED 2023-05-08T22:05:06.092Z,1683583506.092 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-08T22:05:47.987Z,1683583547.987 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T22:06:09.575Z,1683583569.575 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-08T22:06:09.804Z,1683583569.804 [CBIT](FAULT): Communications Fault in component: DAT 2023-05-08T22:07:49.193Z,1683583669.193 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T22:08:26.333Z,1683583706.333 [NAL9602](FAULT): GPS failed to acquire within timeout. 2023-05-08T22:09:30.988Z,1683583770.988 [ESPComponent](CRITICAL): [sample #1] ESP sampling sequence terminated with error: In state S_LOADING_CARTRIDGE got exception while awaiting result for cmd='Cmd.loadCartridge -4' exception=<>. Elapsed time since command issued: 2.0244 2023-05-08T22:09:31.790Z,1683583771.790 [MissionManager](IMPORTANT): Started mission Default 2023-05-08T22:09:50.377Z,1683583790.377 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T22:11:51.588Z,1683583911.588 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T22:13:52.775Z,1683584032.775 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T22:15:53.654Z,1683584153.654 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T22:17:54.824Z,1683584274.824 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T22:18:08.938Z,1683584288.938 [CommandExec](IMPORTANT): got command restart system