2023-05-08T19:35:06.038Z,1683574506.038 [Supervisor](IMPORTANT): Reading configuration overrides from Data/persisted.cfg 2023-05-08T19:35:08.521Z,1683574508.521 [StratificationFrontDetector](IMPORTANT): thresholdVTHI set to: 0.100000 degC 2023-05-08T19:35:09.324Z,1683574509.324 [SBIT](IMPORTANT): git: 2023-04-26-7-g7f279a801 2023-05-08T19:35:09.325Z,1683574509.325 [SBIT](IMPORTANT): Kernel Release: 2.6.27.8 2023-05-08T19:35:10.345Z,1683574510.345 [DropWeight](CRITICAL): DROP WEIGHT MISSING. 2023-05-08T19:35:10.419Z,1683574510.419 [CommandExec](FAULT): Scheduling is paused 2023-05-08T19:35:10.430Z,1683574510.430 [CBIT](CRITICAL): Hardware Fault in component: DropWeight 2023-05-08T19:35:31.392Z,1683574531.392 [CommandExec](IMPORTANT): got command failComponent none DropWeight 2023-05-08T19:35:31.392Z,1683574531.392 [CommandExec](IMPORTANT): DropWeight failureMode is No Fault 2023-05-08T19:35:38.588Z,1683574538.588 [CommandExec](IMPORTANT): got command quick on 2023-05-08T19:35:38.589Z,1683574538.589 [CommandExec](FAULT): Quicker than real-time not allowed. 2023-05-08T19:35:38.589Z,1683574538.589 [CommandExec](IMPORTANT): Quicker than real-time state is off 2023-05-08T19:37:09.519Z,1683574629.519 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T19:37:24.066Z,1683574644.066 [SBIT](IMPORTANT): Beginning Startup BIT 2023-05-08T19:37:24.070Z,1683574644.070 [CBIT](IMPORTANT): Beginning ground fault scan 2023-05-08T19:37:35.047Z,1683574655.047 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): 0.007678 CHAN A1 (24V): -0.001453 CHAN A2 (12V): -0.000519 CHAN A3 (5V): -0.000093 CHAN B0 (3.3V): 0.000296 CHAN B1 (3.15aV): 0.000684 CHAN B2 (3.15bV): 0.000041 CHAN B3 (GND): 0.000578 OPEN: 0.004967 Full Scale: +/- 1 mA 2023-05-08T19:38:18.203Z,1683574698.203 [SBIT](IMPORTANT): SBIT PASSED 2023-05-08T19:38:18.203Z,1683574698.203 [SBIT](IMPORTANT): Listing configuration overrides from Data/persisted.cfg 2023-05-08T19:38:18.204Z,1683574698.204 [SBIT](IMPORTANT): AHRS_M2.loadAtStartup=0 bool; 2023-05-08T19:38:18.204Z,1683574698.204 [SBIT](IMPORTANT): BPC1.batteryMissingStickThreshold=12 count; 2023-05-08T19:38:18.204Z,1683574698.204 [SBIT](IMPORTANT): CTD_Seabird.loadAtStartup=0 bool; 2023-05-08T19:38:18.204Z,1683574698.204 [SBIT](IMPORTANT): DAT.sbdAddress=-1 enum; 2023-05-08T19:38:18.205Z,1683574698.205 [SBIT](IMPORTANT): DVL_micro.loadAtStartup=0 bool; 2023-05-08T19:38:18.205Z,1683574698.205 [SBIT](IMPORTANT): Depth_Keller.offset=3.6 decibar; 2023-05-08T19:38:18.205Z,1683574698.205 [SBIT](IMPORTANT): Express none CBIT.ampHoursUsed; 2023-05-08T19:38:18.205Z,1683574698.205 [SBIT](IMPORTANT): Express linearApproximation VerticalHomogeneityIndexCalculator.vertical_salinity_homogeneity_index 0.050000 practical_salinity_unit; 2023-05-08T19:38:18.205Z,1683574698.205 [SBIT](IMPORTANT): Express linearApproximation VerticalHomogeneityIndexCalculator.vertical_temperature_homogeneity_index 0.050000 celsius; 2023-05-08T19:38:18.205Z,1683574698.205 [SBIT](IMPORTANT): Express none WetLabsBB2FL.bin_mean_mass_concentration_of_chlorophyll_in_sea_water; 2023-05-08T19:38:18.205Z,1683574698.205 [SBIT](IMPORTANT): Express none height_above_sea_floor; 2023-05-08T19:38:18.205Z,1683574698.205 [SBIT](IMPORTANT): StratificationFrontDetector.loadAtStartup=1 bool; 2023-05-08T19:38:18.206Z,1683574698.206 [SBIT](IMPORTANT): StratificationFrontDetector.threshold_VTHI=0.1 celsius; 2023-05-08T19:38:18.206Z,1683574698.206 [SBIT](IMPORTANT): StratificationFrontDetector.verbosity=1 count; 2023-05-08T19:38:18.206Z,1683574698.206 [SBIT](IMPORTANT): VerticalControl.buoyancyNeutral=208.617815 cubic_centimeter; 2023-05-08T19:38:18.206Z,1683574698.206 [SBIT](IMPORTANT): VerticalControl.massDefault=28.688721 millimeter; 2023-05-08T19:38:18.206Z,1683574698.206 [SBIT](IMPORTANT): VerticalControl.massPositionLimitAft=-28 millimeter; 2023-05-08T19:38:18.206Z,1683574698.206 [SBIT](IMPORTANT): VerticalControl.massPositionLimitFwd=32 millimeter; 2023-05-08T19:38:18.206Z,1683574698.206 [SBIT](IMPORTANT): VerticalControl.surfaceThreshold=1.5 meter; 2023-05-08T19:38:18.206Z,1683574698.206 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth1=3 meter; 2023-05-08T19:38:18.206Z,1683574698.206 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth2=5 meter; 2023-05-08T19:38:18.207Z,1683574698.207 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth3=10 meter; 2023-05-08T19:38:18.207Z,1683574698.207 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth4=15 meter; 2023-05-08T19:38:18.207Z,1683574698.207 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.loadAtStartup=1 bool; 2023-05-08T19:38:18.207Z,1683574698.207 [SBIT](IMPORTANT): WetLabsBB2FL.loadAtStartup=0 bool; 2023-05-08T19:38:18.617Z,1683574698.617 [MissionManager](IMPORTANT): Started mission Startup 2023-05-08T19:38:56.870Z,1683574736.870 [CommandExec](IMPORTANT): got command run ./Missions/Maintenance/sample_lab.xml 2023-05-08T19:38:56.929Z,1683574736.929 [CommandExec](IMPORTANT): Running ./Missions/Maintenance/sample_lab.xml 2023-05-08T19:39:10.749Z,1683574750.749 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T19:40:19.201Z,1683574819.201 [MissionManager](IMPORTANT): Started mission sample_lab 2023-05-08T19:40:19.203Z,1683574819.203 [sample_lab:SampleRepeater:A](IMPORTANT): Sampling ESP cartridge type -4.000000 count 2023-05-08T19:40:20.806Z,1683574820.806 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::|summary:' 2023-05-08T19:40:30.894Z,1683574830.894 [ESPComponent](FAULT): Error opening server socket 2023-05-08T19:40:42.655Z,1683574842.655 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-05-08T19:40:42.768Z,1683574842.768 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-05-08T19:40:52.717Z,1683574852.717 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-05-08T19:41:11.764Z,1683574871.764 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T19:41:35.180Z,1683574895.180 [ESPComponent](IMPORTANT): ESP has connected as client 2023-05-08T19:41:35.979Z,1683574895.979 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -4 2023-05-08T19:41:35.980Z,1683574895.980 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-05-08T19:41:37.190Z,1683574897.190 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG 2023-05-08T19:41:37.594Z,1683574897.594 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-05-08T19:41:39.211Z,1683574899.211 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE 2023-05-08T19:41:41.244Z,1683574901.244 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING 2023-05-08T19:42:10.730Z,1683574930.730 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-05-08T19:42:11.136Z,1683574931.136 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED 2023-05-08T19:43:12.559Z,1683574992.559 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T19:45:13.764Z,1683575113.764 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T19:45:51.714Z,1683575151.714 [NAL9602](FAULT): GPS failed to acquire within timeout. 2023-05-08T19:47:10.912Z,1683575230.912 [ESPComponent](CRITICAL): [sample #1] ESP sampling sequence terminated with error: In state S_LOADING_CARTRIDGE got exception while awaiting result for cmd='Cmd.loadCartridge -4' exception=<>. Elapsed time since command issued: 2.0244 2023-05-08T19:47:11.720Z,1683575231.720 [MissionManager](IMPORTANT): Started mission Default 2023-05-08T19:47:14.972Z,1683575234.972 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T19:49:16.157Z,1683575356.157 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T19:51:16.000Z,1683575477.000 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T19:53:17.811Z,1683575597.811 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T19:55:18.653Z,1683575718.653 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T19:56:35.325Z,1683575795.325 [NAL9602](FAULT): GPS failed to acquire within timeout. 2023-05-08T19:57:19.773Z,1683575839.773 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T19:59:20.992Z,1683575960.992 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:00:55.504Z,1683576055.504 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 13.722996 min 2023-05-08T20:01:22.171Z,1683576082.171 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:03:23.385Z,1683576203.385 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:05:24.585Z,1683576324.585 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:05:32.644Z,1683576332.644 [DropWeight](CRITICAL): DROP WEIGHT MISSING. 2023-05-08T20:05:32.715Z,1683576332.715 [CBIT](CRITICAL): Hardware Fault in component: DropWeight 2023-05-08T20:07:19.719Z,1683576439.719 [NAL9602](FAULT): GPS failed to acquire within timeout. 2023-05-08T20:07:25.782Z,1683576445.782 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:09:26.995Z,1683576566.995 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:11:18.892Z,1683576678.892 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 24.112742 min 2023-05-08T20:11:28.185Z,1683576688.185 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:13:29.397Z,1683576809.397 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:15:30.579Z,1683576930.579 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:17:31.804Z,1683577051.804 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:18:04.096Z,1683577084.096 [NAL9602](FAULT): GPS failed to acquire within timeout. 2023-05-08T20:19:32.983Z,1683577172.983 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:20:59.572Z,1683577259.572 [CommandExec](IMPORTANT): got command run ./Missions/Maintenance/sample_lab.xml 2023-05-08T20:20:59.644Z,1683577259.644 [CommandExec](IMPORTANT): Running ./Missions/Maintenance/sample_lab.xml 2023-05-08T20:20:59.857Z,1683577259.857 [MissionManager](IMPORTANT): Started mission sample_lab 2023-05-08T20:20:59.858Z,1683577259.858 [sample_lab:SampleRepeater:A](IMPORTANT): Sampling ESP cartridge type -4.000000 count 2023-05-08T20:21:11.665Z,1683577271.665 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-05-08T20:21:11.817Z,1683577271.817 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-05-08T20:21:33.803Z,1683577293.803 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:22:04.487Z,1683577324.487 [ESPComponent](IMPORTANT): ESP has connected as client 2023-05-08T20:22:05.304Z,1683577325.304 [ESPComponent](IMPORTANT): [sample #2] Setting cartridge argument to -4 2023-05-08T20:22:05.304Z,1683577325.304 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-05-08T20:22:06.096Z,1683577326.096 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_LOG 2023-05-08T20:22:06.496Z,1683577326.496 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-05-08T20:22:08.519Z,1683577328.519 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_LOADING_CARTRIDGE 2023-05-08T20:22:10.539Z,1683577330.539 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPING 2023-05-08T20:22:40.032Z,1683577360.032 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-05-08T20:22:40.453Z,1683577360.453 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPED 2023-05-08T20:23:34.980Z,1683577414.980 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:25:36.201Z,1683577536.201 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:26:19.411Z,1683577579.411 [CommandExec](IMPORTANT): got command run ./Missions/Maintenance/sample_lab.xml 2023-05-08T20:26:19.517Z,1683577579.517 [CommandExec](IMPORTANT): Running ./Missions/Maintenance/sample_lab.xml 2023-05-08T20:26:19.820Z,1683577579.820 [MissionManager](IMPORTANT): Started mission sample_lab 2023-05-08T20:26:19.822Z,1683577579.822 [sample_lab:SampleRepeater:A](IMPORTANT): Sampling ESP cartridge type -4.000000 count 2023-05-08T20:27:37.380Z,1683577657.380 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:27:40.202Z,1683577660.202 [ESPComponent](CRITICAL): [sample #2] ESP sampling sequence terminated with error: In state S_LOADING_CARTRIDGE got exception while awaiting result for cmd='Cmd.loadCartridge -4' exception=<>. Elapsed time since command issued: 2.0212 2023-05-08T20:27:40.245Z,1683577660.245 [CBIT](CRITICAL): Communications Fault in component: ESPComponent 2023-05-08T20:27:41.022Z,1683577661.022 [MissionManager](IMPORTANT): Started mission Default 2023-05-08T20:28:48.477Z,1683577728.477 [NAL9602](FAULT): GPS failed to acquire within timeout. 2023-05-08T20:28:48.494Z,1683577728.494 [CBIT](CRITICAL): Data Fault in component: NAL9602 2023-05-08T20:29:38.198Z,1683577778.198 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:31:39.016Z,1683577899.016 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:33:40.171Z,1683578020.171 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:35:41.371Z,1683578141.371 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:37:42.571Z,1683578262.571 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:38:22.590Z,1683578302.590 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 10.685742 min 2023-05-08T20:39:43.771Z,1683578383.771 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:41:02.565Z,1683578462.565 [NAL9602](FAULT): GPS failed to acquire within timeout. 2023-05-08T20:41:44.604Z,1683578504.604 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:43:45.434Z,1683578625.434 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:45:46.300Z,1683578746.300 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:47:47.407Z,1683578867.407 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:48:45.584Z,1683578925.584 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 21.069318 min 2023-05-08T20:49:48.226Z,1683578988.226 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:50:34.252Z,1683579034.252 [DropWeight](CRITICAL): DROP WEIGHT MISSING. 2023-05-08T20:50:34.315Z,1683579034.315 [CBIT](CRITICAL): Hardware Fault in component: DropWeight 2023-05-08T20:51:46.973Z,1683579106.973 [NAL9602](FAULT): GPS failed to acquire within timeout. 2023-05-08T20:51:49.407Z,1683579109.407 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:53:50.272Z,1683579230.272 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:55:51.449Z,1683579351.449 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:57:52.666Z,1683579472.666 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T20:57:59.408Z,1683579479.408 [CommandExec](IMPORTANT): got command run ./Missions/Maintenance/sample_lab.xml 2023-05-08T20:57:59.458Z,1683579479.458 [CommandExec](IMPORTANT): Running ./Missions/Maintenance/sample_lab.xml 2023-05-08T20:57:59.531Z,1683579479.531 [MissionManager](IMPORTANT): Started mission sample_lab 2023-05-08T20:57:59.534Z,1683579479.534 [sample_lab:SampleRepeater:A](IMPORTANT): Sampling ESP cartridge type -4.000000 count 2023-05-08T20:58:11.348Z,1683579491.348 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-05-08T20:58:11.476Z,1683579491.476 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-05-08T20:58:33.487Z,1683579513.487 [CommandExec](IMPORTANT): got command stop 2023-05-08T20:58:33.488Z,1683579513.488 [CommandExec](IMPORTANT): Scheduling is paused 2023-05-08T20:58:34.266Z,1683579514.266 [MissionManager](IMPORTANT): Started mission Default 2023-05-08T20:59:53.868Z,1683579593.868 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:00:41.513Z,1683579641.513 [ESPComponent](FAULT): Timeout while waiting for ESP to connect (elapsed=150.0373) 2023-05-08T21:01:55.061Z,1683579715.061 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:02:30.186Z,1683579750.186 [NAL9602](FAULT): GPS failed to acquire within timeout. 2023-05-08T21:03:55.861Z,1683579835.861 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:05:57.047Z,1683579957.047 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:07:58.258Z,1683580078.258 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:09:16.214Z,1683580156.214 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 10.692516 min 2023-05-08T21:09:59.464Z,1683580199.464 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:12:00.281Z,1683580320.281 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:13:14.589Z,1683580394.589 [NAL9602](FAULT): GPS failed to acquire within timeout. 2023-05-08T21:14:01.459Z,1683580441.459 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:16:02.399Z,1683580562.399 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:18:03.599Z,1683580683.599 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:19:39.350Z,1683580779.350 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 21.077968 min 2023-05-08T21:20:04.411Z,1683580804.411 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:22:05.595Z,1683580925.595 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:23:57.093Z,1683581037.093 [NAL9602](FAULT): GPS failed to acquire within timeout. 2023-05-08T21:23:57.110Z,1683581037.110 [CBIT](CRITICAL): Data Fault in component: NAL9602 2023-05-08T21:23:57.523Z,1683581037.523 [CommandExec](FAULT): Scheduling is paused 2023-05-08T21:24:06.794Z,1683581046.794 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:26:08.016Z,1683581168.016 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:28:09.196Z,1683581289.196 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:30:06.774Z,1683581406.774 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 31.535183 min 2023-05-08T21:30:10.396Z,1683581410.396 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:32:11.599Z,1683581531.599 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:34:12.797Z,1683581652.797 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:35:36.025Z,1683581736.025 [DropWeight](CRITICAL): DROP WEIGHT MISSING. 2023-05-08T21:35:36.086Z,1683581736.086 [CBIT](CRITICAL): Hardware Fault in component: DropWeight 2023-05-08T21:36:11.173Z,1683581771.173 [NAL9602](FAULT): GPS failed to acquire within timeout. 2023-05-08T21:36:13.602Z,1683581773.602 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:38:14.804Z,1683581894.804 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:40:16.020Z,1683582016.020 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:40:30.565Z,1683582030.565 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 41.931299 min 2023-05-08T21:42:16.830Z,1683582136.830 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:44:18.031Z,1683582258.031 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:46:18.865Z,1683582378.865 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:46:53.994Z,1683582413.994 [NAL9602](FAULT): GPS failed to acquire within timeout. 2023-05-08T21:48:20.058Z,1683582500.058 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:50:21.270Z,1683582621.270 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:50:54.795Z,1683582654.795 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 52.335681 min 2023-05-08T21:52:22.452Z,1683582742.452 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:54:23.727Z,1683582863.727 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:56:24.504Z,1683582984.504 [DeadReckonUsingMultipleVelocitySources](FAULT): Unable to read the rotation from vehicle frame to navigation frame for more than 120 seconds. 2023-05-08T21:57:25.048Z,1683583045.048 [CommandExec](IMPORTANT): got command restart application