2020-10-06T19:52:43.096Z,1602013963.096 [Supervisor](IMPORTANT): Reading configuration overrides from Data/persisted.cfg 2020-10-06T19:52:48.717Z,1602013968.717 [SBIT](IMPORTANT): git: 2020-09-23a 2020-10-06T19:52:48.718Z,1602013968.718 [SBIT](IMPORTANT): Kernel Release: 2.6.27.8 2020-10-06T19:53:05.049Z,1602013985.049 [MassServo](FAULT): Invalid EZ Servo response:"" 2020-10-06T19:53:50.199Z,1602014030.199 [SBIT](IMPORTANT): Beginning Startup BIT 2020-10-06T19:53:50.203Z,1602014030.203 [CBIT](IMPORTANT): Beginning ground fault scan 2020-10-06T19:54:01.129Z,1602014041.129 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.015512 CHAN A1 (24V): -0.169225 CHAN A2 (12V): 0.010560 CHAN A3 (5V): 0.002001 CHAN B0 (3.3V): 0.001541 CHAN B1 (3.15aV): 0.001699 CHAN B2 (3.15bV): 0.001508 CHAN B3 (GND): -0.000883 OPEN: 0.005124 Full Scale Calc: 4.765 mA, -1.589 mA 2020-10-06T19:54:43.989Z,1602014083.989 [SBIT](IMPORTANT): SBIT PASSED 2020-10-06T19:54:43.989Z,1602014083.989 [SBIT](IMPORTANT): Listing configuration overrides from Data/persisted.cfg 2020-10-06T19:54:43.990Z,1602014083.990 [SBIT](IMPORTANT): Aanderaa_O2.loadAtStartup=0 bool; 2020-10-06T19:54:43.990Z,1602014083.990 [SBIT](IMPORTANT): BPC1.batteryMissingStickThreshold=2 count; 2020-10-06T19:54:43.990Z,1602014083.990 [SBIT](IMPORTANT): CANONSampler.loadAtStartup=1 bool; 2020-10-06T19:54:43.991Z,1602014083.991 [SBIT](IMPORTANT): CANONSampler.rotateOnly=1 bool; 2020-10-06T19:54:43.991Z,1602014083.991 [SBIT](IMPORTANT): CBIT.gf24Offset=148.5 microampere; 2020-10-06T19:54:43.991Z,1602014083.991 [SBIT](IMPORTANT): DVL_micro.loadAtStartup=0 bool; 2020-10-06T19:54:43.991Z,1602014083.991 [SBIT](IMPORTANT): DropWeight.loadAtStartup=0 bool; 2020-10-06T19:54:43.991Z,1602014083.991 [SBIT](IMPORTANT): VerticalControl.buoyancyNeutral=230 cubic_centimeter; 2020-10-06T19:54:43.991Z,1602014083.991 [SBIT](IMPORTANT): VerticalControl.massDefault=10.3 millimeter; 2020-10-06T19:54:44.381Z,1602014084.381 [MissionManager](IMPORTANT): Started mission Startup 2020-10-06T19:56:45.109Z,1602014205.109 [MissionManager](IMPORTANT): Started mission Default 2020-10-06T19:57:17.905Z,1602014237.905 [CommandLine](IMPORTANT): got command failComponent 2020-10-06T19:57:17.905Z,1602014237.905 [CommandLine](IMPORTANT): Failed components: 2020-10-06T19:57:17.905Z,1602014237.905 [CommandLine](IMPORTANT): No failed Components. 2020-10-06T19:57:42.779Z,1602014262.779 [CommandLine](IMPORTANT): got command report mod platform_buoyancy_position 2020-10-06T19:57:53.539Z,1602014273.539 [CommandLine](IMPORTANT): got command report mod platform_mass_position 2020-10-06T19:57:57.859Z,1602014277.859 [DataOverHttps](IMPORTANT): SBD MTMSN=20201006T194939 2020-10-06T19:58:05.023Z,1602014285.023 [CommandLine](IMPORTANT): got command load ./Missions/Maintenance/tank_ballast_and_trim.xml 2020-10-06T19:58:07.227Z,1602014287.227 [CommandLine](IMPORTANT): Loaded ./Missions/Maintenance/tank_ballast_and_trim.xml 2020-10-06T19:58:16.251Z,1602014296.251 [CommandLine](IMPORTANT): got command set ballast_and_trim.MissionTimeout 90.000000 minute 2020-10-06T19:58:16.252Z,1602014296.252 [CommandLine](IMPORTANT): got command set ballast_and_trim.MaxWaitOnSurface 5.000000 minute 2020-10-06T19:58:16.253Z,1602014296.253 [CommandLine](IMPORTANT): got command set ballast_and_trim.EstimationTimeout 40.000000 minute 2020-10-06T19:58:16.254Z,1602014296.254 [CommandLine](IMPORTANT): got command set ballast_and_trim.WaitToFloat 1.000000 minute 2020-10-06T19:58:16.254Z,1602014296.254 [CommandLine](IMPORTANT): got command run 2020-10-06T19:58:16.265Z,1602014296.265 [CommandLine](IMPORTANT): Running 2020-10-06T19:58:16.419Z,1602014296.419 [MissionManager](IMPORTANT): Started mission ballast_and_trim 2020-10-06T19:58:32.563Z,1602014312.563 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2020-10-06T20:03:18.017Z,1602014598.017 [ballast_and_trim:RunBallastAndTrim:BallastAndTrim:GoToTargetDepth:ApproachDepth:C.Pitch:A_Timeout:A](IMPORTANT): Timed out trying to reach the target depth. Stopping mission at current depth of 6.000498 m 2020-10-06T20:03:18.433Z,1602014598.433 [CommandLine](IMPORTANT): got command stop 2020-10-06T20:03:18.433Z,1602014598.433 [CommandLine](IMPORTANT): Scheduling is paused 2020-10-06T20:03:18.817Z,1602014598.817 [MissionManager](IMPORTANT): Started mission Default 2020-10-06T20:06:36.833Z,1602014796.833 [NAL9602](FAULT): received: +CSQ:0 OK084, 2, 0, 0, 0 OK 2020-10-06T20:06:37.580Z,1602014797.580 [NAL9602](FAULT): LCB fault: Software Overcurrent. 2020-10-06T20:11:08.429Z,1602015068.429 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2020-10-06T20:12:06.751Z,1602015126.751 [DataOverHttps](IMPORTANT): SBD MTMSN=20201006T200348 2020-10-06T20:12:14.237Z,1602015134.237 [CommandLine](IMPORTANT): got command schedule asap "load Maintenance/tank_ballast_and_trim.xml;set ballast_and_trim.MissionTimeout 90 minute;set ballast_and_trim.MaxWaitOnSurface 10 minute;set ballast_and_trim.EstimationTimeout 40 minute;set ballast_and_trim.WaitToFloat 1 minute" 25h28 1 2.000000 2020-10-06T20:12:14.238Z,1602015134.238 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=25h28 2020-10-06T20:12:14.238Z,1602015134.238 [CommandLine](IMPORTANT): Scheduled #1 (#1 of 2 with id='25h28'): "load Maintenance/tank_ballast_and_trim.xml;set ballast_and_trim.MissionTimeout 90 minute;set ballast_and_trim.MaxWaitOnSurface 10 minute;set ballast_and_trim.EstimationTimeout 40 minute;set ballast_and_trim.WaitToFloat 1 minute" ASAP 2020-10-06T20:12:15.385Z,1602015135.385 [DataOverHttps](IMPORTANT): SBD MOMSN=12798970, MTMSN=20201006T200357 2020-10-06T20:12:22.655Z,1602015142.655 [CommandLine](IMPORTANT): got command schedule asap "run " 25h28 2 2.000000 2020-10-06T20:12:22.655Z,1602015142.655 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=25h28 2020-10-06T20:12:22.656Z,1602015142.656 [CommandLine](IMPORTANT): Scheduled #2 (#2 of 2 with id='25h28'): "run " ASAP 2020-10-06T20:12:22.777Z,1602015142.777 [CommandLine](IMPORTANT): got command load ./Missions/Maintenance/tank_ballast_and_trim.xml 2020-10-06T20:12:24.860Z,1602015144.860 [CommandLine](IMPORTANT): Loaded ./Missions/Maintenance/tank_ballast_and_trim.xml 2020-10-06T20:12:38.042Z,1602015158.042 [CommandLine](IMPORTANT): got command set ballast_and_trim.MissionTimeout 90.000000 minute 2020-10-06T20:12:38.043Z,1602015158.043 [CommandLine](IMPORTANT): got command set ballast_and_trim.MaxWaitOnSurface 10.000000 minute 2020-10-06T20:12:38.044Z,1602015158.044 [CommandLine](IMPORTANT): got command set ballast_and_trim.EstimationTimeout 40.000000 minute 2020-10-06T20:12:38.044Z,1602015158.044 [CommandLine](IMPORTANT): got command set ballast_and_trim.WaitToFloat 1.000000 minute 2020-10-06T20:12:38.257Z,1602015158.257 [CommandLine](IMPORTANT): got command run 2020-10-06T20:12:38.259Z,1602015158.259 [CommandLine](IMPORTANT): Running 2020-10-06T20:12:38.516Z,1602015158.516 [MissionManager](IMPORTANT): Started mission ballast_and_trim 2020-10-06T21:06:57.231Z,1602018417.231 [ballast_and_trim:RunBallastAndTrim:BallastAndTrim:BallastAndTrimAtTargetDepth:F.](FAULT): BallastAndTrim completed. Values did not meet error bound requirements requested by user. Will NOT write estimation values to config! Estimation time: 40.00 minutes (time-out limit reached). 2020-10-06T21:06:57.232Z,1602018417.232 [ballast_and_trim:RunBallastAndTrim:BallastAndTrim:BallastAndTrimAtTargetDepth:F.](IMPORTANT): Estimated buoyancyNeutral: 257.530319 +/- 6.470841 cc (conf. level 99.90%, sigma: 15.773362 cc). 2020-10-06T21:06:57.233Z,1602018417.233 [ballast_and_trim:RunBallastAndTrim:BallastAndTrim:BallastAndTrimAtTargetDepth:F.](IMPORTANT): Estimated massDefault: 13.747354 +/- 0.309624 mm (conf. level 99.90%, sigma: 0.754741 mm). 2020-10-06T21:07:59.022Z,1602018479.022 [MissionManager](IMPORTANT): Started mission Default 2020-10-06T21:09:32.736Z,1602018572.736 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-10-06T21:15:17.785Z,1602018917.785 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2020-10-06T21:22:19.578Z,1602019339.578 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 14.335771 min 2020-10-06T21:22:21.193Z,1602019341.193 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-10-06T21:28:16.335Z,1602019696.335 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2020-10-06T21:32:48.241Z,1602019968.241 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 24.813706 min 2020-10-06T21:37:52.082Z,1602020272.082 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2020-10-06T21:43:16.508Z,1602020596.508 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 35.284737 min 2020-10-06T21:43:18.113Z,1602020598.113 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-10-06T21:49:14.451Z,1602020954.451 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2020-10-06T21:53:45.181Z,1602021225.181 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 45.762708 min 2020-10-06T21:53:54.662Z,1602021234.662 [CommandLine](IMPORTANT): got command strobe off 2020-10-06T21:53:54.662Z,1602021234.662 [CommandLine](IMPORTANT): Deactivating strobe 2020-10-06T21:57:41.912Z,1602021461.912 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-10-06T22:04:21.976Z,1602021861.976 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 56.375863 min 2020-10-06T22:09:25.814Z,1602022165.814 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2020-10-06T22:14:50.649Z,1602022490.649 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 66.853906 min 2020-10-06T22:14:52.253Z,1602022492.253 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-10-06T22:15:48.845Z,1602022548.845 [BPC1](FAULT): Battery stick #38 (s/n: 0139) reported TERMINATE_DISCHARGE_ALARM. Status code: 0x4BD0. 2020-10-06T22:20:37.295Z,1602022837.295 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2020-10-06T22:25:18.088Z,1602023118.088 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 77.310962 min 2020-10-06T22:30:22.292Z,1602023422.292 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2020-10-06T22:35:45.945Z,1602023745.945 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 87.775252 min 2020-10-06T22:35:47.558Z,1602023747.558 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-10-06T22:39:30.041Z,1602023970.041 [CommandLine](IMPORTANT): got command failComponent 2020-10-06T22:39:30.041Z,1602023970.041 [CommandLine](IMPORTANT): Failed components: 2020-10-06T22:39:30.041Z,1602023970.041 [CommandLine](IMPORTANT): No failed Components. 2020-10-06T22:40:53.971Z,1602024053.971 [DataOverHttps](IMPORTANT): SBD MOMSN=12800622, MTMSN=20201006T223235 2020-10-06T22:41:01.280Z,1602024061.280 [CommandLine](IMPORTANT): got command load ./Missions/Maintenance/sample_lab.xml 2020-10-06T22:41:01.339Z,1602024061.339 [CommandLine](IMPORTANT): Loaded ./Missions/Maintenance/sample_lab.xml 2020-10-06T22:41:03.174Z,1602024063.174 [CommandLine](IMPORTANT): got command set sample_lab.CartridgeType -6.000000 count 2020-10-06T22:41:03.175Z,1602024063.175 [CommandLine](IMPORTANT): got command run 2020-10-06T22:41:03.176Z,1602024063.176 [CommandLine](IMPORTANT): Running 2020-10-06T22:41:03.509Z,1602024063.509 [MissionManager](IMPORTANT): Started mission sample_lab 2020-10-06T22:41:03.511Z,1602024063.511 [sample_lab:SampleRepeater:A](IMPORTANT): Sampling ESP cartridge type -6.000000 count 2020-10-06T22:41:05.101Z,1602024065.101 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::' 2020-10-06T22:41:05.542Z,1602024065.542 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-10-06T22:41:05.665Z,1602024065.665 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-10-06T22:41:32.614Z,1602024092.614 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2020-10-06T22:41:43.480Z,1602024103.480 [ESPComponent](IMPORTANT): ESP has connected as client 2020-10-06T22:41:44.294Z,1602024104.294 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -6 2020-10-06T22:41:44.295Z,1602024104.295 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-10-06T22:41:45.501Z,1602024105.501 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG 2020-10-06T22:41:45.905Z,1602024105.905 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-10-06T22:41:47.521Z,1602024107.521 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE 2020-10-06T22:42:20.649Z,1602024140.649 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PRIMING (@59,archive_bac) 2020-10-06T22:42:22.266Z,1602024142.266 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PRIMING (@100.0) 2020-10-06T22:42:23.882Z,1602024143.882 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-10-06T22:44:56.188Z,1602024296.188 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_FILTERING (@0.0) 2020-10-06T22:44:56.594Z,1602024296.594 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-10-06T23:18:18.453Z,1602026298.453 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PAUSED (@1000.0) 2020-10-06T23:18:18.858Z,1602026298.858 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PROCESSING (@1000.0) 2020-10-06T23:18:21.282Z,1602026301.282 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PROCESSED (@59,archive_bac) 2020-10-06T23:30:24.861Z,1602027024.861 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING (@59,archive_bac) 2020-10-06T23:30:50.319Z,1602027050.319 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-10-06T23:30:50.718Z,1602027050.718 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED 2020-10-06T23:35:50.501Z,1602027350.501 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence completed normally. 2020-10-06T23:35:50.906Z,1602027350.906 [ESPComponent](IMPORTANT): [sample #1] ESP log summary report (2 messages): @15:41:57.53 Selecting Cartridge 59 @16:18:17.17 Sampled 1000.0ml 2020-10-06T23:35:51.074Z,1602027351.074 [MissionManager](IMPORTANT): Started mission Default 2020-10-06T23:36:06.280Z,1602027366.280 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-10-06T23:41:51.296Z,1602027711.296 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2020-10-06T23:47:14.950Z,1602028034.950 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.390952 min 2020-10-06T23:47:16.526Z,1602028036.526 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-10-06T23:47:16.546Z,1602028036.546 [CBIT](CRITICAL): Data Fault in component: NAL9602 2020-10-06T23:47:16.950Z,1602028036.950 [CommandLine](FAULT): Scheduling is paused 2020-10-06T23:49:28.141Z,1602028168.141 [CommandLine](IMPORTANT): got command quit