2020-10-02T04:31:26.228Z,1601613086.228 [Supervisor](IMPORTANT): Reading configuration overrides from Data/persisted.cfg 2020-10-02T04:31:30.942Z,1601613090.942 [SBIT](IMPORTANT): git: 2020-09-23a 2020-10-02T04:31:30.943Z,1601613090.943 [SBIT](IMPORTANT): Kernel Release: 2.6.27.8 2020-10-02T04:31:32.510Z,1601613092.510 [RudderServo](FAULT): Rudder failed to initialize 2020-10-02T04:32:32.507Z,1601613152.507 [SBIT](IMPORTANT): Beginning Startup BIT 2020-10-02T04:32:32.511Z,1601613152.511 [CBIT](IMPORTANT): Beginning ground fault scan 2020-10-02T04:32:43.449Z,1601613163.449 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): 0.003790 CHAN A1 (24V): -0.001071 CHAN A2 (12V): -0.005094 CHAN A3 (5V): -0.002601 CHAN B0 (3.3V): -0.000817 CHAN B1 (3.15aV): -0.000996 CHAN B2 (3.15bV): -0.001119 CHAN B3 (GND): 0.000293 OPEN: 0.005312 Full Scale Calc: 4.765 mA, -1.589 mA 2020-10-02T04:33:26.228Z,1601613206.228 [SBIT](IMPORTANT): SBIT PASSED 2020-10-02T04:33:26.229Z,1601613206.229 [SBIT](IMPORTANT): Listing configuration overrides from Data/persisted.cfg 2020-10-02T04:33:26.230Z,1601613206.230 [SBIT](IMPORTANT): Aanderaa_O2.loadAtStartup=0 bool; 2020-10-02T04:33:26.230Z,1601613206.230 [SBIT](IMPORTANT): BPC1.batteryMissingStickThreshold=2 count; 2020-10-02T04:33:26.230Z,1601613206.230 [SBIT](IMPORTANT): CANONSampler.loadAtStartup=1 bool; 2020-10-02T04:33:26.230Z,1601613206.230 [SBIT](IMPORTANT): CANONSampler.rotateOnly=1 bool; 2020-10-02T04:33:26.230Z,1601613206.230 [SBIT](IMPORTANT): CBIT.gf24Offset=-26 microampere; 2020-10-02T04:33:26.230Z,1601613206.230 [SBIT](IMPORTANT): DVL_micro.loadAtStartup=0 bool; 2020-10-02T04:33:26.230Z,1601613206.230 [SBIT](IMPORTANT): DropWeight.loadAtStartup=0 bool; 2020-10-02T04:33:26.231Z,1601613206.231 [SBIT](IMPORTANT): VerticalControl.buoyancyNeutral=230 cubic_centimeter; 2020-10-02T04:33:26.231Z,1601613206.231 [SBIT](IMPORTANT): VerticalControl.massDefault=10.3 millimeter; 2020-10-02T04:33:26.615Z,1601613206.615 [MissionManager](IMPORTANT): Started mission Startup 2020-10-02T04:35:26.609Z,1601613326.609 [MissionManager](IMPORTANT): Started mission Default 2020-10-02T04:37:14.468Z,1601613434.468 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2020-10-02T04:42:13.449Z,1601613733.449 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-10-02T04:44:38.186Z,1601613878.186 [CommandLine](IMPORTANT): got command get CANONSampler.loadControl 2020-10-02T04:44:38.186Z,1601613878.186 [CommandLine](IMPORTANT): CANONSampler.loadControl /dev/loadB1 2020-10-02T04:44:53.816Z,1601613893.816 [CommandLine](IMPORTANT): got command load ./Missions/sample_test.xml 2020-10-02T04:44:54.338Z,1601613894.338 [CommandLine](IMPORTANT): Loaded ./Missions/sample_test.xml 2020-10-02T04:45:06.580Z,1601613906.580 [CommandLine](IMPORTANT): got command set sample_test:Sample.CANONSamplerDelay 5.000000 minute 2020-10-02T04:45:08.359Z,1601613908.359 [CommandLine](IMPORTANT): got command run 2020-10-02T04:45:08.361Z,1601613908.361 [CommandLine](IMPORTANT): Running 2020-10-02T04:45:08.442Z,1601613908.442 [MissionManager](IMPORTANT): Started mission sample_test 2020-10-02T04:45:10.810Z,1601613910.810 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::' 2020-10-02T04:45:16.591Z,1601613916.591 [CommandLine](IMPORTANT): got command stop 2020-10-02T04:45:16.591Z,1601613916.591 [CommandLine](IMPORTANT): Scheduling is paused 2020-10-02T04:45:17.299Z,1601613917.299 [MissionManager](IMPORTANT): Started mission Default 2020-10-02T04:45:17.678Z,1601613917.678 [ESPComponent](IMPORTANT): [sample #0] No ESP summary messages. 2020-10-02T04:45:22.825Z,1601613922.825 [CommandLine](IMPORTANT): got command load ./Missions/sample_test.xml 2020-10-02T04:45:23.200Z,1601613923.200 [CommandLine](IMPORTANT): Loaded ./Missions/sample_test.xml 2020-10-02T04:45:47.241Z,1601613947.241 [CommandLine](IMPORTANT): got command set sample_test:Sample.CANONSamplerDelay 5.000000 minute 2020-10-02T04:45:58.116Z,1601613958.116 [CommandLine](IMPORTANT): got command set sample_test.ESPCartridgeType -6.000000 count 2020-10-02T04:46:00.113Z,1601613960.113 [CommandLine](IMPORTANT): got command run 2020-10-02T04:46:00.115Z,1601613960.115 [CommandLine](IMPORTANT): Running 2020-10-02T04:46:00.160Z,1601613960.160 [MissionManager](IMPORTANT): Started mission sample_test 2020-10-02T04:46:02.975Z,1601613962.975 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-10-02T04:46:03.075Z,1601613963.075 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-10-02T04:46:38.087Z,1601613998.087 [ESPComponent](IMPORTANT): ESP has connected as client 2020-10-02T04:46:38.903Z,1601613998.903 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -6 2020-10-02T04:46:38.904Z,1601613998.904 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-10-02T04:46:39.349Z,1601613999.349 [sample_test:Sample:SampleWrapper:ESP:AquireESP:C](IMPORTANT): ESP sampling at 0.035603 m in nan degC water with nan ug/l chlorophyll fluorescence. 2020-10-02T04:46:40.106Z,1601614000.106 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG 2020-10-02T04:46:40.510Z,1601614000.510 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-10-02T04:46:42.126Z,1601614002.126 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE 2020-10-02T04:47:14.459Z,1601614034.459 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PRIMING (@57,archive_bac) 2020-10-02T04:47:16.075Z,1601614036.075 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PRIMING (@100.0) 2020-10-02T04:47:16.883Z,1601614036.883 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-10-02T04:49:41.111Z,1601614181.111 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_FILTERING (@0.0) 2020-10-02T04:49:41.514Z,1601614181.514 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-10-02T04:51:34.298Z,1601614294.298 [sample_test:Sample:SampleWrapper:CANONSampler:AquireCANONSampler:E](IMPORTANT): CANONSampler sampling at 0.022589 m in nan degC water with nan ug/l chlorophyll fluorescence. 2020-10-02T04:52:56.660Z,1601614376.660 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-10-02T04:53:59.562Z,1601614439.562 [CommandLine](IMPORTANT): got command show stack 2020-10-02T04:53:59.562Z,1601614439.562 [CommandLine](IMPORTANT): Behavior Stack: 2020-10-02T04:53:59.563Z,1601614439.563 [sample_test:Sample:SampleWrapper:CANONSampler:AquireCANONSampler](IMPORTANT): Priority 0: sample_test:Sample:SampleWrapper:CANONSampler:AquireCANONSampler:A 2020-10-02T04:53:59.564Z,1601614439.564 [sample_test:Sample:SampleWrapper:CANONSampler:AquireCANONSampler](IMPORTANT): Priority 1: sample_test:Sample:SampleWrapper:CANONSampler:AquireCANONSampler:B 2020-10-02T04:53:59.565Z,1601614439.565 [sample_test:Sample:SampleWrapper:CANONSampler:AquireCANONSampler](IMPORTANT): Priority 2: sample_test:Sample:SampleWrapper:CANONSampler:AquireCANONSampler:F 2020-10-02T04:53:59.569Z,1601614439.569 [sample_test:Sample:SampleWrapper:ESP](IMPORTANT): Priority 3: sample_test:Sample:SampleWrapper:ESP:A.AbortSample 2020-10-02T04:53:59.570Z,1601614439.570 [sample_test:Sample:SampleWrapper:ESP:AquireESP](IMPORTANT): Priority 4: sample_test:Sample:SampleWrapper:ESP:AquireESP:WaitForESP 2020-10-02T04:53:59.570Z,1601614439.570 [sample_test:Sample:SampleWrapper:WaitForSample](IMPORTANT): Priority 5: sample_test:Sample:SampleWrapper:WaitForSample:A.Wait 2020-10-02T04:55:19.259Z,1601614519.259 [CANONSampler](IMPORTANT): Sample 1, err_code=0 2020-10-02T05:02:58.560Z,1601614978.560 [CommandLine](IMPORTANT): got command show stack 2020-10-02T05:02:58.560Z,1601614978.560 [CommandLine](IMPORTANT): Behavior Stack: 2020-10-02T05:02:58.560Z,1601614978.560 [sample_test:Sample:SampleWrapper:ESP](IMPORTANT): Priority 0: sample_test:Sample:SampleWrapper:ESP:A.AbortSample 2020-10-02T05:02:58.561Z,1601614978.561 [sample_test:Sample:SampleWrapper:ESP:AquireESP](IMPORTANT): Priority 1: sample_test:Sample:SampleWrapper:ESP:AquireESP:WaitForESP 2020-10-02T05:02:58.561Z,1601614978.561 [sample_test:Sample:SampleWrapper:WaitForSample](IMPORTANT): Priority 2: sample_test:Sample:SampleWrapper:WaitForSample:A.Wait 2020-10-02T05:03:39.828Z,1601615019.828 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-10-02T05:09:07.877Z,1601615347.877 [CommandLine](IMPORTANT): got command show stack 2020-10-02T05:09:07.877Z,1601615347.877 [CommandLine](IMPORTANT): Behavior Stack: 2020-10-02T05:09:07.877Z,1601615347.877 [sample_test:Sample:SampleWrapper:ESP](IMPORTANT): Priority 0: sample_test:Sample:SampleWrapper:ESP:A.AbortSample 2020-10-02T05:09:07.878Z,1601615347.878 [sample_test:Sample:SampleWrapper:ESP:AquireESP](IMPORTANT): Priority 1: sample_test:Sample:SampleWrapper:ESP:AquireESP:WaitForESP 2020-10-02T05:09:07.878Z,1601615347.878 [sample_test:Sample:SampleWrapper:WaitForSample](IMPORTANT): Priority 2: sample_test:Sample:SampleWrapper:WaitForSample:A.Wait 2020-10-02T05:14:22.996Z,1601615662.996 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-10-02T05:25:06.191Z,1601616306.191 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-10-02T05:25:06.248Z,1601616306.248 [CBIT](CRITICAL): Data Fault in component: NAL9602 2020-10-02T05:25:06.611Z,1601616306.611 [CommandLine](FAULT): Scheduling is paused 2020-10-02T05:25:07.371Z,1601616307.371 [ESPComponent](IMPORTANT): [sample #1] Stop sampling requested. 2020-10-02T05:25:07.392Z,1601616307.392 [MissionManager](IMPORTANT): Started mission Default 2020-10-02T05:25:07.774Z,1601616307.774 [ESPComponent](IMPORTANT): Stop sampling requested. Issuing Cmd.pauseFiltering 2020-10-02T05:25:13.430Z,1601616313.430 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PAUSED (@886.478) 2020-10-02T05:25:13.836Z,1601616313.836 [ESPComponent](IMPORTANT): In S_PAUSED received result: 886.478 2020-10-02T05:25:14.239Z,1601616314.239 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PROCESSING (@886.478) 2020-10-02T05:25:16.663Z,1601616316.663 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PROCESSED (@57,archive_bac) 2020-10-02T05:35:48.155Z,1601616948.155 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 10.672993 min 2020-10-02T05:37:19.056Z,1601617039.056 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-10-02T05:37:20.650Z,1601617040.650 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING (@57,archive_bac) 2020-10-02T05:37:46.103Z,1601617066.103 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-10-02T05:37:46.507Z,1601617066.507 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED 2020-10-02T05:42:46.291Z,1601617366.291 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence completed normally. 2020-10-02T05:42:46.694Z,1601617366.694 [ESPComponent](IMPORTANT): [sample #1] ESP log summary report (2 messages): @21:46:48.50 Selecting Cartridge 57 @22:25:11.06 Cmd::Paused in FILTERING -- during Sample Pump (SP) move after sampling 886.478ml 2020-10-02T05:46:15.607Z,1601617575.607 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 21.130105 min 2020-10-02T05:48:04.255Z,1601617684.255 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-10-02T05:56:42.595Z,1601618202.595 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 31.579901 min 2020-10-02T05:58:49.439Z,1601618329.439 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-10-02T06:07:10.007Z,1601618830.007 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 42.037044 min 2020-10-02T06:09:33.428Z,1601618973.428 [NAL9602](FAULT): GPS failed to acquire within timeout. 2020-10-02T06:14:04.674Z,1601619244.674 [CommandLine](IMPORTANT): got command show stack 2020-10-02T06:14:04.674Z,1601619244.674 [CommandLine](IMPORTANT): Behavior Stack: 2020-10-02T06:14:04.674Z,1601619244.674 [Default](IMPORTANT): Priority 0: Default:B.GoToSurface 2020-10-02T06:14:04.675Z,1601619244.675 [Default:CheckIn](IMPORTANT): Priority 1: Default:CheckIn:C.Wait 2020-10-02T06:14:17.244Z,1601619257.244 [CommandLine](IMPORTANT): got command quit