2021-04-20T20:15:18.858Z,1618949718.858 [Supervisor](IMPORTANT): Reading configuration overrides from Data/persisted.cfg 2021-04-20T20:15:22.527Z,1618949722.527 [SBIT](IMPORTANT): git: 2021-04-19A 2021-04-20T20:15:22.528Z,1618949722.528 [SBIT](IMPORTANT): Kernel Release: 2.6.27.8 2021-04-20T20:15:23.122Z,1618949723.122 [CommandLine](IMPORTANT): got command ! echo 1 > /dev/loadB2 2021-04-20T20:15:24.093Z,1618949724.093 [RudderServo](FAULT): Rudder failed to initialize 2021-04-20T20:16:17.977Z,1618949777.977 [SBIT](IMPORTANT): Beginning Startup BIT 2021-04-20T20:16:17.981Z,1618949777.981 [CBIT](IMPORTANT): Beginning ground fault scan 2021-04-20T20:16:28.919Z,1618949788.919 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.007797 CHAN A1 (24V): -0.000655 CHAN A2 (12V): -0.006034 CHAN A3 (5V): -0.002577 CHAN B0 (3.3V): -0.001308 CHAN B1 (3.15aV): -0.001270 CHAN B2 (3.15bV): -0.001153 CHAN B3 (GND): 0.001994 OPEN: 0.006671 Full Scale Calc: 4.765 mA, -1.589 mA 2021-04-20T20:17:11.723Z,1618949831.723 [SBIT](IMPORTANT): SBIT PASSED 2021-04-20T20:17:11.723Z,1618949831.723 [SBIT](IMPORTANT): Listing configuration overrides from Data/persisted.cfg 2021-04-20T20:17:11.724Z,1618949831.724 [SBIT](IMPORTANT): AHRS_M2.loadAtStartup=1 bool; 2021-04-20T20:17:11.724Z,1618949831.724 [SBIT](IMPORTANT): BPC1.batteryMissingStickThreshold=2 count; 2021-04-20T20:17:11.724Z,1618949831.724 [SBIT](IMPORTANT): CBIT.gf24Offset=148.5 microampere; 2021-04-20T20:17:11.724Z,1618949831.724 [SBIT](IMPORTANT): DVL_micro.loadAtStartup=0 bool; 2021-04-20T20:17:11.724Z,1618949831.724 [SBIT](IMPORTANT): ESPComponent.sampleTimeout=10 minute; 2021-04-20T20:17:11.725Z,1618949831.725 [SBIT](IMPORTANT): ESPComponent.simulateHardware=0 bool; 2021-04-20T20:17:11.725Z,1618949831.725 [SBIT](IMPORTANT): Express linearApproximation WetLabsBB2FL.bin_median_mass_concentration_of_chlorophyll_in_sea_water 0.200000 microgram_per_liter; 2021-04-20T20:17:11.725Z,1618949831.725 [SBIT](IMPORTANT): VerticalControl.buoyancyNeutral=325.319339 cubic_centimeter; 2021-04-20T20:17:11.725Z,1618949831.725 [SBIT](IMPORTANT): VerticalControl.massDefault=8.946893 millimeter; 2021-04-20T20:17:12.094Z,1618949832.094 [MissionManager](IMPORTANT): Started mission Startup 2021-04-20T20:19:08.274Z,1618949948.274 [MissionManager](IMPORTANT): Started mission Default 2021-04-20T20:25:49.570Z,1618950349.570 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 6.681803 min 2021-04-20T20:31:20.038Z,1618950680.038 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 12.189914 min 2021-04-20T20:31:30.016Z,1618950690.016 [DataOverHttps](IMPORTANT): SBD MOMSN=15591716, MTMSN=20210420T203129 2021-04-20T20:31:37.391Z,1618950697.391 [CommandLine](IMPORTANT): got command schedule asap "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 7 hour;set IsothermDepthSampling.AcousticTrackingTimeout 3 hour" 1y3o5 1 4.000000 2021-04-20T20:31:37.392Z,1618950697.392 [CommandLine](IMPORTANT): Scheduling command #1 of 4 with id=1y3o5 2021-04-20T20:31:37.393Z,1618950697.393 [CommandLine](IMPORTANT): Scheduled #1 (#1 of 4 with id='1y3o5'): "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 7 hour;set IsothermDepthSampling.AcousticTrackingTimeout 3 hour" ASAP 2021-04-20T20:31:38.522Z,1618950698.522 [DataOverHttps](IMPORTANT): SBD MTMSN=20210420T203137 2021-04-20T20:31:45.810Z,1618950705.810 [CommandLine](IMPORTANT): got command schedule asap "set IsothermDepthSampling.MaxWaitNoFiring 3 hour;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 2 meter;set IsothermDepthSampling.DeepBoundChl 20 meter" 1y3o5 2 4.000000 2021-04-20T20:31:45.811Z,1618950705.811 [CommandLine](IMPORTANT): Scheduling command #2 of 4 with id=1y3o5 2021-04-20T20:31:45.812Z,1618950705.812 [CommandLine](IMPORTANT): Scheduled #2 (#2 of 4 with id='1y3o5'): "set IsothermDepthSampling.MaxWaitNoFiring 3 hour;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 2 meter;set IsothermDepthSampling.DeepBoundChl 20 meter" ASAP 2021-04-20T20:31:46.946Z,1618950706.946 [DataOverHttps](IMPORTANT): SBD MOMSN=15591720, MTMSN=20210420T203145 2021-04-20T20:31:54.119Z,1618950714.119 [CommandLine](IMPORTANT): got command schedule asap "set IsothermDepthSampling.CartridgeType1 -6 count;set IsothermDepthSampling.CartridgeType2 -9 count;set IsothermDepthSampling.TempDiffFromPeakChlCommon 0 kelvin;set IsothermDepthSampling.WaitDepUndulation1 20 minute" 1y3o5 3 4.000000 2021-04-20T20:31:54.120Z,1618950714.120 [CommandLine](IMPORTANT): Scheduling command #3 of 4 with id=1y3o5 2021-04-20T20:31:54.120Z,1618950714.120 [CommandLine](IMPORTANT): Scheduled #3 (#3 of 4 with id='1y3o5'): "set IsothermDepthSampling.CartridgeType1 -6 count;set IsothermDepthSampling.CartridgeType2 -9 count;set IsothermDepthSampling.TempDiffFromPeakChlCommon 0 kelvin;set IsothermDepthSampling.WaitDepUndulation1 20 minute" ASAP 2021-04-20T20:31:55.315Z,1618950715.315 [DataOverHttps](IMPORTANT): SBD MTMSN=20210420T203154 2021-04-20T20:32:02.431Z,1618950722.431 [CommandLine](IMPORTANT): got command schedule asap "set IsothermDepthSampling.WaitDepUndulation2 5 minute;run" 1y3o5 4 4.000000 2021-04-20T20:32:02.431Z,1618950722.431 [CommandLine](IMPORTANT): Scheduling command #4 of 4 with id=1y3o5 2021-04-20T20:32:02.432Z,1618950722.432 [CommandLine](IMPORTANT): Scheduled #4 (#4 of 4 with id='1y3o5'): "set IsothermDepthSampling.WaitDepUndulation2 5 minute;run" ASAP 2021-04-20T20:32:02.558Z,1618950722.558 [CommandLine](IMPORTANT): got command load ./Missions/Science/isotherm_depth_sampling.xml 2021-04-20T20:32:25.953Z,1618950745.953 [CommandLine](IMPORTANT): Loaded ./Missions/Science/isotherm_depth_sampling.xml 2021-04-20T20:33:10.348Z,1618950790.348 [CommandLine](IMPORTANT): got command set IsothermDepthSampling.NumSamplers 2.000000 count 2021-04-20T20:33:10.348Z,1618950790.348 [CommandLine](IMPORTANT): got command set IsothermDepthSampling.MissionTimeout 7.000000 hour 2021-04-20T20:33:10.349Z,1618950790.349 [CommandLine](IMPORTANT): got command set IsothermDepthSampling.AcousticTrackingTimeout 3.000000 hour 2021-04-20T20:33:34.759Z,1618950814.759 [CommandLine](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNoFiring 3.000000 hour 2021-04-20T20:33:34.760Z,1618950814.760 [CommandLine](IMPORTANT): got command set IsothermDepthSampling.SampleAtPeakChl 1.000000 bool 2021-04-20T20:33:34.761Z,1618950814.761 [CommandLine](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 2.000000 meter 2021-04-20T20:33:34.761Z,1618950814.761 [CommandLine](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 20.000000 meter 2021-04-20T20:34:00.671Z,1618950840.671 [CommandLine](IMPORTANT): got command set IsothermDepthSampling.CartridgeType1 -6.000000 count 2021-04-20T20:34:00.672Z,1618950840.672 [CommandLine](IMPORTANT): got command set IsothermDepthSampling.CartridgeType2 -9.000000 count 2021-04-20T20:34:00.672Z,1618950840.672 [CommandLine](IMPORTANT): got command set IsothermDepthSampling.TempDiffFromPeakChlCommon 0.000000 kelvin 2021-04-20T20:34:00.673Z,1618950840.673 [CommandLine](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 20.000000 minute 2021-04-20T20:34:08.764Z,1618950848.764 [CommandLine](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation2 5.000000 minute 2021-04-20T20:34:08.765Z,1618950848.765 [CommandLine](IMPORTANT): got command run 2021-04-20T20:34:08.777Z,1618950848.777 [CommandLine](IMPORTANT): Running 2021-04-20T20:34:08.862Z,1618950848.862 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling 2021-04-20T20:34:08.904Z,1618950848.904 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 3.00 hours. 2021-04-20T20:35:47.200Z,1618950947.200 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.430067 m 2021-04-20T20:39:03.515Z,1618951143.515 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoUp:B](IMPORTANT): Go up from 23.145239 m 2021-04-20T20:40:46.117Z,1618951246.117 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2021-04-20T20:40:56.689Z,1618951256.689 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , 0.000000 K , nan m , nan degC , nan m , 20.000000 min . 2021-04-20T20:44:34.424Z,1618951474.424 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:SetChlPeakTempDepth:L](IMPORTANT): Set peak-chl depth and temp. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlTemperatureSet, PeakChlSet = 17.868292 m , 2.017600 ug/l , 7.976478 m , 11.489955 degC , 14.964043 ug/l 2021-04-20T20:44:37.247Z,1618951477.247 [IsothermDepthSampling:TakeSamples:FiringOnTemp:C](IMPORTANT): Taking sample No. 1.000000 count . Target temp = 11.489955 degC . 2021-04-20T20:44:37.627Z,1618951477.627 [IsothermDepthSampling:TakeSamples:FiringOnTemp:D](IMPORTANT): If ESP, requesting ESP cartridge type: -6.000000 count 2021-04-20T20:44:38.450Z,1618951478.450 [IsothermDepthSampling:DampDown:A](IMPORTANT): Wait 20.000000 min for the depth undulation to damp down. 2021-04-20T21:04:41.181Z,1618952681.181 [IsothermDepthSampling:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger sampling. DepthLogged, TempLogged, ChlLogged = 7.277193 m , 11.382410 degC , 15.995200 ug/l . 2021-04-20T21:04:42.729Z,1618952682.729 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::' 2021-04-20T21:04:52.872Z,1618952692.872 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-04-20T21:04:53.170Z,1618952693.170 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-04-20T21:05:30.093Z,1618952730.093 [ESPComponent](IMPORTANT): ESP has connected as client 2021-04-20T21:05:31.020Z,1618952731.020 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -6 2021-04-20T21:05:31.022Z,1618952731.022 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-04-20T21:05:31.411Z,1618952731.411 [IsothermDepthSampling:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-04-20T21:05:32.114Z,1618952732.114 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG 2021-04-20T21:05:32.518Z,1618952732.518 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-04-20T21:05:34.133Z,1618952734.133 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE 2021-04-20T21:06:13.726Z,1618952773.726 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PRIMING (@54,archive_bac) 2021-04-20T21:06:15.343Z,1618952775.343 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PRIMING (@100.0) 2021-04-20T21:06:16.150Z,1618952776.150 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-04-20T21:09:06.638Z,1618952946.638 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_FILTERING (@0.0) 2021-04-20T21:09:07.042Z,1618952947.042 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-04-20T21:47:01.590Z,1618955221.590 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PAUSED (@565.8) 2021-04-20T21:47:01.993Z,1618955221.993 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PROCESSING (@565.8) 2021-04-20T21:47:04.418Z,1618955224.418 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PROCESSED (@54,archive_bac) 2021-04-20T21:59:09.605Z,1618955949.605 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING (@54,archive_bac) 2021-04-20T21:59:22.535Z,1618955962.535 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2021-04-20T21:59:22.936Z,1618955962.936 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED 2021-04-20T22:04:22.706Z,1618956262.706 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence completed normally. 2021-04-20T22:04:23.126Z,1618956263.126 [ESPComponent](IMPORTANT): [sample #1] ESP log summary report (3 messages): @14:05:45.53 Selecting Cartridge 54 @14:46:59.42 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @14:46:59.62 Sampled 565.8ml 2021-04-20T22:04:24.011Z,1618956264.011 [IsothermDepthSampling:TakeSamples:FiringOnTemp:TriggerOnTemp:C](IMPORTANT): Sample No. 1.000000 count completed. 2021-04-20T22:04:26.047Z,1618956266.047 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataCntSamples:A](IMPORTANT): CntSamples = 1.000000 count 2021-04-20T22:04:27.723Z,1618956267.723 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPCartridgeType:A](IMPORTANT): Science:ESPComponent.cartridge = -6 count 2021-04-20T22:04:28.856Z,1618956268.856 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleVolume:A](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2021-04-20T22:04:30.472Z,1618956270.472 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleDep:A](IMPORTANT): Universal:depth = 8.628820 m 2021-04-20T22:04:32.092Z,1618956272.092 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleChl:A](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 14.664001 ug/l 2021-04-20T22:04:38.146Z,1618956278.146 [DAT](FAULT): Ack receipt timeout failure. 2021-04-20T22:04:48.683Z,1618956288.683 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -9.000000 count , 0.000000 K , nan m , nan degC , nan m , 5.000000 min . 2021-04-20T22:04:49.028Z,1618956289.028 [DAT](FAULT): Ack receipt timeout failure. 2021-04-20T22:04:51.472Z,1618956291.472 [IsothermDepthSampling:TakeSamples:FiringOnTemp:C](IMPORTANT): Taking sample No. 2.000000 count . Target temp = 11.489955 degC . 2021-04-20T22:04:51.885Z,1618956291.885 [IsothermDepthSampling:TakeSamples:FiringOnTemp:D](IMPORTANT): If ESP, requesting ESP cartridge type: -9.000000 count 2021-04-20T22:04:52.710Z,1618956292.710 [IsothermDepthSampling:DampDown:A](IMPORTANT): Wait 5.000000 min for the depth undulation to damp down. 2021-04-20T22:04:59.941Z,1618956299.941 [DAT](FAULT): Ack receipt timeout failure. 2021-04-20T22:05:10.842Z,1618956310.842 [DAT](FAULT): Ack receipt timeout failure. 2021-04-20T22:05:22.150Z,1618956322.150 [DAT](FAULT): Ack receipt timeout failure. 2021-04-20T22:05:33.469Z,1618956333.469 [DAT](FAULT): Ack receipt timeout failure. 2021-04-20T22:05:44.778Z,1618956344.778 [DAT](FAULT): Ack receipt timeout failure. 2021-04-20T22:05:56.098Z,1618956356.098 [DAT](FAULT): Ack receipt timeout failure. 2021-04-20T22:09:55.313Z,1618956595.313 [IsothermDepthSampling:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger sampling. DepthLogged, TempLogged, ChlLogged = 6.097878 m , 11.571405 degC , 12.968800 ug/l . 2021-04-20T22:10:07.082Z,1618956607.082 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-04-20T22:10:07.215Z,1618956607.215 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-04-20T22:10:44.177Z,1618956644.177 [ESPComponent](IMPORTANT): ESP has connected as client 2021-04-20T22:10:45.001Z,1618956645.001 [ESPComponent](IMPORTANT): [sample #2] Setting cartridge argument to -9 2021-04-20T22:10:45.003Z,1618956645.003 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-04-20T22:10:45.475Z,1618956645.475 [IsothermDepthSampling:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-04-20T22:10:45.794Z,1618956645.794 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_LOG 2021-04-20T22:10:46.198Z,1618956646.198 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-04-20T22:10:48.220Z,1618956648.220 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_LOADING_CARTRIDGE 2021-04-20T22:11:28.617Z,1618956688.617 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PRIMING (@53,daSPR_bac) 2021-04-20T22:11:30.234Z,1618956690.234 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PRIMING (@100.0) 2021-04-20T22:11:31.042Z,1618956691.042 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-04-20T22:14:24.367Z,1618956864.367 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_FILTERING (@0.0) 2021-04-20T22:14:24.773Z,1618956864.773 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-04-20T22:46:03.594Z,1618958763.594 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PAUSED (@452.3) 2021-04-20T22:46:03.998Z,1618958763.998 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PROCESSING (@452.3) 2021-04-20T22:46:06.422Z,1618958766.422 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PROCESSED (@53,daSPR_bac) 2021-04-20T23:41:40.646Z,1618962100.646 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPING (@53,daSPR_bac) 2021-04-20T23:41:55.191Z,1618962115.191 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2021-04-20T23:41:55.594Z,1618962115.594 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPED 2021-04-20T23:46:55.377Z,1618962415.377 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence completed normally. 2021-04-20T23:46:55.778Z,1618962415.778 [ESPComponent](IMPORTANT): [sample #2] ESP log summary report (3 messages): @15:10:59.07 Selecting Cartridge 53 @15:46:01.08 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @15:46:01.28 Sampled 452.3ml 2021-04-20T23:46:56.649Z,1618962416.649 [IsothermDepthSampling:TakeSamples:FiringOnTemp:TriggerOnTemp:C](IMPORTANT): Sample No. 2.000000 count completed. 2021-04-20T23:46:58.658Z,1618962418.658 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataCntSamples:A](IMPORTANT): CntSamples = 2.000000 count 2021-04-20T23:47:00.276Z,1618962420.276 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPCartridgeType:A](IMPORTANT): Science:ESPComponent.cartridge = -9 count 2021-04-20T23:47:01.517Z,1618962421.517 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleVolume:A](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2021-04-20T23:47:03.106Z,1618962423.106 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleDep:A](IMPORTANT): Universal:depth = 4.059638 m 2021-04-20T23:47:04.711Z,1618962424.711 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleChl:A](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 11.689600 ug/l 2021-04-20T23:47:07.572Z,1618962427.572 [WetLabsBB2FL](FAULT): LCB fault: Software Overcurrent. 2021-04-20T23:47:07.611Z,1618962427.611 [MissionManager](IMPORTANT): Started mission Default 2021-04-20T23:47:10.005Z,1618962430.005 [DAT](FAULT): Ack receipt timeout failure. 2021-04-20T23:47:21.317Z,1618962441.317 [DAT](FAULT): Ack receipt timeout failure. 2021-04-20T23:47:32.630Z,1618962452.630 [DAT](FAULT): Ack receipt timeout failure. 2021-04-20T23:47:59.693Z,1618962479.693 [DAT](FAULT): Ack receipt timeout failure. 2021-04-20T23:48:15.049Z,1618962495.049 [DAT](FAULT): Ack receipt timeout failure. 2021-04-20T23:52:47.058Z,1618962767.058 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2021-04-21T00:03:18.994Z,1618963398.994 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 16.183164 min 2021-04-21T00:03:20.606Z,1618963400.606 [NAL9602](FAULT): GPS failed to acquire within timeout. 2021-04-21T00:09:05.725Z,1618963745.725 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2021-04-21T00:11:30.271Z,1618963890.271 [DataOverHttps](IMPORTANT): SBD MTMSN=20210421T001129 2021-04-21T00:11:37.547Z,1618963897.547 [CommandLine](IMPORTANT): got command load ./Missions/Science/sci2.xml 2021-04-21T00:11:39.413Z,1618963899.413 [CommandLine](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2021-04-21T00:11:49.134Z,1618963909.134 [CommandLine](IMPORTANT): got command set sci2.NeedCommsTime 45.000000 minute 2021-04-21T00:11:49.135Z,1618963909.135 [CommandLine](IMPORTANT): got command set sci2.Lat1 36.811501 degree 2021-04-21T00:11:49.136Z,1618963909.136 [CommandLine](IMPORTANT): got command set sci2.Lon1 -121.839500 degree 2021-04-21T00:11:49.137Z,1618963909.137 [CommandLine](IMPORTANT): got command set sci2.YoYoMinDepth 1.500000 meter 2021-04-21T00:11:49.154Z,1618963909.154 [CommandLine](IMPORTANT): got command set sci2.YoYoMaxDepth 30.000000 meter 2021-04-21T00:11:49.155Z,1618963909.155 [CommandLine](IMPORTANT): got command run 2021-04-21T00:11:49.158Z,1618963909.158 [CommandLine](IMPORTANT): Running 2021-04-21T00:11:49.360Z,1618963909.360 [MissionManager](IMPORTANT): Started mission sci2 2021-04-21T00:16:57.455Z,1618964217.455 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2021-04-21T00:16:58.259Z,1618964218.259 [NAL9602](FAULT): GPS failed to acquire within timeout. 2021-04-21T00:18:50.033Z,1618964330.033 [sci2:NeedComms:C:A_Timeout:A](IMPORTANT): first GPS update timeout 2021-04-21T00:26:13.182Z,1618964773.182 [sci2:NeedComms:E:A_Timeout:A](IMPORTANT): second GPS update timeout 2021-04-21T00:27:40.854Z,1618964860.854 [NAL9602](FAULT): GPS failed to acquire within timeout. 2021-04-21T00:33:14.308Z,1618965194.308 [sci2:NeedComms:C:A_Timeout:A](IMPORTANT): first GPS update timeout 2021-04-21T01:12:38.991Z,1618967558.991 [sci2:Lap:Wpt1:A.Waypoint](IMPORTANT): Reached Waypoint: 36.811499,-121.839496 2021-04-21T01:14:57.171Z,1618967697.171 [MissionManager](IMPORTANT): Started mission Default 2021-04-21T01:14:57.426Z,1618967697.426 [WetLabsBB2FL](FAULT): LCB fault: Software Overcurrent. 2021-04-21T01:19:25.116Z,1618967965.116 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=41379, MT Status=1, MTMSN=2911 2021-04-21T01:19:29.042Z,1618967969.042 [CommandLine](IMPORTANT): got command configSet Express none WetLabsBB2FL.bin_mean_mass_concentration_of_chlorophyll_in_sea_water persist 2021-04-21T01:24:58.108Z,1618968298.108 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 10.008906 min 2021-04-21T01:28:04.984Z,1618968484.984 [DataOverHttps](IMPORTANT): SBD MTMSN=20210421T012804 2021-04-21T01:28:12.303Z,1618968492.303 [CommandLine](IMPORTANT): got command schedule asap "load Science/profile_station.xml;set profile_station.NeedCommsTime 20 minute;set profile_station.Lat 36.81146 degree;set profile_station.Lon -121.83914 degree;set profile_station.YoYoMinDepth 1.5 meter" 1yhem 1 2.000000 2021-04-21T01:28:12.303Z,1618968492.303 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=1yhem 2021-04-21T01:28:12.304Z,1618968492.304 [CommandLine](IMPORTANT): Scheduled #5 (#1 of 2 with id='1yhem'): "load Science/profile_station.xml;set profile_station.NeedCommsTime 20 minute;set profile_station.Lat 36.81146 degree;set profile_station.Lon -121.83914 degree;set profile_station.YoYoMinDepth 1.5 meter" ASAP 2021-04-21T01:28:13.239Z,1618968493.239 [DataOverHttps](IMPORTANT): SBD MTMSN=20210421T012812 2021-04-21T01:28:20.710Z,1618968500.710 [CommandLine](IMPORTANT): got command schedule asap "set profile_station.YoYoMaxDepth 20 meter;run" 1yhem 2 2.000000 2021-04-21T01:28:20.710Z,1618968500.710 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=1yhem 2021-04-21T01:28:20.711Z,1618968500.711 [CommandLine](IMPORTANT): Scheduled #6 (#2 of 2 with id='1yhem'): "set profile_station.YoYoMaxDepth 20 meter;run" ASAP 2021-04-21T01:28:20.891Z,1618968500.891 [CommandLine](IMPORTANT): got command load ./Missions/Science/profile_station.xml 2021-04-21T01:28:22.552Z,1618968502.552 [CommandLine](IMPORTANT): Loaded ./Missions/Science/profile_station.xml 2021-04-21T01:28:40.148Z,1618968520.148 [CommandLine](IMPORTANT): got command set profile_station.NeedCommsTime 20.000000 minute 2021-04-21T01:28:40.154Z,1618968520.154 [CommandLine](IMPORTANT): got command set profile_station.Lat 36.811459 degree 2021-04-21T01:28:40.155Z,1618968520.155 [CommandLine](IMPORTANT): got command set profile_station.Lon -121.839142 degree 2021-04-21T01:28:40.156Z,1618968520.156 [CommandLine](IMPORTANT): got command set profile_station.YoYoMinDepth 1.500000 meter 2021-04-21T01:28:47.911Z,1618968527.911 [CommandLine](IMPORTANT): got command set profile_station.YoYoMaxDepth 20.000000 meter 2021-04-21T01:28:47.938Z,1618968527.938 [CommandLine](IMPORTANT): got command run 2021-04-21T01:28:47.941Z,1618968527.941 [CommandLine](IMPORTANT): Running 2021-04-21T01:28:48.263Z,1618968528.263 [MissionManager](IMPORTANT): Started mission profile_station 2021-04-21T01:34:57.509Z,1618968897.509 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2021-04-21T01:56:16.178Z,1618970176.178 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2021-04-21T02:02:15.368Z,1618970535.368 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2021-04-21T02:16:29.110Z,1618971389.110 [CBIT](IMPORTANT): Beginning ground fault scan 2021-04-21T02:16:40.436Z,1618971400.436 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.008243 CHAN A1 (24V): -0.000755 CHAN A2 (12V): -0.005344 CHAN A3 (5V): -0.002822 CHAN B0 (3.3V): -0.001116 CHAN B1 (3.15aV): -0.000616 CHAN B2 (3.15bV): -0.001091 CHAN B3 (GND): 0.000149 OPEN: 0.007637 Full Scale Calc: 4.765 mA, -1.589 mA 2021-04-21T03:11:00.281Z,1618974660.281 [BuoyancyServo](FAULT): Buoyancy getPosition uart error.serial timeout 2021-04-21T03:31:57.785Z,1618975917.785 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=41404, MT Status=1, MTMSN=2912 2021-04-21T03:31:58.313Z,1618975918.313 [CommandLine](IMPORTANT): got command stop 2021-04-21T03:31:58.313Z,1618975918.313 [CommandLine](IMPORTANT): Scheduling is paused 2021-04-21T03:31:58.608Z,1618975918.608 [MissionManager](IMPORTANT): Started mission Default 2021-04-21T03:32:42.270Z,1618975962.270 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=41405, MT Status=1, MTMSN=2913