2022-05-30T22:55:22.972Z,1653951322.972 [Supervisor](IMPORTANT): Reading configuration overrides from Data/persisted.cfg 2022-05-30T22:55:27.599Z,1653951327.599 [SBIT](IMPORTANT): git: 2022-05-25A 2022-05-30T22:55:27.600Z,1653951327.600 [SBIT](IMPORTANT): Kernel Release: 2.6.27.8 2022-05-30T22:55:29.180Z,1653951329.180 [RudderServo](FAULT): Rudder failed to initialize 2022-05-30T22:57:36.168Z,1653951456.168 [SBIT](IMPORTANT): Beginning Startup BIT 2022-05-30T22:57:36.172Z,1653951456.172 [CBIT](IMPORTANT): Beginning ground fault scan 2022-05-30T22:57:47.131Z,1653951467.131 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.006902 CHAN A1 (24V): 0.001101 CHAN A2 (12V): -0.005859 CHAN A3 (5V): -0.004720 CHAN B0 (3.3V): -0.001793 CHAN B1 (3.15aV): -0.001259 CHAN B2 (3.15bV): -0.000990 CHAN B3 (GND): -0.000407 OPEN: 0.012080 Full Scale: +/- 1 mA 2022-05-30T22:58:29.896Z,1653951509.896 [SBIT](IMPORTANT): SBIT PASSED 2022-05-30T22:58:29.897Z,1653951509.897 [SBIT](IMPORTANT): Listing configuration overrides from Data/persisted.cfg 2022-05-30T22:58:29.897Z,1653951509.897 [SBIT](IMPORTANT): BPC1.loadAtStartup=0 bool; 2022-05-30T22:58:29.898Z,1653951509.898 [SBIT](IMPORTANT): DAT.loadAtStartup=1 bool; 2022-05-30T22:58:29.898Z,1653951509.898 [SBIT](IMPORTANT): DAT.sbdAddress=-1 enum; 2022-05-30T22:58:29.898Z,1653951509.898 [SBIT](IMPORTANT): Depth_Keller.offset=-0.41 decibar; 2022-05-30T22:58:29.898Z,1653951509.898 [SBIT](IMPORTANT): ElevatorServo.offsetAngle=1 degree; 2022-05-30T22:58:29.898Z,1653951509.898 [SBIT](IMPORTANT): Express linearApproximation CBIT.ampHoursUsed 5.0 ampere_hour; 2022-05-30T22:58:29.898Z,1653951509.898 [SBIT](IMPORTANT): Express linearApproximation NAL9602.sigQuality 1.000000 count; 2022-05-30T22:58:29.898Z,1653951509.898 [SBIT](IMPORTANT): Express none WetLabsBB2FL.BackscatteringCoeff470nm; 2022-05-30T22:58:29.898Z,1653951509.898 [SBIT](IMPORTANT): Express none WetLabsBB2FL.BackscatteringCoeff650nm; 2022-05-30T22:58:29.899Z,1653951509.899 [SBIT](IMPORTANT): RudderServo.offsetAngle=0 degree; 2022-05-30T22:58:29.899Z,1653951509.899 [SBIT](IMPORTANT): ShortestDistanceToPolygonSidesCalculator.latVertex1=34.54 degree; 2022-05-30T22:58:29.899Z,1653951509.899 [SBIT](IMPORTANT): ShortestDistanceToPolygonSidesCalculator.latVertex2=34.46 degree; 2022-05-30T22:58:29.899Z,1653951509.899 [SBIT](IMPORTANT): ShortestDistanceToPolygonSidesCalculator.latVertex3=34.23 degree; 2022-05-30T22:58:29.899Z,1653951509.899 [SBIT](IMPORTANT): ShortestDistanceToPolygonSidesCalculator.latVertex4=34.31 degree; 2022-05-30T22:58:29.899Z,1653951509.899 [SBIT](IMPORTANT): ShortestDistanceToPolygonSidesCalculator.latVertex5=nan degree; 2022-05-30T22:58:29.899Z,1653951509.899 [SBIT](IMPORTANT): ShortestDistanceToPolygonSidesCalculator.loadAtStartup=1 bool; 2022-05-30T22:58:29.899Z,1653951509.899 [SBIT](IMPORTANT): ShortestDistanceToPolygonSidesCalculator.lonVertex1=-120.09 degree; 2022-05-30T22:58:29.900Z,1653951509.900 [SBIT](IMPORTANT): ShortestDistanceToPolygonSidesCalculator.lonVertex2=-119.71 degree; 2022-05-30T22:58:29.900Z,1653951509.900 [SBIT](IMPORTANT): ShortestDistanceToPolygonSidesCalculator.lonVertex3=-119.71 degree; 2022-05-30T22:58:29.900Z,1653951509.900 [SBIT](IMPORTANT): ShortestDistanceToPolygonSidesCalculator.lonVertex4=-120.11 degree; 2022-05-30T22:58:29.900Z,1653951509.900 [SBIT](IMPORTANT): ShortestDistanceToPolygonSidesCalculator.lonVertex5=nan degree; 2022-05-30T22:58:29.900Z,1653951509.900 [SBIT](IMPORTANT): VerticalControl.buoyancyNeutral=443 cubic_centimeter; 2022-05-30T22:58:29.900Z,1653951509.900 [SBIT](IMPORTANT): VerticalControl.massDefault=-27 millimeter; 2022-05-30T22:58:29.900Z,1653951509.900 [SBIT](IMPORTANT): VerticalControl.massPositionLimitAft=-28 millimeter; 2022-05-30T22:58:30.306Z,1653951510.306 [MissionManager](IMPORTANT): Started mission Startup 2022-05-30T23:00:31.323Z,1653951631.323 [MissionManager](IMPORTANT): Started mission Default 2022-05-30T23:01:10.474Z,1653951670.474 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-30T23:09:09.294Z,1653952149.294 [DataOverHttps](IMPORTANT): SBD MTMSN=20220530T230904 2022-05-30T23:09:16.916Z,1653952156.916 [CommandExec](IMPORTANT): got command schedule asap "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 4 count;set IsothermDepthSampling.MissionTimeout 17 h;set IsothermDepthSampling.MaxWaitNoFiring 11 h" 27kac 1 7.000000 2022-05-30T23:09:16.916Z,1653952156.916 [CommandExec](IMPORTANT): Scheduling command #1 of 7 with id=27kac 2022-05-30T23:09:16.918Z,1653952156.918 [CommandExec](IMPORTANT): Scheduled #1 (#1 of 7 with id='27kac'): "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 4 count;set IsothermDepthSampling.MissionTimeout 17 h;set IsothermDepthSampling.MaxWaitNoFiring 11 h", ASAP 2022-05-30T23:09:17.846Z,1653952157.846 [DataOverHttps](IMPORTANT): SBD MTMSN=20220530T230913 2022-05-30T23:09:25.385Z,1653952165.385 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.MaxWaitNotAchievingDepth 0.5 h;set IsothermDepthSampling.SendSampleStatusAndData 1 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.InitialDiveDuration 3 min" 27kac 2 7.000000 2022-05-30T23:09:25.385Z,1653952165.385 [CommandExec](IMPORTANT): Scheduling command #2 of 7 with id=27kac 2022-05-30T23:09:25.386Z,1653952165.386 [CommandExec](IMPORTANT): Scheduled #2 (#2 of 7 with id='27kac'): "set IsothermDepthSampling.MaxWaitNotAchievingDepth 0.5 h;set IsothermDepthSampling.SendSampleStatusAndData 1 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.InitialDiveDuration 3 min", ASAP 2022-05-30T23:09:26.374Z,1653952166.374 [DataOverHttps](IMPORTANT): SBD MTMSN=20220530T230921 2022-05-30T23:09:27.197Z,1653952167.197 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 8.924412 min 2022-05-30T23:09:33.717Z,1653952173.717 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.SpeedSampling 0 m/s;set IsothermDepthSampling.HeadingLeavingSide0 210 degree;set IsothermDepthSampling.HeadingLeavingSide2 30 degree;set IsothermDepthSampling.HeadingLeavingSide3 120 degree" 27kac 3 7.000000 2022-05-30T23:09:33.717Z,1653952173.717 [CommandExec](IMPORTANT): Scheduling command #3 of 7 with id=27kac 2022-05-30T23:09:33.718Z,1653952173.718 [CommandExec](IMPORTANT): Scheduled #3 (#3 of 7 with id='27kac'): "set IsothermDepthSampling.SpeedSampling 0 m/s;set IsothermDepthSampling.HeadingLeavingSide0 210 degree;set IsothermDepthSampling.HeadingLeavingSide2 30 degree;set IsothermDepthSampling.HeadingLeavingSide3 120 degree", ASAP 2022-05-30T23:09:34.471Z,1653952174.471 [DataOverHttps](IMPORTANT): SBD MOMSN=16844059, MTMSN=20220530T230930 2022-05-30T23:09:45.300Z,1653952185.300 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.MinOffshore 4 km;set IsothermDepthSampling.ShallowBoundChl 2 m;set IsothermDepthSampling.DeepBoundChl 37 m;set IsothermDepthSampling.CartridgeTypeCommon NaN count" 27kac 4 7.000000 2022-05-30T23:09:45.300Z,1653952185.300 [CommandExec](IMPORTANT): Scheduling command #4 of 7 with id=27kac 2022-05-30T23:09:45.301Z,1653952185.301 [CommandExec](IMPORTANT): Scheduled #4 (#4 of 7 with id='27kac'): "set IsothermDepthSampling.MinOffshore 4 km;set IsothermDepthSampling.ShallowBoundChl 2 m;set IsothermDepthSampling.DeepBoundChl 37 m;set IsothermDepthSampling.CartridgeTypeCommon NaN count", ASAP 2022-05-30T23:09:46.689Z,1653952186.689 [DataOverHttps](IMPORTANT): SBD MTMSN=20220530T230941 2022-05-30T23:09:54.020Z,1653952194.020 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.CartridgeType1 -6 count;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.CartridgeType3 -6 count;set IsothermDepthSampling.DepDiffFromPeakChl1 0 m" 27kac 5 7.000000 2022-05-30T23:09:54.022Z,1653952194.022 [CommandExec](IMPORTANT): Scheduling command #5 of 7 with id=27kac 2022-05-30T23:09:54.023Z,1653952194.023 [CommandExec](IMPORTANT): Scheduled #5 (#5 of 7 with id='27kac'): "set IsothermDepthSampling.CartridgeType1 -6 count;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.CartridgeType3 -6 count;set IsothermDepthSampling.DepDiffFromPeakChl1 0 m", ASAP 2022-05-30T23:09:55.041Z,1653952195.041 [DataOverHttps](IMPORTANT): SBD MOMSN=16844064, MTMSN=20220530T230950 2022-05-30T23:10:02.488Z,1653952202.488 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.DepDiffFromPeakChl2 0 m;set IsothermDepthSampling.DepDiffFromPeakChl3 0 m;set IsothermDepthSampling.DepDiffFromPeakChl4 0 m;set IsothermDepthSampling.WaitDepUndulation1 20 min" 27kac 6 7.000000 2022-05-30T23:10:02.488Z,1653952202.488 [CommandExec](IMPORTANT): Scheduling command #6 of 7 with id=27kac 2022-05-30T23:10:02.489Z,1653952202.489 [CommandExec](IMPORTANT): Scheduled #6 (#6 of 7 with id='27kac'): "set IsothermDepthSampling.DepDiffFromPeakChl2 0 m;set IsothermDepthSampling.DepDiffFromPeakChl3 0 m;set IsothermDepthSampling.DepDiffFromPeakChl4 0 m;set IsothermDepthSampling.WaitDepUndulation1 20 min", ASAP 2022-05-30T23:10:03.669Z,1653952203.669 [DataOverHttps](IMPORTANT): SBD MTMSN=20220530T230958 2022-05-30T23:10:11.160Z,1653952211.160 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.WaitDepUndulation2 5.0 min;set IsothermDepthSampling.WaitDepUndulation3 360 min;set IsothermDepthSampling.WaitDepUndulation4 5 min;run" 27kac 7 7.000000 2022-05-30T23:10:11.161Z,1653952211.161 [CommandExec](IMPORTANT): Scheduling command #7 of 7 with id=27kac 2022-05-30T23:10:11.162Z,1653952211.162 [CommandExec](IMPORTANT): Scheduled #7 (#7 of 7 with id='27kac'): "set IsothermDepthSampling.WaitDepUndulation2 5.0 min;set IsothermDepthSampling.WaitDepUndulation3 360 min;set IsothermDepthSampling.WaitDepUndulation4 5 min;run", ASAP 2022-05-30T23:10:11.297Z,1653952211.297 [CommandExec](IMPORTANT): got command load ./Missions/Science/isotherm_depth_sampling.xml 2022-05-30T23:10:41.182Z,1653952241.182 [CommandExec](IMPORTANT): Loaded ./Missions/Science/isotherm_depth_sampling.xml 2022-05-30T23:11:06.913Z,1653952266.913 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.NumSamplers 4 count 2022-05-30T23:11:06.914Z,1653952266.914 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MissionTimeout 17 hour 2022-05-30T23:11:06.915Z,1653952266.915 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNoFiring 11 hour 2022-05-30T23:11:37.228Z,1653952297.228 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNotAchievingDepth 0.5 hour 2022-05-30T23:11:37.229Z,1653952297.229 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendSampleStatusAndData 1 bool 2022-05-30T23:11:37.229Z,1653952297.229 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SampleAtPeakChl 1 bool 2022-05-30T23:11:37.230Z,1653952297.230 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.InitialDiveDuration 3 minute 2022-05-30T23:12:13.434Z,1653952333.434 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SpeedSampling 0 meter_per_second 2022-05-30T23:12:13.437Z,1653952333.437 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.HeadingLeavingSide0 210 degree 2022-05-30T23:12:13.440Z,1653952333.440 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.HeadingLeavingSide2 30 degree 2022-05-30T23:12:13.440Z,1653952333.440 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.HeadingLeavingSide3 120 degree 2022-05-30T23:12:40.517Z,1653952360.517 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MinOffshore 4 kilometer 2022-05-30T23:12:40.518Z,1653952360.518 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 2 meter 2022-05-30T23:12:40.518Z,1653952360.518 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 37 meter 2022-05-30T23:12:40.519Z,1653952360.519 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeTypeCommon NaN count 2022-05-30T23:13:09.151Z,1653952389.151 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType1 -6 count 2022-05-30T23:13:09.152Z,1653952389.152 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType2 -10 count 2022-05-30T23:13:09.183Z,1653952389.183 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType3 -6 count 2022-05-30T23:13:09.188Z,1653952389.188 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChl1 0 meter 2022-05-30T23:13:40.075Z,1653952420.075 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChl2 0 meter 2022-05-30T23:13:40.075Z,1653952420.075 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChl3 0 meter 2022-05-30T23:13:40.076Z,1653952420.076 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChl4 0 meter 2022-05-30T23:13:40.077Z,1653952420.077 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 20 minute 2022-05-30T23:14:09.784Z,1653952449.784 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation2 5.0 minute 2022-05-30T23:14:09.785Z,1653952449.785 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation3 360 minute 2022-05-30T23:14:09.786Z,1653952449.786 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation4 5 minute 2022-05-30T23:14:09.786Z,1653952449.786 [CommandExec](IMPORTANT): got command run 2022-05-30T23:14:09.837Z,1653952449.837 [CommandExec](IMPORTANT): Running 2022-05-30T23:14:10.172Z,1653952450.172 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling 2022-05-30T23:14:10.276Z,1653952450.276 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 21.00 hours. 2022-05-30T23:14:31.169Z,1653952471.169 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-30T23:15:24.177Z,1653952524.177 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.358246 m 2022-05-30T23:18:33.596Z,1653952713.596 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , nan K , 0.000000 m , nan degC , nan m , 20.000000 min . 2022-05-30T23:20:23.063Z,1653952823.063 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-30T23:27:27.743Z,1653953247.743 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoUp:B](IMPORTANT): Go up from 40.066067 m 2022-05-30T23:31:47.898Z,1653953507.898 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:SetChlPeakTempDepth:L](IMPORTANT): Set peak-chl depth and temp. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlTemperatureSet, PeakChlSet = 34.731415 m , 0.374400 ug/l , 12.521577 m , 14.880821 degC , 1.060800 ug/l 2022-05-30T23:31:48.279Z,1653953508.279 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 1.000000 count . Target depth = 12.521577 m . 2022-05-30T23:31:48.693Z,1653953508.693 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -6.000000 count 2022-05-30T23:35:36.190Z,1653953736.190 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 12.491508 m , settling for 20.000000 min 2022-05-30T23:55:38.829Z,1653954938.829 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::|summary:' 2022-05-30T23:55:48.965Z,1653954948.965 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-05-30T23:55:49.289Z,1653954949.289 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-05-30T23:56:44.440Z,1653955004.440 [ESPComponent](IMPORTANT): ESP has connected as client 2022-05-30T23:56:45.258Z,1653955005.258 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -6 2022-05-30T23:56:45.259Z,1653955005.259 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-05-30T23:56:45.707Z,1653955005.707 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 13.784150 m in 13.752588 degC water with 0.785200 ug/l chlorophyll fluorescence. 2022-05-30T23:56:46.461Z,1653955006.461 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG 2022-05-30T23:56:46.865Z,1653955006.865 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-05-30T23:56:48.482Z,1653955008.482 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE 2022-05-30T23:57:28.074Z,1653955048.074 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PRIMING (@34,archive_bac) 2022-05-30T23:57:30.497Z,1653955050.497 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PRIMING (@100.0) 2022-05-30T23:57:30.498Z,1653955050.498 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-05-30T23:57:30.902Z,1653955050.902 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-05-30T23:59:41.798Z,1653955181.798 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_FILTERING (@0.0) 2022-05-30T23:59:42.202Z,1653955182.202 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-05-31T00:56:13.089Z,1653958573.089 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PAUSED (@1000.0) 2022-05-31T00:56:13.494Z,1653958573.494 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PROCESSING (@1000.0) 2022-05-31T00:56:15.518Z,1653958575.518 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2022-05-31T00:56:15.921Z,1653958575.921 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PROCESSED (@34,archive_bac) 2022-05-31T01:08:20.298Z,1653959300.298 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING (@34,archive_bac) 2022-05-31T01:08:29.590Z,1653959309.590 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-05-31T01:08:29.994Z,1653959309.994 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED 2022-05-31T01:13:29.773Z,1653959609.773 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence completed normally. 2022-05-31T01:13:30.645Z,1653959610.645 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 1.000000 count completed. 2022-05-31T01:13:32.649Z,1653959612.649 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataCntSamples:A](IMPORTANT): CntSamples = 1.000000 count 2022-05-31T01:13:33.880Z,1653959613.880 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleNumber:A](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2022-05-31T01:13:35.204Z,1653959615.204 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPCartridgeType:A](IMPORTANT): Science:ESPComponent.cartridge = -6 count 2022-05-31T01:13:36.297Z,1653959616.297 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleVolume:A](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2022-05-31T01:13:37.909Z,1653959617.909 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleDep:A](IMPORTANT): Universal:depth = 12.165206 m 2022-05-31T01:13:39.550Z,1653959619.550 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleChl:A](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 0.884000 ug/l 2022-05-31T01:13:47.380Z,1653959627.380 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T01:13:56.104Z,1653959636.104 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -10.000000 count , nan K , 0.000000 m , nan degC , nan m , 5.000000 min . 2022-05-31T01:13:59.764Z,1653959639.764 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 2.000000 count . Target depth = 12.521577 m . 2022-05-31T01:14:00.157Z,1653959640.157 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -10.000000 count 2022-05-31T01:14:01.264Z,1653959641.264 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T01:14:15.133Z,1653959655.133 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T01:14:29.006Z,1653959669.006 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T01:15:08.076Z,1653959708.076 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T01:15:21.949Z,1653959721.949 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T01:15:36.690Z,1653959736.690 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 12.573196 m , settling for 5.000000 min 2022-05-31T01:20:49.437Z,1653960049.437 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-05-31T01:20:49.536Z,1653960049.536 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-05-31T01:21:45.897Z,1653960105.897 [ESPComponent](IMPORTANT): ESP has connected as client 2022-05-31T01:21:46.718Z,1653960106.718 [ESPComponent](IMPORTANT): [sample #2] Setting cartridge argument to -10 2022-05-31T01:21:46.718Z,1653960106.718 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-05-31T01:21:47.199Z,1653960107.199 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 14.438097 m in 12.808008 degC water with 0.981760 ug/l chlorophyll fluorescence. 2022-05-31T01:21:47.513Z,1653960107.513 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_LOG 2022-05-31T01:21:47.921Z,1653960107.921 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-05-31T01:21:49.939Z,1653960109.939 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_LOADING_CARTRIDGE 2022-05-31T01:22:30.337Z,1653960150.337 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PRIMING (@33,daSPR_phyto) 2022-05-31T01:22:32.358Z,1653960152.358 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PRIMING (@100.0) 2022-05-31T01:22:32.766Z,1653960152.766 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-05-31T01:22:33.167Z,1653960153.167 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-05-31T01:24:35.988Z,1653960275.988 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_FILTERING (@0.0) 2022-05-31T01:24:36.385Z,1653960276.385 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-05-31T02:10:20.152Z,1653963020.152 [BuoyancyServo](FAULT): Buoyancy initialization uart error:serial timeout 2022-05-31T02:14:34.529Z,1653963274.529 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PAUSED (@1000.0) 2022-05-31T02:14:34.933Z,1653963274.933 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PROCESSING (@1000.0) 2022-05-31T02:14:36.954Z,1653963276.954 [ESPComponent](IMPORTANT): Processing timeoutMinutes=120.000000 issuedCmd_=Cmd.startProcessing 2022-05-31T02:14:37.357Z,1653963277.357 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PROCESSED (@33,daSPR_phyto) 2022-05-31T03:02:51.307Z,1653966171.307 [DVL_micro](FAULT): Failed to initialize within timeout. 2022-05-31T03:10:57.856Z,1653966657.856 [BuoyancyServo](FAULT): Invalid EZ Servo response:"" 2022-05-31T03:10:57.856Z,1653966657.856 [BuoyancyServo](FAULT): Buoyancy engine reporting null position 2022-05-31T03:16:41.502Z,1653967001.502 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPING (@33,daSPR_phyto) 2022-05-31T03:16:52.442Z,1653967012.442 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-05-31T03:16:52.813Z,1653967012.813 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPED 2022-05-31T03:21:52.597Z,1653967312.597 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence completed normally. 2022-05-31T03:21:53.453Z,1653967313.453 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 2.000000 count completed. 2022-05-31T03:21:55.480Z,1653967315.480 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataCntSamples:A](IMPORTANT): CntSamples = 2.000000 count 2022-05-31T03:21:56.728Z,1653967316.728 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleNumber:A](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2022-05-31T03:21:57.936Z,1653967317.936 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPCartridgeType:A](IMPORTANT): Science:ESPComponent.cartridge = -10 count 2022-05-31T03:21:59.154Z,1653967319.154 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleVolume:A](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2022-05-31T03:22:00.761Z,1653967320.761 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleDep:A](IMPORTANT): Universal:depth = 12.205153 m 2022-05-31T03:22:02.368Z,1653967322.368 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleChl:A](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 1.154400 ug/l 2022-05-31T03:22:09.656Z,1653967329.656 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T03:22:18.912Z,1653967338.912 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , nan K , 0.000000 m , nan degC , nan m , 360.000000 min . 2022-05-31T03:22:22.552Z,1653967342.552 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 3.000000 count . Target depth = 12.521577 m . 2022-05-31T03:22:22.981Z,1653967342.981 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -6.000000 count 2022-05-31T03:22:23.516Z,1653967343.516 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T03:22:37.392Z,1653967357.392 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T03:22:51.253Z,1653967371.253 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T03:23:27.044Z,1653967407.044 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T03:23:40.912Z,1653967420.912 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T03:23:54.772Z,1653967434.772 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T03:23:55.060Z,1653967435.060 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 12.597883 m , settling for 360.000000 min 2022-05-31T03:24:30.341Z,1653967470.341 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T03:24:44.205Z,1653967484.205 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T03:24:58.089Z,1653967498.089 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T04:57:47.549Z,1653973067.549 [CBIT](IMPORTANT): Beginning ground fault scan 2022-05-31T04:57:58.389Z,1653973078.389 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.004904 CHAN A1 (24V): 0.002076 CHAN A2 (12V): -0.000811 CHAN A3 (5V): -0.003417 CHAN B0 (3.3V): -0.001605 CHAN B1 (3.15aV): -0.000301 CHAN B2 (3.15bV): -0.001620 CHAN B3 (GND): -0.000086 OPEN: 0.012327 Full Scale: +/- 1 mA 2022-05-31T09:24:07.760Z,1653989047.760 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-05-31T09:24:08.114Z,1653989048.114 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-05-31T09:25:03.652Z,1653989103.652 [ESPComponent](IMPORTANT): ESP has connected as client 2022-05-31T09:25:04.469Z,1653989104.469 [ESPComponent](IMPORTANT): [sample #3] Setting cartridge argument to -6 2022-05-31T09:25:04.469Z,1653989104.469 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-05-31T09:25:04.973Z,1653989104.973 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 11.826785 m in 14.090418 degC water with 0.982800 ug/l chlorophyll fluorescence. 2022-05-31T09:25:05.273Z,1653989105.273 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_LOG 2022-05-31T09:25:05.677Z,1653989105.677 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-05-31T09:25:07.697Z,1653989107.697 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_LOADING_CARTRIDGE 2022-05-31T09:25:47.289Z,1653989147.289 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PRIMING (@32,archive_bac) 2022-05-31T09:25:49.309Z,1653989149.309 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PRIMING (@100.0) 2022-05-31T09:25:49.714Z,1653989149.714 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-05-31T09:25:50.122Z,1653989150.122 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-05-31T09:27:53.337Z,1653989273.337 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_FILTERING (@0.0) 2022-05-31T09:27:53.741Z,1653989273.741 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-05-31T10:24:31.889Z,1653992671.889 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PAUSED (@1000.0) 2022-05-31T10:24:32.309Z,1653992672.309 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PROCESSING (@1000.0) 2022-05-31T10:24:34.317Z,1653992674.317 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2022-05-31T10:24:34.719Z,1653992674.719 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PROCESSED (@32,archive_bac) 2022-05-31T10:36:39.105Z,1653993399.105 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPING (@32,archive_bac) 2022-05-31T10:36:48.402Z,1653993408.402 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-05-31T10:36:48.805Z,1653993408.805 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPED 2022-05-31T10:41:48.572Z,1653993708.572 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence completed normally. 2022-05-31T10:41:49.447Z,1653993709.447 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 3.000000 count completed. 2022-05-31T10:41:51.447Z,1653993711.447 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataCntSamples:A](IMPORTANT): CntSamples = 3.000000 count 2022-05-31T10:41:52.658Z,1653993712.658 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleNumber:A](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2022-05-31T10:41:53.901Z,1653993713.901 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPCartridgeType:A](IMPORTANT): Science:ESPComponent.cartridge = -6 count 2022-05-31T10:41:55.101Z,1653993715.101 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleVolume:A](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2022-05-31T10:41:56.735Z,1653993716.735 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleDep:A](IMPORTANT): Universal:depth = 11.295810 m 2022-05-31T10:41:58.366Z,1653993718.366 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleChl:A](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 0.832000 ug/l 2022-05-31T10:42:05.680Z,1653993725.680 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T10:42:14.907Z,1653993734.907 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -10.000000 count , nan K , 0.000000 m , nan degC , nan m , 5.000000 min . 2022-05-31T10:42:18.508Z,1653993738.508 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 4.000000 count . Target depth = 12.521577 m . 2022-05-31T10:42:18.927Z,1653993738.927 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -10.000000 count 2022-05-31T10:42:19.545Z,1653993739.545 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T10:42:55.096Z,1653993775.096 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T10:42:58.118Z,1653993778.118 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 12.544024 m , settling for 5.000000 min 2022-05-31T10:43:08.956Z,1653993788.956 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T10:43:55.852Z,1653993835.852 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T10:44:09.717Z,1653993849.717 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T10:48:10.877Z,1653994090.877 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-05-31T10:48:10.984Z,1653994090.984 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-05-31T10:49:06.572Z,1653994146.572 [ESPComponent](IMPORTANT): ESP has connected as client 2022-05-31T10:49:07.384Z,1653994147.384 [ESPComponent](IMPORTANT): [sample #4] Setting cartridge argument to -10 2022-05-31T10:49:07.385Z,1653994147.385 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-05-31T10:49:07.873Z,1653994147.873 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 13.064222 m in 13.923975 degC water with 0.842400 ug/l chlorophyll fluorescence. 2022-05-31T10:49:08.190Z,1653994148.190 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_LOG 2022-05-31T10:49:08.612Z,1653994148.612 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-05-31T10:49:10.616Z,1653994150.616 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_LOADING_CARTRIDGE 2022-05-31T10:49:51.026Z,1653994191.026 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PRIMING (@31,daSPR_phyto) 2022-05-31T10:49:53.845Z,1653994193.845 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PRIMING (@100.0) 2022-05-31T10:49:53.846Z,1653994193.846 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-05-31T10:49:54.249Z,1653994194.249 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-05-31T10:52:15.649Z,1653994335.649 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_FILTERING (@0.0) 2022-05-31T10:52:16.053Z,1653994336.053 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-05-31T10:57:58.731Z,1653994678.731 [CBIT](IMPORTANT): Beginning ground fault scan 2022-05-31T10:58:09.679Z,1653994689.679 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): -0.005402 CHAN A1 (24V): -0.061410 CHAN A2 (12V): -0.004941 CHAN A3 (5V): -0.003523 CHAN B0 (3.3V): 0.007797 CHAN B1 (3.15aV): -0.001011 CHAN B2 (3.15bV): -0.001391 CHAN B3 (GND): -0.000839 OPEN: 0.012228 Full Scale: +/- 1 mA 2022-05-31T11:44:46.965Z,1653997486.965 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PAUSED (@1000.0) 2022-05-31T11:44:47.383Z,1653997487.383 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PROCESSING (@1000.0) 2022-05-31T11:44:49.393Z,1653997489.393 [ESPComponent](IMPORTANT): Processing timeoutMinutes=120.000000 issuedCmd_=Cmd.startProcessing 2022-05-31T11:44:49.793Z,1653997489.793 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PROCESSED (@31,daSPR_phyto) 2022-05-31T12:45:53.357Z,1654001153.357 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPING (@31,daSPR_phyto) 2022-05-31T12:46:04.266Z,1654001164.266 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-05-31T12:46:04.669Z,1654001164.669 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPED 2022-05-31T12:51:04.437Z,1654001464.437 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence completed normally. 2022-05-31T12:51:05.323Z,1654001465.323 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 4.000000 count completed. 2022-05-31T12:51:07.325Z,1654001467.325 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataCntSamples:A](IMPORTANT): CntSamples = 4.000000 count 2022-05-31T12:51:08.555Z,1654001468.555 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleNumber:A](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2022-05-31T12:51:09.808Z,1654001469.808 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPCartridgeType:A](IMPORTANT): Science:ESPComponent.cartridge = -10 count 2022-05-31T12:51:10.961Z,1654001470.961 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleVolume:A](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2022-05-31T12:51:12.578Z,1654001472.578 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleDep:A](IMPORTANT): Universal:depth = 12.844294 m 2022-05-31T12:51:14.230Z,1654001474.230 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleChl:A](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 0.457600 ug/l 2022-05-31T12:51:17.171Z,1654001477.171 [MissionManager](IMPORTANT): Started mission Default 2022-05-31T12:51:21.969Z,1654001481.969 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T12:51:35.833Z,1654001495.833 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T12:57:08.117Z,1654001828.117 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-31T13:02:30.209Z,1654002150.209 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.210309 min 2022-05-31T13:02:31.799Z,1654002151.799 [NAL9602](FAULT): GPS failed to acquire within timeout. 2022-05-31T13:08:17.430Z,1654002497.430 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-31T13:11:12.046Z,1654002672.046 [DataOverHttps](IMPORTANT): SBD MTMSN=20220531T131107 2022-05-31T13:11:19.677Z,1654002679.677 [CommandExec](IMPORTANT): got command schedule asap "load Transport/transit.xml;set transit.MissionTimeout 6 h;set transit.NeedCommsTime 6 h;set transit.Latitude 34.292 degree;set transit.Longitude -120.058 degree;set transit.Depth 50 m;set transit.Speed 0.75 m/s" 28na3 1 2.000000 2022-05-31T13:11:19.677Z,1654002679.677 [CommandExec](IMPORTANT): Scheduling command #1 of 2 with id=28na3 2022-05-31T13:11:19.678Z,1654002679.678 [CommandExec](IMPORTANT): Scheduled #8 (#1 of 2 with id='28na3'): "load Transport/transit.xml;set transit.MissionTimeout 6 h;set transit.NeedCommsTime 6 h;set transit.Latitude 34.292 degree;set transit.Longitude -120.058 degree;set transit.Depth 50 m;set transit.Speed 0.75 m/s", ASAP 2022-05-31T13:11:20.605Z,1654002680.605 [DataOverHttps](IMPORTANT): SBD MTMSN=20220531T131115 2022-05-31T13:11:28.211Z,1654002688.211 [CommandExec](IMPORTANT): got command schedule asap "set transit.MaxDepth 60 m;run" 28na3 2 2.000000 2022-05-31T13:11:28.211Z,1654002688.211 [CommandExec](IMPORTANT): Scheduling command #2 of 2 with id=28na3 2022-05-31T13:11:28.212Z,1654002688.212 [CommandExec](IMPORTANT): Scheduled #9 (#2 of 2 with id='28na3'): "set transit.MaxDepth 60 m;run", ASAP 2022-05-31T13:11:28.326Z,1654002688.326 [CommandExec](IMPORTANT): got command load ./Missions/Transport/transit.xml 2022-05-31T13:11:28.981Z,1654002688.981 [CommandExec](IMPORTANT): Loaded ./Missions/Transport/transit.xml 2022-05-31T13:11:48.441Z,1654002708.441 [CommandExec](IMPORTANT): got command set transit.MissionTimeout 6 hour 2022-05-31T13:11:48.442Z,1654002708.442 [CommandExec](IMPORTANT): got command set transit.NeedCommsTime 6 hour 2022-05-31T13:11:48.443Z,1654002708.443 [CommandExec](IMPORTANT): got command set transit.Latitude 34.292 degree 2022-05-31T13:11:48.444Z,1654002708.444 [CommandExec](IMPORTANT): got command set transit.Longitude -120.058 degree 2022-05-31T13:11:48.444Z,1654002708.444 [CommandExec](IMPORTANT): got command set transit.Depth 50 meter 2022-05-31T13:11:48.445Z,1654002708.445 [CommandExec](IMPORTANT): got command set transit.Speed 0.75 meter_per_second 2022-05-31T13:11:52.411Z,1654002712.411 [CommandExec](IMPORTANT): got command set transit.MaxDepth 60 meter 2022-05-31T13:11:52.411Z,1654002712.411 [CommandExec](IMPORTANT): got command run 2022-05-31T13:11:52.417Z,1654002712.417 [CommandExec](IMPORTANT): Running 2022-05-31T13:11:52.577Z,1654002712.577 [MissionManager](IMPORTANT): Started mission transit 2022-05-31T13:11:55.016Z,1654002715.016 [transit:Transit:Wpt1.Waypoint](IMPORTANT): Reached Waypoint: 34.292000,-120.057999 2022-05-31T13:11:55.080Z,1654002715.080 [CBIT](CRITICAL): Navigation error has exceeded threshold. Set navErrorCriticalReporting to false to squeltch critical failure. 2022-05-31T13:11:55.514Z,1654002715.514 [CommandExec](FAULT): Scheduling is paused 2022-05-31T13:11:56.667Z,1654002716.667 [MissionManager](IMPORTANT): Started mission Default 2022-05-31T13:16:57.171Z,1654003017.171 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-31T13:19:57.761Z,1654003197.761 [DataOverHttps](IMPORTANT): SBD MTMSN=20220531T131953 2022-05-31T13:20:05.325Z,1654003205.325 [CommandExec](IMPORTANT): got command resume 2022-05-31T13:20:05.867Z,1654003205.867 [MissionManager](IMPORTANT): Resuming from info in Logs/20220530T225516/Transport_transit_xml.state 2022-05-31T13:20:05.887Z,1654003205.887 [CommandExec](IMPORTANT): Resuming mission and schedule 2022-05-31T13:20:05.887Z,1654003205.887 [CommandExec](IMPORTANT): Scheduling is resumed 2022-05-31T13:20:06.041Z,1654003206.041 [MissionManager](IMPORTANT): Started mission transit 2022-05-31T13:25:11.018Z,1654003511.018 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-31T13:25:13.058Z,1654003513.058 [MissionManager](IMPORTANT): Started mission Default 2022-05-31T13:27:37.154Z,1654003657.154 [DataOverHttps](IMPORTANT): SBD MTMSN=20220531T132732 2022-05-31T13:27:48.250Z,1654003668.250 [CommandExec](IMPORTANT): got command schedule asap "load Transport/transit.xml;set transit.MissionTimeout 6 h;set transit.NeedCommsTime 6 h;set transit.Latitude 34.292 degree;set transit.Longitude -120.058 degree;set transit.Depth 50 m;set transit.Speed 1 m/s" 28o1i 1 2.000000 2022-05-31T13:27:48.250Z,1654003668.250 [CommandExec](IMPORTANT): Scheduling command #1 of 2 with id=28o1i 2022-05-31T13:27:48.251Z,1654003668.251 [CommandExec](IMPORTANT): Scheduled #10 (#1 of 2 with id='28o1i'): "load Transport/transit.xml;set transit.MissionTimeout 6 h;set transit.NeedCommsTime 6 h;set transit.Latitude 34.292 degree;set transit.Longitude -120.058 degree;set transit.Depth 50 m;set transit.Speed 1 m/s", ASAP 2022-05-31T13:27:49.246Z,1654003669.246 [DataOverHttps](IMPORTANT): SBD MTMSN=20220531T132744 2022-05-31T13:27:56.779Z,1654003676.779 [CommandExec](IMPORTANT): got command schedule asap "set transit.MaxDepth 60 m;run" 28o1i 2 2.000000 2022-05-31T13:27:56.779Z,1654003676.779 [CommandExec](IMPORTANT): Scheduling command #2 of 2 with id=28o1i 2022-05-31T13:27:56.780Z,1654003676.780 [CommandExec](IMPORTANT): Scheduled #11 (#2 of 2 with id='28o1i'): "set transit.MaxDepth 60 m;run", ASAP 2022-05-31T13:27:56.915Z,1654003676.915 [CommandExec](IMPORTANT): got command load ./Missions/Transport/transit.xml 2022-05-31T13:27:57.389Z,1654003677.389 [CommandExec](IMPORTANT): Loaded ./Missions/Transport/transit.xml 2022-05-31T13:28:10.255Z,1654003690.255 [CommandExec](IMPORTANT): got command set transit.MissionTimeout 6 hour 2022-05-31T13:28:10.255Z,1654003690.255 [CommandExec](IMPORTANT): got command set transit.NeedCommsTime 6 hour 2022-05-31T13:28:10.256Z,1654003690.256 [CommandExec](IMPORTANT): got command set transit.Latitude 34.292 degree 2022-05-31T13:28:10.257Z,1654003690.257 [CommandExec](IMPORTANT): got command set transit.Longitude -120.058 degree 2022-05-31T13:28:10.258Z,1654003690.258 [CommandExec](IMPORTANT): got command set transit.Depth 50 meter 2022-05-31T13:28:10.258Z,1654003690.258 [CommandExec](IMPORTANT): got command set transit.Speed 1 meter_per_second 2022-05-31T13:28:12.411Z,1654003692.411 [CommandExec](IMPORTANT): got command set transit.MaxDepth 60 meter 2022-05-31T13:28:12.411Z,1654003692.411 [CommandExec](IMPORTANT): got command run 2022-05-31T13:28:12.413Z,1654003692.413 [CommandExec](IMPORTANT): Running 2022-05-31T13:28:12.604Z,1654003692.604 [MissionManager](IMPORTANT): Started mission transit 2022-05-31T13:30:20.333Z,1654003820.333 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T13:30:30.916Z,1654003830.916 [DAT](FAULT): Buffer send receipt timeout failure. 2022-05-31T13:30:46.556Z,1654003846.556 [DAT](FAULT): failed to enter online mode 2022-05-31T13:30:46.556Z,1654003846.556 [DAT](FAULT): Failure returning to online mode 2022-05-31T13:31:22.296Z,1654003882.296 [DAT](FAULT): failed to set time 2022-05-31T13:31:36.669Z,1654003896.669 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T13:31:50.541Z,1654003910.541 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T13:32:04.404Z,1654003924.404 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T13:32:18.279Z,1654003938.279 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T13:32:32.400Z,1654003952.400 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T13:32:46.266Z,1654003966.266 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T13:33:00.132Z,1654003980.132 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T13:33:13.992Z,1654003993.992 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T13:33:28.104Z,1654004008.104 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T13:33:41.965Z,1654004021.965 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T13:33:55.824Z,1654004035.824 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T13:34:09.684Z,1654004049.684 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T13:34:23.820Z,1654004063.820 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T13:34:37.713Z,1654004077.713 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T13:34:51.596Z,1654004091.596 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T13:35:05.472Z,1654004105.472 [DAT](FAULT): Ack receipt timeout failure. 2022-05-31T15:48:59.502Z,1654012139.502 [transit:Transit:Wpt1.Waypoint](IMPORTANT): Reached Waypoint: 34.292000,-120.057999 2022-05-31T15:56:50.156Z,1654012610.156 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-31T15:57:21.294Z,1654012641.294 [MissionManager](IMPORTANT): Started mission Default 2022-05-31T16:03:08.913Z,1654012988.913 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 5.786998 min 2022-05-31T16:03:19.620Z,1654012999.620 [DataOverHttps](IMPORTANT): SBD MOMSN=16845376, MTMSN=20220531T160314 2022-05-31T16:03:27.301Z,1654013007.301 [CommandExec](IMPORTANT): got command schedule asap "load Transport/transit.xml;set transit.MissionTimeout 14 h;set transit.NeedCommsTime 2 h;set transit.Latitude 34.3435 degree;set transit.Longitude -119.86266 degree;set transit.Depth 50 m;set transit.Speed 1 m/s" 28v8z 1 2.000000 2022-05-31T16:03:27.301Z,1654013007.301 [CommandExec](IMPORTANT): Scheduling command #1 of 2 with id=28v8z 2022-05-31T16:03:27.302Z,1654013007.302 [CommandExec](IMPORTANT): Scheduled #12 (#1 of 2 with id='28v8z'): "load Transport/transit.xml;set transit.MissionTimeout 14 h;set transit.NeedCommsTime 2 h;set transit.Latitude 34.3435 degree;set transit.Longitude -119.86266 degree;set transit.Depth 50 m;set transit.Speed 1 m/s", ASAP 2022-05-31T16:03:28.515Z,1654013008.515 [DataOverHttps](IMPORTANT): SBD MTMSN=20220531T160323 2022-05-31T16:03:36.183Z,1654013016.183 [CommandExec](IMPORTANT): got command schedule asap "set transit.MaxDepth 60 m;run" 28v8z 2 2.000000 2022-05-31T16:03:36.183Z,1654013016.183 [CommandExec](IMPORTANT): Scheduling command #2 of 2 with id=28v8z 2022-05-31T16:03:36.184Z,1654013016.184 [CommandExec](IMPORTANT): Scheduled #13 (#2 of 2 with id='28v8z'): "set transit.MaxDepth 60 m;run", ASAP 2022-05-31T16:03:36.295Z,1654013016.295 [CommandExec](IMPORTANT): got command load ./Missions/Transport/transit.xml 2022-05-31T16:03:37.232Z,1654013017.232 [CommandExec](IMPORTANT): Loaded ./Missions/Transport/transit.xml 2022-05-31T16:04:06.013Z,1654013046.013 [CommandExec](IMPORTANT): got command set transit.MissionTimeout 14 hour 2022-05-31T16:04:06.014Z,1654013046.014 [CommandExec](IMPORTANT): got command set transit.NeedCommsTime 2 hour 2022-05-31T16:04:06.014Z,1654013046.014 [CommandExec](IMPORTANT): got command set transit.Latitude 34.3435 degree 2022-05-31T16:04:06.015Z,1654013046.015 [CommandExec](IMPORTANT): got command set transit.Longitude -119.86266 degree 2022-05-31T16:04:06.041Z,1654013046.041 [CommandExec](IMPORTANT): got command set transit.Depth 50 meter 2022-05-31T16:04:06.041Z,1654013046.041 [CommandExec](IMPORTANT): got command set transit.Speed 1 meter_per_second 2022-05-31T16:04:08.213Z,1654013048.213 [CommandExec](IMPORTANT): got command set transit.MaxDepth 60 meter 2022-05-31T16:04:08.213Z,1654013048.213 [CommandExec](IMPORTANT): got command run 2022-05-31T16:04:08.215Z,1654013048.215 [CommandExec](IMPORTANT): Running 2022-05-31T16:04:08.487Z,1654013048.487 [MissionManager](IMPORTANT): Started mission transit 2022-05-31T16:08:12.965Z,1654013292.965 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-31T16:58:09.920Z,1654016289.920 [CBIT](IMPORTANT): Beginning ground fault scan 2022-05-31T16:58:20.880Z,1654016300.880 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): -0.003297 CHAN A1 (24V): 0.001725 CHAN A2 (12V): -0.004881 CHAN A3 (5V): -0.003837 CHAN B0 (3.3V): -0.001691 CHAN B1 (3.15aV): -0.001629 CHAN B2 (3.15bV): -0.111417 CHAN B3 (GND): -0.000318 OPEN: 0.012310 Full Scale: +/- 1 mA 2022-05-31T18:11:07.218Z,1654020667.218 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-31T18:11:45.512Z,1654020705.512 [RudderServo](FAULT): Rudder uart error - getPosition..serial timeout 2022-05-31T18:17:25.183Z,1654021045.183 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-31T20:19:08.899Z,1654028348.899 [DataOverHttps](IMPORTANT): SBD MTMSN=20220531T201904 2022-05-31T20:19:16.956Z,1654028356.956 [CommandExec](IMPORTANT): got command stop 2022-05-31T20:19:16.959Z,1654028356.959 [CommandExec](IMPORTANT): Scheduling is paused 2022-05-31T20:19:17.642Z,1654028357.642 [MissionManager](IMPORTANT): Started mission Default 2022-05-31T20:20:22.268Z,1654028422.268 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-05-31T20:21:15.276Z,1654028475.276 [DataOverHttps](IMPORTANT): SBD MOMSN=16845936, MTMSN=20220531T202110