2023-04-23T15:48:26.585Z,1682264906.585 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 3 meter 2023-04-23T15:48:26.585Z,1682264906.585 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 25 meter 2023-04-23T15:48:26.586Z,1682264906.586 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType2 -10 count 2023-04-23T15:48:26.587Z,1682264906.587 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 meter 2023-04-23T15:48:26.589Z,1682264906.589 [CommandExec](IMPORTANT): got command restart logs 2023-04-23T15:49:19.711Z,1682264959.711 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 10 minute 2023-04-23T15:49:19.722Z,1682264959.722 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.RiseFromTurningDepth 6.0 meter 2023-04-23T15:49:19.723Z,1682264959.723 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepChangeThreshAttitudeFlip 4.0 meter 2023-04-23T15:49:19.723Z,1682264959.723 [CommandExec](IMPORTANT): got command run 2023-04-23T15:49:19.755Z,1682264959.755 [CommandExec](IMPORTANT): Running 2023-04-23T15:49:20.001Z,1682264960.001 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling 2023-04-23T15:49:20.179Z,1682264960.179 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 240.00 hours. 2023-04-23T15:51:46.943Z,1682265106.943 [IsothermDepthSampling:StayAwayFromWallsAndShore:FarEnoughFromWallsAndShore:A](IMPORTANT): Far enough from walls and shore. Latitude = 36.869039 arcdeg , longitude = -121.971374 arcdeg . Distance from shore = 9464.564453 m . OffshoreDistanceTurnBack (MinOffshore + MarginMinOffshore) = 2000.000000 m + 100.000000 m . Shortest distance nan m to side. MinDistFromPolygonSides = 200.000000 m . 2023-04-23T15:51:48.988Z,1682265108.988 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.071120 m 2023-04-23T15:52:58.353Z,1682265178.353 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , nan K , 0.000000 m , nan degC , nan m , 10.000000 min . 2023-04-23T16:00:24.429Z,1682265624.429 [CBIT](IMPORTANT): Beginning ground fault scan 2023-04-23T16:00:35.340Z,1682265635.340 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.001028 CHAN A1 (24V): 0.003153 CHAN A2 (12V): -0.005516 CHAN A3 (5V): 0.002767 CHAN B0 (3.3V): -0.001585 CHAN B1 (3.15aV): -0.001337 CHAN B2 (3.15bV): 0.003959 CHAN B3 (GND): -0.000307 OPEN: 0.012110 Full Scale: +/- 1 mA 2023-04-23T16:51:48.490Z,1682268708.490 [IsothermDepthSampling:TakeSamples:NoFiringForTooLong:B](IMPORTANT): No firing for too long. Stopping mission. ElapsedTime, MaxWaitNoFiring = 60.004704 min , 60.000000 min 2023-04-23T16:51:48.898Z,1682268708.898 [CommandExec](IMPORTANT): got command stop 2023-04-23T16:51:50.934Z,1682268710.934 [MissionManager](IMPORTANT): Started mission Default 2023-04-23T16:57:08.673Z,1682269028.673 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-23T16:57:34.958Z,1682269054.958 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 5.726743 min 2023-04-23T17:03:08.851Z,1682269388.851 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.291995 min 2023-04-23T17:08:13.119Z,1682269693.119 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-23T17:08:41.827Z,1682269721.827 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 16.841334 min 2023-04-23T17:14:12.711Z,1682270052.711 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 22.355953 min 2023-04-23T17:15:18.183Z,1682270118.183 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=3484, MT Status=1, MTMSN=2621 2023-04-23T17:15:18.726Z,1682270118.726 [CommandExec](IMPORTANT): got command ! echo i > /dev/loadA6;echo i > /dev/loadA7 2023-04-23T17:19:44.437Z,1682270384.437 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 27.884627 min 2023-04-23T17:22:23.762Z,1682270543.762 [DataOverHttps](IMPORTANT): SBD MTMSN=20230423T172218 2023-04-23T17:22:31.336Z,1682270551.336 [CommandExec](IMPORTANT): got command schedule asap "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h" 3mywy 1 4.000000 2023-04-23T17:22:31.337Z,1682270551.337 [CommandExec](IMPORTANT): Scheduling command #1 of 4 with id=3mywy 2023-04-23T17:22:31.338Z,1682270551.338 [CommandExec](IMPORTANT): Scheduled #9 (#1 of 4 with id='3mywy'): "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h", ASAP 2023-04-23T17:22:32.274Z,1682270552.274 [DataOverHttps](IMPORTANT): SBD MTMSN=20230423T172226 2023-04-23T17:22:42.365Z,1682270562.365 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.SendSampleStatusAndData 0 bool;set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.SpeedSampling 0.8 m/s" 3mywy 2 4.000000 2023-04-23T17:22:42.366Z,1682270562.366 [CommandExec](IMPORTANT): Scheduling command #2 of 4 with id=3mywy 2023-04-23T17:22:42.367Z,1682270562.367 [CommandExec](IMPORTANT): Scheduled #10 (#2 of 4 with id='3mywy'): "set IsothermDepthSampling.SendSampleStatusAndData 0 bool;set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.SpeedSampling 0.8 m/s", ASAP 2023-04-23T17:22:43.279Z,1682270563.279 [DataOverHttps](IMPORTANT): SBD MTMSN=20230423T172237 2023-04-23T17:22:53.070Z,1682270573.070 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.ShallowBoundChl 3 m;set IsothermDepthSampling.DeepBoundChl 25 m;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 m" 3mywy 3 4.000000 2023-04-23T17:22:53.070Z,1682270573.070 [CommandExec](IMPORTANT): Scheduling command #3 of 4 with id=3mywy 2023-04-23T17:22:53.071Z,1682270573.071 [CommandExec](IMPORTANT): Scheduled #11 (#3 of 4 with id='3mywy'): "set IsothermDepthSampling.ShallowBoundChl 3 m;set IsothermDepthSampling.DeepBoundChl 25 m;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 m", ASAP 2023-04-23T17:22:54.054Z,1682270574.054 [DataOverHttps](IMPORTANT): SBD MTMSN=20230423T172248 2023-04-23T17:23:01.636Z,1682270581.636 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.WaitDepUndulation1 10 min;set IsothermDepthSampling.RiseFromTurningDepth 6.0 m;set IsothermDepthSampling.DepChangeThreshAttitudeFlip 4.0 m;run" 3mywy 4 4.000000 2023-04-23T17:23:01.637Z,1682270581.637 [CommandExec](IMPORTANT): Scheduling command #4 of 4 with id=3mywy 2023-04-23T17:23:01.638Z,1682270581.638 [CommandExec](IMPORTANT): Scheduled #12 (#4 of 4 with id='3mywy'): "set IsothermDepthSampling.WaitDepUndulation1 10 min;set IsothermDepthSampling.RiseFromTurningDepth 6.0 m;set IsothermDepthSampling.DepChangeThreshAttitudeFlip 4.0 m;run", ASAP 2023-04-23T17:23:01.768Z,1682270581.768 [CommandExec](IMPORTANT): got command load ./Missions/Science/isotherm_depth_sampling.xml 2023-04-23T17:23:17.522Z,1682270597.522 [CommandExec](IMPORTANT): Loaded ./Missions/Science/isotherm_depth_sampling.xml 2023-04-23T17:23:40.294Z,1682270620.294 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.NumSamplers 2 count 2023-04-23T17:23:40.295Z,1682270620.295 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MissionTimeout 6 hour 2023-04-23T17:23:40.295Z,1682270620.295 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNoFiring 1 hour 2023-04-23T17:24:17.111Z,1682270657.111 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendSampleStatusAndData 0 bool 2023-04-23T17:24:17.112Z,1682270657.112 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendDataToMultipleModems 0 bool 2023-04-23T17:24:17.112Z,1682270657.112 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SampleAtPeakChl 1 bool 2023-04-23T17:24:17.113Z,1682270657.113 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SpeedSampling 0.8 meter_per_second 2023-04-23T17:24:52.552Z,1682270692.552 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 3 meter 2023-04-23T17:24:52.553Z,1682270692.553 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 25 meter 2023-04-23T17:24:52.554Z,1682270692.554 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType2 -10 count 2023-04-23T17:24:52.554Z,1682270692.554 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 meter 2023-04-23T17:24:53.427Z,1682270693.427 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-23T17:25:15.245Z,1682270715.245 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 33.398360 min 2023-04-23T17:25:18.026Z,1682270718.026 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 10 minute 2023-04-23T17:25:18.026Z,1682270718.026 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.RiseFromTurningDepth 6.0 meter 2023-04-23T17:25:18.027Z,1682270718.027 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepChangeThreshAttitudeFlip 4.0 meter 2023-04-23T17:25:18.027Z,1682270718.027 [CommandExec](IMPORTANT): got command run 2023-04-23T17:25:18.034Z,1682270718.034 [CommandExec](IMPORTANT): Running 2023-04-23T17:25:18.215Z,1682270718.215 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling 2023-04-23T17:25:18.302Z,1682270718.302 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 240.00 hours. 2023-04-23T17:29:00.175Z,1682270940.175 [IsothermDepthSampling:StayAwayFromWallsAndShore:FarEnoughFromWallsAndShore:A](IMPORTANT): Far enough from walls and shore. Latitude = 36.875091 arcdeg , longitude = -121.979813 arcdeg . Distance from shore = 8788.428711 m . OffshoreDistanceTurnBack (MinOffshore + MarginMinOffshore) = 2000.000000 m + 100.000000 m . Shortest distance nan m to side 0 count . MinDistFromPolygonSides = 200.000000 m . 2023-04-23T17:29:02.179Z,1682270942.179 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.244791 m 2023-04-23T17:30:11.700Z,1682271011.700 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , nan K , 0.000000 m , nan degC , nan m , 10.000000 min . 2023-04-23T17:31:57.933Z,1682271117.933 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-23T17:34:36.520Z,1682271276.520 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoUp:B](IMPORTANT): Go up from 28.037395 m 2023-04-23T17:36:49.505Z,1682271409.505 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:SetChlPeakTempDepth:L](IMPORTANT): Set peak-chl depth and temp. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlTemperatureSet, PeakChlSet = 21.827286 m , 0.811200 ug/l , 6.248187 m , 11.378975 degC , 5.084044 ug/l 2023-04-23T17:36:49.834Z,1682271409.834 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 1.000000 count . Target depth = 6.248187 m . 2023-04-23T17:36:50.255Z,1682271410.255 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -6.000000 count 2023-04-23T17:40:25.993Z,1682271625.993 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 6.205602 m , settling for 10.000000 min 2023-04-23T17:50:28.710Z,1682272228.710 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::|summary:' 2023-04-23T17:50:38.848Z,1682272238.848 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-04-23T17:50:39.205Z,1682272239.205 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-04-23T17:51:31.953Z,1682272291.953 [ESPComponent](IMPORTANT): ESP has connected as client 2023-04-23T17:51:32.771Z,1682272292.771 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -6 2023-04-23T17:51:32.772Z,1682272292.772 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-04-23T17:51:33.259Z,1682272293.259 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 5.860514 m in 11.435541 degC water with 4.736160 ug/l chlorophyll fluorescence. 2023-04-23T17:51:33.973Z,1682272293.973 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG 2023-04-23T17:51:34.377Z,1682272294.377 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-04-23T17:51:35.993Z,1682272295.993 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE 2023-04-23T17:52:12.767Z,1682272332.767 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PRIMING (@8,archive_bac) 2023-04-23T17:52:14.780Z,1682272334.780 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PRIMING (@100.0) 2023-04-23T17:52:15.182Z,1682272335.182 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-04-23T17:52:15.586Z,1682272335.586 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-04-23T17:54:31.733Z,1682272471.733 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_FILTERING (@0.0) 2023-04-23T17:54:32.141Z,1682272472.141 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-04-23T18:00:35.439Z,1682272835.439 [CBIT](IMPORTANT): Beginning ground fault scan 2023-04-23T18:00:46.769Z,1682272846.769 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.231621 CHAN A1 (24V): 0.389235 CHAN A2 (12V): 0.173317 CHAN A3 (5V): 0.057637 CHAN B0 (3.3V): 0.035347 CHAN B1 (3.15aV): 0.035332 CHAN B2 (3.15bV): 0.035365 CHAN B3 (GND): -0.009697 OPEN: 0.017615 Full Scale: +/- 1 mA 2023-04-23T18:48:36.733Z,1682275716.733 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PAUSED (@860.3) 2023-04-23T18:48:37.136Z,1682275717.136 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PROCESSING (@860.3) 2023-04-23T18:48:39.157Z,1682275719.157 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2023-04-23T18:48:39.557Z,1682275719.557 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PROCESSED (@8,archive_bac) 2023-04-23T19:00:44.389Z,1682276444.389 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING (@8,archive_bac) 2023-04-23T19:00:54.490Z,1682276454.490 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-04-23T19:00:54.901Z,1682276454.901 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED 2023-04-23T19:05:54.666Z,1682276754.666 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence completed normally. 2023-04-23T19:05:55.540Z,1682276755.540 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 1.000000 count completed. 2023-04-23T19:06:12.125Z,1682276772.125 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -10.000000 count , nan K , 0.000000 m , nan degC , nan m , 5.000000 min . 2023-04-23T19:06:15.736Z,1682276775.736 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 2.000000 count . Target depth = 6.248187 m . 2023-04-23T19:06:16.154Z,1682276776.154 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -10.000000 count 2023-04-23T19:07:36.579Z,1682276856.579 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 6.299837 m , settling for 5.000000 min 2023-04-23T19:12:49.294Z,1682277169.294 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-04-23T19:12:49.465Z,1682277169.465 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-04-23T19:13:38.169Z,1682277218.169 [ESPComponent](IMPORTANT): ESP has connected as client 2023-04-23T19:13:38.981Z,1682277218.981 [ESPComponent](IMPORTANT): [sample #2] Setting cartridge argument to -10 2023-04-23T19:13:38.982Z,1682277218.982 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-04-23T19:13:39.464Z,1682277219.464 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 6.802434 m in 11.346399 degC water with 4.907760 ug/l chlorophyll fluorescence. 2023-04-23T19:13:39.785Z,1682277219.785 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_LOG 2023-04-23T19:13:40.189Z,1682277220.189 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-04-23T19:13:42.209Z,1682277222.209 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_LOADING_CARTRIDGE 2023-04-23T19:14:19.781Z,1682277259.781 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PRIMING (@17,daSPR_phyto) 2023-04-23T19:14:22.610Z,1682277262.610 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PRIMING (@100.0) 2023-04-23T19:14:22.611Z,1682277262.611 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-04-23T19:14:23.013Z,1682277263.013 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-04-23T19:16:43.614Z,1682277403.614 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_FILTERING (@0.0) 2023-04-23T19:16:44.017Z,1682277404.017 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-04-23T19:30:04.108Z,1682278204.108 [ThrusterHE](IMPORTANT): Status lock Detected. 2023-04-23T19:30:04.492Z,1682278204.492 [ThrusterHE](IMPORTANT): Status lock Detected. 2023-04-23T19:30:04.852Z,1682278204.852 [ThrusterHE](IMPORTANT): Status lock Detected. 2023-04-23T19:30:05.348Z,1682278205.348 [ThrusterHE](IMPORTANT): Status lock Detected. 2023-04-23T19:30:05.705Z,1682278205.705 [ThrusterHE](IMPORTANT): Status lock Detected. 2023-04-23T19:30:07.384Z,1682278207.384 [ThrusterHE](IMPORTANT): Status lock Detected. 2023-04-23T20:00:47.191Z,1682280047.191 [CBIT](IMPORTANT): Beginning ground fault scan 2023-04-23T20:00:58.106Z,1682280058.106 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.263392 CHAN A1 (24V): 0.375664 CHAN A2 (12V): 0.161255 CHAN A3 (5V): 0.054236 CHAN B0 (3.3V): 0.044779 CHAN B1 (3.15aV): 0.034447 CHAN B2 (3.15bV): 0.041794 CHAN B3 (GND): -0.011182 OPEN: 0.017400 Full Scale: +/- 1 mA 2023-04-23T20:12:41.317Z,1682280761.317 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PAUSED (@902.0) 2023-04-23T20:12:41.722Z,1682280761.722 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PROCESSING (@902.0) 2023-04-23T20:12:43.746Z,1682280763.746 [ESPComponent](IMPORTANT): Processing timeoutMinutes=120.000000 issuedCmd_=Cmd.startProcessing 2023-04-23T20:12:44.145Z,1682280764.145 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PROCESSED (@17,daSPR_phyto) 2023-04-23T21:12:10.414Z,1682284330.414 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPING (@17,daSPR_phyto) 2023-04-23T21:12:21.726Z,1682284341.726 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-04-23T21:12:22.148Z,1682284342.148 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPED 2023-04-23T21:17:21.922Z,1682284641.922 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence completed normally. 2023-04-23T21:17:22.803Z,1682284642.803 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 2.000000 count completed. 2023-04-23T21:17:25.813Z,1682284645.813 [MissionManager](IMPORTANT): Started mission Default 2023-04-23T21:18:39.690Z,1682284719.690 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=3485, MT Status=1, MTMSN=2622 2023-04-23T21:18:40.251Z,1682284720.251 [CommandExec](IMPORTANT): got command ! echo i > /dev/loadA6;echo i > /dev/loadA7 2023-04-23T21:26:42.971Z,1682285202.971 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 9.279721 min 2023-04-23T21:32:13.854Z,1682285533.854 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 14.794302 min 2023-04-23T21:37:49.278Z,1682285869.278 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 20.384106 min 2023-04-23T21:39:56.894Z,1682285996.894 [DataOverHttps](IMPORTANT): SBD MTMSN=20230423T213951 2023-04-23T21:40:04.390Z,1682286004.390 [CommandExec](IMPORTANT): got command schedule asap "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 3 count;set IsothermDepthSampling.MissionTimeout 12 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h" 3nau4 1 5.000000 2023-04-23T21:40:04.390Z,1682286004.390 [CommandExec](IMPORTANT): Scheduling command #1 of 5 with id=3nau4 2023-04-23T21:40:04.391Z,1682286004.391 [CommandExec](IMPORTANT): Scheduled #13 (#1 of 5 with id='3nau4'): "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 3 count;set IsothermDepthSampling.MissionTimeout 12 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h", ASAP 2023-04-23T21:40:05.334Z,1682286005.334 [DataOverHttps](IMPORTANT): SBD MTMSN=20230423T213959 2023-04-23T21:40:12.925Z,1682286012.925 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.SendSampleStatusAndData 0 bool;set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.SpeedSampling 0.8 m/s" 3nau4 2 5.000000 2023-04-23T21:40:12.925Z,1682286012.925 [CommandExec](IMPORTANT): Scheduling command #2 of 5 with id=3nau4 2023-04-23T21:40:12.926Z,1682286012.926 [CommandExec](IMPORTANT): Scheduled #14 (#2 of 5 with id='3nau4'): "set IsothermDepthSampling.SendSampleStatusAndData 0 bool;set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.SpeedSampling 0.8 m/s", ASAP 2023-04-23T21:40:13.922Z,1682286013.922 [DataOverHttps](IMPORTANT): SBD MTMSN=20230423T214008 2023-04-23T21:40:21.507Z,1682286021.507 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.ShallowBoundChl 3 m;set IsothermDepthSampling.DeepBoundChl 25 m;set IsothermDepthSampling.CartridgeType1 -10 count;set IsothermDepthSampling.CartridgeType2 -6 count" 3nau4 3 5.000000 2023-04-23T21:40:21.507Z,1682286021.507 [CommandExec](IMPORTANT): Scheduling command #3 of 5 with id=3nau4 2023-04-23T21:40:21.509Z,1682286021.509 [CommandExec](IMPORTANT): Scheduled #15 (#3 of 5 with id='3nau4'): "set IsothermDepthSampling.ShallowBoundChl 3 m;set IsothermDepthSampling.DeepBoundChl 25 m;set IsothermDepthSampling.CartridgeType1 -10 count;set IsothermDepthSampling.CartridgeType2 -6 count", ASAP 2023-04-23T21:40:22.486Z,1682286022.486 [DataOverHttps](IMPORTANT): SBD MTMSN=20230423T214016 2023-04-23T21:40:33.148Z,1682286033.148 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.CartridgeType3 -10 count;set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 m;set IsothermDepthSampling.WaitDepUndulation1 20.0 min;set IsothermDepthSampling.WaitDepUndulation2 10 min" 3nau4 4 5.000000 2023-04-23T21:40:33.150Z,1682286033.150 [CommandExec](IMPORTANT): Scheduling command #4 of 5 with id=3nau4 2023-04-23T21:40:33.151Z,1682286033.151 [CommandExec](IMPORTANT): Scheduled #16 (#4 of 5 with id='3nau4'): "set IsothermDepthSampling.CartridgeType3 -10 count;set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 m;set IsothermDepthSampling.WaitDepUndulation1 20.0 min;set IsothermDepthSampling.WaitDepUndulation2 10 min", ASAP 2023-04-23T21:40:34.078Z,1682286034.078 [DataOverHttps](IMPORTANT): SBD MTMSN=20230423T214028 2023-04-23T21:40:42.699Z,1682286042.699 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.WaitDepUndulation3 10 min;set IsothermDepthSampling.RiseFromTurningDepth 6.0 m;set IsothermDepthSampling.DepChangeThreshAttitudeFlip 4.0 m;run" 3nau4 5 5.000000 2023-04-23T21:40:42.700Z,1682286042.700 [CommandExec](IMPORTANT): Scheduling command #5 of 5 with id=3nau4 2023-04-23T21:40:42.701Z,1682286042.701 [CommandExec](IMPORTANT): Scheduled #17 (#5 of 5 with id='3nau4'): "set IsothermDepthSampling.WaitDepUndulation3 10 min;set IsothermDepthSampling.RiseFromTurningDepth 6.0 m;set IsothermDepthSampling.DepChangeThreshAttitudeFlip 4.0 m;run", ASAP 2023-04-23T21:40:42.838Z,1682286042.838 [CommandExec](IMPORTANT): got command load ./Missions/Science/isotherm_depth_sampling.xml 2023-04-23T21:40:58.284Z,1682286058.284 [CommandExec](IMPORTANT): Loaded ./Missions/Science/isotherm_depth_sampling.xml 2023-04-23T21:41:19.138Z,1682286079.138 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.NumSamplers 3 count 2023-04-23T21:41:19.138Z,1682286079.138 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MissionTimeout 12 hour 2023-04-23T21:41:19.139Z,1682286079.139 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNoFiring 1 hour 2023-04-23T21:41:57.664Z,1682286117.664 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendSampleStatusAndData 0 bool 2023-04-23T21:41:57.665Z,1682286117.665 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendDataToMultipleModems 0 bool 2023-04-23T21:41:57.666Z,1682286117.666 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SampleAtPeakChl 1 bool 2023-04-23T21:41:57.666Z,1682286117.666 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SpeedSampling 0.8 meter_per_second 2023-04-23T21:42:26.050Z,1682286146.050 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 3 meter 2023-04-23T21:42:26.051Z,1682286146.051 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 25 meter 2023-04-23T21:42:26.053Z,1682286146.053 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType1 -10 count 2023-04-23T21:42:26.067Z,1682286146.067 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType2 -6 count 2023-04-23T21:42:53.879Z,1682286173.879 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-23T21:43:01.715Z,1682286181.715 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType3 -10 count 2023-04-23T21:43:01.717Z,1682286181.717 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 meter 2023-04-23T21:43:01.718Z,1682286181.718 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 20.0 minute 2023-04-23T21:43:01.718Z,1682286181.718 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation2 10 minute 2023-04-23T21:43:19.326Z,1682286199.326 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 25.885887 min 2023-04-23T21:43:29.808Z,1682286209.808 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation3 10 minute 2023-04-23T21:43:29.809Z,1682286209.809 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.RiseFromTurningDepth 6.0 meter 2023-04-23T21:43:29.810Z,1682286209.810 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepChangeThreshAttitudeFlip 4.0 meter 2023-04-23T21:43:29.810Z,1682286209.810 [CommandExec](IMPORTANT): got command run 2023-04-23T21:43:29.817Z,1682286209.817 [CommandExec](IMPORTANT): Running 2023-04-23T21:43:30.014Z,1682286210.014 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling 2023-04-23T21:43:30.172Z,1682286210.172 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 240.00 hours. 2023-04-23T21:44:44.535Z,1682286284.535 [IsothermDepthSampling:StayAwayFromWallsAndShore:FarEnoughFromWallsAndShore:A](IMPORTANT): Far enough from walls and shore. Latitude = 36.885578 arcdeg , longitude = -121.985366 arcdeg . Distance from shore = 7657.276367 m . OffshoreDistanceTurnBack (MinOffshore + MarginMinOffshore) = 2000.000000 m + 100.000000 m . Shortest distance nan m to side 0 count . MinDistFromPolygonSides = 200.000000 m . 2023-04-23T21:44:46.525Z,1682286286.525 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.015922 m 2023-04-23T21:45:56.078Z,1682286356.078 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -10.000000 count , nan K , 0.000000 m , nan degC , nan m , 20.000000 min . 2023-04-23T21:49:41.040Z,1682286581.040 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-23T21:50:39.271Z,1682286639.271 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoUp:B](IMPORTANT): Go up from 28.093456 m 2023-04-23T21:52:58.270Z,1682286778.270 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:SetChlPeakTempDepth:L](IMPORTANT): Set peak-chl depth and temp. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlTemperatureSet, PeakChlSet = 21.834446 m , 1.362400 ug/l , 9.009177 m , 10.091810 degC , 5.796956 ug/l 2023-04-23T21:52:58.647Z,1682286778.647 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 1.000000 count . Target depth = 9.009177 m . 2023-04-23T21:52:59.044Z,1682286779.044 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -10.000000 count 2023-04-23T21:56:14.585Z,1682286974.585 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 8.999482 m , settling for 20.000000 min 2023-04-23T22:00:58.324Z,1682287258.324 [CBIT](IMPORTANT): Beginning ground fault scan 2023-04-23T22:01:09.159Z,1682287269.159 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.003301 CHAN A1 (24V): 0.005497 CHAN A2 (12V): -0.004411 CHAN A3 (5V): -0.002439 CHAN B0 (3.3V): -0.002152 CHAN B1 (3.15aV): 0.024435 CHAN B2 (3.15bV): -0.000926 CHAN B3 (GND): -0.001122 OPEN: 0.012328 Full Scale: +/- 1 mA 2023-04-23T22:16:27.457Z,1682288187.457 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-04-23T22:16:27.604Z,1682288187.604 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-04-23T22:17:21.977Z,1682288241.977 [ESPComponent](IMPORTANT): ESP has connected as client 2023-04-23T22:17:22.788Z,1682288242.788 [ESPComponent](IMPORTANT): [sample #3] Setting cartridge argument to -10 2023-04-23T22:17:22.788Z,1682288242.788 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-04-23T22:17:23.275Z,1682288243.275 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 10.532378 m in 10.005304 degC water with 4.544800 ug/l chlorophyll fluorescence. 2023-04-23T22:17:23.589Z,1682288243.589 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_LOG 2023-04-23T22:17:23.993Z,1682288243.993 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-04-23T22:17:26.013Z,1682288246.013 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_LOADING_CARTRIDGE 2023-04-23T22:18:03.588Z,1682288283.588 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PRIMING (@15,daSPR_phyto) 2023-04-23T22:18:06.022Z,1682288286.022 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PRIMING (@100.0) 2023-04-23T22:18:06.023Z,1682288286.023 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-04-23T22:18:06.428Z,1682288286.428 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-04-23T22:20:23.785Z,1682288423.785 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_FILTERING (@0.0) 2023-04-23T22:20:24.189Z,1682288424.189 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-04-23T23:18:17.473Z,1682291897.473 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PAUSED (@1000.0) 2023-04-23T23:18:17.888Z,1682291897.888 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PROCESSING (@1000.0) 2023-04-23T23:18:19.907Z,1682291899.907 [ESPComponent](IMPORTANT): Processing timeoutMinutes=120.000000 issuedCmd_=Cmd.startProcessing 2023-04-23T23:18:20.301Z,1682291900.301 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PROCESSED (@15,daSPR_phyto) 2023-04-24T00:01:09.624Z,1682294469.624 [CBIT](IMPORTANT): Beginning ground fault scan 2023-04-24T00:01:20.519Z,1682294480.519 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.532703 CHAN A1 (24V): 0.708154 CHAN A2 (12V): 0.297259 CHAN A3 (5V): 0.093289 CHAN B0 (3.3V): 0.068338 CHAN B1 (3.15aV): 0.057008 CHAN B2 (3.15bV): 0.056820 CHAN B3 (GND): -0.009070 OPEN: 0.012175 Full Scale: +/- 1 mA 2023-04-24T00:16:49.542Z,1682295409.542 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPING (@15,daSPR_phyto) 2023-04-24T00:17:00.854Z,1682295420.854 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-04-24T00:17:01.461Z,1682295421.461 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPED 2023-04-24T00:22:01.239Z,1682295721.239 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence completed normally. 2023-04-24T00:22:02.136Z,1682295722.136 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 1.000000 count completed. 2023-04-24T00:22:18.663Z,1682295738.663 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , nan K , 0.000000 m , nan degC , nan m , 10.000000 min . 2023-04-24T00:22:22.349Z,1682295742.349 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 2.000000 count . Target depth = 9.009177 m . 2023-04-24T00:22:22.712Z,1682295742.712 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -6.000000 count 2023-04-24T00:22:36.462Z,1682295756.462 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 8.951470 m , settling for 10.000000 min 2023-04-24T00:32:49.417Z,1682296369.417 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-04-24T00:32:49.574Z,1682296369.574 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-04-24T00:33:39.893Z,1682296419.893 [ESPComponent](IMPORTANT): ESP has connected as client 2023-04-24T00:33:40.713Z,1682296420.713 [ESPComponent](IMPORTANT): [sample #4] Setting cartridge argument to -6 2023-04-24T00:33:40.713Z,1682296420.713 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-04-24T00:33:41.200Z,1682296421.200 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 9.307323 m in 10.123774 degC water with 3.459040 ug/l chlorophyll fluorescence. 2023-04-24T00:33:41.509Z,1682296421.509 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_LOG 2023-04-24T00:33:41.913Z,1682296421.913 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-04-24T00:33:43.933Z,1682296423.933 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_LOADING_CARTRIDGE 2023-04-24T00:34:20.698Z,1682296460.698 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PRIMING (@6,archive_bac) 2023-04-24T00:34:23.525Z,1682296463.525 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PRIMING (@100.0) 2023-04-24T00:34:23.526Z,1682296463.526 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-04-24T00:34:23.930Z,1682296463.930 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-04-24T00:36:38.057Z,1682296598.057 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_FILTERING (@0.0) 2023-04-24T00:36:38.467Z,1682296598.467 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-04-24T00:53:10.404Z,1682297590.404 [ElevatorServo](FAULT): Reading outside of valid range:0.000000 2023-04-24T00:53:11.112Z,1682297591.112 [ElevatorServo](FAULT): Elevator uart error - getPosition.serial timeout 2023-04-24T01:28:35.854Z,1682299715.854 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PAUSED (@1000.0) 2023-04-24T01:28:36.259Z,1682299716.259 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PROCESSING (@1000.0) 2023-04-24T01:28:38.280Z,1682299718.280 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2023-04-24T01:28:38.681Z,1682299718.681 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PROCESSED (@6,archive_bac) 2023-04-24T01:40:43.066Z,1682300443.066 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPING (@6,archive_bac) 2023-04-24T01:40:53.166Z,1682300453.166 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-04-24T01:40:53.569Z,1682300453.569 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPED 2023-04-24T01:45:53.345Z,1682300753.345 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence completed normally. 2023-04-24T01:45:54.234Z,1682300754.234 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 2.000000 count completed. 2023-04-24T01:46:10.775Z,1682300770.775 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -10.000000 count , nan K , 0.000000 m , nan degC , nan m , 10.000000 min . 2023-04-24T01:46:14.421Z,1682300774.421 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 3.000000 count . Target depth = 9.009177 m . 2023-04-24T01:46:14.825Z,1682300774.825 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -10.000000 count 2023-04-24T01:47:24.503Z,1682300844.503 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 9.034042 m , settling for 10.000000 min 2023-04-24T01:57:37.404Z,1682301457.404 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-04-24T01:57:37.536Z,1682301457.536 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-04-24T01:58:30.337Z,1682301510.337 [ESPComponent](IMPORTANT): ESP has connected as client 2023-04-24T01:58:31.153Z,1682301511.153 [ESPComponent](IMPORTANT): [sample #5] Setting cartridge argument to -10 2023-04-24T01:58:31.154Z,1682301511.154 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-04-24T01:58:31.644Z,1682301511.644 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 9.269632 m in 10.386469 degC water with 3.238560 ug/l chlorophyll fluorescence. 2023-04-24T01:58:31.956Z,1682301511.956 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_LOG 2023-04-24T01:58:32.358Z,1682301512.358 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-04-24T01:58:34.379Z,1682301514.379 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_LOADING_CARTRIDGE 2023-04-24T01:59:11.949Z,1682301551.949 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PRIMING (@13,daSPR_phyto) 2023-04-24T01:59:13.970Z,1682301553.970 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PRIMING (@100.0) 2023-04-24T01:59:14.375Z,1682301554.375 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-04-24T01:59:14.777Z,1682301554.777 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-04-24T02:01:20.523Z,1682301680.523 [CBIT](IMPORTANT): Beginning ground fault scan 2023-04-24T02:01:31.451Z,1682301691.451 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.905332 CHAN A1 (24V): 0.822344 CHAN A2 (12V): 0.788854 CHAN A3 (5V): 0.302387 CHAN B0 (3.3V): 0.199154 CHAN B1 (3.15aV): 0.227495 CHAN B2 (3.15bV): 0.222328 CHAN B3 (GND): -0.014443 OPEN: 0.012427 Full Scale: +/- 1 mA 2023-04-24T02:01:33.352Z,1682301693.352 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_FILTERING (@0.0) 2023-04-24T02:01:33.755Z,1682301693.755 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-04-24T02:58:05.009Z,1682305085.009 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PAUSED (@1000.0) 2023-04-24T02:58:05.414Z,1682305085.414 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PROCESSING (@1000.0) 2023-04-24T02:58:07.434Z,1682305087.434 [ESPComponent](IMPORTANT): Processing timeoutMinutes=120.000000 issuedCmd_=Cmd.startProcessing 2023-04-24T02:58:07.838Z,1682305087.838 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PROCESSED (@13,daSPR_phyto) 2023-04-24T03:54:29.377Z,1682308469.377 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPING (@13,daSPR_phyto) 2023-04-24T03:54:40.687Z,1682308480.687 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-04-24T03:54:41.089Z,1682308481.089 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPED 2023-04-24T03:59:40.857Z,1682308780.857 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence completed normally. 2023-04-24T03:59:41.754Z,1682308781.754 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 3.000000 count completed. 2023-04-24T03:59:44.764Z,1682308784.764 [MissionManager](IMPORTANT): Started mission Default 2023-04-24T04:01:31.833Z,1682308891.833 [CBIT](IMPORTANT): Beginning ground fault scan 2023-04-24T04:01:42.738Z,1682308902.738 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.891705 CHAN A1 (24V): 0.812613 CHAN A2 (12V): 0.758684 CHAN A3 (5V): 0.285228 CHAN B0 (3.3V): 0.201192 CHAN B1 (3.15aV): 0.187347 CHAN B2 (3.15bV): 0.186172 CHAN B3 (GND): -0.010477 OPEN: 0.018025 Full Scale: +/- 1 mA 2023-04-24T04:05:31.283Z,1682309131.283 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=3488, MT Status=1, MTMSN=2623 2023-04-24T04:05:31.830Z,1682309131.830 [CommandExec](IMPORTANT): got command ! echo i > /dev/loadA6;echo i > /dev/loadA7 2023-04-24T04:10:51.887Z,1682309451.887 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.111888 min 2023-04-24T04:10:53.490Z,1682309453.490 [NAL9602](FAULT): GPS failed to acquire within timeout. 2023-04-24T04:18:00.970Z,1682309880.970 [DataOverHttps](IMPORTANT): SBD MTMSN=20230424T041755 2023-04-24T04:18:08.444Z,1682309888.444 [CommandExec](IMPORTANT): got command schedule asap "load Science/profile_station.xml;set profile_station.MissionTimeout 12 h;set profile_station.NeedCommsTime 45 min;set profile_station.Lat 36.92 degree;set profile_station.Lon -121.9 degree;set profile_station.YoYoMaxDepth 20 m" 3nt9c 1 2.000000 2023-04-24T04:18:08.445Z,1682309888.445 [CommandExec](IMPORTANT): Scheduling command #1 of 2 with id=3nt9c 2023-04-24T04:18:08.450Z,1682309888.450 [CommandExec](IMPORTANT): Scheduled #18 (#1 of 2 with id='3nt9c'): "load Science/profile_station.xml;set profile_station.MissionTimeout 12 h;set profile_station.NeedCommsTime 45 min;set profile_station.Lat 36.92 degree;set profile_station.Lon -121.9 degree;set profile_station.YoYoMaxDepth 20 m", ASAP 2023-04-24T04:18:09.433Z,1682309889.433 [DataOverHttps](IMPORTANT): SBD MTMSN=20230424T041803 2023-04-24T04:18:17.072Z,1682309897.072 [CommandExec](IMPORTANT): got command schedule asap "set profile_station.Speed 0.8 m/s;set profile_station.MinAltitude 7 m;set profile_station.MaxDepth 35 m;run" 3nt9c 2 2.000000 2023-04-24T04:18:17.072Z,1682309897.072 [CommandExec](IMPORTANT): Scheduling command #2 of 2 with id=3nt9c 2023-04-24T04:18:17.073Z,1682309897.073 [CommandExec](IMPORTANT): Scheduled #19 (#2 of 2 with id='3nt9c'): "set profile_station.Speed 0.8 m/s;set profile_station.MinAltitude 7 m;set profile_station.MaxDepth 35 m;run", ASAP 2023-04-24T04:18:17.198Z,1682309897.198 [CommandExec](IMPORTANT): got command load ./Missions/Science/profile_station.xml 2023-04-24T04:18:19.140Z,1682309899.140 [CommandExec](IMPORTANT): Loaded ./Missions/Science/profile_station.xml 2023-04-24T04:18:50.518Z,1682309930.518 [CommandExec](IMPORTANT): got command set profile_station.MissionTimeout 12 hour 2023-04-24T04:18:50.519Z,1682309930.519 [CommandExec](IMPORTANT): got command set profile_station.NeedCommsTime 45 minute 2023-04-24T04:18:50.520Z,1682309930.520 [CommandExec](IMPORTANT): got command set profile_station.Lat 36.92 degree 2023-04-24T04:18:50.521Z,1682309930.521 [CommandExec](IMPORTANT): got command set profile_station.Lon -121.9 degree 2023-04-24T04:18:50.521Z,1682309930.521 [CommandExec](IMPORTANT): got command set profile_station.YoYoMaxDepth 20 meter 2023-04-24T04:19:01.856Z,1682309941.856 [CommandExec](IMPORTANT): got command set profile_station.Speed 0.8 meter_per_second 2023-04-24T04:19:01.856Z,1682309941.856 [CommandExec](IMPORTANT): got command set profile_station.MinAltitude 7 meter 2023-04-24T04:19:01.857Z,1682309941.857 [CommandExec](IMPORTANT): got command set profile_station.MaxDepth 35 meter 2023-04-24T04:19:01.858Z,1682309941.858 [CommandExec](IMPORTANT): got command run 2023-04-24T04:19:01.859Z,1682309941.859 [CommandExec](IMPORTANT): Running 2023-04-24T04:19:01.949Z,1682309941.949 [MissionManager](IMPORTANT): Started mission profile_station 2023-04-24T04:22:07.602Z,1682310127.602 [DataOverHttps](IMPORTANT): SBD MTMSN=20230424T042201 2023-04-24T04:22:15.728Z,1682310135.728 [CommandExec](IMPORTANT): got command stop 2023-04-24T04:22:16.316Z,1682310136.316 [MissionManager](IMPORTANT): Started mission Default 2023-04-24T04:24:17.123Z,1682310257.123 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-24T04:30:08.763Z,1682310608.763 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 7.867765 min 2023-04-24T04:35:42.919Z,1682310942.919 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 13.437012 min 2023-04-24T04:37:32.725Z,1682311052.725 [DataOverHttps](IMPORTANT): SBD MTMSN=20230424T043727 2023-04-24T04:37:42.598Z,1682311062.598 [CommandExec](IMPORTANT): got command ! echo i > /dev/loadA6;echo i > /dev/loadA7 2023-04-24T04:39:13.330Z,1682311153.330 [DataOverHttps](IMPORTANT): SBD MTMSN=20230424T043907 2023-04-24T04:39:20.780Z,1682311160.780 [CommandExec](IMPORTANT): got command schedule asap "load Science/profile_station.xml;set profile_station.MissionTimeout 12 h;set profile_station.NeedCommsTime 45 min;set profile_station.Lat 36.852 degree;set profile_station.Lon -121.957 degree;set profile_station.YoYoMaxDepth 20 m" 3nu95 1 2.000000 2023-04-24T04:39:20.781Z,1682311160.781 [CommandExec](IMPORTANT): Scheduling command #1 of 2 with id=3nu95 2023-04-24T04:39:20.782Z,1682311160.782 [CommandExec](IMPORTANT): Scheduled #20 (#1 of 2 with id='3nu95'): "load Science/profile_station.xml;set profile_station.MissionTimeout 12 h;set profile_station.NeedCommsTime 45 min;set profile_station.Lat 36.852 degree;set profile_station.Lon -121.957 degree;set profile_station.YoYoMaxDepth 20 m", ASAP 2023-04-24T04:39:21.733Z,1682311161.733 [DataOverHttps](IMPORTANT): SBD MTMSN=20230424T043916 2023-04-24T04:39:29.464Z,1682311169.464 [CommandExec](IMPORTANT): got command schedule asap "set profile_station.Speed 0.8 m/s;set profile_station.MinAltitude 7 m;set profile_station.MaxDepth 35 m;run" 3nu95 2 2.000000 2023-04-24T04:39:29.464Z,1682311169.464 [CommandExec](IMPORTANT): Scheduling command #2 of 2 with id=3nu95 2023-04-24T04:39:29.465Z,1682311169.465 [CommandExec](IMPORTANT): Scheduled #21 (#2 of 2 with id='3nu95'): "set profile_station.Speed 0.8 m/s;set profile_station.MinAltitude 7 m;set profile_station.MaxDepth 35 m;run", ASAP 2023-04-24T04:39:29.603Z,1682311169.603 [CommandExec](IMPORTANT): got command load ./Missions/Science/profile_station.xml 2023-04-24T04:39:31.372Z,1682311171.372 [CommandExec](IMPORTANT): Loaded ./Missions/Science/profile_station.xml 2023-04-24T04:40:03.847Z,1682311203.847 [CommandExec](IMPORTANT): got command set profile_station.MissionTimeout 12 hour 2023-04-24T04:40:03.861Z,1682311203.861 [CommandExec](IMPORTANT): got command set profile_station.NeedCommsTime 45 minute 2023-04-24T04:40:03.861Z,1682311203.861 [CommandExec](IMPORTANT): got command set profile_station.Lat 36.852 degree 2023-04-24T04:40:03.862Z,1682311203.862 [CommandExec](IMPORTANT): got command set profile_station.Lon -121.957 degree 2023-04-24T04:40:03.863Z,1682311203.863 [CommandExec](IMPORTANT): got command set profile_station.YoYoMaxDepth 20 meter 2023-04-24T04:40:15.259Z,1682311215.259 [CommandExec](IMPORTANT): got command set profile_station.Speed 0.8 meter_per_second 2023-04-24T04:40:15.260Z,1682311215.260 [CommandExec](IMPORTANT): got command set profile_station.MinAltitude 7 meter 2023-04-24T04:40:15.261Z,1682311215.261 [CommandExec](IMPORTANT): got command set profile_station.MaxDepth 35 meter 2023-04-24T04:40:15.261Z,1682311215.261 [CommandExec](IMPORTANT): got command run 2023-04-24T04:40:15.263Z,1682311215.263 [CommandExec](IMPORTANT): Running 2023-04-24T04:40:15.433Z,1682311215.433 [MissionManager](IMPORTANT): Started mission profile_station 2023-04-24T04:40:46.949Z,1682311246.949 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-24T04:46:41.030Z,1682311601.030 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-24T06:01:42.884Z,1682316102.884 [CBIT](IMPORTANT): Beginning ground fault scan 2023-04-24T06:01:53.698Z,1682316113.698 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.002567 CHAN A1 (24V): 0.004238 CHAN A2 (12V): -0.005078 CHAN A3 (5V): -0.003804 CHAN B0 (3.3V): -0.001844 CHAN B1 (3.15aV): -0.001390 CHAN B2 (3.15bV): -0.001244 CHAN B3 (GND): 0.002804 OPEN: 0.012540 Full Scale: +/- 1 mA 2023-04-24T06:20:07.251Z,1682317207.251 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=3492, MT Status=1, MTMSN=2624 2023-04-24T06:20:08.020Z,1682317208.020 [CommandExec](IMPORTANT): got command schedule asap "load Transport/keepstation.tl;set keepstation.MissionTimeout 12 h;set keepstation.NeedCommsTime 60 min;set keepstation.Latitude 36.852 degree;set keepstation.Longitude -121.957 degree;set keepstation.Depth 20 m" 3nwqv 1 2.000000 2023-04-24T06:20:08.020Z,1682317208.020 [CommandExec](IMPORTANT): Scheduling command #1 of 2 with id=3nwqv 2023-04-24T06:20:08.022Z,1682317208.022 [CommandExec](IMPORTANT): Scheduled #22 (#1 of 2 with id='3nwqv'): "load Transport/keepstation.tl;set keepstation.MissionTimeout 12 h;set keepstation.NeedCommsTime 60 min;set keepstation.Latitude 36.852 degree;set keepstation.Longitude -121.957 degree;set keepstation.Depth 20 m", ASAP 2023-04-24T06:20:56.463Z,1682317256.463 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=3493, MT Status=1, MTMSN=2625 2023-04-24T06:20:57.099Z,1682317257.099 [CommandExec](IMPORTANT): got command schedule asap "set keepstation.ApproachDepth 10 m;set keepstation.MaxDepth 35 m;run" 3nwqv 2 2.000000 2023-04-24T06:20:57.099Z,1682317257.099 [CommandExec](IMPORTANT): Scheduling command #2 of 2 with id=3nwqv 2023-04-24T06:20:57.100Z,1682317257.100 [CommandExec](IMPORTANT): Scheduled #23 (#2 of 2 with id='3nwqv'): "set keepstation.ApproachDepth 10 m;set keepstation.MaxDepth 35 m;run", ASAP 2023-04-24T06:20:57.217Z,1682317257.217 [CommandExec](IMPORTANT): got command load ./Missions/Transport/keepstation.tl 2023-04-24T06:20:57.413Z,1682317257.413 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file ./Missions/Transport/keepstation.tx 2023-04-24T06:20:58.301Z,1682317258.301 [CommandExec](IMPORTANT): Loaded ./Missions/Transport/keepstation.tl 2023-04-24T06:20:58.517Z,1682317258.517 [MissionManager](IMPORTANT): Started mission Default 2023-04-24T06:21:16.888Z,1682317276.888 [CommandExec](IMPORTANT): got command set keepstation.MissionTimeout 12 hour 2023-04-24T06:21:16.889Z,1682317276.889 [CommandExec](IMPORTANT): got command set keepstation.NeedCommsTime 60 minute 2023-04-24T06:21:16.889Z,1682317276.889 [CommandExec](IMPORTANT): got command set keepstation.Latitude 36.852 degree 2023-04-24T06:21:16.890Z,1682317276.890 [CommandExec](IMPORTANT): got command set keepstation.Longitude -121.957 degree 2023-04-24T06:21:16.891Z,1682317276.891 [CommandExec](IMPORTANT): got command set keepstation.Depth 20 meter 2023-04-24T06:21:27.745Z,1682317287.745 [CommandExec](IMPORTANT): got command set keepstation.ApproachDepth 10 meter 2023-04-24T06:21:27.746Z,1682317287.746 [CommandExec](IMPORTANT): got command set keepstation.MaxDepth 35 meter 2023-04-24T06:21:27.746Z,1682317287.746 [CommandExec](IMPORTANT): got command run 2023-04-24T06:21:27.750Z,1682317287.750 [CommandExec](IMPORTANT): Running 2023-04-24T06:21:28.023Z,1682317288.023 [MissionManager](IMPORTANT): Started mission keepstation 2023-04-24T06:21:40.034Z,1682317300.034 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=3494, MT Status=1, MTMSN=2626 2023-04-24T06:21:40.532Z,1682317300.532 [CommandExec](IMPORTANT): got command stop 2023-04-24T06:21:40.890Z,1682317300.890 [MissionManager](IMPORTANT): Started mission Default 2023-04-24T06:28:11.654Z,1682317691.654 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 6.505801 min 2023-04-24T06:29:19.201Z,1682317759.201 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=3495, MT Status=1, MTMSN=2627 2023-04-24T06:29:19.906Z,1682317759.906 [CommandExec](IMPORTANT): got command load ./Missions/Transport/keepstation.tl 2023-04-24T06:29:19.911Z,1682317759.911 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file ./Missions/Transport/keepstation.tx 2023-04-24T06:29:20.687Z,1682317760.687 [CommandExec](IMPORTANT): Loaded ./Missions/Transport/keepstation.tl 2023-04-24T06:29:31.601Z,1682317771.601 [CommandExec](IMPORTANT): got command set keepstation.MissionTimeout 12 hour 2023-04-24T06:29:31.601Z,1682317771.601 [CommandExec](IMPORTANT): got command set keepstation.Latitude 36.852 degree 2023-04-24T06:29:31.602Z,1682317771.602 [CommandExec](IMPORTANT): got command set keepstation.Longitude -121.957 degree 2023-04-24T06:29:31.603Z,1682317771.603 [CommandExec](IMPORTANT): got command run 2023-04-24T06:29:31.605Z,1682317771.605 [CommandExec](IMPORTANT): Running 2023-04-24T06:29:31.702Z,1682317771.702 [MissionManager](IMPORTANT): Started mission keepstation 2023-04-24T06:30:08.580Z,1682317808.580 [keepstation:TransitToStation:Wpt1.Waypoint](IMPORTANT): Navigating to waypoint: 36.852001,-121.957001 2023-04-24T06:56:23.068Z,1682319383.068 [keepstation:TransitToStation:Wpt1.Waypoint](IMPORTANT): Reached waypoint: 36.852001,-121.957001 2023-04-24T07:02:18.971Z,1682319738.971 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-24T07:07:56.118Z,1682320076.118 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-24T07:47:59.289Z,1682322479.289 [CBIT](CRITICAL): Navigation error has exceeded threshold. Set navErrorCriticalReporting to false to squeltch critical failure. 2023-04-24T07:47:59.687Z,1682322479.687 [CommandExec](FAULT): Scheduling is paused 2023-04-24T07:48:00.554Z,1682322480.554 [MissionManager](IMPORTANT): Started mission Default 2023-04-24T07:55:55.570Z,1682322955.570 [DataOverHttps](IMPORTANT): SBD MTMSN=20230424T075549 2023-04-24T07:56:03.262Z,1682322963.262 [CommandExec](IMPORTANT): got command load ./Missions/Transport/keepstation.tl 2023-04-24T07:56:03.263Z,1682322963.263 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file ./Missions/Transport/keepstation.tx 2023-04-24T07:56:03.765Z,1682322963.765 [CommandExec](IMPORTANT): Loaded ./Missions/Transport/keepstation.tl 2023-04-24T07:56:14.529Z,1682322974.529 [CommandExec](IMPORTANT): got command set keepstation.MissionTimeout 12 hour 2023-04-24T07:56:14.530Z,1682322974.530 [CommandExec](IMPORTANT): got command set keepstation.Latitude 36.852 degree 2023-04-24T07:56:14.531Z,1682322974.531 [CommandExec](IMPORTANT): got command set keepstation.Longitude -121.957 degree 2023-04-24T07:56:14.531Z,1682322974.531 [CommandExec](IMPORTANT): got command run 2023-04-24T07:56:14.534Z,1682322974.534 [CommandExec](IMPORTANT): Running 2023-04-24T07:56:14.744Z,1682322974.744 [MissionManager](IMPORTANT): Started mission keepstation 2023-04-24T08:01:31.670Z,1682323291.670 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-24T08:01:33.296Z,1682323293.296 [keepstation:TransitToStation:Wpt1.Waypoint](IMPORTANT): Navigating to waypoint: 36.852001,-121.957001 2023-04-24T08:01:54.108Z,1682323314.108 [CBIT](IMPORTANT): Beginning ground fault scan 2023-04-24T08:02:04.904Z,1682323324.904 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): -0.001325 CHAN A1 (24V): 0.004080 CHAN A2 (12V): -0.004452 CHAN A3 (5V): -0.003405 CHAN B0 (3.3V): -0.002475 CHAN B1 (3.15aV): -0.000932 CHAN B2 (3.15bV): -0.001122 CHAN B3 (GND): 0.030986 OPEN: 0.012624 Full Scale: +/- 1 mA 2023-04-24T08:03:28.140Z,1682323408.140 [RudderServo](FAULT): Rudder uart error - getPosition..serial timeout 2023-04-24T08:13:45.457Z,1682324025.457 [RudderServo](FAULT): Rudder uart error - getPosition..serial timeout 2023-04-24T08:20:49.178Z,1682324449.178 [keepstation:TransitToStation:Wpt1.Waypoint](IMPORTANT): Reached waypoint: 36.852001,-121.957001 2023-04-24T08:26:43.117Z,1682324803.117 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-24T09:24:56.474Z,1682328296.474 [BPC1](CRITICAL): Battery Capacity Below Threshold. 18.076000 Ah. 2023-04-24T09:24:57.223Z,1682328297.223 [MissionManager](IMPORTANT): Started mission Default 2023-04-24T09:32:49.278Z,1682328769.278 [DataOverHttps](IMPORTANT): SBD MTMSN=20230424T093243 2023-04-24T09:32:57.526Z,1682328777.526 [CommandExec](IMPORTANT): got command configSet IBIT.batteryCapacityThreshold 1 ampere_hour persist 2023-04-24T09:32:57.536Z,1682328777.536 [CommandExec](IMPORTANT): got command configSet IBIT.batteryVoltageThreshold 10 volt persist 2023-04-24T09:32:57.539Z,1682328777.539 [CommandExec](IMPORTANT): got command restart application