2023-04-17T13:48:47.631Z,1681739327.631 [CommandExec](IMPORTANT): got command restart logs
2023-04-17T13:49:57.174Z,1681739397.174 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 7.847122 min 
2023-04-17T13:51:37.958Z,1681739497.958 [DataOverHttps](IMPORTANT): SBD MOMSN=18231268, MTMSN=20230417T135137
2023-04-17T13:51:46.992Z,1681739506.992 [CommandExec](IMPORTANT): got command schedule asap "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h" 3bl5u 1 3.000000
2023-04-17T13:51:46.992Z,1681739506.992 [CommandExec](IMPORTANT): Scheduling command #1 of 3 with id=3bl5u
2023-04-17T13:51:46.993Z,1681739506.993 [CommandExec](IMPORTANT): Scheduled #29 (#1 of 3 with id='3bl5u'): "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h", ASAP
2023-04-17T13:51:47.938Z,1681739507.938 [DataOverHttps](IMPORTANT): SBD MTMSN=20230417T135147
2023-04-17T13:51:55.336Z,1681739515.336 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.SendSampleStatusAndData 0 bool;set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m" 3bl5u 2 3.000000
2023-04-17T13:51:55.337Z,1681739515.337 [CommandExec](IMPORTANT): Scheduling command #2 of 3 with id=3bl5u
2023-04-17T13:51:55.338Z,1681739515.338 [CommandExec](IMPORTANT): Scheduled #30 (#2 of 3 with id='3bl5u'): "set IsothermDepthSampling.SendSampleStatusAndData 0 bool;set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m", ASAP
2023-04-17T13:51:56.314Z,1681739516.314 [DataOverHttps](IMPORTANT): SBD MTMSN=20230417T135155
2023-04-17T13:52:03.984Z,1681739523.984 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.DeepBoundChl 15 m;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;run" 3bl5u 3 3.000000
2023-04-17T13:52:03.985Z,1681739523.985 [CommandExec](IMPORTANT): Scheduling command #3 of 3 with id=3bl5u
2023-04-17T13:52:03.986Z,1681739523.986 [CommandExec](IMPORTANT): Scheduled #31 (#3 of 3 with id='3bl5u'): "set IsothermDepthSampling.DeepBoundChl 15 m;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;run", ASAP
2023-04-17T13:52:04.121Z,1681739524.121 [CommandExec](IMPORTANT): got command load ./Missions/Science/isotherm_depth_sampling.xml
2023-04-17T13:52:19.734Z,1681739539.734 [CommandExec](IMPORTANT): Loaded ./Missions/Science/isotherm_depth_sampling.xml
2023-04-17T13:52:47.381Z,1681739567.381 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.NumSamplers 2 count
2023-04-17T13:52:47.382Z,1681739567.382 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MissionTimeout 6 hour
2023-04-17T13:52:47.382Z,1681739567.382 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNoFiring 1 hour
2023-04-17T13:53:18.113Z,1681739598.113 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendSampleStatusAndData 0 bool
2023-04-17T13:53:18.114Z,1681739598.114 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendDataToMultipleModems 0 bool
2023-04-17T13:53:18.115Z,1681739598.115 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SampleAtPeakChl 1 bool
2023-04-17T13:53:18.115Z,1681739598.115 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 3 meter
2023-04-17T13:53:54.752Z,1681739634.752 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 15 meter
2023-04-17T13:53:54.753Z,1681739634.753 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType2 -10 count
2023-04-17T13:53:54.753Z,1681739634.753 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 meter
2023-04-17T13:53:54.754Z,1681739634.754 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 10 minute
2023-04-17T13:53:54.755Z,1681739634.755 [CommandExec](IMPORTANT): got command run
2023-04-17T13:53:54.757Z,1681739634.757 [CommandExec](IMPORTANT): Running 
2023-04-17T13:53:54.849Z,1681739634.849 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling
2023-04-17T13:53:54.911Z,1681739634.911 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 240.00 hours.
2023-04-17T13:54:56.697Z,1681739696.697 [IsothermDepthSampling:StayAwayFromWallsAndShore:FarEnoughFromWallsAndShore:A](IMPORTANT): Far enough from walls and shore. Latitude = 36.656347 arcdeg , longitude = -121.869289 arcdeg . Distance from shore = 3289.750244 m . OffshoreDistanceTurnBack (MinOffshore + MarginMinOffshore) = 2000.000000 m + 100.000000 m . Shortest distance nan m to side 0 count . MinDistFromPolygonSides = 200.000000 m .
2023-04-17T13:54:58.719Z,1681739698.719 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.107920 m 
2023-04-17T13:56:08.239Z,1681739768.239 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , nan K , 0.000000 m , nan degC , nan m , 10.000000 min .
2023-04-17T13:58:04.174Z,1681739884.174 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoUp:B](IMPORTANT): Go up from 18.045835 m 
2023-04-17T14:00:24.378Z,1681740024.378 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:SetChlPeakTempDepth:L](IMPORTANT): Set peak-chl depth and temp. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlTemperatureSet, PeakChlSet = 12.885811 m , 0.904800 ug/l , 5.008681 m , 10.977043 degC , 14.661920 ug/l 
2023-04-17T14:00:24.771Z,1681740024.771 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 1.000000 count . Target depth = 5.008681 m .
2023-04-17T14:00:25.193Z,1681740025.193 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -6.000000 count 
2023-04-17T14:03:09.618Z,1681740189.618 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 4.990933 m , settling for 10.000000 min 
2023-04-17T14:13:22.545Z,1681740802.545 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2023-04-17T14:13:22.902Z,1681740802.902 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2023-04-17T14:14:15.221Z,1681740855.221 [ESPComponent](IMPORTANT): ESP has connected as client
2023-04-17T14:14:16.035Z,1681740856.035 [ESPComponent](IMPORTANT): [sample #11] Setting cartridge argument to -6
2023-04-17T14:14:16.036Z,1681740856.036 [ESPComponent](IMPORTANT): [sample #11] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2023-04-17T14:14:16.556Z,1681740856.556 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 4.985099 m in 10.884089 degC water with 15.325440 ug/l chlorophyll fluorescence.
2023-04-17T14:14:16.837Z,1681740856.837 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PREPARING_SHOW_LOG
2023-04-17T14:14:17.242Z,1681740857.242 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PREPARING_SHOW_STATUS
2023-04-17T14:14:19.261Z,1681740859.261 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_LOADING_CARTRIDGE
2023-04-17T14:14:56.039Z,1681740896.039 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PRIMING (@34,archive_bac)
2023-04-17T14:14:58.853Z,1681740898.853 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PRIMING (@100.0)
2023-04-17T14:14:58.854Z,1681740898.854 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering
2023-04-17T14:14:59.257Z,1681740899.257 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2023-04-17T14:17:14.220Z,1681741034.220 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_FILTERING (@0.0)
2023-04-17T14:17:14.598Z,1681741034.598 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2023-04-17T14:23:52.672Z,1681741432.672 [ThrusterHE](IMPORTANT): Status lock Detected.
2023-04-17T14:23:53.080Z,1681741433.080 [ThrusterHE](IMPORTANT): Status lock Detected.
2023-04-17T14:23:53.487Z,1681741433.487 [ThrusterHE](IMPORTANT): Status lock Detected.
2023-04-17T14:23:53.900Z,1681741433.900 [ThrusterHE](IMPORTANT): Status lock Detected.
2023-04-17T14:23:54.296Z,1681741434.296 [ThrusterHE](IMPORTANT): Status lock Detected.
2023-04-17T14:23:54.708Z,1681741434.708 [ThrusterHE](IMPORTANT): Status lock Detected.
2023-04-17T14:24:59.209Z,1681741499.209 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PAUSED (@167.4)
2023-04-17T14:24:59.613Z,1681741499.613 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PROCESSING (@167.4)
2023-04-17T14:25:01.634Z,1681741501.634 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing
2023-04-17T14:25:02.038Z,1681741502.038 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PROCESSED (@34,archive_bac)
2023-04-17T14:25:17.389Z,1681741517.389 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_STOPPING (@34,archive_bac)
2023-04-17T14:25:25.874Z,1681741525.874 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2023-04-17T14:25:26.341Z,1681741526.341 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_STOPPED
2023-04-17T14:30:26.110Z,1681741826.110 [ESPComponent](CRITICAL): [sample #11] ESP sampling sequence terminated with error: In state S_WAITING_FOR_PROCESSED got exception while awaiting completion of cmd='Cmd.startProcessing' exception=<<Thread::ChildDied in LRAUV -- :PROCESSING
>>. Elapsed time since command issued: 17.7799
2023-04-17T14:30:26.276Z,1681741826.276 [CommandExec](FAULT): Scheduling is paused
2023-04-17T14:30:27.933Z,1681741827.933 [MissionManager](IMPORTANT): Started mission Default
2023-04-17T14:39:43.828Z,1681742383.828 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 9.258280 min 
2023-04-17T14:43:54.306Z,1681742634.306 [DataOverHttps](IMPORTANT): SBD MTMSN=20230417T144353
2023-04-17T14:44:01.801Z,1681742641.801 [CommandExec](IMPORTANT): got command schedule asap "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h" 3bnkv 1 3.000000
2023-04-17T14:44:01.801Z,1681742641.801 [CommandExec](IMPORTANT): Scheduling command #1 of 3 with id=3bnkv
2023-04-17T14:44:01.802Z,1681742641.802 [CommandExec](IMPORTANT): Scheduled #32 (#1 of 3 with id='3bnkv'): "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h", ASAP
2023-04-17T14:44:02.798Z,1681742642.798 [DataOverHttps](IMPORTANT): SBD MTMSN=20230417T144402
2023-04-17T14:44:10.484Z,1681742650.484 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.SendSampleStatusAndData 0 bool;set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m" 3bnkv 2 3.000000
2023-04-17T14:44:10.484Z,1681742650.484 [CommandExec](IMPORTANT): Scheduling command #2 of 3 with id=3bnkv
2023-04-17T14:44:10.485Z,1681742650.485 [CommandExec](IMPORTANT): Scheduled #33 (#2 of 3 with id='3bnkv'): "set IsothermDepthSampling.SendSampleStatusAndData 0 bool;set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m", ASAP
2023-04-17T14:44:11.410Z,1681742651.410 [DataOverHttps](IMPORTANT): SBD MTMSN=20230417T144410
2023-04-17T14:44:18.916Z,1681742658.916 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.DeepBoundChl 15 m;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;run" 3bnkv 3 3.000000
2023-04-17T14:44:18.916Z,1681742658.916 [CommandExec](IMPORTANT): Scheduling command #3 of 3 with id=3bnkv
2023-04-17T14:44:18.918Z,1681742658.918 [CommandExec](IMPORTANT): Scheduled #34 (#3 of 3 with id='3bnkv'): "set IsothermDepthSampling.DeepBoundChl 15 m;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;run", ASAP
2023-04-17T14:44:19.081Z,1681742659.081 [CommandExec](IMPORTANT): got command load ./Missions/Science/isotherm_depth_sampling.xml
2023-04-17T14:44:37.194Z,1681742677.194 [CommandExec](IMPORTANT): Loaded ./Missions/Science/isotherm_depth_sampling.xml
2023-04-17T14:45:04.280Z,1681742704.280 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.NumSamplers 2 count
2023-04-17T14:45:04.281Z,1681742704.281 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MissionTimeout 6 hour
2023-04-17T14:45:04.281Z,1681742704.281 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNoFiring 1 hour
2023-04-17T14:45:14.594Z,1681742714.594 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 14.770658 min 
2023-04-17T14:45:45.894Z,1681742745.894 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendSampleStatusAndData 0 bool
2023-04-17T14:45:45.895Z,1681742745.895 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendDataToMultipleModems 0 bool
2023-04-17T14:45:45.900Z,1681742745.900 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SampleAtPeakChl 1 bool
2023-04-17T14:45:45.900Z,1681742745.900 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 3 meter
2023-04-17T14:46:24.007Z,1681742784.007 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 15 meter
2023-04-17T14:46:24.011Z,1681742784.011 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType2 -10 count
2023-04-17T14:46:24.012Z,1681742784.012 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 meter
2023-04-17T14:46:24.013Z,1681742784.013 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 10 minute
2023-04-17T14:46:24.013Z,1681742784.013 [CommandExec](IMPORTANT): got command run
2023-04-17T14:46:24.022Z,1681742784.022 [CommandExec](IMPORTANT): Running 
2023-04-17T14:46:24.137Z,1681742784.137 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling
2023-04-17T14:46:24.273Z,1681742784.273 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 240.00 hours.
2023-04-17T14:47:29.796Z,1681742849.796 [IsothermDepthSampling:StayAwayFromWallsAndShore:FarEnoughFromWallsAndShore:A](IMPORTANT): Far enough from walls and shore. Latitude = 36.657649 arcdeg , longitude = -121.867264 arcdeg . Distance from shore = 3296.975342 m . OffshoreDistanceTurnBack (MinOffshore + MarginMinOffshore) = 2000.000000 m + 100.000000 m . Shortest distance nan m to side 0 count . MinDistFromPolygonSides = 200.000000 m .
2023-04-17T14:47:31.830Z,1681742851.830 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.090418 m 
2023-04-17T14:48:41.393Z,1681742921.393 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , nan K , 0.000000 m , nan degC , nan m , 10.000000 min .
2023-04-17T14:50:26.802Z,1681743026.802 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoUp:B](IMPORTANT): Go up from 18.067823 m 
2023-04-17T14:52:49.855Z,1681743169.855 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:SetChlPeakTempDepth:L](IMPORTANT): Set peak-chl depth and temp. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlTemperatureSet, PeakChlSet = 12.871899 m , 0.977600 ug/l , 4.395539 m , 11.311262 degC , 15.222479 ug/l 
2023-04-17T14:52:50.218Z,1681743170.218 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 1.000000 count . Target depth = 4.395539 m .
2023-04-17T14:52:50.628Z,1681743170.628 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -6.000000 count 
2023-04-17T14:55:33.855Z,1681743333.855 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 4.354591 m , settling for 10.000000 min 
2023-04-17T15:05:46.780Z,1681743946.780 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2023-04-17T15:05:46.969Z,1681743946.969 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2023-04-17T15:06:38.101Z,1681743998.101 [ESPComponent](IMPORTANT): ESP has connected as client
2023-04-17T15:06:38.912Z,1681743998.912 [ESPComponent](IMPORTANT): [sample #12] Setting cartridge argument to -6
2023-04-17T15:06:38.913Z,1681743998.913 [ESPComponent](IMPORTANT): [sample #12] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2023-04-17T15:06:39.402Z,1681743999.402 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 4.438060 m in 11.370661 degC water with 13.506480 ug/l chlorophyll fluorescence.
2023-04-17T15:06:39.717Z,1681743999.717 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PREPARING_SHOW_LOG
2023-04-17T15:06:40.122Z,1681744000.122 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PREPARING_SHOW_STATUS
2023-04-17T15:06:42.142Z,1681744002.142 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_LOADING_CARTRIDGE
2023-04-17T15:07:18.953Z,1681744038.953 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PRIMING (@32,archive_bac)
2023-04-17T15:07:21.782Z,1681744041.782 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PRIMING (@100.0)
2023-04-17T15:07:21.783Z,1681744041.783 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering
2023-04-17T15:07:22.185Z,1681744042.185 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2023-04-17T15:09:37.929Z,1681744177.929 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_FILTERING (@0.0)
2023-04-17T15:09:38.333Z,1681744178.333 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2023-04-17T15:57:43.782Z,1681747063.782 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PAUSED (@711.5)
2023-04-17T15:57:44.185Z,1681747064.185 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PROCESSING (@711.5)
2023-04-17T15:57:46.206Z,1681747066.206 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing
2023-04-17T15:57:46.609Z,1681747066.609 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PROCESSED (@32,archive_bac)
2023-04-17T16:09:50.992Z,1681747790.992 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_STOPPING (@32,archive_bac)
2023-04-17T16:10:01.495Z,1681747801.495 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2023-04-17T16:10:01.898Z,1681747801.898 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_STOPPED
2023-04-17T16:15:01.685Z,1681748101.685 [ESPComponent](IMPORTANT): [sample #12] ESP sampling sequence completed normally.
2023-04-17T16:15:02.605Z,1681748102.605 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 1.000000 count completed.
2023-04-17T16:15:19.169Z,1681748119.169 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -10.000000 count , nan K , 0.000000 m , nan degC , nan m , 5.000000 min .
2023-04-17T16:15:22.788Z,1681748122.788 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 2.000000 count . Target depth = 4.395539 m .
2023-04-17T16:15:23.194Z,1681748123.194 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -10.000000 count 
2023-04-17T16:15:42.586Z,1681748142.586 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 4.351000 m , settling for 5.000000 min 
2023-04-17T16:20:55.340Z,1681748455.340 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2023-04-17T16:20:55.507Z,1681748455.507 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2023-04-17T16:21:47.069Z,1681748507.069 [ESPComponent](IMPORTANT): ESP has connected as client
2023-04-17T16:21:47.881Z,1681748507.881 [ESPComponent](IMPORTANT): [sample #13] Setting cartridge argument to -10
2023-04-17T16:21:47.881Z,1681748507.881 [ESPComponent](IMPORTANT): [sample #13] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2023-04-17T16:21:48.361Z,1681748508.361 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 4.442996 m in 11.323084 degC water with 14.372800 ug/l chlorophyll fluorescence.
2023-04-17T16:21:48.685Z,1681748508.685 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PREPARING_SHOW_LOG
2023-04-17T16:21:49.089Z,1681748509.089 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PREPARING_SHOW_STATUS
2023-04-17T16:21:51.110Z,1681748511.110 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_LOADING_CARTRIDGE
2023-04-17T16:22:29.159Z,1681748549.159 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_PRIMING (@43,daSPR_phyto)
2023-04-17T16:22:31.985Z,1681748551.985 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PRIMING (@100.0)
2023-04-17T16:22:31.987Z,1681748551.987 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering
2023-04-17T16:22:32.389Z,1681748552.389 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2023-04-17T16:24:52.185Z,1681748692.185 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_FILTERING (@0.0)
2023-04-17T16:24:52.578Z,1681748692.578 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2023-04-17T16:52:01.328Z,1681750321.328 [ThrusterHE](FAULT): getSpeed error serial timeout
2023-04-17T16:52:01.328Z,1681750321.328 [ThrusterHE](FAULT): Thruster uart error: serial timeout
2023-04-17T17:27:46.033Z,1681752466.033 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PAUSED (@1000.0)
2023-04-17T17:27:46.440Z,1681752466.440 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PROCESSING (@1000.0)
2023-04-17T17:27:48.461Z,1681752468.461 [ESPComponent](IMPORTANT): Processing timeoutMinutes=120.000000 issuedCmd_=Cmd.startProcessing
2023-04-17T17:27:48.861Z,1681752468.861 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_PROCESSED (@43,daSPR_phyto)
2023-04-17T18:02:36.609Z,1681754556.609 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-17T18:02:47.462Z,1681754567.462 [CBIT](IMPORTANT): Ground fault detected
mA:
CHAN A0 (Batt): 0.063011
CHAN A1 (24V): 0.130576
CHAN A2 (12V): 0.034199
CHAN A3 (5V): 0.000141
CHAN B0 (3.3V): 0.000549
CHAN B1 (3.15aV): 0.000301
CHAN B2 (3.15bV): 0.000576
CHAN B3 (GND): -0.008517
OPEN: 0.012643
Full Scale: +/- 1 mA
2023-04-17T18:25:33.726Z,1681755933.726 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_STOPPING (@43,daSPR_phyto)
2023-04-17T18:25:45.039Z,1681755945.039 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2023-04-17T18:25:45.443Z,1681755945.443 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_STOPPED
2023-04-17T18:30:45.221Z,1681756245.221 [ESPComponent](IMPORTANT): [sample #13] ESP sampling sequence completed normally.
2023-04-17T18:30:46.134Z,1681756246.134 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 2.000000 count completed.
2023-04-17T18:30:49.130Z,1681756249.130 [MissionManager](IMPORTANT): Started mission Default
2023-04-17T18:38:44.674Z,1681756724.674 [DataOverHttps](IMPORTANT): SBD MTMSN=20230417T183843
2023-04-17T18:38:52.204Z,1681756732.204 [CommandExec](IMPORTANT): got command schedule asap "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h" 3bygg 1 3.000000
2023-04-17T18:38:52.205Z,1681756732.205 [CommandExec](IMPORTANT): Scheduling command #1 of 3 with id=3bygg
2023-04-17T18:38:52.206Z,1681756732.206 [CommandExec](IMPORTANT): Scheduled #35 (#1 of 3 with id='3bygg'): "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h", ASAP
2023-04-17T18:38:53.170Z,1681756733.170 [DataOverHttps](IMPORTANT): SBD MTMSN=20230417T183852
2023-04-17T18:39:04.040Z,1681756744.040 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.SendSampleStatusAndData 0 bool;set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m" 3bygg 2 3.000000
2023-04-17T18:39:04.041Z,1681756744.041 [CommandExec](IMPORTANT): Scheduling command #2 of 3 with id=3bygg
2023-04-17T18:39:04.042Z,1681756744.042 [CommandExec](IMPORTANT): Scheduled #36 (#2 of 3 with id='3bygg'): "set IsothermDepthSampling.SendSampleStatusAndData 0 bool;set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m", ASAP
2023-04-17T18:39:05.031Z,1681756745.031 [DataOverHttps](IMPORTANT): SBD MTMSN=20230417T183904
2023-04-17T18:39:13.012Z,1681756753.012 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.DeepBoundChl 15 m;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;run" 3bygg 3 3.000000
2023-04-17T18:39:13.012Z,1681756753.012 [CommandExec](IMPORTANT): Scheduling command #3 of 3 with id=3bygg
2023-04-17T18:39:13.013Z,1681756753.013 [CommandExec](IMPORTANT): Scheduled #37 (#3 of 3 with id='3bygg'): "set IsothermDepthSampling.DeepBoundChl 15 m;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;run", ASAP
2023-04-17T18:39:13.150Z,1681756753.150 [CommandExec](IMPORTANT): got command load ./Missions/Science/isotherm_depth_sampling.xml
2023-04-17T18:39:28.830Z,1681756768.830 [CommandExec](IMPORTANT): Loaded ./Missions/Science/isotherm_depth_sampling.xml
2023-04-17T18:39:49.318Z,1681756789.318 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.NumSamplers 2 count
2023-04-17T18:39:49.318Z,1681756789.318 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MissionTimeout 6 hour
2023-04-17T18:39:49.319Z,1681756789.319 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNoFiring 1 hour
2023-04-17T18:40:01.349Z,1681756801.349 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 9.196715 min 
2023-04-17T18:40:21.042Z,1681756821.042 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendSampleStatusAndData 0 bool
2023-04-17T18:40:21.043Z,1681756821.043 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendDataToMultipleModems 0 bool
2023-04-17T18:40:21.043Z,1681756821.043 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SampleAtPeakChl 1 bool
2023-04-17T18:40:21.048Z,1681756821.048 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 3 meter
2023-04-17T18:41:10.184Z,1681756870.184 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 15 meter
2023-04-17T18:41:10.185Z,1681756870.185 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType2 -10 count
2023-04-17T18:41:10.186Z,1681756870.186 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 meter
2023-04-17T18:41:10.186Z,1681756870.186 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 10 minute
2023-04-17T18:41:10.187Z,1681756870.187 [CommandExec](IMPORTANT): got command run
2023-04-17T18:41:10.203Z,1681756870.203 [CommandExec](IMPORTANT): Running 
2023-04-17T18:41:10.285Z,1681756870.285 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling
2023-04-17T18:41:10.430Z,1681756870.430 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 240.00 hours.
2023-04-17T18:44:48.854Z,1681757088.854 [IsothermDepthSampling:StayAwayFromWallsAndShore:FarEnoughFromWallsAndShore:A](IMPORTANT): Far enough from walls and shore. Latitude = 36.653108 arcdeg , longitude = -121.865586 arcdeg . Distance from shore = 2802.046387 m . OffshoreDistanceTurnBack (MinOffshore + MarginMinOffshore) = 2000.000000 m + 100.000000 m . Shortest distance nan m to side 0 count . MinDistFromPolygonSides = 200.000000 m .
2023-04-17T18:44:50.889Z,1681757090.889 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.067082 m 
2023-04-17T18:46:00.462Z,1681757160.462 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , nan K , 0.000000 m , nan degC , nan m , 10.000000 min .
2023-04-17T18:47:36.584Z,1681757256.584 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoUp:B](IMPORTANT): Go up from 18.074112 m 
2023-04-17T18:50:09.298Z,1681757409.298 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:SetChlPeakTempDepth:L](IMPORTANT): Set peak-chl depth and temp. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlTemperatureSet, PeakChlSet = 12.832864 m , 2.652000 ug/l , 6.850655 m , 11.405843 degC , 15.203752 ug/l 
2023-04-17T18:50:09.672Z,1681757409.672 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 1.000000 count . Target depth = 6.850655 m .
2023-04-17T18:50:10.093Z,1681757410.093 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -6.000000 count 
2023-04-17T18:52:39.613Z,1681757559.613 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 6.837574 m , settling for 10.000000 min 
2023-04-17T19:02:52.497Z,1681758172.497 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2023-04-17T19:02:52.694Z,1681758172.694 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2023-04-17T19:03:45.005Z,1681758225.005 [ESPComponent](IMPORTANT): ESP has connected as client
2023-04-17T19:03:45.841Z,1681758225.841 [ESPComponent](IMPORTANT): [sample #14] Setting cartridge argument to -6
2023-04-17T19:03:45.841Z,1681758225.841 [ESPComponent](IMPORTANT): [sample #14] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2023-04-17T19:03:46.290Z,1681758226.290 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 6.702498 m in 11.508295 degC water with 16.149120 ug/l chlorophyll fluorescence.
2023-04-17T19:03:46.621Z,1681758226.621 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PREPARING_SHOW_LOG
2023-04-17T19:03:47.029Z,1681758227.029 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PREPARING_SHOW_STATUS
2023-04-17T19:03:49.048Z,1681758229.048 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_LOADING_CARTRIDGE
2023-04-17T19:04:25.810Z,1681758265.810 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_WAITING_FOR_PRIMING (@30,archive_bac)
2023-04-17T19:04:28.637Z,1681758268.637 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PRIMING (@100.0)
2023-04-17T19:04:28.638Z,1681758268.638 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering
2023-04-17T19:04:29.044Z,1681758269.044 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2023-04-17T19:06:42.846Z,1681758402.846 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_FILTERING (@0.0)
2023-04-17T19:06:43.250Z,1681758403.250 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2023-04-17T20:04:08.396Z,1681761848.396 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PAUSED (@1000.0)
2023-04-17T20:04:08.799Z,1681761848.799 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PROCESSING (@1000.0)
2023-04-17T20:04:10.818Z,1681761850.818 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing
2023-04-17T20:04:11.221Z,1681761851.221 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_WAITING_FOR_PROCESSED (@30,archive_bac)
2023-04-17T20:16:15.597Z,1681762575.597 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_STOPPING (@30,archive_bac)
2023-04-17T20:16:25.699Z,1681762585.699 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2023-04-17T20:16:26.147Z,1681762586.147 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_STOPPED
2023-04-17T20:21:26.085Z,1681762886.085 [ESPComponent](IMPORTANT): [sample #14] ESP sampling sequence completed normally.
2023-04-17T20:21:26.966Z,1681762886.966 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 1.000000 count completed.
2023-04-17T20:21:43.538Z,1681762903.538 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -10.000000 count , nan K , 0.000000 m , nan degC , nan m , 5.000000 min .
2023-04-17T20:21:47.171Z,1681762907.171 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 2.000000 count . Target depth = 6.850655 m .
2023-04-17T20:21:47.566Z,1681762907.566 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -10.000000 count 
2023-04-17T20:22:10.232Z,1681762930.232 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 6.781482 m , settling for 5.000000 min 
2023-04-17T20:27:22.952Z,1681763242.952 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2023-04-17T20:27:23.140Z,1681763243.140 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2023-04-17T20:28:15.441Z,1681763295.441 [ESPComponent](IMPORTANT): ESP has connected as client
2023-04-17T20:28:16.253Z,1681763296.253 [ESPComponent](IMPORTANT): [sample #15] Setting cartridge argument to -10
2023-04-17T20:28:16.253Z,1681763296.253 [ESPComponent](IMPORTANT): [sample #15] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2023-04-17T20:28:16.765Z,1681763296.765 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 6.776546 m in 11.381952 degC water with 16.433041 ug/l chlorophyll fluorescence.
2023-04-17T20:28:17.058Z,1681763297.058 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_PREPARING_SHOW_LOG
2023-04-17T20:28:17.461Z,1681763297.461 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_PREPARING_SHOW_STATUS
2023-04-17T20:28:19.481Z,1681763299.481 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_LOADING_CARTRIDGE
2023-04-17T20:28:55.450Z,1681763335.450 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_STOPPING
2023-04-17T20:29:03.114Z,1681763343.114 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2023-04-17T20:29:03.520Z,1681763343.520 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_STOPPED
2023-04-17T20:34:03.312Z,1681763643.312 [ESPComponent](CRITICAL): [sample #15] ESP sampling sequence terminated with error: In state S_LOADING_CARTRIDGE got exception while awaiting result for cmd='Cmd.loadCartridge -10' exception=<<I2C::SoftErr in LRAUV -- Bus Error writing to 0x00 
>>. Elapsed time since command issued: 35.9557
2023-04-17T20:34:04.972Z,1681763644.972 [MissionManager](IMPORTANT): Started mission Default
2023-04-17T20:43:00.396Z,1681764180.396 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 8.916632 min 
2023-04-17T20:49:06.113Z,1681764546.113 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 15.012376 min 
2023-04-17T20:54:36.763Z,1681764876.763 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 20.523169 min 
2023-04-17T21:00:11.697Z,1681765211.697 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 26.105056 min 
2023-04-17T21:05:44.627Z,1681765544.627 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 31.654356 min 
2023-04-17T21:11:15.505Z,1681765875.505 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 37.168787 min 
2023-04-17T21:16:20.180Z,1681766180.180 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-17T21:16:50.101Z,1681766210.101 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 42.745048 min 
2023-04-17T21:22:23.023Z,1681766543.023 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 48.294287 min 
2023-04-17T21:27:27.424Z,1681766847.424 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-17T21:27:57.800Z,1681766877.800 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 53.873694 min