2023-04-15T00:33:52.929Z,1681518832.929 [CommandExec](IMPORTANT): got command restart logs
2023-04-15T00:34:55.422Z,1681518895.422 [DataOverHttps](IMPORTANT): SBD MTMSN=20230415T003454
2023-04-15T00:35:02.925Z,1681518902.925 [CommandExec](IMPORTANT): got command schedule asap "load Science/sci2.tl;set sci2.MissionTimeout 1 h;set sci2.NeedCommsTime 20 min;set sci2.Lat1 36.797 degree;set sci2.Lon1 -121.847 degree;set sci2.Speed 1 m/s;set sci2.YoYoMaxDepth 20 m;set sci2.YoYoMinAltitude 9 m" 36uxp 1 2.000000
2023-04-15T00:35:02.925Z,1681518902.925 [CommandExec](IMPORTANT): Scheduling command #1 of 2 with id=36uxp
2023-04-15T00:35:02.926Z,1681518902.926 [CommandExec](IMPORTANT): Scheduled #1 (#1 of 2 with id='36uxp'): "load Science/sci2.tl;set sci2.MissionTimeout 1 h;set sci2.NeedCommsTime 20 min;set sci2.Lat1 36.797 degree;set sci2.Lon1 -121.847 degree;set sci2.Speed 1 m/s;set sci2.YoYoMaxDepth 20 m;set sci2.YoYoMinAltitude 9 m", ASAP
2023-04-15T00:35:03.918Z,1681518903.918 [DataOverHttps](IMPORTANT): SBD MTMSN=20230415T003503
2023-04-15T00:35:11.467Z,1681518911.467 [CommandExec](IMPORTANT): got command schedule asap "set sci2.MaxDepth 30 m;set sci2.MinOffshore 1 km;run" 36uxp 2 2.000000
2023-04-15T00:35:11.467Z,1681518911.467 [CommandExec](IMPORTANT): Scheduling command #2 of 2 with id=36uxp
2023-04-15T00:35:11.468Z,1681518911.468 [CommandExec](IMPORTANT): Scheduled #2 (#2 of 2 with id='36uxp'): "set sci2.MaxDepth 30 m;set sci2.MinOffshore 1 km;run", ASAP
2023-04-15T00:35:11.583Z,1681518911.583 [CommandExec](IMPORTANT): got command load ./Missions/Science/sci2.tl
2023-04-15T00:35:11.584Z,1681518911.584 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file ./Missions/Science/sci2.tx
2023-04-15T00:35:14.080Z,1681518914.080 [CommandExec](IMPORTANT): Loaded ./Missions/Science/sci2.tl
2023-04-15T00:35:23.780Z,1681518923.780 [CommandExec](IMPORTANT): got command set sci2.MissionTimeout 1 hour
2023-04-15T00:35:23.781Z,1681518923.781 [CommandExec](IMPORTANT): got command set sci2.NeedCommsTime 20 minute
2023-04-15T00:35:23.782Z,1681518923.782 [CommandExec](IMPORTANT): got command set sci2.Lat1 36.797 degree
2023-04-15T00:35:23.782Z,1681518923.782 [CommandExec](IMPORTANT): got command set sci2.Lon1 -121.847 degree
2023-04-15T00:35:23.783Z,1681518923.783 [CommandExec](IMPORTANT): got command set sci2.Speed 1 meter_per_second
2023-04-15T00:35:23.784Z,1681518923.784 [CommandExec](IMPORTANT): got command set sci2.YoYoMaxDepth 20 meter
2023-04-15T00:35:23.785Z,1681518923.785 [CommandExec](IMPORTANT): got command set sci2.YoYoMinAltitude 9 meter
2023-04-15T00:35:26.389Z,1681518926.389 [CommandExec](IMPORTANT): got command set sci2.MaxDepth 30 meter
2023-04-15T00:35:26.390Z,1681518926.390 [CommandExec](IMPORTANT): got command set sci2.MinOffshore 1 kilometer
2023-04-15T00:35:26.390Z,1681518926.390 [CommandExec](IMPORTANT): got command run
2023-04-15T00:35:26.393Z,1681518926.393 [CommandExec](IMPORTANT): Running 
2023-04-15T00:35:26.729Z,1681518926.729 [MissionManager](IMPORTANT): Started mission sci2
2023-04-15T00:37:02.966Z,1681519022.966 [sci2:Lap:Wpt1:A.Waypoint](IMPORTANT): Navigating to waypoint: 36.797001,-121.847000
2023-04-15T00:59:26.339Z,1681520366.339 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2455, MT Status=1, MTMSN=2520
2023-04-15T00:59:26.850Z,1681520366.850 [CommandExec](IMPORTANT): got command schedule resume
2023-04-15T00:59:26.850Z,1681520366.850 [CommandExec](IMPORTANT): Scheduling is resumed
2023-04-15T01:24:37.340Z,1681521877.340 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=2462, MT Status=1, MTMSN=2521
2023-04-15T01:24:38.092Z,1681521878.092 [CommandExec](IMPORTANT): got command schedule asap "load Science/sci2.tl;set sci2.MissionTimeout 2 h;set sci2.NeedCommsTime 30 min;set sci2.Lat1 36.806 degree;set sci2.Lon1 -121.840 degree;set sci2.Speed 1 m/s;set sci2.YoYoMaxDepth 20 m;set sci2.YoYoMinAltitude 9 m" 36wuu 1 2.000000
2023-04-15T01:24:38.093Z,1681521878.093 [CommandExec](IMPORTANT): Scheduling command #1 of 2 with id=36wuu
2023-04-15T01:24:38.094Z,1681521878.094 [CommandExec](IMPORTANT): Scheduled #3 (#1 of 2 with id='36wuu'): "load Science/sci2.tl;set sci2.MissionTimeout 2 h;set sci2.NeedCommsTime 30 min;set sci2.Lat1 36.806 degree;set sci2.Lon1 -121.840 degree;set sci2.Speed 1 m/s;set sci2.YoYoMaxDepth 20 m;set sci2.YoYoMinAltitude 9 m", ASAP
2023-04-15T01:28:24.965Z,1681522104.965 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2463, MT Status=1, MTMSN=2522
2023-04-15T01:28:25.645Z,1681522105.645 [CommandExec](IMPORTANT): got command schedule asap "set sci2.MaxDepth 30 m;set sci2.MinOffshore 1 km;run" 36wuu 2 2.000000
2023-04-15T01:28:25.645Z,1681522105.645 [CommandExec](IMPORTANT): Scheduling command #2 of 2 with id=36wuu
2023-04-15T01:28:25.646Z,1681522105.646 [CommandExec](IMPORTANT): Scheduled #4 (#2 of 2 with id='36wuu'): "set sci2.MaxDepth 30 m;set sci2.MinOffshore 1 km;run", ASAP
2023-04-15T01:28:25.773Z,1681522105.773 [CommandExec](IMPORTANT): got command load ./Missions/Science/sci2.tl
2023-04-15T01:28:26.105Z,1681522106.105 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file ./Missions/Science/sci2.tx
2023-04-15T01:28:30.317Z,1681522110.317 [CommandExec](IMPORTANT): Loaded ./Missions/Science/sci2.tl
2023-04-15T01:28:30.483Z,1681522110.483 [MissionManager](IMPORTANT): Started mission Default
2023-04-15T01:28:41.927Z,1681522121.927 [CommandExec](IMPORTANT): got command set sci2.MissionTimeout 2 hour
2023-04-15T01:28:41.927Z,1681522121.927 [CommandExec](IMPORTANT): got command set sci2.NeedCommsTime 30 minute
2023-04-15T01:28:41.928Z,1681522121.928 [CommandExec](IMPORTANT): got command set sci2.Lat1 36.806 degree
2023-04-15T01:28:41.929Z,1681522121.929 [CommandExec](IMPORTANT): got command set sci2.Lon1 -121.840 degree
2023-04-15T01:28:41.930Z,1681522121.930 [CommandExec](IMPORTANT): got command set sci2.Speed 1 meter_per_second
2023-04-15T01:28:41.930Z,1681522121.930 [CommandExec](IMPORTANT): got command set sci2.YoYoMaxDepth 20 meter
2023-04-15T01:28:41.931Z,1681522121.931 [CommandExec](IMPORTANT): got command set sci2.YoYoMinAltitude 9 meter
2023-04-15T01:28:45.669Z,1681522125.669 [CommandExec](IMPORTANT): got command set sci2.MaxDepth 30 meter
2023-04-15T01:28:45.670Z,1681522125.670 [CommandExec](IMPORTANT): got command set sci2.MinOffshore 1 kilometer
2023-04-15T01:28:45.671Z,1681522125.671 [CommandExec](IMPORTANT): got command run
2023-04-15T01:28:45.717Z,1681522125.717 [CommandExec](IMPORTANT): Running 
2023-04-15T01:28:45.721Z,1681522125.721 [MissionManager](IMPORTANT): Started mission sci2
2023-04-15T01:29:26.534Z,1681522166.534 [sci2:Lap:Wpt1:A.Waypoint](IMPORTANT): Navigating to waypoint: 36.806000,-121.839996
2023-04-15T01:49:11.105Z,1681523351.105 [sci2:Lap:Wpt1:A.Waypoint](IMPORTANT): Reached waypoint: 36.806000,-121.839996
2023-04-15T01:49:13.933Z,1681523353.933 [MissionManager](IMPORTANT): Started mission Default
2023-04-15T01:55:07.195Z,1681523707.195 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-15T01:56:35.178Z,1681523795.178 [DataOverHttps](IMPORTANT): SBD MTMSN=20230415T015634
2023-04-15T01:56:41.820Z,1681523801.820 [CommandExec](IMPORTANT): got command schedule asap "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.MissionTimeout 4 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h;set IsothermDepthSampling.SendSampleStatusAndData 0 bool" 36ypz 1 3.000000
2023-04-15T01:56:41.820Z,1681523801.820 [CommandExec](IMPORTANT): Scheduling command #1 of 3 with id=36ypz
2023-04-15T01:56:41.821Z,1681523801.821 [CommandExec](IMPORTANT): Scheduled #5 (#1 of 3 with id='36ypz'): "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.MissionTimeout 4 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h;set IsothermDepthSampling.SendSampleStatusAndData 0 bool", ASAP
2023-04-15T01:56:42.782Z,1681523802.782 [DataOverHttps](IMPORTANT): SBD MTMSN=20230415T015642
2023-04-15T01:56:50.380Z,1681523810.380 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m;set IsothermDepthSampling.DeepBoundChl 20 m" 36ypz 2 3.000000
2023-04-15T01:56:50.381Z,1681523810.381 [CommandExec](IMPORTANT): Scheduling command #2 of 3 with id=36ypz
2023-04-15T01:56:50.381Z,1681523810.381 [CommandExec](IMPORTANT): Scheduled #6 (#2 of 3 with id='36ypz'): "set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m;set IsothermDepthSampling.DeepBoundChl 20 m", ASAP
2023-04-15T01:56:51.286Z,1681523811.286 [DataOverHttps](IMPORTANT): SBD MTMSN=20230415T015650
2023-04-15T01:56:59.036Z,1681523819.036 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.CartridgeType1 -10 count;set IsothermDepthSampling.DepDiffFromPeakChl1 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;run" 36ypz 3 3.000000
2023-04-15T01:56:59.036Z,1681523819.036 [CommandExec](IMPORTANT): Scheduling command #3 of 3 with id=36ypz
2023-04-15T01:56:59.037Z,1681523819.037 [CommandExec](IMPORTANT): Scheduled #7 (#3 of 3 with id='36ypz'): "set IsothermDepthSampling.CartridgeType1 -10 count;set IsothermDepthSampling.DepDiffFromPeakChl1 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;run", ASAP
2023-04-15T01:56:59.186Z,1681523819.186 [CommandExec](IMPORTANT): got command load ./Missions/Science/isotherm_depth_sampling.xml
2023-04-15T01:57:23.033Z,1681523843.033 [CommandExec](IMPORTANT): Loaded ./Missions/Science/isotherm_depth_sampling.xml
2023-04-15T01:57:57.569Z,1681523877.569 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MissionTimeout 4 hour
2023-04-15T01:57:57.570Z,1681523877.570 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNoFiring 1 hour
2023-04-15T01:57:57.571Z,1681523877.571 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendSampleStatusAndData 0 bool
2023-04-15T01:58:33.353Z,1681523913.353 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendDataToMultipleModems 0 bool
2023-04-15T01:58:33.353Z,1681523913.353 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SampleAtPeakChl 1 bool
2023-04-15T01:58:33.354Z,1681523913.354 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 3 meter
2023-04-15T01:58:33.355Z,1681523913.355 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 20 meter
2023-04-15T01:58:53.005Z,1681523933.005 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType1 -10 count
2023-04-15T01:58:53.006Z,1681523933.006 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChl1 0 meter
2023-04-15T01:58:53.006Z,1681523933.006 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 10 minute
2023-04-15T01:58:53.007Z,1681523933.007 [CommandExec](IMPORTANT): got command run
2023-04-15T01:58:53.045Z,1681523933.045 [CommandExec](IMPORTANT): Running 
2023-04-15T01:58:53.348Z,1681523933.348 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling
2023-04-15T01:58:53.431Z,1681523933.431 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 240.00 hours.
2023-04-15T02:03:59.110Z,1681524239.110 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-15T02:04:09.298Z,1681524249.298 [IsothermDepthSampling:StayAwayFromWallsAndShore:FarEnoughFromWallsAndShore:A](IMPORTANT): Far enough from walls and shore. Latitude = 36.805541 arcdeg , longitude = -121.839499 arcdeg . Distance from shore = 4166.740723 m . OffshoreDistanceTurnBack (MinOffshore + MarginMinOffshore) = 2000.000000 m + 100.000000 m . Shortest distance nan m to side. MinDistFromPolygonSides = 200.000000 m .
2023-04-15T02:04:11.344Z,1681524251.344 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.051823 m 
2023-04-15T02:05:20.756Z,1681524320.756 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -10.000000 count , nan K , 0.000000 m , nan degC , nan m , 10.000000 min .
2023-04-15T02:08:26.205Z,1681524506.205 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoUp:B](IMPORTANT): Go up from 23.089657 m 
2023-04-15T02:09:51.854Z,1681524591.854 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:SetChlPeakTempDepth:L](IMPORTANT): Set peak-chl depth and temp. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlTemperatureSet, PeakChlSet = 17.766491 m , 1.716000 ug/l , 5.579587 m , 11.873747 degC , 5.951923 ug/l 
2023-04-15T02:09:52.319Z,1681524592.319 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 1.000000 count . Target depth = 5.579587 m .
2023-04-15T02:09:52.671Z,1681524592.671 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -10.000000 count 
2023-04-15T02:13:17.094Z,1681524797.094 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 5.532513 m , settling for 10.000000 min 
2023-04-15T02:23:19.814Z,1681525399.814 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::|summary:'
2023-04-15T02:23:29.948Z,1681525409.948 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2023-04-15T02:23:30.091Z,1681525410.091 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2023-04-15T02:24:17.589Z,1681525457.589 [ESPComponent](IMPORTANT): ESP has connected as client
2023-04-15T02:24:18.403Z,1681525458.403 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -10
2023-04-15T02:24:18.404Z,1681525458.404 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2023-04-15T02:24:18.892Z,1681525458.892 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 5.682396 m in 11.989649 degC water with 5.597280 ug/l chlorophyll fluorescence.
2023-04-15T02:24:19.609Z,1681525459.609 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG
2023-04-15T02:24:20.020Z,1681525460.020 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS
2023-04-15T02:24:21.630Z,1681525461.630 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE
2023-04-15T02:24:59.202Z,1681525499.202 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PRIMING (@52,daSPR_phyto)
2023-04-15T02:25:02.046Z,1681525502.046 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PRIMING (@100.0)
2023-04-15T02:25:02.047Z,1681525502.047 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering
2023-04-15T02:25:02.436Z,1681525502.436 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2023-04-15T02:27:18.181Z,1681525638.181 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_FILTERING (@0.0)
2023-04-15T02:27:18.586Z,1681525638.586 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2023-04-15T02:47:27.370Z,1681526847.370 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PAUSED (@317.3)
2023-04-15T02:47:27.773Z,1681526847.773 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PROCESSING (@317.3)
2023-04-15T02:47:29.798Z,1681526849.798 [ESPComponent](IMPORTANT): Processing timeoutMinutes=120.000000 issuedCmd_=Cmd.startProcessing
2023-04-15T02:47:30.198Z,1681526850.198 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PROCESSED (@52,daSPR_phyto)
2023-04-15T03:46:15.981Z,1681530375.981 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING (@52,daSPR_phyto)
2023-04-15T03:46:27.296Z,1681530387.296 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2023-04-15T03:46:27.697Z,1681530387.697 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED
2023-04-15T03:51:27.487Z,1681530687.487 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence completed normally.
2023-04-15T03:51:28.360Z,1681530688.360 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 1.000000 count completed.
2023-04-15T03:51:31.434Z,1681530691.434 [MissionManager](IMPORTANT): Started mission Default
2023-04-15T03:57:01.179Z,1681531021.179 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-15T04:02:26.487Z,1681531346.487 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 10.910739 min 
2023-04-15T04:02:28.088Z,1681531348.088 [NAL9602](FAULT): GPS failed to acquire within timeout.
2023-04-15T04:02:40.034Z,1681531360.034 [DataOverHttps](IMPORTANT): SBD MTMSN=20230415T040239
2023-04-15T04:02:47.628Z,1681531367.628 [CommandExec](IMPORTANT): got command schedule asap "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.MissionTimeout 4 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h;set IsothermDepthSampling.SendSampleStatusAndData 0 bool" 374js 1 3.000000
2023-04-15T04:02:47.629Z,1681531367.629 [CommandExec](IMPORTANT): Scheduling command #1 of 3 with id=374js
2023-04-15T04:02:47.630Z,1681531367.630 [CommandExec](IMPORTANT): Scheduled #8 (#1 of 3 with id='374js'): "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.MissionTimeout 4 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h;set IsothermDepthSampling.SendSampleStatusAndData 0 bool", ASAP
2023-04-15T04:02:48.573Z,1681531368.573 [DataOverHttps](IMPORTANT): SBD MTMSN=20230415T040248
2023-04-15T04:02:57.128Z,1681531377.128 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m;set IsothermDepthSampling.DeepBoundChl 20 m" 374js 2 3.000000
2023-04-15T04:02:57.129Z,1681531377.129 [CommandExec](IMPORTANT): Scheduling command #2 of 3 with id=374js
2023-04-15T04:02:57.130Z,1681531377.130 [CommandExec](IMPORTANT): Scheduled #9 (#2 of 3 with id='374js'): "set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m;set IsothermDepthSampling.DeepBoundChl 20 m", ASAP
2023-04-15T04:02:58.122Z,1681531378.122 [DataOverHttps](IMPORTANT): SBD MTMSN=20230415T040257
2023-04-15T04:03:05.767Z,1681531385.767 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.DepDiffFromPeakChl1 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;run" 374js 3 3.000000
2023-04-15T04:03:05.768Z,1681531385.768 [CommandExec](IMPORTANT): Scheduling command #3 of 3 with id=374js
2023-04-15T04:03:05.769Z,1681531385.769 [CommandExec](IMPORTANT): Scheduled #10 (#3 of 3 with id='374js'): "set IsothermDepthSampling.DepDiffFromPeakChl1 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;run", ASAP
2023-04-15T04:03:05.915Z,1681531385.915 [CommandExec](IMPORTANT): got command load ./Missions/Science/isotherm_depth_sampling.xml
2023-04-15T04:03:22.287Z,1681531402.287 [CommandExec](IMPORTANT): Loaded ./Missions/Science/isotherm_depth_sampling.xml
2023-04-15T04:03:52.777Z,1681531432.777 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MissionTimeout 4 hour
2023-04-15T04:03:52.777Z,1681531432.777 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNoFiring 1 hour
2023-04-15T04:03:52.778Z,1681531432.778 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendSampleStatusAndData 0 bool
2023-04-15T04:04:22.546Z,1681531462.546 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendDataToMultipleModems 0 bool
2023-04-15T04:04:22.547Z,1681531462.547 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SampleAtPeakChl 1 bool
2023-04-15T04:04:22.547Z,1681531462.547 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 3 meter
2023-04-15T04:04:22.549Z,1681531462.549 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 20 meter
2023-04-15T04:04:44.698Z,1681531484.698 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChl1 0 meter
2023-04-15T04:04:44.699Z,1681531484.699 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 10 minute
2023-04-15T04:04:44.700Z,1681531484.700 [CommandExec](IMPORTANT): got command run
2023-04-15T04:04:44.702Z,1681531484.702 [CommandExec](IMPORTANT): Running 
2023-04-15T04:04:44.959Z,1681531484.959 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling
2023-04-15T04:04:45.022Z,1681531485.022 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 240.00 hours.
2023-04-15T04:06:47.155Z,1681531607.155 [IsothermDepthSampling:StayAwayFromWallsAndShore:FarEnoughFromWallsAndShore:A](IMPORTANT): Far enough from walls and shore. Latitude = 36.801369 arcdeg , longitude = -121.848758 arcdeg . Distance from shore = 5010.094727 m . OffshoreDistanceTurnBack (MinOffshore + MarginMinOffshore) = 2000.000000 m + 100.000000 m . Shortest distance nan m to side 0 count . MinDistFromPolygonSides = 200.000000 m .
2023-04-15T04:06:49.152Z,1681531609.152 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.052721 m 
2023-04-15T04:07:58.674Z,1681531678.674 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , nan K , 0.000000 m , nan degC , nan m , 10.000000 min .
2023-04-15T04:10:14.029Z,1681531814.029 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoUp:B](IMPORTANT): Go up from 23.124664 m 
2023-04-15T04:12:24.915Z,1681531944.915 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:SetChlPeakTempDepth:L](IMPORTANT): Set peak-chl depth and temp. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlTemperatureSet, PeakChlSet = 17.847717 m , 0.665600 ug/l , 10.140324 m , 10.870268 degC , 6.206718 ug/l 
2023-04-15T04:12:25.302Z,1681531945.302 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 1.000000 count . Target depth = 10.140324 m .
2023-04-15T04:12:25.705Z,1681531945.705 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -6.000000 count 
2023-04-15T04:15:10.579Z,1681532110.579 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 10.114677 m , settling for 10.000000 min 
2023-04-15T04:25:23.453Z,1681532723.453 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2023-04-15T04:25:23.594Z,1681532723.594 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2023-04-15T04:26:15.461Z,1681532775.461 [ESPComponent](IMPORTANT): ESP has connected as client
2023-04-15T04:26:16.283Z,1681532776.283 [ESPComponent](IMPORTANT): [sample #2] Setting cartridge argument to -6
2023-04-15T04:26:16.284Z,1681532776.284 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2023-04-15T04:26:16.756Z,1681532776.756 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 10.569254 m in 10.614191 degC water with 5.676320 ug/l chlorophyll fluorescence.
2023-04-15T04:26:17.077Z,1681532777.077 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_LOG
2023-04-15T04:26:17.484Z,1681532777.484 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_STATUS
2023-04-15T04:26:19.503Z,1681532779.503 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_LOADING_CARTRIDGE
2023-04-15T04:26:56.267Z,1681532816.267 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PRIMING (@44,archive_bac)
2023-04-15T04:26:58.288Z,1681532818.288 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PRIMING (@100.0)
2023-04-15T04:26:58.690Z,1681532818.690 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering
2023-04-15T04:26:59.094Z,1681532819.094 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2023-04-15T04:29:13.225Z,1681532953.225 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_FILTERING (@0.0)
2023-04-15T04:29:13.630Z,1681532953.630 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2023-04-15T05:04:56.873Z,1681535096.873 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PAUSED (@599.4)
2023-04-15T05:04:57.280Z,1681535097.280 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PROCESSING (@599.4)
2023-04-15T05:04:59.702Z,1681535099.702 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing
2023-04-15T05:05:00.105Z,1681535100.105 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PROCESSED (@44,archive_bac)
2023-04-15T05:17:04.502Z,1681535824.502 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPING (@44,archive_bac)
2023-04-15T05:17:14.609Z,1681535834.609 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2023-04-15T05:17:15.010Z,1681535835.010 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPED
2023-04-15T05:22:14.773Z,1681536134.773 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence completed normally.
2023-04-15T05:22:15.627Z,1681536135.627 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 1.000000 count completed.
2023-04-15T05:22:18.681Z,1681536138.681 [MissionManager](IMPORTANT): Started mission Default
2023-04-15T05:25:06.671Z,1681536306.671 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=2466, MT Status=1, MTMSN=2523
2023-04-15T05:25:07.268Z,1681536307.268 [CommandExec](IMPORTANT): got command schedule clear
2023-04-15T05:25:07.268Z,1681536307.268 [CommandExec](IMPORTANT): Cleared 0 scheduled commands.
2023-04-15T05:25:07.268Z,1681536307.268 [CommandExec](IMPORTANT): got command schedule resume
2023-04-15T05:31:33.777Z,1681536693.777 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 9.244359 min 
2023-04-15T05:31:58.177Z,1681536718.177 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2467, MT Status=1, MTMSN=2524
2023-04-15T05:31:58.926Z,1681536718.926 [CommandExec](IMPORTANT): got command schedule "load Science/profile_station.xml;set profile_station.MissionTimeout 12 h;set profile_station.Lat 36.658 degree;set profile_station.Lon -121.874 degree;set profile_station.YoYoMaxDepth 40 m;set profile_station.MaxDepth 50 m;run"
2023-04-15T05:31:58.926Z,1681536718.926 [CommandExec](IMPORTANT): Scheduled #11: "load Science/profile_station.xml;set profile_station.MissionTimeout 12 h;set profile_station.Lat 36.658 degree;set profile_station.Lon -121.874 degree;set profile_station.YoYoMaxDepth 40 m;set profile_station.MaxDepth 50 m;run", AFTER MISSION
2023-04-15T05:31:59.069Z,1681536719.069 [CommandExec](IMPORTANT): got command load ./Missions/Science/profile_station.xml
2023-04-15T05:32:02.578Z,1681536722.578 [CommandExec](IMPORTANT): Loaded ./Missions/Science/profile_station.xml
2023-04-15T05:32:27.879Z,1681536747.879 [CommandExec](IMPORTANT): got command set profile_station.MissionTimeout 12 hour
2023-04-15T05:32:27.883Z,1681536747.883 [CommandExec](IMPORTANT): got command set profile_station.Lat 36.658 degree
2023-04-15T05:32:27.886Z,1681536747.886 [CommandExec](IMPORTANT): got command set profile_station.Lon -121.874 degree
2023-04-15T05:32:27.906Z,1681536747.906 [CommandExec](IMPORTANT): got command set profile_station.YoYoMaxDepth 40 meter
2023-04-15T05:32:27.907Z,1681536747.907 [CommandExec](IMPORTANT): got command set profile_station.MaxDepth 50 meter
2023-04-15T05:32:27.907Z,1681536747.907 [CommandExec](IMPORTANT): got command run
2023-04-15T05:32:27.911Z,1681536747.911 [CommandExec](IMPORTANT): Running 
2023-04-15T05:32:28.085Z,1681536748.085 [MissionManager](IMPORTANT): Started mission profile_station
2023-04-15T05:36:22.228Z,1681536982.228 [StratificationFrontDetector](IMPORTANT): Initial vertical homogeneity condition (0 = stratified, 1 = homogeneous): 0
2023-04-15T05:45:46.243Z,1681537546.243 [StratificationFrontDetector](IMPORTANT): Front detection is now enabled. Present vertical homogeneity condition (0 = stratified, 1 = homogeneous), VTHI, VSHI, countSameWaterType_, countOppositeWaterType_, frontDetectionEnabled_ = 0, 1.061914, nan, 5, 0, 1
2023-04-15T06:00:44.403Z,1681538444.403 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-15T06:00:55.350Z,1681538455.350 [CBIT](IMPORTANT): No ground fault detected
mA:
CHAN A0 (Batt): 0.013372
CHAN A1 (24V): 0.023337
CHAN A2 (12V): 0.006346
CHAN A3 (5V): 0.002525
CHAN B0 (3.3V): 0.003383
CHAN B1 (3.15aV): 0.003959
CHAN B2 (3.15bV): 0.003229
CHAN B3 (GND): 0.000641
OPEN: 0.012678
Full Scale: +/- 1 mA
2023-04-15T08:42:40.514Z,1681548160.514 [Radio_Surface](FAULT): LCB fault: LCB Watchdog Reset. Invalid Command. Current Limiter Activated.
2023-04-15T10:30:44.011Z,1681554644.011 [ThrusterHE](IMPORTANT): Status lock Detected.
2023-04-15T10:30:44.475Z,1681554644.475 [ThrusterHE](IMPORTANT): Status lock Detected.
2023-04-15T10:30:44.915Z,1681554644.915 [ThrusterHE](IMPORTANT): Status lock Detected.
2023-04-15T10:30:45.260Z,1681554645.260 [ThrusterHE](IMPORTANT): Status lock Detected.
2023-04-15T10:30:48.520Z,1681554648.520 [ThrusterHE](FAULT): Thruster failed to initialize
2023-04-15T10:38:43.257Z,1681555123.257 [ThrusterHE](FAULT): getSpeed error serial timeout
2023-04-15T10:38:43.257Z,1681555123.257 [ThrusterHE](FAULT): Thruster uart error: serial timeout
2023-04-15T12:00:55.599Z,1681560055.599 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-15T12:01:06.394Z,1681560066.394 [CBIT](IMPORTANT): No ground fault detected
mA:
CHAN A0 (Batt): -0.003784
CHAN A1 (24V): 0.004936
CHAN A2 (12V): -0.004593
CHAN A3 (5V): 0.004517
CHAN B0 (3.3V): -0.001517
CHAN B1 (3.15aV): -0.002067
CHAN B2 (3.15bV): -0.000429
CHAN B3 (GND): -0.001083
OPEN: 0.012481
Full Scale: +/- 1 mA
2023-04-15T14:24:21.353Z,1681568661.353 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2526, MT Status=1, MTMSN=2525
2023-04-15T14:24:21.901Z,1681568661.901 [CommandExec](IMPORTANT): got command stop
2023-04-15T14:24:21.901Z,1681568661.901 [CommandExec](IMPORTANT): Scheduling is paused
2023-04-15T14:24:22.604Z,1681568662.604 [MissionManager](IMPORTANT): Started mission Default
2023-04-15T14:25:08.326Z,1681568708.326 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2527, MT Status=1, MTMSN=2526
2023-04-15T14:25:08.919Z,1681568708.919 [CommandExec](IMPORTANT): got command schedule clear
2023-04-15T14:25:08.920Z,1681568708.920 [CommandExec](IMPORTANT): Cleared 0 scheduled commands.
2023-04-15T14:25:08.920Z,1681568708.920 [CommandExec](IMPORTANT): got command schedule resume
2023-04-15T14:25:08.920Z,1681568708.920 [CommandExec](IMPORTANT): Scheduling is resumed
2023-04-15T14:30:37.778Z,1681569037.778 [DataOverHttps](IMPORTANT): SBD MTMSN=20230415T143037
2023-04-15T14:30:47.221Z,1681569047.221 [CommandExec](IMPORTANT): got command schedule "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.MissionTimeout 4 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h;set IsothermDepthSampling.SendSampleStatusAndData 0 bool" 37xm6 1 3.000000
2023-04-15T14:30:47.222Z,1681569047.222 [CommandExec](IMPORTANT): Scheduling command #1 of 3 with id=37xm6
2023-04-15T14:30:47.223Z,1681569047.223 [CommandExec](IMPORTANT): Scheduled #12 (#1 of 3 with id='37xm6'): "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.MissionTimeout 4 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h;set IsothermDepthSampling.SendSampleStatusAndData 0 bool", AFTER MISSION
2023-04-15T14:30:48.146Z,1681569048.146 [DataOverHttps](IMPORTANT): SBD MTMSN=20230415T143047
2023-04-15T14:30:55.770Z,1681569055.770 [CommandExec](IMPORTANT): got command schedule "set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m;set IsothermDepthSampling.DeepBoundChl 20 m" 37xm6 2 3.000000
2023-04-15T14:30:55.771Z,1681569055.771 [CommandExec](IMPORTANT): Scheduling command #2 of 3 with id=37xm6
2023-04-15T14:30:55.772Z,1681569055.772 [CommandExec](IMPORTANT): Scheduled #13 (#2 of 3 with id='37xm6'): "set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m;set IsothermDepthSampling.DeepBoundChl 20 m", AFTER MISSION
2023-04-15T14:30:56.686Z,1681569056.686 [DataOverHttps](IMPORTANT): SBD MTMSN=20230415T143056
2023-04-15T14:31:04.506Z,1681569064.506 [CommandExec](IMPORTANT): got command schedule "set IsothermDepthSampling.CartridgeType1 -10 count;set IsothermDepthSampling.DepDiffFromPeakChl1 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;run" 37xm6 3 3.000000
2023-04-15T14:31:04.507Z,1681569064.507 [CommandExec](IMPORTANT): Scheduling command #3 of 3 with id=37xm6
2023-04-15T14:31:04.508Z,1681569064.508 [CommandExec](IMPORTANT): Scheduled #14 (#3 of 3 with id='37xm6'): "set IsothermDepthSampling.CartridgeType1 -10 count;set IsothermDepthSampling.DepDiffFromPeakChl1 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;run", AFTER MISSION
2023-04-15T14:31:04.663Z,1681569064.663 [CommandExec](IMPORTANT): got command load ./Missions/Science/isotherm_depth_sampling.xml
2023-04-15T14:31:20.771Z,1681569080.771 [CommandExec](IMPORTANT): Loaded ./Missions/Science/isotherm_depth_sampling.xml
2023-04-15T14:31:51.902Z,1681569111.902 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MissionTimeout 4 hour
2023-04-15T14:31:51.903Z,1681569111.903 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNoFiring 1 hour
2023-04-15T14:31:51.904Z,1681569111.904 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendSampleStatusAndData 0 bool
2023-04-15T14:32:19.757Z,1681569139.757 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendDataToMultipleModems 0 bool
2023-04-15T14:32:19.758Z,1681569139.758 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SampleAtPeakChl 1 bool
2023-04-15T14:32:19.759Z,1681569139.759 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 3 meter
2023-04-15T14:32:19.759Z,1681569139.759 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 20 meter
2023-04-15T14:32:49.824Z,1681569169.824 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType1 -10 count
2023-04-15T14:32:49.824Z,1681569169.824 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChl1 0 meter
2023-04-15T14:32:49.825Z,1681569169.825 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 10 minute
2023-04-15T14:32:49.826Z,1681569169.826 [CommandExec](IMPORTANT): got command run
2023-04-15T14:32:49.828Z,1681569169.828 [CommandExec](IMPORTANT): Running 
2023-04-15T14:32:50.041Z,1681569170.041 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling
2023-04-15T14:32:50.169Z,1681569170.169 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 240.00 hours.
2023-04-15T14:34:00.365Z,1681569240.365 [IsothermDepthSampling:StayAwayFromWallsAndShore:FarEnoughFromWallsAndShore:A](IMPORTANT): Far enough from walls and shore. Latitude = 36.656875 arcdeg , longitude = -121.870217 arcdeg . Distance from shore = 3387.438232 m . OffshoreDistanceTurnBack (MinOffshore + MarginMinOffshore) = 2000.000000 m + 100.000000 m . Shortest distance nan m to side 0 count . MinDistFromPolygonSides = 200.000000 m .
2023-04-15T14:34:02.384Z,1681569242.384 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.111062 m 
2023-04-15T14:35:11.889Z,1681569311.889 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -10.000000 count , nan K , 0.000000 m , nan degC , nan m , 10.000000 min .
2023-04-15T14:37:35.298Z,1681569455.298 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoUp:B](IMPORTANT): Go up from 23.100281 m 
2023-04-15T14:39:53.501Z,1681569593.501 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:SetChlPeakTempDepth:L](IMPORTANT): Set peak-chl depth and temp. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlTemperatureSet, PeakChlSet = 17.813393 m , 0.686400 ug/l , 8.484387 m , 11.135303 degC , 11.314158 ug/l 
2023-04-15T14:39:53.870Z,1681569593.870 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 1.000000 count . Target depth = 8.484387 m .
2023-04-15T14:39:54.364Z,1681569594.364 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -10.000000 count 
2023-04-15T14:42:55.714Z,1681569775.714 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 8.470587 m , settling for 10.000000 min 
2023-04-15T14:53:08.616Z,1681570388.616 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2023-04-15T14:53:08.921Z,1681570388.921 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2023-04-15T14:53:59.653Z,1681570439.653 [ESPComponent](IMPORTANT): ESP has connected as client
2023-04-15T14:54:00.493Z,1681570440.493 [ESPComponent](IMPORTANT): [sample #3] Setting cartridge argument to -10
2023-04-15T14:54:00.493Z,1681570440.493 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2023-04-15T14:54:00.945Z,1681570440.945 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 8.410454 m in 11.126062 degC water with 11.376560 ug/l chlorophyll fluorescence.
2023-04-15T14:54:01.269Z,1681570441.269 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_LOG
2023-04-15T14:54:01.674Z,1681570441.674 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_STATUS
2023-04-15T14:54:03.695Z,1681570443.695 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_LOADING_CARTRIDGE
2023-04-15T14:54:41.278Z,1681570481.278 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PRIMING (@51,daSPR_phyto)
2023-04-15T14:54:43.298Z,1681570483.298 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PRIMING (@100.0)
2023-04-15T14:54:43.702Z,1681570483.702 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering
2023-04-15T14:54:44.105Z,1681570484.105 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2023-04-15T14:57:05.114Z,1681570625.114 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_FILTERING (@0.0)
2023-04-15T14:57:05.517Z,1681570625.517 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2023-04-15T15:59:52.897Z,1681574392.897 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PAUSED (@924.9)
2023-04-15T15:59:53.298Z,1681574393.298 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PROCESSING (@924.9)
2023-04-15T15:59:55.322Z,1681574395.322 [ESPComponent](IMPORTANT): Processing timeoutMinutes=120.000000 issuedCmd_=Cmd.startProcessing
2023-04-15T15:59:55.722Z,1681574395.722 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PROCESSED (@51,daSPR_phyto)
2023-04-15T16:57:51.079Z,1681577871.079 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPING (@51,daSPR_phyto)
2023-04-15T16:58:02.390Z,1681577882.390 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2023-04-15T16:58:02.797Z,1681577882.797 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPED
2023-04-15T17:03:02.581Z,1681578182.581 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence completed normally.
2023-04-15T17:03:03.452Z,1681578183.452 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 1.000000 count completed.
2023-04-15T17:03:06.495Z,1681578186.495 [MissionManager](IMPORTANT): Started mission Default
2023-04-15T17:05:48.867Z,1681578348.867 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2537, MT Status=1, MTMSN=2527
2023-04-15T17:05:49.630Z,1681578349.630 [CommandExec](IMPORTANT): got command schedule "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.MissionTimeout 4 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h;set IsothermDepthSampling.SendSampleStatusAndData 0 bool" 3820g 1 3.000000
2023-04-15T17:05:49.631Z,1681578349.631 [CommandExec](IMPORTANT): Scheduling command #1 of 3 with id=3820g
2023-04-15T17:05:49.640Z,1681578349.640 [CommandExec](IMPORTANT): Scheduled #15 (#1 of 3 with id='3820g'): "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.MissionTimeout 4 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h;set IsothermDepthSampling.SendSampleStatusAndData 0 bool", AFTER MISSION
2023-04-15T17:06:42.589Z,1681578402.589 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2538, MT Status=1, MTMSN=2528
2023-04-15T17:06:43.379Z,1681578403.379 [CommandExec](IMPORTANT): got command schedule "set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m;set IsothermDepthSampling.DeepBoundChl 15 m" 3820g 2 3.000000
2023-04-15T17:06:43.380Z,1681578403.380 [CommandExec](IMPORTANT): Scheduling command #2 of 3 with id=3820g
2023-04-15T17:06:43.409Z,1681578403.409 [CommandExec](IMPORTANT): Scheduled #16 (#2 of 3 with id='3820g'): "set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m;set IsothermDepthSampling.DeepBoundChl 15 m", AFTER MISSION
2023-04-15T17:07:06.155Z,1681578426.155 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2539, MT Status=1, MTMSN=2529
2023-04-15T17:07:06.837Z,1681578426.837 [CommandExec](IMPORTANT): got command schedule "set IsothermDepthSampling.DepDiffFromPeakChl1 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;run" 3820g 3 3.000000
2023-04-15T17:07:06.837Z,1681578426.837 [CommandExec](IMPORTANT): Scheduling command #3 of 3 with id=3820g
2023-04-15T17:07:06.838Z,1681578426.838 [CommandExec](IMPORTANT): Scheduled #17 (#3 of 3 with id='3820g'): "set IsothermDepthSampling.DepDiffFromPeakChl1 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;run", AFTER MISSION
2023-04-15T17:07:07.013Z,1681578427.013 [CommandExec](IMPORTANT): got command load ./Missions/Science/isotherm_depth_sampling.xml
2023-04-15T17:07:23.530Z,1681578443.530 [CommandExec](IMPORTANT): Loaded ./Missions/Science/isotherm_depth_sampling.xml
2023-04-15T17:07:55.381Z,1681578475.381 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MissionTimeout 4 hour
2023-04-15T17:07:55.382Z,1681578475.382 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNoFiring 1 hour
2023-04-15T17:07:55.382Z,1681578475.382 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendSampleStatusAndData 0 bool
2023-04-15T17:08:23.323Z,1681578503.323 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendDataToMultipleModems 0 bool
2023-04-15T17:08:23.324Z,1681578503.324 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SampleAtPeakChl 1 bool
2023-04-15T17:08:23.325Z,1681578503.325 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 3 meter
2023-04-15T17:08:23.326Z,1681578503.326 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 15 meter
2023-04-15T17:08:46.058Z,1681578526.058 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChl1 0 meter
2023-04-15T17:08:46.059Z,1681578526.059 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 10 minute
2023-04-15T17:08:46.060Z,1681578526.060 [CommandExec](IMPORTANT): got command run
2023-04-15T17:08:46.063Z,1681578526.063 [CommandExec](IMPORTANT): Running 
2023-04-15T17:08:46.258Z,1681578526.258 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling
2023-04-15T17:08:46.398Z,1681578526.398 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 240.00 hours.
2023-04-15T17:10:39.866Z,1681578639.866 [IsothermDepthSampling:StayAwayFromWallsAndShore:FarEnoughFromWallsAndShore:A](IMPORTANT): Far enough from walls and shore. Latitude = 36.652224 arcdeg , longitude = -121.878491 arcdeg . Distance from shore = 3476.524170 m . OffshoreDistanceTurnBack (MinOffshore + MarginMinOffshore) = 2000.000000 m + 100.000000 m . Shortest distance nan m to side 0 count . MinDistFromPolygonSides = 200.000000 m .
2023-04-15T17:10:41.914Z,1681578641.914 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.135295 m 
2023-04-15T17:11:51.424Z,1681578711.424 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , nan K , 0.000000 m , nan degC , nan m , 10.000000 min .
2023-04-15T17:13:40.898Z,1681578820.898 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoUp:B](IMPORTANT): Go up from 18.076357 m 
2023-04-15T17:16:14.012Z,1681578974.012 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:SetChlPeakTempDepth:L](IMPORTANT): Set peak-chl depth and temp. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlTemperatureSet, PeakChlSet = 12.840941 m , 0.738400 ug/l , 9.857184 m , 11.114894 degC , 11.706758 ug/l 
2023-04-15T17:16:14.436Z,1681578974.436 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 1.000000 count . Target depth = 9.857184 m .
2023-04-15T17:16:14.819Z,1681578974.819 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -6.000000 count 
2023-04-15T17:17:44.549Z,1681579064.549 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 9.813701 m , settling for 10.000000 min 
2023-04-15T17:27:57.432Z,1681579677.432 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2023-04-15T17:27:57.552Z,1681579677.552 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2023-04-15T17:28:49.518Z,1681579729.518 [ESPComponent](IMPORTANT): ESP has connected as client
2023-04-15T17:28:50.335Z,1681579730.335 [ESPComponent](IMPORTANT): [sample #4] Setting cartridge argument to -6
2023-04-15T17:28:50.337Z,1681579730.337 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2023-04-15T17:28:50.823Z,1681579730.823 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 10.579716 m in 11.027948 degC water with 10.727600 ug/l chlorophyll fluorescence.
2023-04-15T17:28:51.136Z,1681579731.136 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_LOG
2023-04-15T17:28:51.538Z,1681579731.538 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_STATUS
2023-04-15T17:28:53.557Z,1681579733.557 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_LOADING_CARTRIDGE
2023-04-15T17:29:30.324Z,1681579770.324 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PRIMING (@42,archive_bac)
2023-04-15T17:29:33.150Z,1681579773.150 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PRIMING (@100.0)
2023-04-15T17:29:33.151Z,1681579773.151 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering
2023-04-15T17:29:33.554Z,1681579773.554 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2023-04-15T17:31:47.682Z,1681579907.682 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_FILTERING (@0.0)
2023-04-15T17:31:48.089Z,1681579908.089 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2023-04-15T18:01:06.471Z,1681581666.471 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-15T18:01:17.388Z,1681581677.388 [CBIT](IMPORTANT): Ground fault detected
mA:
CHAN A0 (Batt): 0.154155
CHAN A1 (24V): 0.153128
CHAN A2 (12V): 0.063839
CHAN A3 (5V): 0.018578
CHAN B0 (3.3V): 0.011394
CHAN B1 (3.15aV): 0.010969
CHAN B2 (3.15bV): 0.011142
CHAN B3 (GND): -0.021173
OPEN: 0.015194
Full Scale: +/- 1 mA
2023-04-15T18:28:29.101Z,1681583309.101 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PAUSED (@1000.0)
2023-04-15T18:28:29.505Z,1681583309.505 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PROCESSING (@1000.0)
2023-04-15T18:28:31.526Z,1681583311.526 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing
2023-04-15T18:28:31.932Z,1681583311.932 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PROCESSED (@42,archive_bac)
2023-04-15T18:40:36.310Z,1681584036.310 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPING (@42,archive_bac)
2023-04-15T18:40:46.410Z,1681584046.410 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2023-04-15T18:40:46.815Z,1681584046.815 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPED
2023-04-15T18:45:46.589Z,1681584346.589 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence completed normally.
2023-04-15T18:45:47.482Z,1681584347.482 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 1.000000 count completed.
2023-04-15T18:45:50.501Z,1681584350.501 [MissionManager](IMPORTANT): Started mission Default
2023-04-15T18:47:50.018Z,1681584470.018 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=2541, MT Status=1, MTMSN=2530
2023-04-15T18:47:50.735Z,1681584470.735 [CommandExec](IMPORTANT): got command schedule "load Science/sci2.tl;set sci2.MissionTimeout 5 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 36.725 degree;set sci2.Lon1 -121.85 degree;set sci2.YoYoMaxDepth 40 m;set sci2.MaxDepth 50 m;run"
2023-04-15T18:47:50.736Z,1681584470.736 [CommandExec](IMPORTANT): Scheduled #18: "load Science/sci2.tl;set sci2.MissionTimeout 5 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 36.725 degree;set sci2.Lon1 -121.85 degree;set sci2.YoYoMaxDepth 40 m;set sci2.MaxDepth 50 m;run", AFTER MISSION
2023-04-15T18:47:50.869Z,1681584470.869 [CommandExec](IMPORTANT): got command load ./Missions/Science/sci2.tl
2023-04-15T18:47:50.871Z,1681584470.871 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file ./Missions/Science/sci2.tx
2023-04-15T18:47:52.988Z,1681584472.988 [CommandExec](IMPORTANT): Loaded ./Missions/Science/sci2.tl
2023-04-15T18:48:06.390Z,1681584486.390 [CommandExec](IMPORTANT): got command set sci2.MissionTimeout 5 hour
2023-04-15T18:48:06.391Z,1681584486.391 [CommandExec](IMPORTANT): got command set sci2.NeedCommsTime 45 minute
2023-04-15T18:48:06.391Z,1681584486.391 [CommandExec](IMPORTANT): got command set sci2.Lat1 36.725 degree
2023-04-15T18:48:06.392Z,1681584486.392 [CommandExec](IMPORTANT): got command set sci2.Lon1 -121.85 degree
2023-04-15T18:48:06.393Z,1681584486.393 [CommandExec](IMPORTANT): got command set sci2.YoYoMaxDepth 40 meter
2023-04-15T18:48:06.394Z,1681584486.394 [CommandExec](IMPORTANT): got command set sci2.MaxDepth 50 meter
2023-04-15T18:48:06.394Z,1681584486.394 [CommandExec](IMPORTANT): got command run
2023-04-15T18:48:06.396Z,1681584486.396 [CommandExec](IMPORTANT): Running 
2023-04-15T18:48:06.501Z,1681584486.501 [MissionManager](IMPORTANT): Started mission sci2
2023-04-15T18:50:46.123Z,1681584646.123 [sci2:Lap:Wpt1:A.Waypoint](IMPORTANT): Navigating to waypoint: 36.724998,-121.849998
2023-04-15T18:51:00.774Z,1681584660.774 [BuoyancyServo](FAULT): Buoyancy getPosition uart error.serial timeout
2023-04-15T20:32:54.003Z,1681590774.003 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2552, MT Status=1, MTMSN=2531