2023-04-21T13:37:14.165Z,1682084234.165 [CommandExec](IMPORTANT): got command restart logs
2023-04-21T13:37:14.670Z,1682084234.670 [DataOverHttps](IMPORTANT): SBD MTMSN=20230421T133709
2023-04-21T13:37:26.454Z,1682084246.454 [DataOverHttps](IMPORTANT): SBD MTMSN=20230421T133721
2023-04-21T13:37:33.784Z,1682084253.784 [CommandExec](IMPORTANT): got command schedule asap "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h" 3iz5n 1 4.000000
2023-04-21T13:37:33.784Z,1682084253.784 [CommandExec](IMPORTANT): Scheduling command #1 of 4 with id=3iz5n
2023-04-21T13:37:33.785Z,1682084253.785 [CommandExec](IMPORTANT): Scheduled #10 (#1 of 4 with id='3iz5n'): "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h", ASAP
2023-04-21T13:37:37.659Z,1682084257.659 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.SendSampleStatusAndData 0 bool;set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m" 3iz5n 2 4.000000
2023-04-21T13:37:37.660Z,1682084257.660 [CommandExec](IMPORTANT): Scheduling command #2 of 4 with id=3iz5n
2023-04-21T13:37:37.662Z,1682084257.662 [CommandExec](IMPORTANT): Scheduled #11 (#2 of 4 with id='3iz5n'): "set IsothermDepthSampling.SendSampleStatusAndData 0 bool;set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m", ASAP
2023-04-21T13:37:38.647Z,1682084258.647 [DataOverHttps](IMPORTANT): SBD MTMSN=20230421T133733
2023-04-21T13:37:50.109Z,1682084270.109 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.DeepBoundChl 25 m;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min" 3iz5n 3 4.000000
2023-04-21T13:37:50.109Z,1682084270.109 [CommandExec](IMPORTANT): Scheduling command #3 of 4 with id=3iz5n
2023-04-21T13:37:50.110Z,1682084270.110 [CommandExec](IMPORTANT): Scheduled #12 (#3 of 4 with id='3iz5n'): "set IsothermDepthSampling.DeepBoundChl 25 m;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min", ASAP
2023-04-21T13:37:51.086Z,1682084271.086 [DataOverHttps](IMPORTANT): SBD MTMSN=20230421T133745
2023-04-21T13:37:58.743Z,1682084278.743 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.RiseFromTurningDepth 6.0 m;set IsothermDepthSampling.DepChangeThreshAttitudeFlip 4.0 m;run" 3iz5n 4 4.000000
2023-04-21T13:37:58.744Z,1682084278.744 [CommandExec](IMPORTANT): Scheduling command #4 of 4 with id=3iz5n
2023-04-21T13:37:58.745Z,1682084278.745 [CommandExec](IMPORTANT): Scheduled #13 (#4 of 4 with id='3iz5n'): "set IsothermDepthSampling.RiseFromTurningDepth 6.0 m;set IsothermDepthSampling.DepChangeThreshAttitudeFlip 4.0 m;run", ASAP
2023-04-21T13:37:58.878Z,1682084278.878 [CommandExec](IMPORTANT): got command load ./Missions/Science/isotherm_depth_sampling.xml
2023-04-21T13:38:14.536Z,1682084294.536 [CommandExec](IMPORTANT): Loaded ./Missions/Science/isotherm_depth_sampling.xml
2023-04-21T13:38:34.297Z,1682084314.297 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.NumSamplers 2 count
2023-04-21T13:38:34.297Z,1682084314.297 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MissionTimeout 6 hour
2023-04-21T13:38:34.298Z,1682084314.298 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNoFiring 1 hour
2023-04-21T13:39:12.111Z,1682084352.111 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendSampleStatusAndData 0 bool
2023-04-21T13:39:12.118Z,1682084352.118 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendDataToMultipleModems 0 bool
2023-04-21T13:39:12.119Z,1682084352.119 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SampleAtPeakChl 1 bool
2023-04-21T13:39:12.120Z,1682084352.120 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 3 meter
2023-04-21T13:39:34.923Z,1682084374.923 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.463503 min 
2023-04-21T13:39:43.781Z,1682084383.781 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 25 meter
2023-04-21T13:39:43.782Z,1682084383.782 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType2 -10 count
2023-04-21T13:39:43.782Z,1682084383.782 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 meter
2023-04-21T13:39:43.783Z,1682084383.783 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 10 minute
2023-04-21T13:40:09.826Z,1682084409.826 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.RiseFromTurningDepth 6.0 meter
2023-04-21T13:40:09.827Z,1682084409.827 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepChangeThreshAttitudeFlip 4.0 meter
2023-04-21T13:40:09.827Z,1682084409.827 [CommandExec](IMPORTANT): got command run
2023-04-21T13:40:09.831Z,1682084409.831 [CommandExec](IMPORTANT): Running 
2023-04-21T13:40:10.127Z,1682084410.127 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling
2023-04-21T13:40:10.183Z,1682084410.183 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 240.00 hours.
2023-04-21T13:42:16.894Z,1682084536.894 [IsothermDepthSampling:StayAwayFromWallsAndShore:FarEnoughFromWallsAndShore:A](IMPORTANT): Far enough from walls and shore. Latitude = 36.661639 arcdeg , longitude = -121.871499 arcdeg . Distance from shore = 3877.301270 m . OffshoreDistanceTurnBack (MinOffshore + MarginMinOffshore) = 2000.000000 m + 100.000000 m . Shortest distance nan m to side 0 count . MinDistFromPolygonSides = 200.000000 m .
2023-04-21T13:42:18.876Z,1682084538.876 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.213381 m 
2023-04-21T13:43:28.266Z,1682084608.266 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , nan K , 0.000000 m , nan degC , nan m , 10.000000 min .
2023-04-21T13:47:13.667Z,1682084833.667 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-21T13:47:33.475Z,1682084853.475 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoUp:B](IMPORTANT): Go up from 28.028502 m 
2023-04-21T13:49:35.909Z,1682084975.909 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:SetChlPeakTempDepth:L](IMPORTANT): Set peak-chl depth and temp. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlTemperatureSet, PeakChlSet = 21.818274 m , 5.085600 ug/l , 14.098711 m , 10.664946 degC , 9.344398 ug/l 
2023-04-21T13:49:36.347Z,1682084976.347 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 1.000000 count . Target depth = 14.098711 m .
2023-04-21T13:49:36.738Z,1682084976.738 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -6.000000 count 
2023-04-21T13:52:01.769Z,1682085121.769 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 14.074968 m , settling for 10.000000 min 
2023-04-21T14:02:14.680Z,1682085734.680 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2023-04-21T14:02:14.820Z,1682085734.820 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2023-04-21T14:03:07.918Z,1682085787.918 [ESPComponent](IMPORTANT): ESP has connected as client
2023-04-21T14:03:08.733Z,1682085788.733 [ESPComponent](IMPORTANT): [sample #4] Setting cartridge argument to -6
2023-04-21T14:03:08.734Z,1682085788.734 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2023-04-21T14:03:09.194Z,1682085789.194 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 14.657880 m in 10.714411 degC water with 9.639760 ug/l chlorophyll fluorescence.
2023-04-21T14:03:09.534Z,1682085789.534 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_LOG
2023-04-21T14:03:09.937Z,1682085789.937 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_STATUS
2023-04-21T14:03:11.957Z,1682085791.957 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_LOADING_CARTRIDGE
2023-04-21T14:04:16.600Z,1682085856.600 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PRIMING (@12,archive_bac)
2023-04-21T14:04:19.429Z,1682085859.429 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PRIMING (@100.0)
2023-04-21T14:04:19.431Z,1682085859.431 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering
2023-04-21T14:04:19.829Z,1682085859.829 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2023-04-21T14:06:34.765Z,1682085994.765 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_FILTERING (@0.0)
2023-04-21T14:06:35.170Z,1682085995.170 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2023-04-21T14:41:17.360Z,1682088077.360 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-21T14:41:28.207Z,1682088088.207 [CBIT](IMPORTANT): Ground fault detected
mA:
CHAN A0 (Batt): 0.167288
CHAN A1 (24V): 0.296938
CHAN A2 (12V): 0.125236
CHAN A3 (5V): 0.047943
CHAN B0 (3.3V): 0.025460
CHAN B1 (3.15aV): 0.015636
CHAN B2 (3.15bV): 0.031678
CHAN B3 (GND): -0.003405
OPEN: 0.014373
Full Scale: +/- 1 mA
2023-04-21T15:00:37.477Z,1682089237.477 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PAUSED (@1000.0)
2023-04-21T15:00:37.882Z,1682089237.882 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PROCESSING (@1000.0)
2023-04-21T15:00:39.905Z,1682089239.905 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing
2023-04-21T15:00:40.305Z,1682089240.305 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PROCESSED (@12,archive_bac)
2023-04-21T15:12:44.718Z,1682089964.718 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPING (@12,archive_bac)
2023-04-21T15:12:54.818Z,1682089974.818 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2023-04-21T15:12:55.224Z,1682089975.224 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPED
2023-04-21T15:17:55.014Z,1682090275.014 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence completed normally.
2023-04-21T15:17:55.897Z,1682090275.897 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 1.000000 count completed.
2023-04-21T15:18:12.480Z,1682090292.480 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -10.000000 count , nan K , 0.000000 m , nan degC , nan m , 5.000000 min .
2023-04-21T15:18:16.127Z,1682090296.127 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 2.000000 count . Target depth = 14.098711 m .
2023-04-21T15:18:16.503Z,1682090296.503 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -10.000000 count 
2023-04-21T15:18:33.102Z,1682090313.102 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 14.023811 m , settling for 5.000000 min 
2023-04-21T15:23:45.820Z,1682090625.820 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2023-04-21T15:23:45.990Z,1682090625.990 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2023-04-21T15:24:38.297Z,1682090678.297 [ESPComponent](IMPORTANT): ESP has connected as client
2023-04-21T15:24:39.110Z,1682090679.110 [ESPComponent](IMPORTANT): [sample #5] Setting cartridge argument to -10
2023-04-21T15:24:39.110Z,1682090679.110 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2023-04-21T15:24:39.567Z,1682090679.567 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 13.899061 m in 10.976282 degC water with 11.029200 ug/l chlorophyll fluorescence.
2023-04-21T15:24:39.913Z,1682090679.913 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_LOG
2023-04-21T15:24:40.317Z,1682090680.317 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_STATUS
2023-04-21T15:24:42.337Z,1682090682.337 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_LOADING_CARTRIDGE
2023-04-21T15:25:19.909Z,1682090719.909 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PRIMING (@21,daSPR_phyto)
2023-04-21T15:25:22.737Z,1682090722.737 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PRIMING (@100.0)
2023-04-21T15:25:22.738Z,1682090722.738 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering
2023-04-21T15:25:23.141Z,1682090723.141 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2023-04-21T15:27:36.869Z,1682090856.869 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_FILTERING (@0.0)
2023-04-21T15:27:37.270Z,1682090857.270 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2023-04-21T16:22:27.897Z,1682094147.897 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PAUSED (@1000.0)
2023-04-21T16:22:28.301Z,1682094148.301 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PROCESSING (@1000.0)
2023-04-21T16:22:30.330Z,1682094150.330 [ESPComponent](IMPORTANT): Processing timeoutMinutes=120.000000 issuedCmd_=Cmd.startProcessing
2023-04-21T16:22:30.730Z,1682094150.730 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PROCESSED (@21,daSPR_phyto)
2023-04-21T16:41:28.511Z,1682095288.511 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-21T16:41:39.499Z,1682095299.499 [CBIT](IMPORTANT): Ground fault detected
mA:
CHAN A0 (Batt): 0.238416
CHAN A1 (24V): 0.350137
CHAN A2 (12V): 0.144438
CHAN A3 (5V): 0.038856
CHAN B0 (3.3V): 0.040288
CHAN B1 (3.15aV): 0.023132
CHAN B2 (3.15bV): 0.023393
CHAN B3 (GND): -0.010308
OPEN: 0.014891
Full Scale: +/- 1 mA
2023-04-21T17:18:13.930Z,1682097493.930 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPING (@21,daSPR_phyto)
2023-04-21T17:18:25.242Z,1682097505.242 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2023-04-21T17:18:25.646Z,1682097505.646 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPED
2023-04-21T17:23:25.419Z,1682097805.419 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence completed normally.
2023-04-21T17:23:26.225Z,1682097806.225 [ESPComponent](FAULT): LCB 1 fault:  Invalid Command.
2023-04-21T17:23:26.330Z,1682097806.330 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 2.000000 count completed.
2023-04-21T17:23:29.338Z,1682097809.338 [MissionManager](IMPORTANT): Started mission Default
2023-04-21T17:27:21.188Z,1682098041.188 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=3370, MT Status=1, MTMSN=2608
2023-04-21T17:27:21.782Z,1682098041.782 [CommandExec](IMPORTANT): got command ! echo i > /dev/loadA6;echo i > /dev/loadA7
2023-04-21T17:33:06.758Z,1682098386.758 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 9.616521 min 
2023-04-21T17:35:53.441Z,1682098553.441 [CommandExec](IMPORTANT): got command get height_above_sea_floor
2023-04-21T17:35:53.441Z,1682098553.441 [CommandExec](IMPORTANT): height_above_sea_floor 67.180000 m
2023-04-21T17:38:36.949Z,1682098716.949 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 15.119991 min 
2023-04-21T17:40:20.322Z,1682098820.322 [DataOverHttps](IMPORTANT): SBD MTMSN=20230421T174014
2023-04-21T17:40:31.093Z,1682098831.093 [CommandExec](IMPORTANT): got command load ./Missions/Science/sci2.tl
2023-04-21T17:40:31.095Z,1682098831.095 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file ./Missions/Science/sci2.tx
2023-04-21T17:40:35.411Z,1682098835.411 [CommandExec](IMPORTANT): Loaded ./Missions/Science/sci2.tl
2023-04-21T17:40:49.122Z,1682098849.122 [CommandExec](IMPORTANT): got command set sci2.MissionTimeout 10 hour
2023-04-21T17:40:49.123Z,1682098849.123 [CommandExec](IMPORTANT): got command set sci2.Lat1 36.787 degree
2023-04-21T17:40:49.124Z,1682098849.124 [CommandExec](IMPORTANT): got command set sci2.Lon1 -121.957 degree
2023-04-21T17:40:49.125Z,1682098849.125 [CommandExec](IMPORTANT): got command set sci2.Speed 0.8 meter_per_second
2023-04-21T17:40:49.125Z,1682098849.125 [CommandExec](IMPORTANT): got command set sci2.YoYoMaxDepth 45 meter
2023-04-21T17:40:49.126Z,1682098849.126 [CommandExec](IMPORTANT): got command set sci2.MaxDepth 50 meter
2023-04-21T17:40:49.126Z,1682098849.126 [CommandExec](IMPORTANT): got command run
2023-04-21T17:40:49.130Z,1682098849.130 [CommandExec](IMPORTANT): Running 
2023-04-21T17:40:49.314Z,1682098849.314 [MissionManager](IMPORTANT): Started mission sci2
2023-04-21T17:44:37.690Z,1682099077.690 [sci2:Lap:Wpt1:A.Waypoint](IMPORTANT): Navigating to waypoint: 36.786999,-121.957001
2023-04-21T17:49:39.906Z,1682099379.906 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-21T17:59:19.048Z,1682099959.048 [ThrusterHE](FAULT): getSpeed error serial timeout
2023-04-21T17:59:19.048Z,1682099959.048 [ThrusterHE](FAULT): Thruster uart error: serial timeout
2023-04-21T18:41:39.915Z,1682102499.915 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-21T18:41:50.778Z,1682102510.778 [CBIT](IMPORTANT): Ground fault detected
mA:
CHAN A0 (Batt): 0.070395
CHAN A1 (24V): 0.003581
CHAN A2 (12V): -0.004976
CHAN A3 (5V): -0.003331
CHAN B0 (3.3V): -0.001086
CHAN B1 (3.15aV): -0.001365
CHAN B2 (3.15bV): -0.001166
CHAN B3 (GND): -0.005786
OPEN: 0.012493
Full Scale: +/- 1 mA
2023-04-21T18:48:06.338Z,1682102886.338 [RudderServo](FAULT): Rudder uart error - getPosition..serial timeout
2023-04-21T18:53:15.996Z,1682103195.996 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-21T18:59:02.998Z,1682103542.998 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-21T20:38:36.308Z,1682109516.308 [Radio_Surface](FAULT): LCB fault:  Hardware Overcurrent Shutdown.
2023-04-21T20:41:50.840Z,1682109710.840 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-21T20:42:02.175Z,1682109722.175 [CBIT](IMPORTANT): Ground fault detected
mA:
CHAN A0 (Batt): -0.004191
CHAN A1 (24V): -0.036411
CHAN A2 (12V): -0.004843
CHAN A3 (5V): -0.002763
CHAN B0 (3.3V): 0.005476
CHAN B1 (3.15aV): -0.001064
CHAN B2 (3.15bV): -0.001265
CHAN B3 (GND): 0.013996
OPEN: 0.012507
Full Scale: +/- 1 mA
2023-04-21T21:14:25.845Z,1682111665.845 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-21T21:20:19.822Z,1682112019.822 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-21T22:42:02.442Z,1682116922.442 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-21T22:42:14.825Z,1682116934.825 [CBIT](IMPORTANT): No ground fault detected
mA:
CHAN A0 (Batt): -0.003523
CHAN A1 (24V): 0.003802
CHAN A2 (12V): -0.005141
CHAN A3 (5V): -0.003301
CHAN B0 (3.3V): -0.001343
CHAN B1 (3.15aV): -0.001465
CHAN B2 (3.15bV): -0.001484
CHAN B3 (GND): -0.001118
OPEN: 0.012313
Full Scale: +/- 1 mA
2023-04-21T22:49:04.013Z,1682117344.013 [sci2:NeedComms:D:A_Timeout:A](IMPORTANT): Comms timed out after 30.000000 min minutes
2023-04-21T23:17:30.033Z,1682119050.033 [RudderServo](FAULT): Rudder uart error - getPosition..serial timeout
2023-04-21T23:45:57.920Z,1682120757.920 [Radio_Surface](FAULT): LCB fault: LCB Watchdog Reset.
2023-04-22T00:24:33.155Z,1682123073.155 [sci2:NeedComms:D:A_Timeout:A](IMPORTANT): Comms timed out after 30.000000 min minutes
2023-04-22T00:26:27.976Z,1682123187.976 [ThrusterHE](FAULT): Could not get status:serial timeout
2023-04-22T00:42:14.984Z,1682124134.984 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-22T00:42:26.263Z,1682124146.263 [CBIT](IMPORTANT): No ground fault detected
mA:
CHAN A0 (Batt): -0.000828
CHAN A1 (24V): 0.004206
CHAN A2 (12V): -0.005231
CHAN A3 (5V): -0.003917
CHAN B0 (3.3V): -0.001135
CHAN B1 (3.15aV): -0.001372
CHAN B2 (3.15bV): -0.001406
CHAN B3 (GND): -0.000594
OPEN: 0.012516
Full Scale: +/- 1 mA
2023-04-22T00:58:59.568Z,1682125139.568 [Radio_Surface](FAULT): LCB fault: LCB Watchdog Reset.
2023-04-22T01:35:25.853Z,1682127325.853 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-22T01:37:31.018Z,1682127451.018 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=3390, MT Status=1, MTMSN=2609
2023-04-22T01:37:31.513Z,1682127451.513 [CommandExec](IMPORTANT): got command stop
2023-04-22T01:37:31.514Z,1682127451.514 [CommandExec](IMPORTANT): Scheduling is paused
2023-04-22T01:37:31.835Z,1682127451.835 [MissionManager](IMPORTANT): Started mission Default
2023-04-22T02:42:26.357Z,1682131346.357 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-22T02:42:36.997Z,1682131356.997 [CBIT](IMPORTANT): No ground fault detected
mA:
CHAN A0 (Batt): -0.003277
CHAN A1 (24V): 0.004055
CHAN A2 (12V): 0.001343
CHAN A3 (5V): -0.003023
CHAN B0 (3.3V): -0.003242
CHAN B1 (3.15aV): -0.000128
CHAN B2 (3.15bV): -0.001659
CHAN B3 (GND): -0.001081
OPEN: 0.012749
Full Scale: +/- 1 mA
2023-04-22T03:44:42.037Z,1682135082.037 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=3414, MT Status=1, MTMSN=2610
2023-04-22T03:44:42.834Z,1682135082.834 [CommandExec](IMPORTANT): got command load ./Missions/Science/sci2.tl
2023-04-22T03:44:42.836Z,1682135082.836 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file ./Missions/Science/sci2.tx
2023-04-22T03:44:44.764Z,1682135084.764 [CommandExec](IMPORTANT): Loaded ./Missions/Science/sci2.tl
2023-04-22T03:44:59.951Z,1682135099.951 [CommandExec](IMPORTANT): got command set sci2.MissionTimeout 10 hour
2023-04-22T03:44:59.952Z,1682135099.952 [CommandExec](IMPORTANT): got command set sci2.NeedCommsTime 45 minute
2023-04-22T03:44:59.953Z,1682135099.953 [CommandExec](IMPORTANT): got command set sci2.Lat1 36.81 degree
2023-04-22T03:44:59.953Z,1682135099.953 [CommandExec](IMPORTANT): got command set sci2.Lon1 -121.906 degree
2023-04-22T03:44:59.954Z,1682135099.954 [CommandExec](IMPORTANT): got command set sci2.Speed 0.8 meter_per_second
2023-04-22T03:44:59.955Z,1682135099.955 [CommandExec](IMPORTANT): got command set sci2.YoYoMaxDepth 45 meter
2023-04-22T03:44:59.955Z,1682135099.955 [CommandExec](IMPORTANT): got command set sci2.MaxDepth 50 meter
2023-04-22T03:44:59.956Z,1682135099.956 [CommandExec](IMPORTANT): got command run
2023-04-22T03:44:59.958Z,1682135099.958 [CommandExec](IMPORTANT): Running 
2023-04-22T03:45:00.049Z,1682135100.049 [MissionManager](IMPORTANT): Started mission sci2
2023-04-22T03:49:25.624Z,1682135365.624 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=3415, MT Status=1, MTMSN=2611
2023-04-22T03:49:26.148Z,1682135366.148 [CommandExec](IMPORTANT): got command ibit
2023-04-22T03:49:26.426Z,1682135366.426 [IBIT](IMPORTANT): Beginning Initiated BIT
2023-04-22T03:49:26.426Z,1682135366.426 [IBIT](IMPORTANT): Beginning control surface checks.
2023-04-22T03:49:26.430Z,1682135366.430 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-22T03:49:37.430Z,1682135377.430 [CBIT](IMPORTANT): No ground fault detected
mA:
CHAN A0 (Batt): -0.004649
CHAN A1 (24V): 0.003838
CHAN A2 (12V): -0.004792
CHAN A3 (5V): -0.003938
CHAN B0 (3.3V): -0.002284
CHAN B1 (3.15aV): -0.001591
CHAN B2 (3.15bV): -0.001455
CHAN B3 (GND): -0.001242
OPEN: 0.012092
Full Scale: +/- 1 mA
2023-04-22T03:50:15.481Z,1682135415.481 [IBIT](IMPORTANT): Communications Status:
Fix Status: 1
Iridium Signal Strength: 2
Latitude: 36.747219 Longitude: -121.939827
2023-04-22T03:50:16.151Z,1682135416.151 [IBIT](IMPORTANT): Battery Status:
Battery Charge (AH): 0.000000
Voltage: 14.113000
2023-04-22T03:50:16.152Z,1682135416.152 [IBIT](IMPORTANT): batteryCapacityThreshold: 50.000000 Ah
2023-04-22T03:50:16.152Z,1682135416.152 [IBIT](IMPORTANT): batteryVoltageThreshold: 13.700000 V
2023-04-22T03:50:16.297Z,1682135416.297 [IBIT](IMPORTANT): bitHumidityThreshold: 55.000000 %
2023-04-22T03:50:16.297Z,1682135416.297 [IBIT](IMPORTANT): bitPressureThreshold: 0.750000 psi
2023-04-22T03:50:16.308Z,1682135416.308 [IBIT](IMPORTANT): Pressure:9.179359 PSI
2023-04-22T03:50:16.309Z,1682135416.309 [IBIT](IMPORTANT): Humidity:3.332926 %
2023-04-22T03:50:18.693Z,1682135418.693 [IBIT](IMPORTANT): Vehicle Pitch:-3.199811 degrees
2023-04-22T03:50:18.693Z,1682135418.693 [IBIT](IMPORTANT): Vehicle  Roll:3.564900 degrees
2023-04-22T03:50:18.693Z,1682135418.693 [IBIT](IMPORTANT): Vehicle  Heading:322.128174 degrees
2023-04-22T03:50:18.822Z,1682135418.822 [IBIT](IMPORTANT): surfaceThreshold: 1.000000 m
2023-04-22T03:50:18.823Z,1682135418.823 [IBIT](IMPORTANT): buoyancyNeutral: 191.501740 cc
2023-04-22T03:50:18.824Z,1682135418.824 [IBIT](IMPORTANT): massDefault: 1.294477 cm
2023-04-22T03:50:18.824Z,1682135418.824 [IBIT](IMPORTANT): stopDepth: 60.000000 m
2023-04-22T03:50:18.825Z,1682135418.825 [IBIT](IMPORTANT): abortDepth: 250.000000 m
2023-04-22T03:50:18.825Z,1682135418.825 [IBIT](IMPORTANT): IBIT PASSED
2023-04-22T04:15:03.587Z,1682136903.587 [sci2:NeedComms:D:A_Timeout:A](IMPORTANT): Comms timed out after 30.000000 min minutes
2023-04-22T04:15:12.579Z,1682136912.579 [sci2:Lap:Wpt1:A.Waypoint](IMPORTANT): Navigating to waypoint: 36.810001,-121.905998
2023-04-22T05:08:07.734Z,1682140087.734 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-22T05:38:14.494Z,1682141894.494 [sci2:NeedComms:D:A_Timeout:A](IMPORTANT): Comms timed out after 30.000000 min minutes
2023-04-22T05:49:37.904Z,1682142577.904 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-22T05:49:48.791Z,1682142588.791 [CBIT](IMPORTANT): Ground fault detected
mA:
CHAN A0 (Batt): 0.109136
CHAN A1 (24V): 0.003882
CHAN A2 (12V): -0.005067
CHAN A3 (5V): -0.004023
CHAN B0 (3.3V): -0.001181
CHAN B1 (3.15aV): -0.000681
CHAN B2 (3.15bV): -0.001114
CHAN B3 (GND): 0.013178
OPEN: 0.012493
Full Scale: +/- 1 mA
2023-04-22T06:29:54.548Z,1682144994.548 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=3427, MT Status=1, MTMSN=2612
2023-04-22T06:29:55.051Z,1682144995.051 [CommandExec](IMPORTANT): got command schedule resume
2023-04-22T06:29:55.051Z,1682144995.051 [CommandExec](IMPORTANT): Scheduling is resumed
2023-04-22T06:31:23.582Z,1682145083.582 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=3428, MT Status=1, MTMSN=2613
2023-04-22T06:31:24.392Z,1682145084.392 [CommandExec](IMPORTANT): got command schedule "load Science/sci2.tl;set sci2.MissionTimeout 12 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 36.81 degree;set sci2.Lon1 -121.906 degree;set sci2.Speed 0.8 m/s;set sci2.YoYoMaxDepth 45 m;set sci2.MaxDepth 50 m;run"
2023-04-22T06:31:24.393Z,1682145084.393 [CommandExec](IMPORTANT): Scheduled #14: "load Science/sci2.tl;set sci2.MissionTimeout 12 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 36.81 degree;set sci2.Lon1 -121.906 degree;set sci2.Speed 0.8 m/s;set sci2.YoYoMaxDepth 45 m;set sci2.MaxDepth 50 m;run", AFTER MISSION
2023-04-22T06:31:39.819Z,1682145099.819 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=3429, MT Status=1, MTMSN=2614
2023-04-22T06:31:40.419Z,1682145100.419 [CommandExec](IMPORTANT): got command schedule clear
2023-04-22T06:31:40.419Z,1682145100.419 [CommandExec](IMPORTANT): Cleared 1 scheduled commands.
2023-04-22T06:31:40.420Z,1682145100.420 [CommandExec](IMPORTANT): got command schedule resume
2023-04-22T06:33:20.786Z,1682145200.786 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=3430, MT Status=1, MTMSN=2615
2023-04-22T06:33:21.514Z,1682145201.514 [CommandExec](IMPORTANT): got command schedule "load Science/profile_station.xml;set profile_station.MissionTimeout 12 h;set profile_station.NeedCommsTime 45 min;set profile_station.Lat 36.81 degree;set profile_station.Lon -121.906 degree;set profile_station.YoYoMaxDepth 30 m;run"
2023-04-22T06:33:21.515Z,1682145201.515 [CommandExec](IMPORTANT): Scheduled #15: "load Science/profile_station.xml;set profile_station.MissionTimeout 12 h;set profile_station.NeedCommsTime 45 min;set profile_station.Lat 36.81 degree;set profile_station.Lon -121.906 degree;set profile_station.YoYoMaxDepth 30 m;run", AFTER MISSION
2023-04-22T07:40:29.813Z,1682149229.813 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-22T07:46:15.986Z,1682149575.986 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-22T07:49:48.796Z,1682149788.796 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-22T07:49:59.536Z,1682149799.536 [CBIT](IMPORTANT): Ground fault detected
mA:
CHAN A0 (Batt): 0.021618
CHAN A1 (24V): 0.004859
CHAN A2 (12V): -0.004513
CHAN A3 (5V): -0.004119
CHAN B0 (3.3V): -0.001984
CHAN B1 (3.15aV): -0.001125
CHAN B2 (3.15bV): -0.001231
CHAN B3 (GND): -0.078619
OPEN: 0.012663
Full Scale: +/- 1 mA
2023-04-22T08:26:59.475Z,1682152019.475 [sci2:Lap:Wpt1:A.Waypoint](IMPORTANT): Reached waypoint: 36.810001,-121.905998
2023-04-22T08:27:02.075Z,1682152022.075 [CommandExec](IMPORTANT): got command load ./Missions/Science/profile_station.xml
2023-04-22T08:27:02.625Z,1682152022.625 [WetLabsBB2FL](FAULT): LCB fault: LCB Watchdog Reset. Invalid Command.
2023-04-22T08:27:04.130Z,1682152024.130 [CommandExec](IMPORTANT): Loaded ./Missions/Science/profile_station.xml
2023-04-22T08:27:04.360Z,1682152024.360 [MissionManager](IMPORTANT): Started mission Default
2023-04-22T08:27:26.846Z,1682152046.846 [CommandExec](IMPORTANT): got command set profile_station.MissionTimeout 12 hour
2023-04-22T08:27:26.847Z,1682152046.847 [CommandExec](IMPORTANT): got command set profile_station.NeedCommsTime 45 minute
2023-04-22T08:27:26.847Z,1682152046.847 [CommandExec](IMPORTANT): got command set profile_station.Lat 36.81 degree
2023-04-22T08:27:26.848Z,1682152046.848 [CommandExec](IMPORTANT): got command set profile_station.Lon -121.906 degree
2023-04-22T08:27:26.849Z,1682152046.849 [CommandExec](IMPORTANT): got command set profile_station.YoYoMaxDepth 30 meter
2023-04-22T08:27:26.849Z,1682152046.849 [CommandExec](IMPORTANT): got command run
2023-04-22T08:27:26.852Z,1682152046.852 [CommandExec](IMPORTANT): Running 
2023-04-22T08:27:26.957Z,1682152046.957 [MissionManager](IMPORTANT): Started mission profile_station
2023-04-22T08:33:31.764Z,1682152411.764 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-22T08:39:26.044Z,1682152766.044 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-22T08:42:44.792Z,1682152964.792 [DVL_micro](FAULT): Failed to initialize within timeout.
2023-04-22T09:49:59.888Z,1682156999.888 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-22T09:50:11.148Z,1682157011.148 [CBIT](IMPORTANT): No ground fault detected
mA:
CHAN A0 (Batt): -0.004363
CHAN A1 (24V): 0.003067
CHAN A2 (12V): 0.004473
CHAN A3 (5V): -0.002898
CHAN B0 (3.3V): -0.001800
CHAN B1 (3.15aV): 0.000405
CHAN B2 (3.15bV): -0.000681
CHAN B3 (GND): -0.000492
OPEN: 0.008814
Full Scale: +/- 1 mA
2023-04-22T10:19:33.976Z,1682158773.976 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-22T10:25:27.001Z,1682159127.001 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-22T10:49:32.221Z,1682160572.221 [ElevatorServo](FAULT): Reading outside of valid range:0.000000

2023-04-22T10:49:32.884Z,1682160572.884 [ElevatorServo](FAULT): Elevator uart error - getPosition.serial timeout
2023-04-22T11:12:20.984Z,1682161940.984 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-22T11:18:09.775Z,1682162289.775 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-22T11:50:11.356Z,1682164211.356 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-22T11:50:22.283Z,1682164222.283 [CBIT](IMPORTANT): No ground fault detected
mA:
CHAN A0 (Batt): -0.002768
CHAN A1 (24V): 0.003437
CHAN A2 (12V): -0.004929
CHAN A3 (5V): -0.003375
CHAN B0 (3.3V): -0.001838
CHAN B1 (3.15aV): -0.000790
CHAN B2 (3.15bV): -0.001264
CHAN B3 (GND): 0.007512
OPEN: 0.012430
Full Scale: +/- 1 mA
2023-04-22T12:04:59.675Z,1682165099.675 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-22T12:13:03.052Z,1682165583.052 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-22T12:51:54.884Z,1682167914.884 [Radio_Surface](FAULT): LCB fault: LCB Watchdog Reset.
2023-04-22T12:59:38.873Z,1682168378.873 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-22T13:05:27.043Z,1682168727.043 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-22T13:11:46.100Z,1682169106.100 [ThrusterHE](FAULT): Could not get status:serial timeout
2023-04-22T13:40:59.208Z,1682170859.208 [Radio_Surface](FAULT): LCB fault: LCB Watchdog Reset.
2023-04-22T13:50:22.314Z,1682171422.314 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-22T13:50:34.957Z,1682171434.957 [CBIT](IMPORTANT): No ground fault detected
mA:
CHAN A0 (Batt): -0.006111
CHAN A1 (24V): 0.003394
CHAN A2 (12V): -0.004745
CHAN A3 (5V): -0.009291
CHAN B0 (3.3V): 0.000944
CHAN B1 (3.15aV): -0.000896
CHAN B2 (3.15bV): -0.001353
CHAN B3 (GND): 0.023374
OPEN: 0.012534
Full Scale: +/- 1 mA
2023-04-22T14:43:06.751Z,1682174586.751 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-22T15:13:08.173Z,1682176388.173 [profile_station:NeedComms:D:A_Timeout:A](IMPORTANT): Comms timed out after 30.000000 min minutes
2023-04-22T15:14:21.972Z,1682176461.972 [ThrusterHE](FAULT): getSpeed error serial timeout
2023-04-22T15:14:21.972Z,1682176461.972 [ThrusterHE](FAULT): Thruster uart error: serial timeout
2023-04-22T15:41:19.421Z,1682178079.421 [RudderServo](FAULT): Rudder uart error - getPosition..serial timeout
2023-04-22T15:50:35.019Z,1682178635.019 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-22T15:50:45.807Z,1682178645.807 [CBIT](IMPORTANT): Ground fault detected
mA:
CHAN A0 (Batt): -0.004287
CHAN A1 (24V): 0.003334
CHAN A2 (12V): -0.004970
CHAN A3 (5V): -0.057516
CHAN B0 (3.3V): -0.001963
CHAN B1 (3.15aV): -0.001437
CHAN B2 (3.15bV): 0.012055
CHAN B3 (GND): 0.000726
OPEN: 0.012022
Full Scale: +/- 1 mA
2023-04-22T16:03:18.901Z,1682179398.901 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=3446, MT Status=1, MTMSN=2616
2023-04-22T16:03:19.457Z,1682179399.457 [CommandExec](IMPORTANT): got command stop
2023-04-22T16:03:19.457Z,1682179399.457 [CommandExec](IMPORTANT): Scheduling is paused
2023-04-22T16:03:20.168Z,1682179400.168 [MissionManager](IMPORTANT): Started mission Default
2023-04-22T16:09:02.719Z,1682179742.719 [DataOverHttps](IMPORTANT): SBD MTMSN=20230422T160857
2023-04-22T16:09:10.224Z,1682179750.224 [CommandExec](IMPORTANT): got command schedule asap "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h" 3l0uo 1 4.000000
2023-04-22T16:09:10.224Z,1682179750.224 [CommandExec](IMPORTANT): Scheduling command #1 of 4 with id=3l0uo
2023-04-22T16:09:10.225Z,1682179750.225 [CommandExec](IMPORTANT): Scheduled #16 (#1 of 4 with id='3l0uo'): "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h", ASAP
2023-04-22T16:09:11.210Z,1682179751.210 [DataOverHttps](IMPORTANT): SBD MTMSN=20230422T160905
2023-04-22T16:09:18.892Z,1682179758.892 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.SendSampleStatusAndData 0 bool;set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m" 3l0uo 2 4.000000
2023-04-22T16:09:18.893Z,1682179758.893 [CommandExec](IMPORTANT): Scheduling command #2 of 4 with id=3l0uo
2023-04-22T16:09:18.894Z,1682179758.894 [CommandExec](IMPORTANT): Scheduled #17 (#2 of 4 with id='3l0uo'): "set IsothermDepthSampling.SendSampleStatusAndData 0 bool;set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m", ASAP
2023-04-22T16:09:19.806Z,1682179759.806 [DataOverHttps](IMPORTANT): SBD MTMSN=20230422T160914
2023-04-22T16:09:27.656Z,1682179767.656 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.DeepBoundChl 25 m;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min" 3l0uo 3 4.000000
2023-04-22T16:09:27.656Z,1682179767.656 [CommandExec](IMPORTANT): Scheduling command #3 of 4 with id=3l0uo
2023-04-22T16:09:27.657Z,1682179767.657 [CommandExec](IMPORTANT): Scheduled #18 (#3 of 4 with id='3l0uo'): "set IsothermDepthSampling.DeepBoundChl 25 m;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min", ASAP
2023-04-22T16:09:28.582Z,1682179768.582 [DataOverHttps](IMPORTANT): SBD MTMSN=20230422T160923
2023-04-22T16:09:36.091Z,1682179776.091 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.RiseFromTurningDepth 6.0 m;set IsothermDepthSampling.DepChangeThreshAttitudeFlip 4.0 m;run" 3l0uo 4 4.000000
2023-04-22T16:09:36.091Z,1682179776.091 [CommandExec](IMPORTANT): Scheduling command #4 of 4 with id=3l0uo
2023-04-22T16:09:36.100Z,1682179776.100 [CommandExec](IMPORTANT): Scheduled #19 (#4 of 4 with id='3l0uo'): "set IsothermDepthSampling.RiseFromTurningDepth 6.0 m;set IsothermDepthSampling.DepChangeThreshAttitudeFlip 4.0 m;run", ASAP
2023-04-22T16:09:36.236Z,1682179776.236 [CommandExec](IMPORTANT): got command load ./Missions/Science/isotherm_depth_sampling.xml
2023-04-22T16:10:00.561Z,1682179800.561 [CommandExec](IMPORTANT): Loaded ./Missions/Science/isotherm_depth_sampling.xml
2023-04-22T16:10:20.919Z,1682179820.919 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.NumSamplers 2 count
2023-04-22T16:10:20.920Z,1682179820.920 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MissionTimeout 6 hour
2023-04-22T16:10:20.920Z,1682179820.920 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNoFiring 1 hour
2023-04-22T16:10:59.370Z,1682179859.370 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendSampleStatusAndData 0 bool
2023-04-22T16:10:59.370Z,1682179859.370 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendDataToMultipleModems 0 bool
2023-04-22T16:10:59.371Z,1682179859.371 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SampleAtPeakChl 1 bool
2023-04-22T16:10:59.372Z,1682179859.372 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 3 meter
2023-04-22T16:11:27.691Z,1682179887.691 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 25 meter
2023-04-22T16:11:27.692Z,1682179887.692 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType2 -10 count
2023-04-22T16:11:27.692Z,1682179887.692 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 meter
2023-04-22T16:11:27.693Z,1682179887.693 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 10 minute
2023-04-22T16:11:53.579Z,1682179913.579 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.RiseFromTurningDepth 6.0 meter
2023-04-22T16:11:53.588Z,1682179913.588 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepChangeThreshAttitudeFlip 4.0 meter
2023-04-22T16:11:53.589Z,1682179913.589 [CommandExec](IMPORTANT): got command run
2023-04-22T16:11:53.592Z,1682179913.592 [CommandExec](IMPORTANT): Running 
2023-04-22T16:11:53.823Z,1682179913.823 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling
2023-04-22T16:11:53.944Z,1682179913.944 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 240.00 hours.
2023-04-22T16:13:36.993Z,1682180016.993 [IsothermDepthSampling:StayAwayFromWallsAndShore:FarEnoughFromWallsAndShore:A](IMPORTANT): Far enough from walls and shore. Latitude = 36.815474 arcdeg , longitude = -121.902421 arcdeg . Distance from shore = 8946.892578 m . OffshoreDistanceTurnBack (MinOffshore + MarginMinOffshore) = 2000.000000 m + 100.000000 m . Shortest distance nan m to side 0 count . MinDistFromPolygonSides = 200.000000 m .
2023-04-22T16:13:38.997Z,1682180018.997 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.102534 m 
2023-04-22T16:14:48.499Z,1682180088.499 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , nan K , 0.000000 m , nan degC , nan m , 10.000000 min .
2023-04-22T16:18:24.245Z,1682180304.245 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoUp:B](IMPORTANT): Go up from 28.077475 m 
2023-04-22T16:18:33.886Z,1682180313.886 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-22T16:20:13.321Z,1682180413.321 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:SetChlPeakTempDepth:L](IMPORTANT): Set peak-chl depth and temp. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlTemperatureSet, PeakChlSet = 21.809450 m , 2.329600 ug/l , 5.330367 m , 11.188741 degC , 11.755119 ug/l 
2023-04-22T16:20:13.710Z,1682180413.710 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 1.000000 count . Target depth = 5.330367 m .
2023-04-22T16:20:14.100Z,1682180414.100 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -6.000000 count 
2023-04-22T16:24:03.587Z,1682180643.587 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 5.279860 m , settling for 10.000000 min 
2023-04-22T16:34:16.572Z,1682181256.572 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2023-04-22T16:34:17.077Z,1682181257.077 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2023-04-22T16:35:10.217Z,1682181310.217 [ESPComponent](IMPORTANT): ESP has connected as client
2023-04-22T16:35:11.034Z,1682181311.034 [ESPComponent](IMPORTANT): [sample #6] Setting cartridge argument to -6
2023-04-22T16:35:11.034Z,1682181311.034 [ESPComponent](IMPORTANT): [sample #6] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2023-04-22T16:35:11.519Z,1682181311.519 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 5.399228 m in 11.184076 degC water with 12.039040 ug/l chlorophyll fluorescence.
2023-04-22T16:35:11.834Z,1682181311.834 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PREPARING_SHOW_LOG
2023-04-22T16:35:12.238Z,1682181312.238 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PREPARING_SHOW_STATUS
2023-04-22T16:35:14.257Z,1682181314.257 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_LOADING_CARTRIDGE
2023-04-22T16:35:51.097Z,1682181351.097 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PRIMING (@10,archive_bac)
2023-04-22T16:35:53.926Z,1682181353.926 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PRIMING (@100.0)
2023-04-22T16:35:53.927Z,1682181353.927 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering
2023-04-22T16:35:54.330Z,1682181354.330 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2023-04-22T16:38:11.690Z,1682181491.690 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_FILTERING (@0.0)
2023-04-22T16:38:12.096Z,1682181492.096 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2023-04-22T16:50:33.070Z,1682182233.070 [DVL_micro](FAULT): Failed to initialize within timeout.
2023-04-22T17:39:57.729Z,1682185197.729 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PAUSED (@1000.0)
2023-04-22T17:39:58.131Z,1682185198.131 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PROCESSING (@1000.0)
2023-04-22T17:40:00.154Z,1682185200.154 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing
2023-04-22T17:40:00.553Z,1682185200.553 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PROCESSED (@10,archive_bac)
2023-04-22T17:50:45.915Z,1682185845.915 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-22T17:50:56.810Z,1682185856.810 [CBIT](IMPORTANT): Ground fault detected
mA:
CHAN A0 (Batt): 0.152660
CHAN A1 (24V): 0.264735
CHAN A2 (12V): 0.091083
CHAN A3 (5V): 0.018574
CHAN B0 (3.3V): 0.016876
CHAN B1 (3.15aV): 0.009460
CHAN B2 (3.15bV): 0.008920
CHAN B3 (GND): -0.009109
OPEN: 0.015099
Full Scale: +/- 1 mA
2023-04-22T17:52:04.939Z,1682185924.939 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_STOPPING (@10,archive_bac)
2023-04-22T17:52:15.038Z,1682185935.038 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2023-04-22T17:52:15.442Z,1682185935.442 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_STOPPED
2023-04-22T17:57:15.215Z,1682186235.215 [ESPComponent](IMPORTANT): [sample #6] ESP sampling sequence completed normally.
2023-04-22T17:57:16.100Z,1682186236.100 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 1.000000 count completed.
2023-04-22T17:57:32.697Z,1682186252.697 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -10.000000 count , nan K , 0.000000 m , nan degC , nan m , 5.000000 min .
2023-04-22T17:57:36.346Z,1682186256.346 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 2.000000 count . Target depth = 5.330367 m .
2023-04-22T17:57:36.716Z,1682186256.716 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -10.000000 count 
2023-04-22T17:58:36.093Z,1682186316.093 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 5.377236 m , settling for 5.000000 min 
2023-04-22T18:03:48.841Z,1682186628.841 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2023-04-22T18:03:48.969Z,1682186628.969 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2023-04-22T18:04:40.916Z,1682186680.916 [ESPComponent](IMPORTANT): ESP has connected as client
2023-04-22T18:04:41.733Z,1682186681.733 [ESPComponent](IMPORTANT): [sample #7] Setting cartridge argument to -10
2023-04-22T18:04:41.734Z,1682186681.734 [ESPComponent](IMPORTANT): [sample #7] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2023-04-22T18:04:42.224Z,1682186682.224 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 5.589047 m in 11.158106 degC water with 13.650000 ug/l chlorophyll fluorescence.
2023-04-22T18:04:42.534Z,1682186682.534 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PREPARING_SHOW_LOG
2023-04-22T18:04:42.939Z,1682186682.939 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PREPARING_SHOW_STATUS
2023-04-22T18:04:44.957Z,1682186684.957 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_LOADING_CARTRIDGE
2023-04-22T18:05:22.601Z,1682186722.601 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PRIMING (@19,daSPR_phyto)
2023-04-22T18:05:25.025Z,1682186725.025 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PRIMING (@100.0)
2023-04-22T18:05:25.025Z,1682186725.025 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering
2023-04-22T18:05:25.426Z,1682186725.426 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2023-04-22T18:07:46.018Z,1682186866.018 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_FILTERING (@0.0)
2023-04-22T18:07:46.422Z,1682186866.422 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2023-04-22T19:09:29.666Z,1682190569.666 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PAUSED (@1000.0)
2023-04-22T19:09:30.070Z,1682190570.070 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PROCESSING (@1000.0)
2023-04-22T19:09:32.090Z,1682190572.090 [ESPComponent](IMPORTANT): Processing timeoutMinutes=120.000000 issuedCmd_=Cmd.startProcessing
2023-04-22T19:09:32.494Z,1682190572.494 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PROCESSED (@19,daSPR_phyto)
2023-04-22T19:50:56.895Z,1682193056.895 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-22T19:51:07.851Z,1682193067.851 [CBIT](IMPORTANT): Ground fault detected
mA:
CHAN A0 (Batt): 0.345389
CHAN A1 (24V): 0.446994
CHAN A2 (12V): 0.170251
CHAN A3 (5V): 0.047862
CHAN B0 (3.3V): 0.034935
CHAN B1 (3.15aV): 0.029418
CHAN B2 (3.15bV): 0.029991
CHAN B3 (GND): -0.008538
OPEN: 0.012457
Full Scale: +/- 1 mA
2023-04-22T20:04:18.718Z,1682193858.718 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_STOPPING (@19,daSPR_phyto)
2023-04-22T20:04:30.032Z,1682193870.032 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2023-04-22T20:04:30.475Z,1682193870.475 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_STOPPED
2023-04-22T20:09:30.249Z,1682194170.249 [ESPComponent](IMPORTANT): [sample #7] ESP sampling sequence completed normally.
2023-04-22T20:09:31.145Z,1682194171.145 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 2.000000 count completed.
2023-04-22T20:09:34.087Z,1682194174.087 [MissionManager](IMPORTANT): Started mission Default
2023-04-22T20:15:00.780Z,1682194500.780 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2023-04-22T20:20:43.858Z,1682194843.858 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.155922 min 
2023-04-22T20:20:45.445Z,1682194845.445 [NAL9602](FAULT): GPS failed to acquire within timeout.
2023-04-22T20:21:25.802Z,1682194885.802 [DataOverHttps](IMPORTANT): SBD MTMSN=20230422T202120