2023-04-24T06:27:54.057Z,1682317674.057 [CommandExec](IMPORTANT): got command restart logs
2023-04-24T06:34:47.631Z,1682318087.631 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=16638, MT Status=1, MTMSN=1212
2023-04-24T06:34:48.453Z,1682318088.453 [CommandExec](IMPORTANT): got command schedule asap "load Science/front_sampling.xml;set FrontSampling.NumSamplers 2 count;set FrontSampling.MissionTimeout 36 h;set FrontSampling.MaxDepth 60 m;set FrontSampling.RepeatTransects 2 count;set FrontSampling.FrontAutonomousDetection 0 bool" 3nzjj 1 6.000000
2023-04-24T06:34:48.454Z,1682318088.454 [CommandExec](IMPORTANT): Scheduling command #1 of 6 with id=3nzjj
2023-04-24T06:34:48.455Z,1682318088.455 [CommandExec](IMPORTANT): Scheduled #15 (#1 of 6 with id='3nzjj'): "load Science/front_sampling.xml;set FrontSampling.NumSamplers 2 count;set FrontSampling.MissionTimeout 36 h;set FrontSampling.MaxDepth 60 m;set FrontSampling.RepeatTransects 2 count;set FrontSampling.FrontAutonomousDetection 0 bool", ASAP
2023-04-24T06:35:18.590Z,1682318118.590 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=16639, MT Status=1, MTMSN=1213
2023-04-24T06:35:19.396Z,1682318119.396 [CommandExec](IMPORTANT): got command schedule asap "set FrontSampling.LonFrontMinDesignated -122.671 degree;set FrontSampling.LonFrontMaxDesignated -122.67 degree;set FrontSampling.Lat1 36.66 degree;set FrontSampling.Lon1 -122.668 degree;set FrontSampling.Lat2 36.64 degree" 3nzjj 2 6.000000
2023-04-24T06:35:19.397Z,1682318119.397 [CommandExec](IMPORTANT): Scheduling command #2 of 6 with id=3nzjj
2023-04-24T06:35:19.398Z,1682318119.398 [CommandExec](IMPORTANT): Scheduled #16 (#2 of 6 with id='3nzjj'): "set FrontSampling.LonFrontMinDesignated -122.671 degree;set FrontSampling.LonFrontMaxDesignated -122.67 degree;set FrontSampling.Lat1 36.66 degree;set FrontSampling.Lon1 -122.668 degree;set FrontSampling.Lat2 36.64 degree", ASAP
2023-04-24T06:35:49.113Z,1682318149.113 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=16640, MT Status=1, MTMSN=1214
2023-04-24T06:35:49.925Z,1682318149.925 [CommandExec](IMPORTANT): got command schedule asap "set FrontSampling.Lon2 -122.67 degree;set FrontSampling.LatUpwellingEnd 36.64 degree;set FrontSampling.LonUpwellingEnd -122.67 degree;set FrontSampling.DeltaLatUpwellingSide1 -0.01 degree" 3nzjj 3 6.000000
2023-04-24T06:35:49.925Z,1682318149.925 [CommandExec](IMPORTANT): Scheduling command #3 of 6 with id=3nzjj
2023-04-24T06:35:49.926Z,1682318149.926 [CommandExec](IMPORTANT): Scheduled #17 (#3 of 6 with id='3nzjj'): "set FrontSampling.Lon2 -122.67 degree;set FrontSampling.LatUpwellingEnd 36.64 degree;set FrontSampling.LonUpwellingEnd -122.67 degree;set FrontSampling.DeltaLatUpwellingSide1 -0.01 degree", ASAP
2023-04-24T06:36:29.831Z,1682318189.831 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=16641, MT Status=1, MTMSN=1215
2023-04-24T06:36:30.645Z,1682318190.645 [CommandExec](IMPORTANT): got command schedule asap "set FrontSampling.DeltaLonUpwellingSide1 0 degree;set FrontSampling.LatStratifiedEnd 36.64501 degree;set FrontSampling.LonStratifiedEnd -122.01862 degree;set FrontSampling.SpeedTransit 1.1 m/s;set FrontSampling.ShallowBoundChl 3 m" 3nzjj 4 6.000000
2023-04-24T06:36:30.645Z,1682318190.645 [CommandExec](IMPORTANT): Scheduling command #4 of 6 with id=3nzjj
2023-04-24T06:36:30.646Z,1682318190.646 [CommandExec](IMPORTANT): Scheduled #18 (#4 of 6 with id='3nzjj'): "set FrontSampling.DeltaLonUpwellingSide1 0 degree;set FrontSampling.LatStratifiedEnd 36.64501 degree;set FrontSampling.LonStratifiedEnd -122.01862 degree;set FrontSampling.SpeedTransit 1.1 m/s;set FrontSampling.ShallowBoundChl 3 m", ASAP
2023-04-24T06:37:02.763Z,1682318222.763 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=16642, MT Status=1, MTMSN=1216
2023-04-24T06:37:03.568Z,1682318223.568 [CommandExec](IMPORTANT): got command schedule asap "set FrontSampling.DeepBoundChl 25 m;set FrontSampling.YoYoMinDepth 2 m;set FrontSampling.YoYoMaxDepth 50 m;set FrontSampling.WaitDepthUndulation 5 min;set FrontSampling.RiseFromTurningDepth 4 m" 3nzjj 5 6.000000
2023-04-24T06:37:03.569Z,1682318223.569 [CommandExec](IMPORTANT): Scheduling command #5 of 6 with id=3nzjj
2023-04-24T06:37:03.570Z,1682318223.570 [CommandExec](IMPORTANT): Scheduled #19 (#5 of 6 with id='3nzjj'): "set FrontSampling.DeepBoundChl 25 m;set FrontSampling.YoYoMinDepth 2 m;set FrontSampling.YoYoMaxDepth 50 m;set FrontSampling.WaitDepthUndulation 5 min;set FrontSampling.RiseFromTurningDepth 4 m", ASAP
2023-04-24T06:37:14.188Z,1682318234.188 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=16643, MT Status=1, MTMSN=1217
2023-04-24T06:37:14.811Z,1682318234.811 [CommandExec](IMPORTANT): got command schedule asap "set FrontSampling.DepChangeThreshAttitudeFlip 3 m;run" 3nzjj 6 6.000000
2023-04-24T06:37:14.811Z,1682318234.811 [CommandExec](IMPORTANT): Scheduling command #6 of 6 with id=3nzjj
2023-04-24T06:37:14.812Z,1682318234.812 [CommandExec](IMPORTANT): Scheduled #20 (#6 of 6 with id='3nzjj'): "set FrontSampling.DepChangeThreshAttitudeFlip 3 m;run", ASAP
2023-04-24T06:37:14.941Z,1682318234.941 [CommandExec](IMPORTANT): got command load ./Missions/Science/front_sampling.xml
2023-04-24T06:37:20.870Z,1682318240.870 [CommandExec](IMPORTANT): Loaded ./Missions/Science/front_sampling.xml
2023-04-24T06:37:38.812Z,1682318258.812 [CommandExec](IMPORTANT): got command set FrontSampling.NumSamplers 2 count
2023-04-24T06:37:38.813Z,1682318258.813 [CommandExec](IMPORTANT): got command set FrontSampling.MissionTimeout 36 hour
2023-04-24T06:37:38.814Z,1682318258.814 [CommandExec](IMPORTANT): got command set FrontSampling.MaxDepth 60 meter
2023-04-24T06:37:38.814Z,1682318258.814 [CommandExec](IMPORTANT): got command set FrontSampling.RepeatTransects 2 count
2023-04-24T06:37:38.815Z,1682318258.815 [CommandExec](IMPORTANT): got command set FrontSampling.FrontAutonomousDetection 0 bool
2023-04-24T06:37:53.982Z,1682318273.982 [CommandExec](IMPORTANT): got command set FrontSampling.LonFrontMinDesignated -122.671 degree
2023-04-24T06:37:53.983Z,1682318273.983 [CommandExec](IMPORTANT): got command set FrontSampling.LonFrontMaxDesignated -122.67 degree
2023-04-24T06:37:54.016Z,1682318274.016 [CommandExec](IMPORTANT): got command set FrontSampling.Lat1 36.66 degree
2023-04-24T06:37:54.017Z,1682318274.017 [CommandExec](IMPORTANT): got command set FrontSampling.Lon1 -122.668 degree
2023-04-24T06:37:54.017Z,1682318274.017 [CommandExec](IMPORTANT): got command set FrontSampling.Lat2 36.64 degree
2023-04-24T06:38:07.368Z,1682318287.368 [CommandExec](IMPORTANT): got command set FrontSampling.Lon2 -122.67 degree
2023-04-24T06:38:07.369Z,1682318287.369 [CommandExec](IMPORTANT): got command set FrontSampling.LatUpwellingEnd 36.64 degree
2023-04-24T06:38:07.369Z,1682318287.369 [CommandExec](IMPORTANT): got command set FrontSampling.LonUpwellingEnd -122.67 degree
2023-04-24T06:38:07.370Z,1682318287.370 [CommandExec](IMPORTANT): got command set FrontSampling.DeltaLatUpwellingSide1 -0.01 degree
2023-04-24T06:38:25.490Z,1682318305.490 [CommandExec](IMPORTANT): got command set FrontSampling.DeltaLonUpwellingSide1 0 degree
2023-04-24T06:38:25.492Z,1682318305.492 [CommandExec](IMPORTANT): got command set FrontSampling.LatStratifiedEnd 36.64501 degree
2023-04-24T06:38:25.493Z,1682318305.493 [CommandExec](IMPORTANT): got command set FrontSampling.LonStratifiedEnd -122.01862 degree
2023-04-24T06:38:25.494Z,1682318305.494 [CommandExec](IMPORTANT): got command set FrontSampling.SpeedTransit 1.1 meter_per_second
2023-04-24T06:38:25.494Z,1682318305.494 [CommandExec](IMPORTANT): got command set FrontSampling.ShallowBoundChl 3 meter
2023-04-24T06:38:43.332Z,1682318323.332 [CommandExec](IMPORTANT): got command set FrontSampling.DeepBoundChl 25 meter
2023-04-24T06:38:43.342Z,1682318323.342 [CommandExec](IMPORTANT): got command set FrontSampling.YoYoMinDepth 2 meter
2023-04-24T06:38:43.343Z,1682318323.343 [CommandExec](IMPORTANT): got command set FrontSampling.YoYoMaxDepth 50 meter
2023-04-24T06:38:43.348Z,1682318323.348 [CommandExec](IMPORTANT): got command set FrontSampling.WaitDepthUndulation 5 minute
2023-04-24T06:38:43.349Z,1682318323.349 [CommandExec](IMPORTANT): got command set FrontSampling.RiseFromTurningDepth 4 meter
2023-04-24T06:38:48.245Z,1682318328.245 [CommandExec](IMPORTANT): got command set FrontSampling.DepChangeThreshAttitudeFlip 3 meter
2023-04-24T06:38:48.245Z,1682318328.245 [CommandExec](IMPORTANT): got command run
2023-04-24T06:38:48.247Z,1682318328.247 [CommandExec](IMPORTANT): Running 
2023-04-24T06:38:48.408Z,1682318328.408 [MissionManager](IMPORTANT): Started mission FrontSampling
2023-04-24T06:41:03.117Z,1682318463.117 [NAL9602](FAULT): Verify xmit timeout failure.
2023-04-24T06:55:01.238Z,1682319301.238 [FrontSampling:BackAndForth:Waypoints:SampleFrontFirstPass:Wpt1:A.Waypoint](IMPORTANT): Navigating to waypoint: 36.660000,-122.667999
2023-04-24T06:55:06.452Z,1682319306.452 [FrontSampling:CrossFrontFromStratifiedToUpwelling:P](IMPORTANT): Crossed the front from stratified to upwelling. VTHI = 0.009882 degC . VSHI = 0.006924 psu . Front latitude, longitude = 36.646222 arcdeg , -122.679001 arcdeg . Lat1, Lon1 = 36.636222 arcdeg , -122.679001 arcdeg . Lat2, Lon2 = nan arcdeg , nan arcdeg . Lat3, Lon3 = nan arcdeg , nan arcdeg . Lat4, Lon4 = nan arcdeg , nan arcdeg . Lat5, Lon5 = 36.639999 arcdeg , -122.669998 arcdeg . Lat6, Lon6 = 36.645012 arcdeg , -122.018623 arcdeg . Sample count = 1.000000 count .
2023-04-24T06:55:09.852Z,1682319309.852 [FrontSampling:BackAndForth:Waypoints:SampleFrontNotFirstPass:Wpt5:A.Waypoint](IMPORTANT): Navigating to waypoint: 36.639999,-122.669998
2023-04-24T06:55:11.051Z,1682319311.051 [FrontSampling:BackAndForth:Waypoints:SampleFrontFirstPass:Wpt1:A.Waypoint](IMPORTANT): Navigating to waypoint: 36.636222,-122.679001
2023-04-24T06:55:11.450Z,1682319311.450 [FrontSampling:BackAndForth:Waypoints:SampleFrontNotFirstPass:Wpt5:A.Waypoint](IMPORTANT): Navigating to waypoint: 36.639999,-122.669998
2023-04-24T06:55:11.852Z,1682319311.852 [FrontSampling:BackAndForth:Waypoints:SampleFrontNotFirstPass:Wpt1:A.Waypoint](IMPORTANT): Navigating to waypoint: 36.636222,-122.679001
2023-04-24T06:55:13.489Z,1682319313.489 [FrontSampling:FindPeakChlVerticalAndSample:FindPeakTakeSample:LogGoDown:B](IMPORTANT): Go down from 0.241276 m 
2023-04-24T06:59:31.254Z,1682319571.254 [FrontSampling:FindPeakChlVerticalAndSample:FindPeakTakeSample:LogGoUp:B](IMPORTANT): Go up from 28.171604 m 
2023-04-24T07:00:32.673Z,1682319632.673 [FrontSampling:FindPeakChlVerticalAndSample:FindPeakTakeSample:SetChlPeakDepth:J](IMPORTANT): Set peak-chl depth. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlSet = 22.586191 m , 4.210800 ug/l , 3.173112 m , 4.749040 ug/l 
2023-04-24T07:00:36.273Z,1682319636.273 [FrontSampling:FindPeakChlVerticalAndSample:FindPeakTakeSample:FiringOnDepth:E](IMPORTANT): Taking sample No. 1.000000 count . Latitude, longitude = 36.646721 arcdeg , -122.679091 arcdeg . Target depth = 3.173112 m .
2023-04-24T07:00:36.677Z,1682319636.677 [FrontSampling:FindPeakChlVerticalAndSample:FindPeakTakeSample:FiringOnDepth:F](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 
2023-04-24T07:01:44.184Z,1682319704.184 [FrontSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 3.066938 m , settling for 5.000000 min 
2023-04-24T07:06:56.937Z,1682320016.937 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2023-04-24T07:06:57.128Z,1682320017.128 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2023-04-24T07:07:50.199Z,1682320070.199 [ESPComponent](IMPORTANT): ESP has connected as client
2023-04-24T07:07:51.020Z,1682320071.020 [ESPComponent](IMPORTANT): [sample #11] Setting cartridge argument to -6
2023-04-24T07:07:51.022Z,1682320071.022 [ESPComponent](IMPORTANT): [sample #11] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2023-04-24T07:07:51.471Z,1682320071.471 [FrontSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 3.110157 m in 10.289118 degC water with 4.606360 ug/l chlorophyll fluorescence.
2023-04-24T07:07:51.809Z,1682320071.809 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PREPARING_SHOW_LOG
2023-04-24T07:07:52.214Z,1682320072.214 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PREPARING_SHOW_STATUS
2023-04-24T07:07:54.239Z,1682320074.239 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_LOADING_CARTRIDGE
2023-04-24T07:08:26.160Z,1682320106.160 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PRIMING (@19,archive_bac)
2023-04-24T07:08:28.993Z,1682320108.993 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PRIMING (@100.0)
2023-04-24T07:08:28.994Z,1682320108.994 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering
2023-04-24T07:08:29.401Z,1682320109.401 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2023-04-24T07:11:13.026Z,1682320273.026 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_FILTERING (@0.0)
2023-04-24T07:11:13.419Z,1682320273.419 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2023-04-24T07:52:55.944Z,1682322775.944 [CBIT](IMPORTANT): Beginning ground fault scan
2023-04-24T07:53:06.876Z,1682322786.876 [CBIT](IMPORTANT): Ground fault detected
mA:
CHAN A0 (Batt): -0.052316
CHAN A1 (24V): -0.001368
CHAN A2 (12V): -0.002040
CHAN A3 (5V): -0.000363
CHAN B0 (3.3V): 0.000233
CHAN B1 (3.15aV): -0.000164
CHAN B2 (3.15bV): 0.000430
CHAN B3 (GND): 0.000084
OPEN: 0.007799
Full Scale: +/- 1 mA
2023-04-24T08:02:15.418Z,1682323335.418 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PAUSED (@1000.0)
2023-04-24T08:02:15.802Z,1682323335.802 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PROCESSING (@1000.0)
2023-04-24T08:02:17.821Z,1682323337.821 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing
2023-04-24T08:02:18.225Z,1682323338.225 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PROCESSED (@19,archive_bac)
2023-04-24T08:14:21.802Z,1682324061.802 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_STOPPING (@19,archive_bac)
2023-04-24T08:14:31.905Z,1682324071.905 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2023-04-24T08:14:32.307Z,1682324072.307 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_STOPPED
2023-04-24T08:19:32.077Z,1682324372.077 [ESPComponent](IMPORTANT): [sample #11] ESP sampling sequence completed normally.
2023-04-24T08:19:33.341Z,1682324373.341 [FrontSampling:FindPeakChlVerticalAndSample:FindPeakTakeSample:FiringOnDepth:TriggerOnDepth:D](IMPORTANT): Sample No. 1.000000 count completed.
2023-04-24T08:19:37.524Z,1682324377.524 [ThrusterHE](FAULT): Could not get status:serial timeout
2023-04-24T08:19:37.620Z,1682324377.620 [ThrusterHE](FAULT): getSpeed error serial timeout
2023-04-24T08:19:37.621Z,1682324377.621 [ThrusterHE](FAULT): Thruster uart error: serial timeout
2023-04-24T08:21:24.839Z,1682324484.839 [FrontSampling:BackAndForth:Waypoints:SampleFrontNotFirstPass:Wpt1:A.Waypoint](IMPORTANT): Reached waypoint: 36.636222,-122.679001
2023-04-24T08:33:53.724Z,1682325233.724 [FrontSampling:FindPeakChlVerticalAndSample:FindPeakTakeSample:LogGoDown:B](IMPORTANT): Go down from 0.175151 m 
2023-04-24T08:33:57.608Z,1682325237.608 [ThrusterHE](FAULT): Could not get status:serial timeout
2023-04-24T08:33:57.703Z,1682325237.703 [ThrusterHE](FAULT): getSpeed error serial timeout
2023-04-24T08:33:57.705Z,1682325237.705 [ThrusterHE](FAULT): Thruster uart error: serial timeout
2023-04-24T08:33:58.293Z,1682325238.293 [ThrusterHE](FAULT): LCB fault: LCB Watchdog Reset. Invalid Command. Hardware Overcurrent Shutdown. Current Limiter Activated.
2023-04-24T08:37:12.606Z,1682325432.606 [FrontSampling:FindPeakChlVerticalAndSample:FindPeakTakeSample:LogGoUp:B](IMPORTANT): Go up from 28.154804 m 
2023-04-24T08:38:07.150Z,1682325487.150 [FrontSampling:FindPeakChlVerticalAndSample:FindPeakTakeSample:SetChlPeakDepth:J](IMPORTANT): Set peak-chl depth. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlSet = 23.730122 m , 5.057600 ug/l , 4.094765 m , 4.943337 ug/l 
2023-04-24T08:38:09.594Z,1682325489.594 [FrontSampling:FindPeakChlVerticalAndSample:FindPeakTakeSample:FiringOnDepth:E](IMPORTANT): Taking sample No. 2.000000 count . Latitude, longitude = 36.626317 arcdeg , -122.708272 arcdeg . Target depth = 4.094765 m .
2023-04-24T08:38:09.977Z,1682325489.977 [FrontSampling:FindPeakChlVerticalAndSample:FindPeakTakeSample:FiringOnDepth:F](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 
2023-04-24T08:39:18.276Z,1682325558.276 [FrontSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 4.021645 m , settling for 5.000000 min 
2023-04-24T08:44:31.056Z,1682325871.056 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2023-04-24T08:44:31.213Z,1682325871.213 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2023-04-24T08:45:25.081Z,1682325925.081 [ESPComponent](IMPORTANT): ESP has connected as client
2023-04-24T08:45:25.901Z,1682325925.901 [ESPComponent](IMPORTANT): [sample #12] Setting cartridge argument to -6
2023-04-24T08:45:25.902Z,1682325925.902 [ESPComponent](IMPORTANT): [sample #12] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2023-04-24T08:45:26.351Z,1682325926.351 [FrontSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 3.727758 m in 10.284754 degC water with 4.588960 ug/l chlorophyll fluorescence.
2023-04-24T08:45:26.698Z,1682325926.698 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PREPARING_SHOW_LOG
2023-04-24T08:45:27.103Z,1682325927.103 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PREPARING_SHOW_STATUS
2023-04-24T08:45:29.130Z,1682325929.130 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_LOADING_CARTRIDGE
2023-04-24T08:46:01.038Z,1682325961.038 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PRIMING (@18,archive_bac)
2023-04-24T08:46:03.894Z,1682325963.894 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PRIMING (@100.0)
2023-04-24T08:46:03.895Z,1682325963.895 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering
2023-04-24T08:46:04.293Z,1682325964.293 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2023-04-24T08:48:48.312Z,1682326128.312 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_FILTERING (@0.0)
2023-04-24T08:48:48.715Z,1682326128.715 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2023-04-24T09:39:55.949Z,1682329195.949 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PAUSED (@1000.0)
2023-04-24T09:39:56.353Z,1682329196.353 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PROCESSING (@1000.0)
2023-04-24T09:39:58.375Z,1682329198.375 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing
2023-04-24T09:39:58.782Z,1682329198.782 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PROCESSED (@18,archive_bac)
2023-04-24T09:52:02.357Z,1682329922.357 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_STOPPING (@18,archive_bac)
2023-04-24T09:52:12.468Z,1682329932.468 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2023-04-24T09:52:12.895Z,1682329932.895 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_STOPPED
2023-04-24T09:57:12.641Z,1682330232.641 [ESPComponent](IMPORTANT): [sample #12] ESP sampling sequence completed normally.
2023-04-24T09:57:13.990Z,1682330233.990 [FrontSampling:FindPeakChlVerticalAndSample:FindPeakTakeSample:FiringOnDepth:TriggerOnDepth:D](IMPORTANT): Sample No. 2.000000 count completed.
2023-04-24T09:57:18.220Z,1682330238.220 [ThrusterHE](FAULT): Could not get status:serial timeout
2023-04-24T09:57:18.308Z,1682330238.308 [ThrusterHE](FAULT): getSpeed error serial timeout
2023-04-24T09:57:18.308Z,1682330238.308 [ThrusterHE](FAULT): Thruster uart error: serial timeout
2023-04-24T11:10:55.112Z,1682334655.112 [ThrusterHE](FAULT): Could not get status:serial timeout
2023-04-24T11:10:55.197Z,1682334655.197 [ThrusterHE](FAULT): getSpeed error serial timeout
2023-04-24T11:10:55.197Z,1682334655.197 [ThrusterHE](FAULT): Thruster uart error: serial timeout
2023-04-24T11:11:03.528Z,1682334663.528 [ThrusterHE](FAULT): Could not get status:serial timeout
2023-04-24T11:11:03.613Z,1682334663.613 [ThrusterHE](FAULT): getSpeed error serial timeout
2023-04-24T11:11:03.613Z,1682334663.613 [ThrusterHE](FAULT): Thruster uart error: serial timeout
2023-04-24T11:11:12.764Z,1682334672.764 [ThrusterHE](FAULT): Could not get status:serial timeout
2023-04-24T11:11:12.860Z,1682334672.860 [ThrusterHE](FAULT): getSpeed error serial timeout
2023-04-24T11:11:12.860Z,1682334672.860 [ThrusterHE](FAULT): Thruster uart error: serial timeout
2023-04-24T11:11:21.656Z,1682334681.656 [ThrusterHE](FAULT): Could not get status:serial timeout
2023-04-24T11:11:21.756Z,1682334681.756 [ThrusterHE](FAULT): getSpeed error serial timeout
2023-04-24T11:11:21.756Z,1682334681.756 [ThrusterHE](FAULT): Thruster uart error: serial timeout
2023-04-24T11:11:30.548Z,1682334690.548 [ThrusterHE](FAULT): Could not get status:serial timeout
2023-04-24T11:11:30.636Z,1682334690.636 [ThrusterHE](FAULT): getSpeed error serial timeout
2023-04-24T11:11:30.636Z,1682334690.636 [ThrusterHE](FAULT): Thruster uart error: serial timeout
2023-04-24T11:11:30.640Z,1682334690.640 [CBIT](CRITICAL): Communications Fault in component: ThrusterHE
2023-04-24T11:11:30.892Z,1682334690.892 [CommandExec](FAULT): Scheduling is paused
2023-04-24T11:11:31.659Z,1682334691.659 [MissionManager](IMPORTANT): Started mission Default
2023-04-24T11:25:04.029Z,1682335504.029 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 13.532820 min 
2023-04-24T11:32:36.389Z,1682335956.389 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 21.072298 min