2023-05-22T17:52:08.023Z,1684777928.023 [Supervisor](IMPORTANT): Reading configuration overrides from Data/persisted.cfg 2023-05-22T17:52:12.401Z,1684777932.401 [SBIT](IMPORTANT): git: 2023-05-16 2023-05-22T17:52:12.402Z,1684777932.402 [SBIT](IMPORTANT): Kernel Release: 2.6.27.8 2023-05-22T17:53:57.108Z,1684778037.108 [SBIT](IMPORTANT): Beginning Startup BIT 2023-05-22T17:53:57.116Z,1684778037.116 [CBIT](IMPORTANT): Beginning ground fault scan 2023-05-22T17:54:08.408Z,1684778048.408 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.005505 CHAN A1 (24V): 0.000045 CHAN A2 (12V): -0.000155 CHAN A3 (5V): -0.000308 CHAN B0 (3.3V): 0.000789 CHAN B1 (3.15aV): 0.000307 CHAN B2 (3.15bV): 0.000510 CHAN B3 (GND): 0.001032 OPEN: 0.007430 Full Scale: +/- 1 mA 2023-05-22T17:54:51.223Z,1684778091.223 [SBIT](IMPORTANT): SBIT PASSED 2023-05-22T17:54:51.224Z,1684778091.224 [SBIT](IMPORTANT): Listing configuration overrides from Data/persisted.cfg 2023-05-22T17:54:51.225Z,1684778091.225 [SBIT](IMPORTANT): BPC1.batteryMissingStickThreshold=12 count; 2023-05-22T17:54:51.225Z,1684778091.225 [SBIT](IMPORTANT): CBIT.abortDepth=300 meter; 2023-05-22T17:54:51.225Z,1684778091.225 [SBIT](IMPORTANT): CBIT.stopDepth=290 meter; 2023-05-22T17:54:51.225Z,1684778091.225 [SBIT](IMPORTANT): DAT.loadAtStartup=1 bool; 2023-05-22T17:54:51.225Z,1684778091.225 [SBIT](IMPORTANT): DAT.maxAckTimeouts=1 count; 2023-05-22T17:54:51.225Z,1684778091.225 [SBIT](IMPORTANT): DAT.sbdAddress=-1 enum; 2023-05-22T17:54:51.225Z,1684778091.225 [SBIT](IMPORTANT): DAT.verbosity=1 count; 2023-05-22T17:54:51.225Z,1684778091.225 [SBIT](IMPORTANT): DATMMP.loadAtStartup=0 bool; 2023-05-22T17:54:51.226Z,1684778091.226 [SBIT](IMPORTANT): DATMMP.simulateHardware=0 bool; 2023-05-22T17:54:51.226Z,1684778091.226 [SBIT](IMPORTANT): DVL_micro.loadAtStartup=0 bool; 2023-05-22T17:54:51.226Z,1684778091.226 [SBIT](IMPORTANT): Depth_Keller.offset=3.6 decibar; 2023-05-22T17:54:51.226Z,1684778091.226 [SBIT](IMPORTANT): DropWeight.loadAtStartup=0 bool; 2023-05-22T17:54:51.226Z,1684778091.226 [SBIT](IMPORTANT): ESPComponent.sampleTimeout=3 minute; 2023-05-22T17:54:51.226Z,1684778091.226 [SBIT](IMPORTANT): ESPComponent.simulateHardware=0 bool; 2023-05-22T17:54:51.226Z,1684778091.226 [SBIT](IMPORTANT): Express none CBIT.ampHoursUsed; 2023-05-22T17:54:51.226Z,1684778091.226 [SBIT](IMPORTANT): Express none TrackAcousticContact.azimuth_to_contact_vehicle_frame; 2023-05-22T17:54:51.226Z,1684778091.226 [SBIT](IMPORTANT): Express none TrackAcousticContact.range_to_contact; 2023-05-22T17:54:51.227Z,1684778091.227 [SBIT](IMPORTANT): Express none VerticalHomogeneityIndexCalculator.vertical_salinity_homogeneity_index; 2023-05-22T17:54:51.227Z,1684778091.227 [SBIT](IMPORTANT): Express none VerticalHomogeneityIndexCalculator.vertical_temperature_homogeneity_index; 2023-05-22T17:54:51.227Z,1684778091.227 [SBIT](IMPORTANT): Express none WetLabsBB2FL.bin_mean_mass_concentration_of_chlorophyll_in_sea_water; 2023-05-22T17:54:51.227Z,1684778091.227 [SBIT](IMPORTANT): Express none height_above_sea_floor; 2023-05-22T17:54:51.227Z,1684778091.227 [SBIT](IMPORTANT): IBIT.batteryCapacityThreshold=15 ampere_hour; 2023-05-22T17:54:51.227Z,1684778091.227 [SBIT](IMPORTANT): StratificationFrontDetector.loadAtStartup=0 bool; 2023-05-22T17:54:51.227Z,1684778091.227 [SBIT](IMPORTANT): StratificationFrontDetector.threshold_VTHI=0.1 celsius; 2023-05-22T17:54:51.227Z,1684778091.227 [SBIT](IMPORTANT): StratificationFrontDetector.verbosity=1 count; 2023-05-22T17:54:51.228Z,1684778091.228 [SBIT](IMPORTANT): VerticalControl.buoyancyNeutral=75.046417 cubic_centimeter; 2023-05-22T17:54:51.228Z,1684778091.228 [SBIT](IMPORTANT): VerticalControl.massDefault=21.239223 millimeter; 2023-05-22T17:54:51.228Z,1684778091.228 [SBIT](IMPORTANT): VerticalControl.massPositionLimitAft=-28 millimeter; 2023-05-22T17:54:51.228Z,1684778091.228 [SBIT](IMPORTANT): VerticalControl.massPositionLimitFwd=32 millimeter; 2023-05-22T17:54:51.228Z,1684778091.228 [SBIT](IMPORTANT): VerticalControl.surfaceThreshold=1.5 meter; 2023-05-22T17:54:51.228Z,1684778091.228 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth1=3 meter; 2023-05-22T17:54:51.228Z,1684778091.228 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth2=5 meter; 2023-05-22T17:54:51.228Z,1684778091.228 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth3=10 meter; 2023-05-22T17:54:51.229Z,1684778091.229 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth4=15 meter; 2023-05-22T17:54:51.229Z,1684778091.229 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.loadAtStartup=0 bool; 2023-05-22T17:54:51.625Z,1684778091.625 [MissionManager](IMPORTANT): Started mission Startup 2023-05-22T17:56:53.134Z,1684778213.134 [MissionManager](IMPORTANT): Started mission Default 2023-05-22T18:30:34.384Z,1684780234.384 [NAL9602](IMPORTANT): SBD MO Status=2, MOMSN=19310, MT Status=1, MTMSN=1330 2023-05-22T18:32:08.662Z,1684780328.662 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=19310, MT Status=1, MTMSN=1330 2023-05-22T18:32:09.186Z,1684780329.186 [CommandExec](IMPORTANT): got command schedule resume 2023-05-22T18:37:54.009Z,1684780674.009 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=19316, MT Status=1, MTMSN=1331 2023-05-22T18:37:54.782Z,1684780674.782 [CommandExec](IMPORTANT): got command schedule 20230522T193000 "load Science/circle_sample.xml;set circle_sample.NumSamplers 23 count;set circle_sample.MissionTimeout 50 h;set circle_sample.AcousticTrackingTimeout 0.5 h;set circle_sample.NeedCommsMissionStart 0 bool" 54ro4 1 4.000000 2023-05-22T18:37:54.783Z,1684780674.783 [CommandExec](IMPORTANT): Scheduling command #1 of 4 with id=54ro4 2023-05-22T18:37:54.784Z,1684780674.784 [CommandExec](IMPORTANT): Scheduled #1 (#1 of 4 with id='54ro4'): "load Science/circle_sample.xml;set circle_sample.NumSamplers 23 count;set circle_sample.MissionTimeout 50 h;set circle_sample.AcousticTrackingTimeout 0.5 h;set circle_sample.NeedCommsMissionStart 0 bool", AT TIME: 2023-05-22T19:30:00Z 2023-05-22T18:41:47.042Z,1684780907.042 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=19317, MT Status=1, MTMSN=1333 2023-05-22T18:41:47.782Z,1684780907.782 [CommandExec](IMPORTANT): got command schedule 20230522T193000 "set circle_sample.SpeedSampling 0.8 m/s;set circle_sample.DepthCircle 100 m;set circle_sample.CircleYoYoMinDepth 2 m;set circle_sample.CircleYoYoMaxDepth 280 m;set circle_sample.MaxDepth 290 m" 54ro4 3 4.000000 2023-05-22T18:41:47.782Z,1684780907.782 [CommandExec](IMPORTANT): Scheduling command #3 of 4 with id=54ro4 2023-05-22T18:41:47.784Z,1684780907.784 [CommandExec](IMPORTANT): Scheduled #2 (#3 of 4 with id='54ro4'): "set circle_sample.SpeedSampling 0.8 m/s;set circle_sample.DepthCircle 100 m;set circle_sample.CircleYoYoMinDepth 2 m;set circle_sample.CircleYoYoMaxDepth 280 m;set circle_sample.MaxDepth 290 m", AT TIME: 2023-05-22T19:30:00Z 2023-05-22T18:42:14.175Z,1684780934.175 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=19318, MT Status=1, MTMSN=1334 2023-05-22T18:42:14.974Z,1684780934.974 [CommandExec](IMPORTANT): got command schedule 20230522T193000 "set circle_sample.CenterLatitude 36.7215 degree;set circle_sample.CenterLongitude -122.1869 degree;set circle_sample.TrackingUpdatePeriod 45 s;set circle_sample.NumberOfStartingFixesToIgnore 1 count;run" 54ro4 4 4.000000 2023-05-22T18:42:14.975Z,1684780934.975 [CommandExec](IMPORTANT): Scheduling command #4 of 4 with id=54ro4 2023-05-22T18:42:14.976Z,1684780934.976 [CommandExec](IMPORTANT): Scheduled #3 (#4 of 4 with id='54ro4'): "set circle_sample.CenterLatitude 36.7215 degree;set circle_sample.CenterLongitude -122.1869 degree;set circle_sample.TrackingUpdatePeriod 45 s;set circle_sample.NumberOfStartingFixesToIgnore 1 count;run", AT TIME: 2023-05-22T19:30:00Z 2023-05-22T18:51:59.650Z,1684781519.650 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=19326, MT Status=1, MTMSN=1335 2023-05-22T18:52:00.419Z,1684781520.419 [CommandExec](IMPORTANT): got command load ./Missions/Transport/transit.tl 2023-05-22T18:52:00.420Z,1684781520.420 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file ./Missions/Transport/transit.tx 2023-05-22T18:52:01.152Z,1684781521.152 [CommandExec](IMPORTANT): Loaded ./Missions/Transport/transit.tl 2023-05-22T18:52:07.057Z,1684781527.057 [CommandExec](IMPORTANT): got command set transit.Latitude 36.7265 degree 2023-05-22T18:52:07.058Z,1684781527.058 [CommandExec](IMPORTANT): got command set transit.Longitude -122.1919 degree 2023-05-22T18:52:07.059Z,1684781527.059 [CommandExec](IMPORTANT): got command set transit.Depth 50 meter 2023-05-22T18:52:07.059Z,1684781527.059 [CommandExec](IMPORTANT): got command set transit.Speed 0.8 meter_per_second 2023-05-22T18:52:07.060Z,1684781527.060 [CommandExec](IMPORTANT): got command set transit.MaxDepth 60 meter 2023-05-22T18:52:07.090Z,1684781527.090 [CommandExec](IMPORTANT): got command run 2023-05-22T18:52:07.093Z,1684781527.093 [CommandExec](IMPORTANT): Running 2023-05-22T18:52:07.340Z,1684781527.340 [MissionManager](IMPORTANT): Started mission transit 2023-05-22T18:52:08.605Z,1684781528.605 [transit:Transit:Wpt1.Waypoint](IMPORTANT): Navigating to waypoint: 36.726501,-122.191902 2023-05-22T19:19:25.433Z,1684783165.433 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=19381, MT Status=1, MTMSN=1336 2023-05-22T19:19:25.993Z,1684783165.993 [CommandExec](IMPORTANT): got command stop 2023-05-22T19:19:25.993Z,1684783165.993 [CommandExec](IMPORTANT): Scheduling is paused for 3 commands 2023-05-22T19:19:26.657Z,1684783166.657 [MissionManager](IMPORTANT): Started mission Default 2023-05-22T19:20:03.456Z,1684783203.456 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=19382, MT Status=1, MTMSN=1337 2023-05-22T19:20:03.959Z,1684783203.959 [CommandExec](IMPORTANT): got command schedule clear 2023-05-22T19:20:03.959Z,1684783203.959 [CommandExec](IMPORTANT): Cleared 3 scheduled commands. 2023-05-22T19:20:03.961Z,1684783203.961 [CommandExec](IMPORTANT): got command schedule resume 2023-05-22T19:20:03.961Z,1684783203.961 [CommandExec](IMPORTANT): Scheduling is resumed 2023-05-22T19:41:43.191Z,1684784503.191 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 22.268850 min 2023-05-22T19:42:39.467Z,1684784559.467 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=19407, MT Status=1, MTMSN=1338 2023-05-22T19:42:40.024Z,1684784560.024 [CommandExec](IMPORTANT): got command schedule clear 2023-05-22T19:42:40.025Z,1684784560.025 [CommandExec](IMPORTANT): Cleared 0 scheduled commands. 2023-05-22T19:42:40.025Z,1684784560.025 [CommandExec](IMPORTANT): got command schedule resume 2023-05-22T19:43:22.367Z,1684784602.367 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=19408, MT Status=1, MTMSN=1339 2023-05-22T19:43:23.198Z,1684784603.198 [CommandExec](IMPORTANT): got command schedule 20230522T203000 "load Science/circle_sample.xml;set circle_sample.NumSamplers 23 count;set circle_sample.MissionTimeout 50 h;set circle_sample.AcousticTrackingTimeout 0.5 h;set circle_sample.NeedCommsMissionStart 0 bool" 54unk 1 4.000000 2023-05-22T19:43:23.199Z,1684784603.199 [CommandExec](IMPORTANT): Scheduling command #1 of 4 with id=54unk 2023-05-22T19:43:23.200Z,1684784603.200 [CommandExec](IMPORTANT): Scheduled #4 (#1 of 4 with id='54unk'): "load Science/circle_sample.xml;set circle_sample.NumSamplers 23 count;set circle_sample.MissionTimeout 50 h;set circle_sample.AcousticTrackingTimeout 0.5 h;set circle_sample.NeedCommsMissionStart 0 bool", AT TIME: 2023-05-22T20:30:00Z 2023-05-22T19:43:40.950Z,1684784620.950 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=19409, MT Status=1, MTMSN=1340 2023-05-22T19:43:41.746Z,1684784621.746 [CommandExec](IMPORTANT): got command schedule 20230522T203000 "set circle_sample.UseOtherLRAUVSignals 0 bool;set circle_sample.AcousticTargetDepth 0 m;set circle_sample.WaitBeforeFiring 0 min;set circle_sample.MaxWaitFirstSample 0 min;set circle_sample.MaxWaitMustFire 2 h" 54unk 2 4.000000 2023-05-22T19:43:41.748Z,1684784621.748 [CommandExec](IMPORTANT): Scheduling command #2 of 4 with id=54unk 2023-05-22T19:43:41.765Z,1684784621.765 [CommandExec](IMPORTANT): Scheduled #5 (#2 of 4 with id='54unk'): "set circle_sample.UseOtherLRAUVSignals 0 bool;set circle_sample.AcousticTargetDepth 0 m;set circle_sample.WaitBeforeFiring 0 min;set circle_sample.MaxWaitFirstSample 0 min;set circle_sample.MaxWaitMustFire 2 h", AT TIME: 2023-05-22T20:30:00Z 2023-05-22T19:44:01.156Z,1684784641.156 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=19410, MT Status=1, MTMSN=1341 2023-05-22T19:44:01.947Z,1684784641.947 [CommandExec](IMPORTANT): got command schedule 20230522T203000 "set circle_sample.SpeedSampling 0.8 m/s;set circle_sample.DepthCircle 100 m;set circle_sample.CircleYoYoMinDepth 2 m;set circle_sample.CircleYoYoMaxDepth 280 m;set circle_sample.MaxDepth 290 m" 54unk 3 4.000000 2023-05-22T19:44:01.947Z,1684784641.947 [CommandExec](IMPORTANT): Scheduling command #3 of 4 with id=54unk 2023-05-22T19:44:01.948Z,1684784641.948 [CommandExec](IMPORTANT): Scheduled #6 (#3 of 4 with id='54unk'): "set circle_sample.SpeedSampling 0.8 m/s;set circle_sample.DepthCircle 100 m;set circle_sample.CircleYoYoMinDepth 2 m;set circle_sample.CircleYoYoMaxDepth 280 m;set circle_sample.MaxDepth 290 m", AT TIME: 2023-05-22T20:30:00Z 2023-05-22T19:44:14.487Z,1684784654.487 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=19411, MT Status=1, MTMSN=1342 2023-05-22T19:44:15.302Z,1684784655.302 [CommandExec](IMPORTANT): got command schedule 20230522T203000 "set circle_sample.CenterLatitude 36.7215 degree;set circle_sample.CenterLongitude -122.1869 degree;set circle_sample.TrackingUpdatePeriod 45 s;set circle_sample.NumberOfStartingFixesToIgnore 1 count;run" 54unk 4 4.000000 2023-05-22T19:44:15.303Z,1684784655.303 [CommandExec](IMPORTANT): Scheduling command #4 of 4 with id=54unk 2023-05-22T19:44:15.304Z,1684784655.304 [CommandExec](IMPORTANT): Scheduled #7 (#4 of 4 with id='54unk'): "set circle_sample.CenterLatitude 36.7215 degree;set circle_sample.CenterLongitude -122.1869 degree;set circle_sample.TrackingUpdatePeriod 45 s;set circle_sample.NumberOfStartingFixesToIgnore 1 count;run", AT TIME: 2023-05-22T20:30:00Z 2023-05-22T19:47:25.799Z,1684784845.799 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=19414, MT Status=1, MTMSN=1343 2023-05-22T19:47:26.549Z,1684784846.549 [CommandExec](IMPORTANT): got command load ./Missions/Transport/transit.tl 2023-05-22T19:47:26.550Z,1684784846.550 [MissionManager](IMPORTANT): Loading Compiled TethysL script from file ./Missions/Transport/transit.tx 2023-05-22T19:47:27.091Z,1684784847.091 [CommandExec](IMPORTANT): Loaded ./Missions/Transport/transit.tl 2023-05-22T19:47:35.996Z,1684784855.996 [CommandExec](IMPORTANT): got command set transit.MissionTimeout 120 minute 2023-05-22T19:47:35.997Z,1684784855.997 [CommandExec](IMPORTANT): got command set transit.NeedCommsTime 60 minute 2023-05-22T19:47:35.997Z,1684784855.997 [CommandExec](IMPORTANT): got command set transit.Latitude 36.7265 degree 2023-05-22T19:47:35.998Z,1684784855.998 [CommandExec](IMPORTANT): got command set transit.Longitude -122.1919 degree 2023-05-22T19:47:35.999Z,1684784855.999 [CommandExec](IMPORTANT): got command set transit.Depth 50 meter 2023-05-22T19:47:35.999Z,1684784855.999 [CommandExec](IMPORTANT): got command set transit.MaxDepth 60 meter 2023-05-22T19:47:35.000Z,1684784856.000 [CommandExec](IMPORTANT): got command run 2023-05-22T19:47:36.002Z,1684784856.002 [CommandExec](IMPORTANT): Running 2023-05-22T19:47:36.316Z,1684784856.316 [MissionManager](IMPORTANT): Started mission transit 2023-05-22T19:47:37.945Z,1684784857.945 [transit:Transit:Wpt1.Waypoint](IMPORTANT): Navigating to waypoint: 36.726501,-122.191902 2023-05-22T20:30:00.099Z,1684787400.099 [CommandExec](IMPORTANT): got command load ./Missions/Science/circle_sample.xml 2023-05-22T20:30:09.143Z,1684787409.143 [CommandExec](IMPORTANT): Loaded ./Missions/Science/circle_sample.xml 2023-05-22T20:30:09.219Z,1684787409.219 [MissionManager](IMPORTANT): Started mission Default 2023-05-22T20:30:24.773Z,1684787424.773 [CommandExec](IMPORTANT): got command set circle_sample.NumSamplers 23 count 2023-05-22T20:30:24.774Z,1684787424.774 [CommandExec](IMPORTANT): got command set circle_sample.MissionTimeout 50 hour 2023-05-22T20:30:24.774Z,1684787424.774 [CommandExec](IMPORTANT): got command set circle_sample.AcousticTrackingTimeout 0.5 hour 2023-05-22T20:30:24.775Z,1684787424.775 [CommandExec](IMPORTANT): got command set circle_sample.NeedCommsMissionStart 0 bool 2023-05-22T20:30:42.503Z,1684787442.503 [CommandExec](IMPORTANT): got command set circle_sample.UseOtherLRAUVSignals 0 bool 2023-05-22T20:30:42.504Z,1684787442.504 [CommandExec](IMPORTANT): got command set circle_sample.AcousticTargetDepth 0 meter 2023-05-22T20:30:42.504Z,1684787442.504 [CommandExec](IMPORTANT): got command set circle_sample.WaitBeforeFiring 0 minute 2023-05-22T20:30:42.505Z,1684787442.505 [CommandExec](IMPORTANT): got command set circle_sample.MaxWaitFirstSample 0 minute 2023-05-22T20:30:42.506Z,1684787442.506 [CommandExec](IMPORTANT): got command set circle_sample.MaxWaitMustFire 2 hour 2023-05-22T20:30:57.763Z,1684787457.763 [CommandExec](IMPORTANT): got command set circle_sample.SpeedSampling 0.8 meter_per_second 2023-05-22T20:30:57.764Z,1684787457.764 [CommandExec](IMPORTANT): got command set circle_sample.DepthCircle 100 meter 2023-05-22T20:30:57.764Z,1684787457.764 [CommandExec](IMPORTANT): got command set circle_sample.CircleYoYoMinDepth 2 meter 2023-05-22T20:30:57.765Z,1684787457.765 [CommandExec](IMPORTANT): got command set circle_sample.CircleYoYoMaxDepth 280 meter 2023-05-22T20:30:57.766Z,1684787457.766 [CommandExec](IMPORTANT): got command set circle_sample.MaxDepth 290 meter 2023-05-22T20:31:12.805Z,1684787472.805 [CommandExec](IMPORTANT): got command set circle_sample.CenterLatitude 36.7215 degree 2023-05-22T20:31:12.806Z,1684787472.806 [CommandExec](IMPORTANT): got command set circle_sample.CenterLongitude -122.1869 degree 2023-05-22T20:31:12.807Z,1684787472.807 [CommandExec](IMPORTANT): got command set circle_sample.TrackingUpdatePeriod 45 second 2023-05-22T20:31:12.808Z,1684787472.808 [CommandExec](IMPORTANT): got command set circle_sample.NumberOfStartingFixesToIgnore 1 count 2023-05-22T20:31:12.809Z,1684787472.809 [CommandExec](IMPORTANT): got command run 2023-05-22T20:31:12.886Z,1684787472.886 [CommandExec](IMPORTANT): Running 2023-05-22T20:31:13.028Z,1684787473.028 [MissionManager](IMPORTANT): Started mission circle_sample 2023-05-22T20:31:13.065Z,1684787473.065 [circle_sample:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 0.50 hours. 2023-05-22T20:31:15.036Z,1684787475.036 [circle_sample:MissionStartNoComms:A](IMPORTANT): Mission start no comms. 2023-05-22T20:31:16.276Z,1684787476.276 [circle_sample:CircleAndSample:A](IMPORTANT): Circle around location 36.721500 arcdeg , -122.186897 arcdeg , at radius = 20.000000 m and depth = 100.000000 m . 2023-05-22T20:31:18.296Z,1684787478.296 [circle_sample:SetSampleOptions:D](IMPORTANT): Set CartridgeType (if ESP), SettleDuration to -1.000000 count , 5.000000 min . 2023-05-22T20:31:21.512Z,1684787481.512 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:F](IMPORTANT): Elapsed time since start or last firing(= 0.092909 min ) is longer than MaxWaitFirstSample (= 0.000000 min ) for the 1st sample, or longer than MaxWaitMustFire (= 120.000000 min ) for non-1st samples. Firing sample No. 1.000000 count 2023-05-22T20:41:04.914Z,1684788064.914 [circle_sample:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 100.029198 m , settling for 5.000000 min 2023-05-22T20:46:07.481Z,1684788367.481 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::|summary:' 2023-05-22T20:46:17.605Z,1684788377.605 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-05-22T20:46:17.726Z,1684788377.726 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-05-22T20:47:10.506Z,1684788430.506 [ESPComponent](IMPORTANT): ESP has connected as client 2023-05-22T20:47:11.331Z,1684788431.331 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -1 2023-05-22T20:47:11.332Z,1684788431.332 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-05-22T20:47:11.767Z,1684788431.767 [circle_sample:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 99.879311 m in 9.343470 degC water with 0.032480 ug/l chlorophyll fluorescence. 2023-05-22T20:47:12.532Z,1684788432.532 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG 2023-05-22T20:47:12.930Z,1684788432.930 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-05-22T20:47:14.551Z,1684788434.551 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE 2023-05-22T20:47:46.467Z,1684788466.467 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PRIMING (@24,aRNAl_bac) 2023-05-22T20:47:48.887Z,1684788468.887 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PRIMING (@100.0) 2023-05-22T20:47:48.888Z,1684788468.888 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-05-22T20:47:49.295Z,1684788469.295 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-05-22T20:50:32.121Z,1684788632.121 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_FILTERING (@0.0) 2023-05-22T20:50:32.523Z,1684788632.523 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-05-22T21:07:43.761Z,1684789663.761 [ThrusterHE](FAULT): Could not get status:serial timeout 2023-05-22T21:35:45.992Z,1684791345.992 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PAUSED (@1000.0) 2023-05-22T21:35:46.390Z,1684791346.390 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PROCESSING (@1000.0) 2023-05-22T21:35:48.407Z,1684791348.407 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2023-05-22T21:35:48.818Z,1684791348.818 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PROCESSED (@24,aRNAl_bac) 2023-05-22T21:37:23.774Z,1684791443.774 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING (@24,aRNAl_bac) 2023-05-22T21:37:31.429Z,1684791451.429 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-05-22T21:37:31.827Z,1684791451.827 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED 2023-05-22T21:42:31.688Z,1684791751.688 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence completed normally. 2023-05-22T21:42:34.211Z,1684791754.211 [circle_sample:SendSampleInfo:SampleInfo:C](IMPORTANT): CntSamples = 1.000000 count 2023-05-22T21:42:34.600Z,1684791754.600 [circle_sample:SendSampleInfo:SampleInfo:D](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2023-05-22T21:42:35.015Z,1684791755.015 [circle_sample:SendSampleInfo:SampleInfo:E](IMPORTANT): Science:ESPComponent.cartridge = -1 count 2023-05-22T21:42:35.419Z,1684791755.419 [circle_sample:SendSampleInfo:SampleInfo:F](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2023-05-22T21:42:35.826Z,1684791755.826 [circle_sample:SendSampleInfo:SampleInfo:G](IMPORTANT): Universal:depth = 99.499184 m 2023-05-22T21:42:36.211Z,1684791756.211 [circle_sample:SendSampleInfo:SampleInfo:H](IMPORTANT): Universal:sea_water_temperature = 9.409510 degC 2023-05-22T21:42:36.620Z,1684791756.620 [circle_sample:SendSampleInfo:SampleInfo:I](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 0.034800 ug/l 2023-05-22T21:42:37.439Z,1684791757.439 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:O](IMPORTANT): Sample No. 1.000000 count completed. 2023-05-22T21:42:41.888Z,1684791761.888 [circle_sample:SetSampleOptions:D](IMPORTANT): Set CartridgeType (if ESP), SettleDuration to -1.000000 count , 5.000000 min . 2023-05-22T21:42:58.531Z,1684791778.531 [DAT](FAULT): Buffer send receipt timeout failure. 2023-05-22T21:43:25.017Z,1684791805.017 [DAT](FAULT): failed to enter command mode 2023-05-22T22:31:24.087Z,1684794684.087 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:F](IMPORTANT): Elapsed time since start or last firing(= 120.029500 min ) is longer than MaxWaitFirstSample (= 0.000000 min ) for the 1st sample, or longer than MaxWaitMustFire (= 120.000000 min ) for non-1st samples. Firing sample No. 2.000000 count 2023-05-22T22:32:42.068Z,1684794762.068 [circle_sample:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 99.724251 m , settling for 5.000000 min 2023-05-22T22:37:54.846Z,1684795074.846 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-05-22T22:37:54.980Z,1684795074.980 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-05-22T22:38:47.727Z,1684795127.727 [ESPComponent](IMPORTANT): ESP has connected as client 2023-05-22T22:38:48.535Z,1684795128.535 [ESPComponent](IMPORTANT): [sample #2] Setting cartridge argument to -1 2023-05-22T22:38:48.536Z,1684795128.536 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-05-22T22:38:48.971Z,1684795128.971 [circle_sample:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 100.311752 m in 9.396662 degC water with 0.026680 ug/l chlorophyll fluorescence. 2023-05-22T22:38:49.334Z,1684795129.334 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_LOG 2023-05-22T22:38:49.742Z,1684795129.742 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-05-22T22:38:51.783Z,1684795131.783 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_LOADING_CARTRIDGE 2023-05-22T22:39:23.779Z,1684795163.779 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PRIMING (@23,aRNAl_bac) 2023-05-22T22:39:26.560Z,1684795166.560 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PRIMING (@100.0) 2023-05-22T22:39:26.561Z,1684795166.561 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-05-22T22:39:26.958Z,1684795166.958 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-05-22T22:42:09.372Z,1684795329.372 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_FILTERING (@0.0) 2023-05-22T22:42:09.769Z,1684795329.769 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-05-22T23:26:29.522Z,1684797989.522 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PAUSED (@1000.0) 2023-05-22T23:26:29.927Z,1684797989.927 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PROCESSING (@1000.0) 2023-05-22T23:26:31.952Z,1684797991.952 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2023-05-22T23:26:32.355Z,1684797992.355 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PROCESSED (@23,aRNAl_bac) 2023-05-22T23:28:07.294Z,1684798087.294 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPING (@23,aRNAl_bac) 2023-05-22T23:28:14.971Z,1684798094.971 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-05-22T23:28:15.375Z,1684798095.375 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPED 2023-05-22T23:33:15.224Z,1684798395.224 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence completed normally. 2023-05-22T23:33:17.743Z,1684798397.743 [circle_sample:SendSampleInfo:SampleInfo:C](IMPORTANT): CntSamples = 2.000000 count 2023-05-22T23:33:18.103Z,1684798398.103 [circle_sample:SendSampleInfo:SampleInfo:D](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2023-05-22T23:33:18.481Z,1684798398.481 [circle_sample:SendSampleInfo:SampleInfo:E](IMPORTANT): Science:ESPComponent.cartridge = -1 count 2023-05-22T23:33:18.895Z,1684798398.895 [circle_sample:SendSampleInfo:SampleInfo:F](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2023-05-22T23:33:19.263Z,1684798399.263 [circle_sample:SendSampleInfo:SampleInfo:G](IMPORTANT): Universal:depth = 100.861221 m 2023-05-22T23:33:19.672Z,1684798399.672 [circle_sample:SendSampleInfo:SampleInfo:H](IMPORTANT): Universal:sea_water_temperature = 9.355188 degC 2023-05-22T23:33:20.100Z,1684798400.100 [circle_sample:SendSampleInfo:SampleInfo:I](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 0.023200 ug/l 2023-05-22T23:33:20.927Z,1684798400.927 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:O](IMPORTANT): Sample No. 2.000000 count completed. 2023-05-22T23:33:25.355Z,1684798405.355 [circle_sample:SetSampleOptions:D](IMPORTANT): Set CartridgeType (if ESP), SettleDuration to -1.000000 count , 5.000000 min . 2023-05-22T23:54:08.640Z,1684799648.640 [CBIT](IMPORTANT): Beginning ground fault scan 2023-05-22T23:54:19.889Z,1684799659.889 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.002505 CHAN A1 (24V): 0.000222 CHAN A2 (12V): -0.000072 CHAN A3 (5V): -0.000546 CHAN B0 (3.3V): 0.000599 CHAN B1 (3.15aV): 0.000041 CHAN B2 (3.15bV): 0.000548 CHAN B3 (GND): 0.000113 OPEN: 0.007545 Full Scale: +/- 1 mA 2023-05-23T00:31:26.772Z,1684801886.772 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:F](IMPORTANT): Elapsed time since start or last firing(= 120.031136 min ) is longer than MaxWaitFirstSample (= 0.000000 min ) for the 1st sample, or longer than MaxWaitMustFire (= 120.000000 min ) for non-1st samples. Firing sample No. 3.000000 count 2023-05-23T00:33:08.580Z,1684801988.580 [circle_sample:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 99.875870 m , settling for 5.000000 min 2023-05-23T00:38:21.382Z,1684802301.382 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-05-23T00:38:21.483Z,1684802301.483 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-05-23T00:39:14.607Z,1684802354.607 [ESPComponent](IMPORTANT): ESP has connected as client 2023-05-23T00:39:15.413Z,1684802355.413 [ESPComponent](IMPORTANT): [sample #3] Setting cartridge argument to -1 2023-05-23T00:39:15.413Z,1684802355.413 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-05-23T00:39:15.855Z,1684802355.855 [circle_sample:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 99.362259 m in 9.334070 degC water with 0.033640 ug/l chlorophyll fluorescence. 2023-05-23T00:39:16.218Z,1684802356.218 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_LOG 2023-05-23T00:39:16.640Z,1684802356.640 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-05-23T00:39:18.642Z,1684802358.642 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_LOADING_CARTRIDGE 2023-05-23T00:39:50.567Z,1684802390.567 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PRIMING (@22,aRNAl_bac) 2023-05-23T00:39:52.991Z,1684802392.991 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PRIMING (@100.0) 2023-05-23T00:39:52.992Z,1684802392.992 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-05-23T00:39:53.392Z,1684802393.392 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-05-23T00:42:36.274Z,1684802556.274 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_FILTERING (@0.0) 2023-05-23T00:42:36.624Z,1684802556.624 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-05-23T01:27:45.902Z,1684805265.902 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PAUSED (@1000.0) 2023-05-23T01:27:46.307Z,1684805266.307 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PROCESSING (@1000.0) 2023-05-23T01:27:48.326Z,1684805268.326 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2023-05-23T01:27:48.748Z,1684805268.748 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PROCESSED (@22,aRNAl_bac) 2023-05-23T01:29:23.675Z,1684805363.675 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPING (@22,aRNAl_bac) 2023-05-23T01:29:31.346Z,1684805371.346 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-05-23T01:29:31.769Z,1684805371.769 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPED 2023-05-23T01:34:31.545Z,1684805671.545 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence completed normally. 2023-05-23T01:34:34.011Z,1684805674.011 [circle_sample:SendSampleInfo:SampleInfo:C](IMPORTANT): CntSamples = 3.000000 count 2023-05-23T01:34:34.422Z,1684805674.422 [circle_sample:SendSampleInfo:SampleInfo:D](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2023-05-23T01:34:34.802Z,1684805674.802 [circle_sample:SendSampleInfo:SampleInfo:E](IMPORTANT): Science:ESPComponent.cartridge = -1 count 2023-05-23T01:34:35.206Z,1684805675.206 [circle_sample:SendSampleInfo:SampleInfo:F](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2023-05-23T01:34:35.635Z,1684805675.635 [circle_sample:SendSampleInfo:SampleInfo:G](IMPORTANT): Universal:depth = 99.872871 m 2023-05-23T01:34:36.045Z,1684805676.045 [circle_sample:SendSampleInfo:SampleInfo:H](IMPORTANT): Universal:sea_water_temperature = 9.182001 degC 2023-05-23T01:34:36.414Z,1684805676.414 [circle_sample:SendSampleInfo:SampleInfo:I](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 0.034800 ug/l 2023-05-23T01:34:37.239Z,1684805677.239 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:O](IMPORTANT): Sample No. 3.000000 count completed. 2023-05-23T01:34:41.676Z,1684805681.676 [circle_sample:SetSampleOptions:D](IMPORTANT): Set CartridgeType (if ESP), SettleDuration to -1.000000 count , 5.000000 min . 2023-05-23T02:31:29.175Z,1684809089.175 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:F](IMPORTANT): Elapsed time since start or last firing(= 120.026359 min ) is longer than MaxWaitFirstSample (= 0.000000 min ) for the 1st sample, or longer than MaxWaitMustFire (= 120.000000 min ) for non-1st samples. Firing sample No. 4.000000 count 2023-05-23T02:35:28.757Z,1684809328.757 [circle_sample:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 99.802040 m , settling for 5.000000 min 2023-05-23T02:40:41.553Z,1684809641.553 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-05-23T02:40:41.693Z,1684809641.693 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-05-23T02:41:34.010Z,1684809694.010 [ESPComponent](IMPORTANT): ESP has connected as client 2023-05-23T02:41:34.836Z,1684809694.836 [ESPComponent](IMPORTANT): [sample #4] Setting cartridge argument to -1 2023-05-23T02:41:34.836Z,1684809694.836 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-05-23T02:41:35.266Z,1684809695.266 [circle_sample:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 99.878082 m in 9.378839 degC water with 0.034800 ug/l chlorophyll fluorescence. 2023-05-23T02:41:35.622Z,1684809695.622 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_LOG 2023-05-23T02:41:36.032Z,1684809696.032 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-05-23T02:41:38.055Z,1684809698.055 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_LOADING_CARTRIDGE 2023-05-23T02:42:09.966Z,1684809729.966 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PRIMING (@21,aRNAl_bac) 2023-05-23T02:42:12.812Z,1684809732.812 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PRIMING (@100.0) 2023-05-23T02:42:12.813Z,1684809732.813 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-05-23T02:42:13.198Z,1684809733.198 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-05-23T02:44:55.611Z,1684809895.611 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_FILTERING (@0.0) 2023-05-23T02:44:56.015Z,1684809896.015 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-05-23T02:54:21.513Z,1684810461.513 [ThrusterHE](FAULT): Could not get status:serial timeout 2023-05-23T02:56:25.513Z,1684810585.513 [ThrusterHE](FAULT): getSpeed error serial timeout 2023-05-23T02:56:25.513Z,1684810585.513 [ThrusterHE](FAULT): Thruster uart error: serial timeout 2023-05-23T03:29:35.102Z,1684812575.102 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PAUSED (@1000.0) 2023-05-23T03:29:35.512Z,1684812575.512 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PROCESSING (@1000.0) 2023-05-23T03:29:37.531Z,1684812577.531 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2023-05-23T03:29:37.930Z,1684812577.930 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PROCESSED (@21,aRNAl_bac) 2023-05-23T03:31:12.880Z,1684812672.880 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPING (@21,aRNAl_bac) 2023-05-23T03:31:20.552Z,1684812680.552 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-05-23T03:31:20.971Z,1684812680.971 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPED 2023-05-23T03:36:20.751Z,1684812980.751 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence completed normally. 2023-05-23T03:36:23.199Z,1684812983.199 [circle_sample:SendSampleInfo:SampleInfo:C](IMPORTANT): CntSamples = 4.000000 count 2023-05-23T03:36:23.603Z,1684812983.603 [circle_sample:SendSampleInfo:SampleInfo:D](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2023-05-23T03:36:24.023Z,1684812984.023 [circle_sample:SendSampleInfo:SampleInfo:E](IMPORTANT): Science:ESPComponent.cartridge = -1 count 2023-05-23T03:36:24.407Z,1684812984.407 [circle_sample:SendSampleInfo:SampleInfo:F](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2023-05-23T03:36:24.807Z,1684812984.807 [circle_sample:SendSampleInfo:SampleInfo:G](IMPORTANT): Universal:depth = 99.713951 m 2023-05-23T03:36:25.215Z,1684812985.215 [circle_sample:SendSampleInfo:SampleInfo:H](IMPORTANT): Universal:sea_water_temperature = 9.291895 degC 2023-05-23T03:36:25.630Z,1684812985.630 [circle_sample:SendSampleInfo:SampleInfo:I](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 0.034800 ug/l 2023-05-23T03:36:26.423Z,1684812986.423 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:O](IMPORTANT): Sample No. 4.000000 count completed. 2023-05-23T03:36:30.910Z,1684812990.910 [circle_sample:SetSampleOptions:D](IMPORTANT): Set CartridgeType (if ESP), SettleDuration to -1.000000 count , 5.000000 min . 2023-05-23T03:36:47.182Z,1684813007.182 [DAT](FAULT): Sending transmit timeout failure. 2023-05-23T03:37:02.313Z,1684813022.313 [DAT](FAULT): failed to enter command mode 2023-05-23T04:31:31.612Z,1684816291.612 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:F](IMPORTANT): Elapsed time since start or last firing(= 120.027059 min ) is longer than MaxWaitFirstSample (= 0.000000 min ) for the 1st sample, or longer than MaxWaitMustFire (= 120.000000 min ) for non-1st samples. Firing sample No. 5.000000 count 2023-05-23T04:34:46.035Z,1684816486.035 [circle_sample:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 99.767540 m , settling for 5.000000 min 2023-05-23T04:39:58.729Z,1684816798.729 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-05-23T04:39:58.847Z,1684816798.847 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-05-23T04:40:51.151Z,1684816851.151 [ESPComponent](IMPORTANT): ESP has connected as client 2023-05-23T04:40:51.962Z,1684816851.962 [ESPComponent](IMPORTANT): [sample #5] Setting cartridge argument to -1 2023-05-23T04:40:51.963Z,1684816851.963 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-05-23T04:40:52.399Z,1684816852.399 [circle_sample:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 99.574036 m in 9.268885 degC water with 0.030160 ug/l chlorophyll fluorescence. 2023-05-23T04:40:52.766Z,1684816852.766 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_LOG 2023-05-23T04:40:53.175Z,1684816853.175 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-05-23T04:40:55.196Z,1684816855.196 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_LOADING_CARTRIDGE 2023-05-23T04:41:27.108Z,1684816887.108 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PRIMING (@20,aRNAl_bac) 2023-05-23T04:41:29.969Z,1684816889.969 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PRIMING (@100.0) 2023-05-23T04:41:29.974Z,1684816889.974 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-05-23T04:41:30.343Z,1684816890.343 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-05-23T04:44:12.750Z,1684817052.750 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_FILTERING (@0.0) 2023-05-23T04:44:13.152Z,1684817053.152 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-05-23T05:15:38.773Z,1684818938.773 [ThrusterHE](FAULT): Could not get status:serial timeout 2023-05-23T05:30:11.286Z,1684819811.286 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PAUSED (@1000.0) 2023-05-23T05:30:11.689Z,1684819811.689 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PROCESSING (@1000.0) 2023-05-23T05:30:13.716Z,1684819813.716 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2023-05-23T05:30:14.119Z,1684819814.119 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PROCESSED (@20,aRNAl_bac) 2023-05-23T05:31:49.071Z,1684819909.071 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPING (@20,aRNAl_bac) 2023-05-23T05:31:56.730Z,1684819916.730 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-05-23T05:31:57.151Z,1684819917.151 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPED 2023-05-23T05:36:56.922Z,1684820216.922 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence completed normally. 2023-05-23T05:36:59.392Z,1684820219.392 [circle_sample:SendSampleInfo:SampleInfo:C](IMPORTANT): CntSamples = 5.000000 count 2023-05-23T05:36:59.775Z,1684820219.775 [circle_sample:SendSampleInfo:SampleInfo:D](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2023-05-23T05:37:00.178Z,1684820220.178 [circle_sample:SendSampleInfo:SampleInfo:E](IMPORTANT): Science:ESPComponent.cartridge = -1 count 2023-05-23T05:37:00.589Z,1684820220.589 [circle_sample:SendSampleInfo:SampleInfo:F](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2023-05-23T05:37:01.014Z,1684820221.014 [circle_sample:SendSampleInfo:SampleInfo:G](IMPORTANT): Universal:depth = 99.840591 m 2023-05-23T05:37:01.414Z,1684820221.414 [circle_sample:SendSampleInfo:SampleInfo:H](IMPORTANT): Universal:sea_water_temperature = 9.339899 degC 2023-05-23T05:37:01.802Z,1684820221.802 [circle_sample:SendSampleInfo:SampleInfo:I](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 0.046400 ug/l 2023-05-23T05:37:02.615Z,1684820222.615 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:O](IMPORTANT): Sample No. 5.000000 count completed. 2023-05-23T05:37:07.059Z,1684820227.059 [circle_sample:SetSampleOptions:D](IMPORTANT): Set CartridgeType (if ESP), SettleDuration to -1.000000 count , 5.000000 min . 2023-05-23T05:37:08.825Z,1684820228.825 [DAT](FAULT): Sending transmit timeout failure. 2023-05-23T05:37:19.162Z,1684820239.162 [DAT](FAULT): Sending transmit timeout failure. 2023-05-23T05:37:34.282Z,1684820254.282 [DAT](FAULT): failed to enter command mode 2023-05-23T05:54:20.241Z,1684821260.241 [CBIT](IMPORTANT): Beginning ground fault scan 2023-05-23T05:54:31.099Z,1684821271.099 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.002038 CHAN A1 (24V): -0.000063 CHAN A2 (12V): 0.000358 CHAN A3 (5V): -0.000420 CHAN B0 (3.3V): -0.000244 CHAN B1 (3.15aV): -0.000337 CHAN B2 (3.15bV): 0.000142 CHAN B3 (GND): -0.000428 OPEN: 0.007711 Full Scale: +/- 1 mA 2023-05-23T06:31:34.351Z,1684823494.351 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:F](IMPORTANT): Elapsed time since start or last firing(= 120.032633 min ) is longer than MaxWaitFirstSample (= 0.000000 min ) for the 1st sample, or longer than MaxWaitMustFire (= 120.000000 min ) for non-1st samples. Firing sample No. 6.000000 count 2023-05-23T06:35:14.152Z,1684823714.152 [circle_sample:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 100.199158 m , settling for 5.000000 min 2023-05-23T06:40:26.918Z,1684824026.918 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-05-23T06:40:27.028Z,1684824027.028 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-05-23T06:41:19.001Z,1684824079.001 [ESPComponent](IMPORTANT): ESP has connected as client 2023-05-23T06:41:19.813Z,1684824079.813 [ESPComponent](IMPORTANT): [sample #6] Setting cartridge argument to -1 2023-05-23T06:41:19.814Z,1684824079.814 [ESPComponent](IMPORTANT): [sample #6] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-05-23T06:41:20.244Z,1684824080.244 [circle_sample:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 101.224686 m in 9.341089 degC water with 0.035960 ug/l chlorophyll fluorescence. 2023-05-23T06:41:20.618Z,1684824080.618 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PREPARING_SHOW_LOG 2023-05-23T06:41:21.023Z,1684824081.023 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-05-23T06:41:23.042Z,1684824083.042 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_LOADING_CARTRIDGE 2023-05-23T06:41:54.959Z,1684824114.959 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PRIMING (@19,aRNAl_bac) 2023-05-23T06:41:57.786Z,1684824117.786 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PRIMING (@100.0) 2023-05-23T06:41:57.787Z,1684824117.787 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-05-23T06:41:58.191Z,1684824118.191 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-05-23T06:44:40.598Z,1684824280.598 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_FILTERING (@0.0) 2023-05-23T06:44:41.002Z,1684824281.002 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-05-23T07:32:13.275Z,1684827133.275 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PAUSED (@1000.0) 2023-05-23T07:32:13.676Z,1684827133.676 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PROCESSING (@1000.0) 2023-05-23T07:32:15.713Z,1684827135.713 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2023-05-23T07:32:16.098Z,1684827136.098 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PROCESSED (@19,aRNAl_bac) 2023-05-23T07:33:51.043Z,1684827231.043 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_STOPPING (@19,aRNAl_bac) 2023-05-23T07:33:58.721Z,1684827238.721 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-05-23T07:33:59.123Z,1684827239.123 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_STOPPED 2023-05-23T07:38:58.903Z,1684827538.903 [ESPComponent](IMPORTANT): [sample #6] ESP sampling sequence completed normally. 2023-05-23T07:39:01.364Z,1684827541.364 [circle_sample:SendSampleInfo:SampleInfo:C](IMPORTANT): CntSamples = 6.000000 count 2023-05-23T07:39:01.756Z,1684827541.756 [circle_sample:SendSampleInfo:SampleInfo:D](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2023-05-23T07:39:02.221Z,1684827542.221 [circle_sample:SendSampleInfo:SampleInfo:E](IMPORTANT): Science:ESPComponent.cartridge = -1 count 2023-05-23T07:39:02.554Z,1684827542.554 [circle_sample:SendSampleInfo:SampleInfo:F](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2023-05-23T07:39:02.963Z,1684827542.963 [circle_sample:SendSampleInfo:SampleInfo:G](IMPORTANT): Universal:depth = 99.105423 m 2023-05-23T07:39:03.369Z,1684827543.369 [circle_sample:SendSampleInfo:SampleInfo:H](IMPORTANT): Universal:sea_water_temperature = 9.441706 degC 2023-05-23T07:39:03.821Z,1684827543.821 [circle_sample:SendSampleInfo:SampleInfo:I](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 0.046400 ug/l 2023-05-23T07:39:04.580Z,1684827544.580 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:O](IMPORTANT): Sample No. 6.000000 count completed. 2023-05-23T07:39:09.050Z,1684827549.050 [circle_sample:SetSampleOptions:D](IMPORTANT): Set CartridgeType (if ESP), SettleDuration to -1.000000 count , 5.000000 min . 2023-05-23T07:39:10.885Z,1684827550.885 [DAT](FAULT): Sending transmit timeout failure. 2023-05-23T07:39:21.222Z,1684827561.222 [DAT](FAULT): Sending transmit timeout failure. 2023-05-23T08:31:37.023Z,1684830697.023 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:F](IMPORTANT): Elapsed time since start or last firing(= 120.031340 min ) is longer than MaxWaitFirstSample (= 0.000000 min ) for the 1st sample, or longer than MaxWaitMustFire (= 120.000000 min ) for non-1st samples. Firing sample No. 7.000000 count 2023-05-23T08:32:16.644Z,1684830736.644 [circle_sample:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 99.800934 m , settling for 5.000000 min 2023-05-23T08:37:29.425Z,1684831049.425 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-05-23T08:37:29.532Z,1684831049.532 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-05-23T08:38:21.490Z,1684831101.490 [ESPComponent](IMPORTANT): ESP has connected as client 2023-05-23T08:38:22.302Z,1684831102.302 [ESPComponent](IMPORTANT): [sample #7] Setting cartridge argument to -1 2023-05-23T08:38:22.302Z,1684831102.302 [ESPComponent](IMPORTANT): [sample #7] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-05-23T08:38:22.732Z,1684831102.732 [circle_sample:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 99.644127 m in 9.428736 degC water with 0.042920 ug/l chlorophyll fluorescence. 2023-05-23T08:38:23.106Z,1684831103.106 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PREPARING_SHOW_LOG 2023-05-23T08:38:23.511Z,1684831103.511 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-05-23T08:38:25.570Z,1684831105.570 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_LOADING_CARTRIDGE 2023-05-23T08:38:57.456Z,1684831137.456 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PRIMING (@18,aRNAl_bac) 2023-05-23T08:39:00.291Z,1684831140.291 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PRIMING (@100.0) 2023-05-23T08:39:00.292Z,1684831140.292 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-05-23T08:39:00.678Z,1684831140.678 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-05-23T08:41:43.098Z,1684831303.098 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_FILTERING (@0.0) 2023-05-23T08:41:43.496Z,1684831303.496 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-05-23T09:29:54.164Z,1684834194.164 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PAUSED (@1000.0) 2023-05-23T09:29:54.563Z,1684834194.563 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PROCESSING (@1000.0) 2023-05-23T09:29:56.586Z,1684834196.586 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2023-05-23T09:29:56.982Z,1684834196.982 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PROCESSED (@18,aRNAl_bac) 2023-05-23T09:31:31.927Z,1684834291.927 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_STOPPING (@18,aRNAl_bac) 2023-05-23T09:31:39.613Z,1684834299.613 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-05-23T09:31:40.014Z,1684834300.014 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_STOPPED 2023-05-23T09:36:39.795Z,1684834599.795 [ESPComponent](IMPORTANT): [sample #7] ESP sampling sequence completed normally. 2023-05-23T09:36:42.262Z,1684834602.262 [circle_sample:SendSampleInfo:SampleInfo:C](IMPORTANT): CntSamples = 7.000000 count 2023-05-23T09:36:42.642Z,1684834602.642 [circle_sample:SendSampleInfo:SampleInfo:D](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2023-05-23T09:36:43.051Z,1684834603.051 [circle_sample:SendSampleInfo:SampleInfo:E](IMPORTANT): Science:ESPComponent.cartridge = -1 count 2023-05-23T09:36:43.463Z,1684834603.463 [circle_sample:SendSampleInfo:SampleInfo:F](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2023-05-23T09:36:43.855Z,1684834603.855 [circle_sample:SendSampleInfo:SampleInfo:G](IMPORTANT): Universal:depth = 99.974617 m 2023-05-23T09:36:44.263Z,1684834604.263 [circle_sample:SendSampleInfo:SampleInfo:H](IMPORTANT): Universal:sea_water_temperature = 9.478510 degC 2023-05-23T09:36:44.692Z,1684834604.692 [circle_sample:SendSampleInfo:SampleInfo:I](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 0.046400 ug/l 2023-05-23T09:36:45.463Z,1684834605.463 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:O](IMPORTANT): Sample No. 7.000000 count completed. 2023-05-23T09:36:49.942Z,1684834609.942 [circle_sample:SetSampleOptions:D](IMPORTANT): Set CartridgeType (if ESP), SettleDuration to -1.000000 count , 5.000000 min . 2023-05-23T09:36:51.729Z,1684834611.729 [DAT](FAULT): Sending transmit timeout failure. 2023-05-23T09:37:02.067Z,1684834622.067 [DAT](FAULT): Sending transmit timeout failure. 2023-05-23T10:31:39.743Z,1684837899.743 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:F](IMPORTANT): Elapsed time since start or last firing(= 120.031787 min ) is longer than MaxWaitFirstSample (= 0.000000 min ) for the 1st sample, or longer than MaxWaitMustFire (= 120.000000 min ) for non-1st samples. Firing sample No. 8.000000 count 2023-05-23T10:34:41.571Z,1684838081.571 [circle_sample:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 100.156479 m , settling for 5.000000 min 2023-05-23T10:39:54.437Z,1684838394.437 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-05-23T10:39:54.564Z,1684838394.564 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-05-23T10:40:46.476Z,1684838446.476 [ESPComponent](IMPORTANT): ESP has connected as client 2023-05-23T10:40:47.299Z,1684838447.299 [ESPComponent](IMPORTANT): [sample #8] Setting cartridge argument to -1 2023-05-23T10:40:47.299Z,1684838447.299 [ESPComponent](IMPORTANT): [sample #8] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-05-23T10:40:47.716Z,1684838447.716 [circle_sample:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 100.045883 m in 9.514185 degC water with 0.054520 ug/l chlorophyll fluorescence. 2023-05-23T10:40:48.091Z,1684838448.091 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PREPARING_SHOW_LOG 2023-05-23T10:40:48.494Z,1684838448.494 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-05-23T10:40:50.523Z,1684838450.523 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_LOADING_CARTRIDGE 2023-05-23T10:41:22.429Z,1684838482.429 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PRIMING (@17,aRNAl_bac) 2023-05-23T10:41:25.258Z,1684838485.258 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PRIMING (@100.0) 2023-05-23T10:41:25.259Z,1684838485.259 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-05-23T10:41:25.662Z,1684838485.662 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-05-23T10:44:08.496Z,1684838648.496 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_FILTERING (@0.0) 2023-05-23T10:44:08.900Z,1684838648.900 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-05-23T11:35:57.446Z,1684841757.446 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PAUSED (@1000.0) 2023-05-23T11:35:57.847Z,1684841757.847 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PROCESSING (@1000.0) 2023-05-23T11:35:59.871Z,1684841759.871 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2023-05-23T11:36:00.278Z,1684841760.278 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PROCESSED (@17,aRNAl_bac) 2023-05-23T11:37:35.211Z,1684841855.211 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_STOPPING (@17,aRNAl_bac) 2023-05-23T11:37:42.886Z,1684841862.886 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-05-23T11:37:43.299Z,1684841863.299 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_STOPPED 2023-05-23T11:42:43.062Z,1684842163.062 [ESPComponent](IMPORTANT): [sample #8] ESP sampling sequence completed normally. 2023-05-23T11:42:45.542Z,1684842165.542 [circle_sample:SendSampleInfo:SampleInfo:C](IMPORTANT): CntSamples = 8.000000 count 2023-05-23T11:42:45.913Z,1684842165.913 [circle_sample:SendSampleInfo:SampleInfo:D](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2023-05-23T11:42:46.326Z,1684842166.326 [circle_sample:SendSampleInfo:SampleInfo:E](IMPORTANT): Science:ESPComponent.cartridge = -1 count 2023-05-23T11:42:46.729Z,1684842166.729 [circle_sample:SendSampleInfo:SampleInfo:F](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2023-05-23T11:42:47.122Z,1684842167.122 [circle_sample:SendSampleInfo:SampleInfo:G](IMPORTANT): Universal:depth = 100.007858 m 2023-05-23T11:42:47.529Z,1684842167.529 [circle_sample:SendSampleInfo:SampleInfo:H](IMPORTANT): Universal:sea_water_temperature = 9.544306 degC 2023-05-23T11:42:47.938Z,1684842167.938 [circle_sample:SendSampleInfo:SampleInfo:I](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 0.058000 ug/l 2023-05-23T11:42:48.803Z,1684842168.803 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:O](IMPORTANT): Sample No. 8.000000 count completed. 2023-05-23T11:42:53.189Z,1684842173.189 [circle_sample:SetSampleOptions:D](IMPORTANT): Set CartridgeType (if ESP), SettleDuration to -1.000000 count , 5.000000 min . 2023-05-23T11:42:54.873Z,1684842174.873 [DAT](FAULT): Sending transmit timeout failure. 2023-05-23T11:43:05.217Z,1684842185.217 [DAT](FAULT): Sending transmit timeout failure. 2023-05-23T11:43:20.351Z,1684842200.351 [DAT](FAULT): failed to enter command mode 2023-05-23T11:54:31.421Z,1684842871.421 [CBIT](IMPORTANT): Beginning ground fault scan 2023-05-23T11:54:42.439Z,1684842882.439 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.002439 CHAN A1 (24V): 0.000178 CHAN A2 (12V): 0.000378 CHAN A3 (5V): -0.000819 CHAN B0 (3.3V): -0.000050 CHAN B1 (3.15aV): -0.000143 CHAN B2 (3.15bV): 0.000503 CHAN B3 (GND): -0.000321 OPEN: 0.007540 Full Scale: +/- 1 mA 2023-05-23T12:31:42.267Z,1684845102.267 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:F](IMPORTANT): Elapsed time since start or last firing(= 120.028532 min ) is longer than MaxWaitFirstSample (= 0.000000 min ) for the 1st sample, or longer than MaxWaitMustFire (= 120.000000 min ) for non-1st samples. Firing sample No. 9.000000 count 2023-05-23T12:32:30.762Z,1684845150.762 [circle_sample:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 99.771126 m , settling for 5.000000 min 2023-05-23T12:37:43.545Z,1684845463.545 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-05-23T12:37:43.689Z,1684845463.689 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-05-23T12:38:36.035Z,1684845516.035 [ESPComponent](IMPORTANT): ESP has connected as client 2023-05-23T12:38:36.848Z,1684845516.848 [ESPComponent](IMPORTANT): [sample #9] Setting cartridge argument to -1 2023-05-23T12:38:36.849Z,1684845516.849 [ESPComponent](IMPORTANT): [sample #9] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-05-23T12:38:37.288Z,1684845517.288 [circle_sample:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 99.069138 m in 9.503077 degC water with 0.061480 ug/l chlorophyll fluorescence. 2023-05-23T12:38:37.642Z,1684845517.642 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PREPARING_SHOW_LOG 2023-05-23T12:38:38.059Z,1684845518.059 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-05-23T12:38:40.066Z,1684845520.066 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_LOADING_CARTRIDGE 2023-05-23T12:39:11.987Z,1684845551.987 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_PRIMING (@16,aRNAl_bac) 2023-05-23T12:39:14.811Z,1684845554.811 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PRIMING (@100.0) 2023-05-23T12:39:14.812Z,1684845554.812 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-05-23T12:39:15.214Z,1684845555.214 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-05-23T12:39:54.161Z,1684845594.161 [ElevatorServo](FAULT): Elevator uart error: serial timeout 2023-05-23T12:41:57.623Z,1684845717.623 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_FILTERING (@0.0) 2023-05-23T12:41:58.037Z,1684845718.037 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-05-23T13:26:38.797Z,1684848398.797 [ThrusterHE](FAULT): getSpeed error serial timeout 2023-05-23T13:26:38.798Z,1684848398.798 [ThrusterHE](FAULT): Thruster uart error: serial timeout 2023-05-23T13:28:52.495Z,1684848532.495 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PAUSED (@1000.0) 2023-05-23T13:28:52.891Z,1684848532.891 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PROCESSING (@1000.0) 2023-05-23T13:28:54.910Z,1684848534.910 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2023-05-23T13:28:55.314Z,1684848535.314 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_PROCESSED (@16,aRNAl_bac) 2023-05-23T13:30:30.254Z,1684848630.254 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_STOPPING (@16,aRNAl_bac) 2023-05-23T13:30:37.936Z,1684848637.936 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-05-23T13:30:38.340Z,1684848638.340 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_STOPPED 2023-05-23T13:34:13.809Z,1684848853.809 [RudderServo](FAULT): Rudder uart error - getPosition..serial timeout 2023-05-23T13:35:38.111Z,1684848938.111 [ESPComponent](IMPORTANT): [sample #9] ESP sampling sequence completed normally. 2023-05-23T13:35:40.566Z,1684848940.566 [circle_sample:SendSampleInfo:SampleInfo:C](IMPORTANT): CntSamples = 9.000000 count 2023-05-23T13:35:40.949Z,1684848940.949 [circle_sample:SendSampleInfo:SampleInfo:D](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2023-05-23T13:35:41.361Z,1684848941.361 [circle_sample:SendSampleInfo:SampleInfo:E](IMPORTANT): Science:ESPComponent.cartridge = -1 count 2023-05-23T13:35:41.771Z,1684848941.771 [circle_sample:SendSampleInfo:SampleInfo:F](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2023-05-23T13:35:42.186Z,1684848942.186 [circle_sample:SendSampleInfo:SampleInfo:G](IMPORTANT): Universal:depth = 99.440590 m 2023-05-23T13:35:42.566Z,1684848942.566 [circle_sample:SendSampleInfo:SampleInfo:H](IMPORTANT): Universal:sea_water_temperature = 9.372705 degC 2023-05-23T13:35:42.971Z,1684848942.971 [circle_sample:SendSampleInfo:SampleInfo:I](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 0.046400 ug/l 2023-05-23T13:35:43.800Z,1684848943.800 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:O](IMPORTANT): Sample No. 9.000000 count completed. 2023-05-23T13:35:48.252Z,1684848948.252 [circle_sample:SetSampleOptions:D](IMPORTANT): Set CartridgeType (if ESP), SettleDuration to -1.000000 count , 5.000000 min . 2023-05-23T13:35:49.941Z,1684848949.941 [DAT](FAULT): Sending transmit timeout failure. 2023-05-23T13:36:00.273Z,1684848960.273 [DAT](FAULT): Sending transmit timeout failure. 2023-05-23T13:36:22.962Z,1684848982.962 [DAT](FAULT): failed to enter command mode 2023-05-23T14:31:44.719Z,1684852304.719 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:F](IMPORTANT): Elapsed time since start or last firing(= 120.027197 min ) is longer than MaxWaitFirstSample (= 0.000000 min ) for the 1st sample, or longer than MaxWaitMustFire (= 120.000000 min ) for non-1st samples. Firing sample No. 10.000000 count 2023-05-23T14:33:12.409Z,1684852392.409 [circle_sample:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 99.786171 m , settling for 5.000000 min 2023-05-23T14:38:25.185Z,1684852705.185 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-05-23T14:38:25.361Z,1684852705.361 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-05-23T14:39:17.667Z,1684852757.667 [ESPComponent](IMPORTANT): ESP has connected as client 2023-05-23T14:39:18.494Z,1684852758.494 [ESPComponent](IMPORTANT): [sample #10] Setting cartridge argument to -1 2023-05-23T14:39:18.494Z,1684852758.494 [ESPComponent](IMPORTANT): [sample #10] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-05-23T14:39:18.928Z,1684852758.928 [circle_sample:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 99.968895 m in 9.409479 degC water with 0.045240 ug/l chlorophyll fluorescence. 2023-05-23T14:39:19.282Z,1684852759.282 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PREPARING_SHOW_LOG 2023-05-23T14:39:19.687Z,1684852759.687 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-05-23T14:39:21.706Z,1684852761.706 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_LOADING_CARTRIDGE 2023-05-23T14:39:53.627Z,1684852793.627 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PRIMING (@15,aRNAl_bac) 2023-05-23T14:39:56.452Z,1684852796.452 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PRIMING (@100.0) 2023-05-23T14:39:56.454Z,1684852796.454 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-05-23T14:39:56.859Z,1684852796.859 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-05-23T14:42:39.666Z,1684852959.666 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_FILTERING (@0.0) 2023-05-23T14:42:40.070Z,1684852960.070 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-05-23T15:30:27.336Z,1684855827.336 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PAUSED (@1000.0) 2023-05-23T15:30:27.718Z,1684855827.718 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PROCESSING (@1000.0) 2023-05-23T15:30:29.739Z,1684855829.739 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2023-05-23T15:30:30.141Z,1684855830.141 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PROCESSED (@15,aRNAl_bac) 2023-05-23T15:32:05.082Z,1684855925.082 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_STOPPING (@15,aRNAl_bac) 2023-05-23T15:32:12.768Z,1684855932.768 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-05-23T15:32:13.189Z,1684855933.189 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_STOPPED 2023-05-23T15:37:12.945Z,1684856232.945 [ESPComponent](IMPORTANT): [sample #10] ESP sampling sequence completed normally. 2023-05-23T15:37:15.408Z,1684856235.408 [circle_sample:SendSampleInfo:SampleInfo:C](IMPORTANT): CntSamples = 10.000000 count 2023-05-23T15:37:15.805Z,1684856235.805 [circle_sample:SendSampleInfo:SampleInfo:D](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2023-05-23T15:37:16.221Z,1684856236.221 [circle_sample:SendSampleInfo:SampleInfo:E](IMPORTANT): Science:ESPComponent.cartridge = -1 count 2023-05-23T15:37:16.605Z,1684856236.605 [circle_sample:SendSampleInfo:SampleInfo:F](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2023-05-23T15:37:17.011Z,1684856237.011 [circle_sample:SendSampleInfo:SampleInfo:G](IMPORTANT): Universal:depth = 99.604691 m 2023-05-23T15:37:17.428Z,1684856237.428 [circle_sample:SendSampleInfo:SampleInfo:H](IMPORTANT): Universal:sea_water_temperature = 9.370813 degC 2023-05-23T15:37:17.837Z,1684856237.837 [circle_sample:SendSampleInfo:SampleInfo:I](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 0.046400 ug/l 2023-05-23T15:37:18.651Z,1684856238.651 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:O](IMPORTANT): Sample No. 10.000000 count completed. 2023-05-23T15:37:23.090Z,1684856243.090 [circle_sample:SetSampleOptions:D](IMPORTANT): Set CartridgeType (if ESP), SettleDuration to -1.000000 count , 5.000000 min . 2023-05-23T15:37:24.685Z,1684856244.685 [DAT](FAULT): Sending transmit timeout failure. 2023-05-23T15:37:35.030Z,1684856255.030 [DAT](FAULT): Sending transmit timeout failure. 2023-05-23T16:31:47.499Z,1684859507.499 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:F](IMPORTANT): Elapsed time since start or last firing(= 120.032707 min ) is longer than MaxWaitFirstSample (= 0.000000 min ) for the 1st sample, or longer than MaxWaitMustFire (= 120.000000 min ) for non-1st samples. Firing sample No. 11.000000 count 2023-05-23T16:33:30.539Z,1684859610.539 [circle_sample:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 99.823242 m , settling for 5.000000 min 2023-05-23T16:38:43.293Z,1684859923.293 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-05-23T16:38:43.406Z,1684859923.406 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-05-23T16:39:36.118Z,1684859976.118 [ESPComponent](IMPORTANT): ESP has connected as client 2023-05-23T16:39:36.924Z,1684859976.924 [ESPComponent](IMPORTANT): [sample #11] Setting cartridge argument to -1 2023-05-23T16:39:36.925Z,1684859976.925 [ESPComponent](IMPORTANT): [sample #11] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-05-23T16:39:37.378Z,1684859977.378 [circle_sample:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 99.945938 m in 9.425043 degC water with 0.045240 ug/l chlorophyll fluorescence. 2023-05-23T16:39:37.732Z,1684859977.732 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PREPARING_SHOW_LOG 2023-05-23T16:39:38.139Z,1684859978.139 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-05-23T16:39:40.163Z,1684859980.163 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_LOADING_CARTRIDGE 2023-05-23T16:40:12.079Z,1684860012.079 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PRIMING (@14,aRNAl_bac) 2023-05-23T16:40:14.915Z,1684860014.915 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PRIMING (@100.0) 2023-05-23T16:40:14.916Z,1684860014.916 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-05-23T16:40:15.311Z,1684860015.311 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-05-23T16:42:58.119Z,1684860178.119 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_FILTERING (@0.0) 2023-05-23T16:42:58.518Z,1684860178.518 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-05-23T16:43:50.377Z,1684860230.377 [ElevatorServo](FAULT): Reading outside of valid range:0.000000 2023-05-23T16:43:50.989Z,1684860230.989 [ElevatorServo](FAULT): Elevator uart error - getPosition.serial timeout 2023-05-23T17:29:35.936Z,1684862975.936 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PAUSED (@1000.0) 2023-05-23T17:29:36.359Z,1684862976.359 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PROCESSING (@1000.0) 2023-05-23T17:29:38.364Z,1684862978.364 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2023-05-23T17:29:38.762Z,1684862978.762 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PROCESSED (@14,aRNAl_bac) 2023-05-23T17:31:13.705Z,1684863073.705 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_STOPPING (@14,aRNAl_bac) 2023-05-23T17:31:21.384Z,1684863081.384 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-05-23T17:31:21.787Z,1684863081.787 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_STOPPED 2023-05-23T17:36:21.591Z,1684863381.591 [ESPComponent](IMPORTANT): [sample #11] ESP sampling sequence completed normally. 2023-05-23T17:36:24.044Z,1684863384.044 [circle_sample:SendSampleInfo:SampleInfo:C](IMPORTANT): CntSamples = 11.000000 count 2023-05-23T17:36:24.444Z,1684863384.444 [circle_sample:SendSampleInfo:SampleInfo:D](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2023-05-23T17:36:24.851Z,1684863384.851 [circle_sample:SendSampleInfo:SampleInfo:E](IMPORTANT): Science:ESPComponent.cartridge = -1 count 2023-05-23T17:36:25.291Z,1684863385.291 [circle_sample:SendSampleInfo:SampleInfo:F](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2023-05-23T17:36:25.678Z,1684863385.678 [circle_sample:SendSampleInfo:SampleInfo:G](IMPORTANT): Universal:depth = 99.640945 m 2023-05-23T17:36:26.055Z,1684863386.055 [circle_sample:SendSampleInfo:SampleInfo:H](IMPORTANT): Universal:sea_water_temperature = 9.300409 degC 2023-05-23T17:36:26.562Z,1684863386.562 [circle_sample:SendSampleInfo:SampleInfo:I](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 0.034800 ug/l 2023-05-23T17:36:27.324Z,1684863387.324 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:O](IMPORTANT): Sample No. 11.000000 count completed. 2023-05-23T17:36:31.741Z,1684863391.741 [circle_sample:SetSampleOptions:D](IMPORTANT): Set CartridgeType (if ESP), SettleDuration to -1.000000 count , 5.000000 min . 2023-05-23T17:36:33.470Z,1684863393.470 [DAT](FAULT): Sending transmit timeout failure. 2023-05-23T17:36:38.762Z,1684863398.762 [DAT](FAULT): failed to set remote address 2023-05-23T17:36:43.805Z,1684863403.805 [DAT](FAULT): Sending transmit timeout failure. 2023-05-23T17:37:27.662Z,1684863447.662 [DAT](FAULT): failed to set remote address 2023-05-23T17:38:12.802Z,1684863492.802 [DAT](FAULT): failed to set remote address 2023-05-23T17:38:58.198Z,1684863538.198 [DAT](FAULT): failed to set remote address 2023-05-23T17:39:43.309Z,1684863583.309 [DAT](FAULT): failed to set remote address 2023-05-23T17:40:28.682Z,1684863628.682 [DAT](FAULT): failed to set remote address 2023-05-23T17:41:14.322Z,1684863674.322 [DAT](FAULT): failed to set remote address 2023-05-23T17:41:59.450Z,1684863719.450 [DAT](FAULT): failed to set remote address 2023-05-23T17:42:44.854Z,1684863764.854 [DAT](FAULT): failed to set remote address 2023-05-23T17:43:30.007Z,1684863810.007 [DAT](FAULT): failed to set remote address 2023-05-23T17:45:56.761Z,1684863956.761 [DAT](FAULT): failed to enter command mode 2023-05-23T17:54:42.673Z,1684864482.673 [CBIT](IMPORTANT): Beginning ground fault scan 2023-05-23T17:54:53.531Z,1684864493.531 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.001943 CHAN A1 (24V): 0.000202 CHAN A2 (12V): 0.000402 CHAN A3 (5V): -0.000307 CHAN B0 (3.3V): 0.000242 CHAN B1 (3.15aV): 0.000047 CHAN B2 (3.15bV): 0.000106 CHAN B3 (GND): -0.000234 OPEN: 0.007681 Full Scale: +/- 1 mA 2023-05-23T18:31:50.232Z,1684866710.232 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:F](IMPORTANT): Elapsed time since start or last firing(= 120.032308 min ) is longer than MaxWaitFirstSample (= 0.000000 min ) for the 1st sample, or longer than MaxWaitMustFire (= 120.000000 min ) for non-1st samples. Firing sample No. 12.000000 count 2023-05-23T18:37:19.504Z,1684867039.504 [circle_sample:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 100.119118 m , settling for 5.000000 min 2023-05-23T18:42:32.297Z,1684867352.297 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-05-23T18:42:32.442Z,1684867352.442 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-05-23T18:43:25.130Z,1684867405.130 [ESPComponent](IMPORTANT): ESP has connected as client 2023-05-23T18:43:25.938Z,1684867405.938 [ESPComponent](IMPORTANT): [sample #12] Setting cartridge argument to -1 2023-05-23T18:43:25.939Z,1684867405.939 [ESPComponent](IMPORTANT): [sample #12] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-05-23T18:43:26.370Z,1684867406.370 [circle_sample:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 100.090164 m in 9.229334 degC water with 0.031320 ug/l chlorophyll fluorescence. 2023-05-23T18:43:26.748Z,1684867406.748 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PREPARING_SHOW_LOG 2023-05-23T18:43:27.152Z,1684867407.152 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-05-23T18:43:29.172Z,1684867409.172 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_LOADING_CARTRIDGE 2023-05-23T18:44:01.157Z,1684867441.157 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PRIMING (@13,aRNAl_bac) 2023-05-23T18:44:03.939Z,1684867443.939 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PRIMING (@100.0) 2023-05-23T18:44:03.940Z,1684867443.940 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-05-23T18:44:04.343Z,1684867444.343 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-05-23T18:46:47.189Z,1684867607.189 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_FILTERING (@0.0) 2023-05-23T18:46:47.543Z,1684867607.543 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-05-23T19:02:21.333Z,1684868541.333 [ThrusterHE](FAULT): Could not get status:serial timeout 2023-05-23T19:33:30.580Z,1684870410.580 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PAUSED (@1000.0) 2023-05-23T19:33:30.986Z,1684870410.986 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PROCESSING (@1000.0) 2023-05-23T19:33:33.004Z,1684870413.004 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2023-05-23T19:33:33.415Z,1684870413.415 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PROCESSED (@13,aRNAl_bac) 2023-05-23T19:35:08.351Z,1684870508.351 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_STOPPING (@13,aRNAl_bac) 2023-05-23T19:35:16.026Z,1684870516.026 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-05-23T19:35:16.435Z,1684870516.435 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_STOPPED 2023-05-23T19:40:16.208Z,1684870816.208 [ESPComponent](IMPORTANT): [sample #12] ESP sampling sequence completed normally. 2023-05-23T19:40:18.675Z,1684870818.675 [circle_sample:SendSampleInfo:SampleInfo:C](IMPORTANT): CntSamples = 12.000000 count 2023-05-23T19:40:19.096Z,1684870819.096 [circle_sample:SendSampleInfo:SampleInfo:D](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2023-05-23T19:40:19.503Z,1684870819.503 [circle_sample:SendSampleInfo:SampleInfo:E](IMPORTANT): Science:ESPComponent.cartridge = -1 count 2023-05-23T19:40:19.888Z,1684870819.888 [circle_sample:SendSampleInfo:SampleInfo:F](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2023-05-23T19:40:20.299Z,1684870820.299 [circle_sample:SendSampleInfo:SampleInfo:G](IMPORTANT): Universal:depth = 100.783043 m 2023-05-23T19:40:20.710Z,1684870820.710 [circle_sample:SendSampleInfo:SampleInfo:H](IMPORTANT): Universal:sea_water_temperature = 9.304102 degC 2023-05-23T19:40:21.127Z,1684870821.127 [circle_sample:SendSampleInfo:SampleInfo:I](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 0.034800 ug/l 2023-05-23T19:40:21.902Z,1684870821.902 [circle_sample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:O](IMPORTANT): Sample No. 12.000000 count completed. 2023-05-23T19:40:26.380Z,1684870826.380 [circle_sample:SetSampleOptions:D](IMPORTANT): Set CartridgeType (if ESP), SettleDuration to -1.000000 count , 5.000000 min . 2023-05-23T19:40:28.145Z,1684870828.145 [DAT](FAULT): Sending transmit timeout failure. 2023-05-23T19:40:33.454Z,1684870833.454 [DAT](FAULT): failed to set remote address 2023-05-23T19:40:38.494Z,1684870838.494 [DAT](FAULT): Sending transmit timeout failure. 2023-05-23T19:41:54.141Z,1684870914.141 [DAT](FAULT): failed to set remote address 2023-05-23T19:42:39.309Z,1684870959.309 [DAT](FAULT): failed to set remote address 2023-05-23T19:43:24.710Z,1684871004.710 [DAT](FAULT): failed to set remote address 2023-05-23T19:44:09.842Z,1684871049.842 [DAT](FAULT): failed to set remote address 2023-05-23T19:44:55.242Z,1684871095.242 [DAT](FAULT): failed to set remote address 2023-05-23T19:45:40.407Z,1684871140.407 [DAT](FAULT): failed to set remote address 2023-05-23T19:46:25.546Z,1684871185.546 [DAT](FAULT): failed to set remote address 2023-05-23T19:47:10.930Z,1684871230.930 [DAT](FAULT): failed to set remote address 2023-05-23T19:47:56.046Z,1684871276.046 [DAT](FAULT): failed to set remote address 2023-05-23T19:48:41.430Z,1684871321.430 [DAT](FAULT): failed to set remote address 2023-05-23T19:49:26.802Z,1684871366.802 [DAT](FAULT): failed to set remote address 2023-05-23T19:50:57.092Z,1684871457.092 [DAT](FAULT): failed to set remote address 2023-05-23T19:51:42.485Z,1684871502.485 [DAT](FAULT): failed to set remote address 2023-05-23T19:52:27.613Z,1684871547.613 [DAT](FAULT): failed to set remote address 2023-05-23T19:53:12.762Z,1684871592.762 [DAT](FAULT): failed to set remote address 2023-05-23T19:53:58.194Z,1684871638.194 [DAT](FAULT): failed to set remote address 2023-05-23T19:54:43.338Z,1684871683.338 [DAT](FAULT): failed to set remote address 2023-05-23T19:55:28.727Z,1684871728.727 [DAT](FAULT): failed to set remote address 2023-05-23T19:56:13.861Z,1684871773.861 [DAT](FAULT): failed to set remote address 2023-05-23T20:31:13.459Z,1684873873.459 [circle_sample:CycleLogs:A:B](IMPORTANT): Restarting logs.