2019-10-04T04:52:25.536Z,1570164745.536 [Supervisor](IMPORTANT): Reading configuration overrides from Data/persisted.cfg
2019-10-04T04:52:30.059Z,1570164750.059 [SBIT](IMPORTANT): git: 2019-10-03
2019-10-04T04:52:30.060Z,1570164750.060 [SBIT](IMPORTANT): Kernel Release: 2.6.27.8
2019-10-04T04:53:04.846Z,1570164784.846 [SBIT](IMPORTANT): Beginning Startup BIT
2019-10-04T04:53:04.850Z,1570164784.850 [CBIT](IMPORTANT): Beginning ground fault scan
2019-10-04T04:53:15.842Z,1570164795.842 [CBIT](IMPORTANT): Ground fault detected
mA:
CHAN A0 (Batt): -0.010253
CHAN A1 (24V): 0.179117
CHAN A2 (12V): -0.004610
CHAN A3 (5V): -0.003670
CHAN B0 (3.3V): -0.001023
CHAN B1 (3.15aV): -0.001515
CHAN B2 (3.15bV): -0.001994
CHAN B3 (GND): -0.000831
OPEN: 0.004521
Full Scale Calc: 4.765 mA, -1.589 mA
2019-10-04T04:53:58.106Z,1570164838.106 [SBIT](IMPORTANT): SBIT PASSED
2019-10-04T04:53:58.191Z,1570164838.191 [CommandLine](IMPORTANT): got command configSet list
2019-10-04T04:53:58.191Z,1570164838.191 [CommandLine](IMPORTANT): Listing configuration overrides from Data/persisted.cfg
2019-10-04T04:53:58.193Z,1570164838.193 [CommandLine](IMPORTANT): BPC1.batteryMissingStickThreshold=2 count;

2019-10-04T04:53:58.193Z,1570164838.193 [CommandLine](IMPORTANT): BR_Ping1D.loadAtStartup=0 bool;

2019-10-04T04:53:58.193Z,1570164838.193 [CommandLine](IMPORTANT): DAT.loadAtStartup=0 bool;

2019-10-04T04:53:58.193Z,1570164838.193 [CommandLine](IMPORTANT): DVL_micro.loadAtStartup=0 bool;

2019-10-04T04:53:58.194Z,1570164838.194 [CommandLine](IMPORTANT): Express none CTD_Seabird.bin_median_sea_water_salinity;

2019-10-04T04:53:58.194Z,1570164838.194 [CommandLine](IMPORTANT): Express linearApproximation WetLabsBB2FL.bin_mean_mass_concentration_of_chlorophyll_in_sea_water 0.100000 microgram_per_liter;

2019-10-04T04:53:58.194Z,1570164838.194 [CommandLine](IMPORTANT): Express linearApproximation depth 5.000000 meter;

2019-10-04T04:53:58.194Z,1570164838.194 [CommandLine](IMPORTANT): Express linearApproximation latitude 0.005000 degree;

2019-10-04T04:53:58.194Z,1570164838.194 [CommandLine](IMPORTANT): Express linearApproximation longitude 0.005000 degree;

2019-10-04T04:53:58.194Z,1570164838.194 [CommandLine](IMPORTANT): VerticalControl.buoyancyNeutral=168 cubic_centimeter;

2019-10-04T04:53:58.194Z,1570164838.194 [CommandLine](IMPORTANT): VerticalControl.massDefault=3.7 millimeter;

2019-10-04T04:53:58.513Z,1570164838.513 [MissionManager](IMPORTANT): Started mission Startup
2019-10-04T04:55:31.846Z,1570164931.846 [MissionManager](IMPORTANT): Started mission Default
2019-10-04T05:01:57.077Z,1570165317.077 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 6.413885 min 
2019-10-04T05:02:25.394Z,1570165345.394 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2270, MT Status=1, MTMSN=58
2019-10-04T05:02:26.176Z,1570165346.176 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_yoyo_sampling.xml;set Smear.MissionTimeout 6 hour;set Smear.MaxWaitNoFiring 2.5 hour;set Smear.SpeedSampling 0.8 meter_per_second;set Smear.MaxDepth 295 meter;set Smear.ShallowBoundSmear1 50 meter" 3rkim 1 3.000000
2019-10-04T05:02:26.177Z,1570165346.177 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=3rkim
2019-10-04T05:02:26.178Z,1570165346.178 [CommandLine](IMPORTANT): Scheduled #1 (#1 of 3 with id='3rkim'): "load Science/smear_yoyo_sampling.xml;set Smear.MissionTimeout 6 hour;set Smear.MaxWaitNoFiring 2.5 hour;set Smear.SpeedSampling 0.8 meter_per_second;set Smear.MaxDepth 295 meter;set Smear.ShallowBoundSmear1 50 meter" ASAP
2019-10-04T05:02:46.368Z,1570165366.368 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2271, MT Status=1, MTMSN=59
2019-10-04T05:02:47.464Z,1570165367.464 [CommandLine](IMPORTANT): got command schedule asap "set Smear.ShallowBoundSmear2 160 meter;set Smear.ShallowBoundSmear3 230 meter;set Smear.ThicknessSmear1 5 meter;set Smear.ThicknessSmear2 5 meter;set Smear.ThicknessSmear3 5 meter;set Smear.Wait1 5 minute;set Smear.Wait2 0 minute" 3rkim 2 3.000000
2019-10-04T05:02:47.464Z,1570165367.464 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=3rkim
2019-10-04T05:02:47.465Z,1570165367.465 [CommandLine](IMPORTANT): Scheduled #2 (#2 of 3 with id='3rkim'): "set Smear.ShallowBoundSmear2 160 meter;set Smear.ShallowBoundSmear3 230 meter;set Smear.ThicknessSmear1 5 meter;set Smear.ThicknessSmear2 5 meter;set Smear.ThicknessSmear3 5 meter;set Smear.Wait1 5 minute;set Smear.Wait2 0 minute" ASAP
2019-10-04T05:02:56.573Z,1570165376.573 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=2272, MT Status=1, MTMSN=60
2019-10-04T05:02:57.197Z,1570165377.197 [CommandLine](IMPORTANT): got command schedule asap "set Smear.Wait3 0 minute;run " 3rkim 3 3.000000
2019-10-04T05:02:57.197Z,1570165377.197 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=3rkim
2019-10-04T05:02:57.198Z,1570165377.198 [CommandLine](IMPORTANT): Scheduled #3 (#3 of 3 with id='3rkim'): "set Smear.Wait3 0 minute;run " ASAP
2019-10-04T05:02:57.329Z,1570165377.329 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_yoyo_sampling.xml
2019-10-04T05:03:10.951Z,1570165390.951 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_yoyo_sampling.xml
2019-10-04T05:03:22.522Z,1570165402.522 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 6.000000 hour
2019-10-04T05:03:22.523Z,1570165402.523 [CommandLine](IMPORTANT): got command set Smear.MaxWaitNoFiring 2.500000 hour
2019-10-04T05:03:22.524Z,1570165402.524 [CommandLine](IMPORTANT): got command set Smear.SpeedSampling 0.800000 meter_per_second
2019-10-04T05:03:22.525Z,1570165402.525 [CommandLine](IMPORTANT): got command set Smear.MaxDepth 295.000000 meter
2019-10-04T05:03:22.525Z,1570165402.525 [CommandLine](IMPORTANT): got command set Smear.ShallowBoundSmear1 50.000000 meter
2019-10-04T05:03:36.877Z,1570165416.877 [CommandLine](IMPORTANT): got command set Smear.ShallowBoundSmear2 160.000000 meter
2019-10-04T05:03:36.878Z,1570165416.878 [CommandLine](IMPORTANT): got command set Smear.ShallowBoundSmear3 230.000000 meter
2019-10-04T05:03:36.878Z,1570165416.878 [CommandLine](IMPORTANT): got command set Smear.ThicknessSmear1 5.000000 meter
2019-10-04T05:03:36.879Z,1570165416.879 [CommandLine](IMPORTANT): got command set Smear.ThicknessSmear2 5.000000 meter
2019-10-04T05:03:36.880Z,1570165416.880 [CommandLine](IMPORTANT): got command set Smear.ThicknessSmear3 5.000000 meter
2019-10-04T05:03:36.881Z,1570165416.881 [CommandLine](IMPORTANT): got command set Smear.Wait1 5.000000 minute
2019-10-04T05:03:36.881Z,1570165416.881 [CommandLine](IMPORTANT): got command set Smear.Wait2 0.000000 minute
2019-10-04T05:03:38.113Z,1570165418.113 [CommandLine](IMPORTANT): got command set Smear.Wait3 0.000000 minute
2019-10-04T05:03:38.113Z,1570165418.113 [CommandLine](IMPORTANT): got command run 
2019-10-04T05:03:38.120Z,1570165418.120 [CommandLine](IMPORTANT): Running 
2019-10-04T05:03:38.208Z,1570165418.208 [MissionManager](IMPORTANT): Started mission Smear
2019-10-04T05:03:38.283Z,1570165418.283 [Smear:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 21.00 hours.
2019-10-04T05:03:39.023Z,1570165419.023 [Smear:TakeSamples:SetOptionsOfSample1:SettingsSample1:C](IMPORTANT): Set YoYoMinDepth to 50.000000 m , YoYoMaxDepth to 55.000000 m .
2019-10-04T05:03:39.024Z,1570165419.024 [Smear:InitializeWithGPSlatlon:C](IMPORTANT): Initialize CenterLatitude and CenterLongitude to GPS fix: 36.710593 arcdeg , -122.215301 arcdeg .
2019-10-04T05:05:56.904Z,1570165556.904 [Smear:Cylinder:CylinderYoYo:A](IMPORTANT): Yoyo profile on a cylinder around location 36.710593 arcdeg , -122.215301 arcdeg , at radius = 20.000000 m .
2019-10-04T05:10:35.369Z,1570165835.369 [Smear:TakeSamples:Firing:B](IMPORTANT): Taking ESP sample No. 1.000000 count .
2019-10-04T05:10:36.561Z,1570165836.561 [Smear:InsertWait:A](IMPORTANT): Wait 5.000000 min before firing sample.
2019-10-04T05:15:39.176Z,1570166139.176 [Smear:ESPSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 55.628860 m , 10.879510 degC , nan ug/l .
2019-10-04T05:15:40.372Z,1570166140.372 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::'
2019-10-04T05:15:40.827Z,1570166140.827 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.12.2:10.89.12.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2019-10-04T05:15:41.113Z,1570166141.113 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2019-10-04T05:16:16.824Z,1570166176.824 [ESPComponent](IMPORTANT): ESP has connected as client
2019-10-04T05:16:17.756Z,1570166177.756 [ESPComponent](IMPORTANT): [sample #1] Explicit cartridge argument not given
2019-10-04T05:16:17.757Z,1570166177.757 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2019-10-04T05:16:18.099Z,1570166178.099 [Smear:ESPSampling:TriggerESP:F](IMPORTANT): Wait for ESP sampling to complete.
2019-10-04T05:16:18.848Z,1570166178.848 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG
2019-10-04T05:16:19.260Z,1570166179.260 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS
2019-10-04T05:16:20.871Z,1570166180.871 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE
2019-10-04T05:16:53.589Z,1570166213.589 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PRIMING (@59,archive_bac)
2019-10-04T05:16:55.211Z,1570166215.211 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PRIMING (@100.0)
2019-10-04T05:16:56.020Z,1570166216.020 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2019-10-04T05:18:06.728Z,1570166286.728 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING (@0.0)
2019-10-04T05:18:08.763Z,1570166288.763 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs &
2019-10-04T05:18:09.151Z,1570166289.151 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_ERROR (@0.0)
2019-10-04T05:23:08.948Z,1570166588.948 [ESPComponent](CRITICAL): [sample #1] ESP sampling sequence terminated with error: Unexpected ESP state ESP_STATE_FILTERING_ERR. Expecting one of: ESP_STATE_PRIMING, ESP_STATE_FILTERING
2019-10-04T05:23:09.180Z,1570166589.180 [CommandLine](FAULT): Scheduling is paused
2019-10-04T05:23:09.337Z,1570166589.337 [ESPComponent](IMPORTANT): [sample #1] ESP log summary report (8 messages):
@22:16:31.00 Selecting Cartridge 59
@22:17:00.15 Cartridge::Sampler::Leak in FILTERING -- Isolated toroid pressure fell by 22% to 72.6psia
@22:17:00.17 Retry #1 of 2
@22:17:00.21 Selecting Cartridge 58
@22:17:31.72 Cartridge::Sampler::Leak in FILTERING -- Serious Leak or Stall -- 0.90ml/s made only -4.1psi vacuum
@22:17:31.73 Retry #2 of 2
@22:17:31.78 Selecting Cartridge 57
@22:18:04.79 Cartridge::Sampler::Leak in FILTERING -- Serious Leak or Stall -- 0.93ml/s made only -0.3psi vacuum

2019-10-04T05:23:10.294Z,1570166590.294 [MissionManager](IMPORTANT): Started mission Default
2019-10-04T05:23:11.003Z,1570166591.003 [BuoyancyServo](FAULT): Buoyancy getPosition uart error.serial timeout
2019-10-04T05:31:21.034Z,1570167081.034 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=2281, MT Status=1, MTMSN=61
2019-10-04T05:31:21.849Z,1570167081.849 [CommandLine](IMPORTANT): got command schedule "load Science/profile_station.xml;set profile_station.MissionTimeout 10 hour;set profile_station.Lat 36.712110 degree;set profile_station.Lon -122.187028 degree;set profile_station.Radius 2000 meter;run "
2019-10-04T05:31:21.849Z,1570167081.849 [CommandLine](IMPORTANT): Scheduled #4: "load Science/profile_station.xml;set profile_station.MissionTimeout 10 hour;set profile_station.Lat 36.712110 degree;set profile_station.Lon -122.187028 degree;set profile_station.Radius 2000 meter;run "
2019-10-04T05:31:21.850Z,1570167081.850 [CommandLine](FAULT): Scheduling was paused by an error at 2019-10-04T05:23:08Z
2019-10-04T05:42:53.190Z,1570167773.190 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 19.708329 min 
2019-10-04T05:43:13.945Z,1570167793.945 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2293, MT Status=1, MTMSN=62
2019-10-04T05:43:14.469Z,1570167794.469 [CommandLine](IMPORTANT): got command schedule clear
2019-10-04T05:43:14.469Z,1570167794.469 [CommandLine](IMPORTANT): #Cleared scheduled commands:1
2019-10-04T05:43:14.469Z,1570167794.469 [CommandLine](IMPORTANT): got command schedule resume
2019-10-04T05:43:14.469Z,1570167794.469 [CommandLine](IMPORTANT): Scheduling is resumed
2019-10-04T05:43:37.057Z,1570167817.057 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2294, MT Status=1, MTMSN=63
2019-10-04T05:43:37.782Z,1570167817.782 [CommandLine](IMPORTANT): got command load ./Missions/Science/profile_station.xml
2019-10-04T05:43:39.209Z,1570167819.209 [CommandLine](IMPORTANT): Loaded ./Missions/Science/profile_station.xml
2019-10-04T05:43:47.926Z,1570167827.926 [CommandLine](IMPORTANT): got command set profile_station.MissionTimeout 10.000000 hour
2019-10-04T05:43:47.927Z,1570167827.927 [CommandLine](IMPORTANT): got command set profile_station.Lat 36.712109 degree
2019-10-04T05:43:47.928Z,1570167827.928 [CommandLine](IMPORTANT): got command set profile_station.Lon -122.187027 degree
2019-10-04T05:43:47.929Z,1570167827.929 [CommandLine](IMPORTANT): got command set profile_station.Radius 2000.000000 meter
2019-10-04T05:43:47.929Z,1570167827.929 [CommandLine](IMPORTANT): got command run 
2019-10-04T05:43:47.932Z,1570167827.932 [CommandLine](IMPORTANT): Running 
2019-10-04T05:43:47.955Z,1570167827.955 [MissionManager](IMPORTANT): Started mission profile_station
2019-10-04T05:43:48.831Z,1570167828.831 [BuoyancyServo](FAULT): Buoyancy getPosition uart error.serial timeout
2019-10-04T06:56:07.840Z,1570172167.840 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=2302, MT Status=1, MTMSN=64
2019-10-04T06:56:08.640Z,1570172168.640 [CommandLine](IMPORTANT): got command schedule asap "load Science/profile_station.xml;set profile_station.MissionTimeout 10 hour;set profile_station.Lat 36.712110 degree;set profile_station.Lon -122.187028 degree;set profile_station.Radius 2000 meter" 3rmxe 1 2.000000
2019-10-04T06:56:08.640Z,1570172168.640 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=3rmxe
2019-10-04T06:56:08.641Z,1570172168.641 [CommandLine](IMPORTANT): Scheduled #5 (#1 of 2 with id='3rmxe'): "load Science/profile_station.xml;set profile_station.MissionTimeout 10 hour;set profile_station.Lat 36.712110 degree;set profile_station.Lon -122.187028 degree;set profile_station.Radius 2000 meter" ASAP
2019-10-04T06:56:36.406Z,1570172196.406 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2303, MT Status=1, MTMSN=65
2019-10-04T06:56:37.100Z,1570172197.100 [CommandLine](IMPORTANT): got command schedule asap "set profile_station.Speed 0.8 meter_per_second;run " 3rmxe 2 2.000000
2019-10-04T06:56:37.100Z,1570172197.100 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=3rmxe
2019-10-04T06:56:37.101Z,1570172197.101 [CommandLine](IMPORTANT): Scheduled #6 (#2 of 2 with id='3rmxe'): "set profile_station.Speed 0.8 meter_per_second;run " ASAP
2019-10-04T06:56:37.300Z,1570172197.300 [CommandLine](IMPORTANT): got command load ./Missions/Science/profile_station.xml
2019-10-04T06:56:38.854Z,1570172198.854 [CommandLine](IMPORTANT): Loaded ./Missions/Science/profile_station.xml
2019-10-04T06:56:38.934Z,1570172198.934 [MissionManager](IMPORTANT): Started mission Default
2019-10-04T06:56:48.220Z,1570172208.220 [CommandLine](IMPORTANT): got command set profile_station.MissionTimeout 10.000000 hour
2019-10-04T06:56:48.221Z,1570172208.221 [CommandLine](IMPORTANT): got command set profile_station.Lat 36.712109 degree
2019-10-04T06:56:48.221Z,1570172208.221 [CommandLine](IMPORTANT): got command set profile_station.Lon -122.187027 degree
2019-10-04T06:56:48.222Z,1570172208.222 [CommandLine](IMPORTANT): got command set profile_station.Radius 2000.000000 meter
2019-10-04T06:56:50.555Z,1570172210.555 [CommandLine](IMPORTANT): got command set profile_station.Speed 0.800000 meter_per_second
2019-10-04T06:56:50.555Z,1570172210.555 [CommandLine](IMPORTANT): got command run 
2019-10-04T06:56:50.558Z,1570172210.558 [CommandLine](IMPORTANT): Running 
2019-10-04T06:56:50.642Z,1570172210.642 [MissionManager](IMPORTANT): Started mission profile_station
2019-10-04T09:05:31.915Z,1570179931.915 [BuoyancyServo](FAULT): Buoyancy getPosition uart error.serial timeout
2019-10-04T10:53:16.027Z,1570186396.027 [CBIT](IMPORTANT): Beginning ground fault scan
2019-10-04T10:53:26.972Z,1570186406.972 [CBIT](IMPORTANT): Ground fault detected
mA:
CHAN A0 (Batt): -0.010946
CHAN A1 (24V): 0.178481
CHAN A2 (12V): -0.004301
CHAN A3 (5V): -0.003337
CHAN B0 (3.3V): -0.000498
CHAN B1 (3.15aV): -0.001340
CHAN B2 (3.15bV): -0.001267
CHAN B3 (GND): -0.000110
OPEN: 0.004847
Full Scale Calc: 4.765 mA, -1.589 mA
2019-10-04T11:09:58.847Z,1570187398.847 [ThrusterServo](FAULT): getVelocity uart error serial timeout
2019-10-04T11:09:58.847Z,1570187398.847 [ThrusterServo](FAULT): Thruster uart error: serial timeout
2019-10-04T11:10:12.939Z,1570187412.939 [BuoyancyServo](FAULT): Buoyancy getPosition uart error.serial timeout
2019-10-04T12:18:53.539Z,1570191533.539 [BuoyancyServo](FAULT): Buoyancy getPosition uart error.serial timeout
2019-10-04T13:23:05.785Z,1570195385.785 [ElevatorOffsetCalculator](IMPORTANT): Completed estimation for commanded vars: speed 0.80 m/s, pitch 20.00 deg, mass-position 3.70 mm. Average elevator angle=-2.201607 +/- 0.092644 deg (conf. level 99.90%, sigma: 0.310607 deg).
2019-10-04T14:25:19.551Z,1570199119.551 [BuoyancyServo](FAULT): Buoyancy getPosition uart error.serial timeout
2019-10-04T14:25:21.889Z,1570199121.889 [BuoyancyServo](FAULT): LCB fault:  Current Limiter Activated.
2019-10-04T14:27:18.561Z,1570199238.561 [ElevatorOffsetCalculator](IMPORTANT): Completed estimation for commanded vars: speed 0.80 m/s, pitch -20.00 deg, mass-position 3.70 mm. Average elevator angle=2.612916 +/- 0.085910 deg (conf. level 99.90%, sigma: 0.346698 deg).
2019-10-04T15:31:20.156Z,1570203080.156 [BuoyancyServo](FAULT): Buoyancy getPosition uart error.serial timeout
2019-10-04T16:02:33.660Z,1570204953.660 [ElevatorOffsetCalculator](IMPORTANT): Completed estimation for commanded vars: speed 0.80 m/s, pitch 20.00 deg, mass-position 3.70 mm. Average elevator angle=-2.194631 +/- 0.098448 deg (conf. level 99.90%, sigma: 0.302497 deg).
2019-10-04T16:33:48.634Z,1570206828.634 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=2355, MT Status=1, MTMSN=66
2019-10-04T16:33:49.231Z,1570206829.231 [CommandLine](IMPORTANT): got command schedule clear
2019-10-04T16:33:49.232Z,1570206829.232 [CommandLine](IMPORTANT): #Cleared scheduled commands:0
2019-10-04T16:33:49.232Z,1570206829.232 [CommandLine](IMPORTANT): got command schedule resume
2019-10-04T16:34:49.473Z,1570206889.473 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2356, MT Status=1, MTMSN=67
2019-10-04T16:34:50.269Z,1570206890.269 [CommandLine](IMPORTANT): got command schedule 20191004T170000 "load Science/smear_yoyo_sampling.xml;set Smear.MissionTimeout 6 hour;set Smear.MaxWaitNoFiring 2.5 hour;set Smear.SpeedSampling 0.8 meter_per_second;set Smear.MaxDepth 295 meter;set Smear.ShallowBoundSmear1 40 meter" 3se29 1 3.000000
2019-10-04T16:34:50.269Z,1570206890.269 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=3se29
2019-10-04T16:34:50.270Z,1570206890.270 [CommandLine](IMPORTANT): Scheduled #7 (#1 of 3 with id='3se29'): "load Science/smear_yoyo_sampling.xml;set Smear.MissionTimeout 6 hour;set Smear.MaxWaitNoFiring 2.5 hour;set Smear.SpeedSampling 0.8 meter_per_second;set Smear.MaxDepth 295 meter;set Smear.ShallowBoundSmear1 40 meter" at 2019-10-04T17:00:00Z
2019-10-04T16:35:13.013Z,1570206913.013 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2357, MT Status=1, MTMSN=68
2019-10-04T16:35:13.812Z,1570206913.812 [CommandLine](IMPORTANT): got command schedule 20191004T170000 "set Smear.ShallowBoundSmear2 100 meter;set Smear.ShallowBoundSmear3 220 meter;set Smear.ThicknessSmear1 5 meter;set Smear.ThicknessSmear2 5 meter;set Smear.ThicknessSmear3 5 meter;set Smear.Wait1 5 minute" 3se29 2 3.000000
2019-10-04T16:35:13.813Z,1570206913.813 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=3se29
2019-10-04T16:35:13.814Z,1570206913.814 [CommandLine](IMPORTANT): Scheduled #8 (#2 of 3 with id='3se29'): "set Smear.ShallowBoundSmear2 100 meter;set Smear.ShallowBoundSmear3 220 meter;set Smear.ThicknessSmear1 5 meter;set Smear.ThicknessSmear2 5 meter;set Smear.ThicknessSmear3 5 meter;set Smear.Wait1 5 minute" at 2019-10-04T17:00:00Z
2019-10-04T16:35:35.162Z,1570206935.162 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2358, MT Status=1, MTMSN=69
2019-10-04T16:35:35.753Z,1570206935.753 [CommandLine](IMPORTANT): got command schedule 20191004T170000 "set Smear.Wait2 0 minute;set Smear.Wait3 0 minute;run " 3se29 3 3.000000
2019-10-04T16:35:35.754Z,1570206935.754 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=3se29
2019-10-04T16:35:35.755Z,1570206935.755 [CommandLine](IMPORTANT): Scheduled #9 (#3 of 3 with id='3se29'): "set Smear.Wait2 0 minute;set Smear.Wait3 0 minute;run " at 2019-10-04T17:00:00Z
2019-10-04T16:35:54.682Z,1570206954.682 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2359, MT Status=1, MTMSN=70
2019-10-04T16:35:55.168Z,1570206955.168 [CommandLine](IMPORTANT): got command stop
2019-10-04T16:35:55.169Z,1570206955.169 [CommandLine](IMPORTANT): Scheduling is paused for 3 commands
2019-10-04T16:35:55.507Z,1570206955.507 [MissionManager](IMPORTANT): Started mission Default
2019-10-04T16:35:56.116Z,1570206956.116 [WetLabsBB2FL](FAULT): LCB fault:  Software Overcurrent.
2019-10-04T16:43:28.548Z,1570207408.548 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 7.543964 min 
2019-10-04T16:49:33.737Z,1570207773.737 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 13.630533 min 
2019-10-04T16:53:05.080Z,1570207985.080 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2370, MT Status=1, MTMSN=71
2019-10-04T16:53:05.672Z,1570207985.672 [CommandLine](IMPORTANT): got command schedule clear
2019-10-04T16:53:05.672Z,1570207985.672 [CommandLine](IMPORTANT): #Cleared scheduled commands:3
2019-10-04T16:53:05.672Z,1570207985.672 [CommandLine](IMPORTANT): got command schedule resume
2019-10-04T16:53:05.673Z,1570207985.673 [CommandLine](IMPORTANT): Scheduling is resumed
2019-10-04T16:53:26.981Z,1570208006.981 [CBIT](IMPORTANT): Beginning ground fault scan
2019-10-04T16:53:38.974Z,1570208018.974 [CBIT](IMPORTANT): Ground fault detected
mA:
CHAN A0 (Batt): -0.010928
CHAN A1 (24V): 0.178617
CHAN A2 (12V): -0.004978
CHAN A3 (5V): -0.002864
CHAN B0 (3.3V): -0.000811
CHAN B1 (3.15aV): -0.001574
CHAN B2 (3.15bV): -0.001184
CHAN B3 (GND): -0.000333
OPEN: 0.005108
Full Scale Calc: 4.765 mA, -1.589 mA
2019-10-04T16:59:10.281Z,1570208350.281 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 23.239321 min 
2019-10-04T17:01:17.466Z,1570208477.466 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2376, MT Status=1, MTMSN=72
2019-10-04T17:01:18.264Z,1570208478.264 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_yoyo_sampling.xml;set Smear.MissionTimeout 6 hour;set Smear.MaxWaitNoFiring 2.5 hour;set Smear.SpeedSampling 0.8 meter_per_second;set Smear.MaxDepth 295 meter;set Smear.ShallowBoundSmear1 40 meter" 3shm1 1 3.000000
2019-10-04T17:01:18.264Z,1570208478.264 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=3shm1
2019-10-04T17:01:18.265Z,1570208478.265 [CommandLine](IMPORTANT): Scheduled #10 (#1 of 3 with id='3shm1'): "load Science/smear_yoyo_sampling.xml;set Smear.MissionTimeout 6 hour;set Smear.MaxWaitNoFiring 2.5 hour;set Smear.SpeedSampling 0.8 meter_per_second;set Smear.MaxDepth 295 meter;set Smear.ShallowBoundSmear1 40 meter" ASAP
2019-10-04T17:02:12.412Z,1570208532.412 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2377, MT Status=1, MTMSN=73
2019-10-04T17:02:13.208Z,1570208533.208 [CommandLine](IMPORTANT): got command schedule asap "set Smear.ShallowBoundSmear2 100 meter;set Smear.ShallowBoundSmear3 220 meter;set Smear.ThicknessSmear1 5 meter;set Smear.ThicknessSmear2 5 meter;set Smear.ThicknessSmear3 5 meter;set Smear.Wait1 5 minute;set Smear.Wait2 0 minute" 3shm1 2 3.000000
2019-10-04T17:02:13.209Z,1570208533.209 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=3shm1
2019-10-04T17:02:13.210Z,1570208533.210 [CommandLine](IMPORTANT): Scheduled #11 (#2 of 3 with id='3shm1'): "set Smear.ShallowBoundSmear2 100 meter;set Smear.ShallowBoundSmear3 220 meter;set Smear.ThicknessSmear1 5 meter;set Smear.ThicknessSmear2 5 meter;set Smear.ThicknessSmear3 5 meter;set Smear.Wait1 5 minute;set Smear.Wait2 0 minute" ASAP
2019-10-04T17:02:35.091Z,1570208555.091 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=2378, MT Status=1, MTMSN=74
2019-10-04T17:02:35.716Z,1570208555.716 [CommandLine](IMPORTANT): got command schedule asap "set Smear.Wait3 0 minute;run " 3shm1 3 3.000000
2019-10-04T17:02:35.717Z,1570208555.717 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=3shm1
2019-10-04T17:02:35.718Z,1570208555.718 [CommandLine](IMPORTANT): Scheduled #12 (#3 of 3 with id='3shm1'): "set Smear.Wait3 0 minute;run " ASAP
2019-10-04T17:02:35.852Z,1570208555.852 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_yoyo_sampling.xml
2019-10-04T17:02:46.829Z,1570208566.829 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_yoyo_sampling.xml
2019-10-04T17:02:56.894Z,1570208576.894 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 6.000000 hour
2019-10-04T17:02:56.894Z,1570208576.894 [CommandLine](IMPORTANT): got command set Smear.MaxWaitNoFiring 2.500000 hour
2019-10-04T17:02:56.895Z,1570208576.895 [CommandLine](IMPORTANT): got command set Smear.SpeedSampling 0.800000 meter_per_second
2019-10-04T17:02:56.896Z,1570208576.896 [CommandLine](IMPORTANT): got command set Smear.MaxDepth 295.000000 meter
2019-10-04T17:02:56.897Z,1570208576.897 [CommandLine](IMPORTANT): got command set Smear.ShallowBoundSmear1 40.000000 meter
2019-10-04T17:03:12.435Z,1570208592.435 [CommandLine](IMPORTANT): got command set Smear.ShallowBoundSmear2 100.000000 meter
2019-10-04T17:03:12.436Z,1570208592.436 [CommandLine](IMPORTANT): got command set Smear.ShallowBoundSmear3 220.000000 meter
2019-10-04T17:03:12.437Z,1570208592.437 [CommandLine](IMPORTANT): got command set Smear.ThicknessSmear1 5.000000 meter
2019-10-04T17:03:12.437Z,1570208592.437 [CommandLine](IMPORTANT): got command set Smear.ThicknessSmear2 5.000000 meter
2019-10-04T17:03:12.438Z,1570208592.438 [CommandLine](IMPORTANT): got command set Smear.ThicknessSmear3 5.000000 meter
2019-10-04T17:03:12.439Z,1570208592.439 [CommandLine](IMPORTANT): got command set Smear.Wait1 5.000000 minute
2019-10-04T17:03:12.447Z,1570208592.447 [CommandLine](IMPORTANT): got command set Smear.Wait2 0.000000 minute
2019-10-04T17:03:14.186Z,1570208594.186 [CommandLine](IMPORTANT): got command set Smear.Wait3 0.000000 minute
2019-10-04T17:03:14.187Z,1570208594.187 [CommandLine](IMPORTANT): got command run 
2019-10-04T17:03:14.224Z,1570208594.224 [CommandLine](IMPORTANT): Running 
2019-10-04T17:03:14.436Z,1570208594.436 [MissionManager](IMPORTANT): Started mission Smear
2019-10-04T17:03:14.654Z,1570208594.654 [Smear:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 21.00 hours.
2019-10-04T17:03:15.189Z,1570208595.189 [Smear:TakeSamples:SetOptionsOfSample1:SettingsSample1:C](IMPORTANT): Set YoYoMinDepth to 40.000000 m , YoYoMaxDepth to 45.000000 m .
2019-10-04T17:03:15.190Z,1570208595.190 [Smear:InitializeWithGPSlatlon:C](IMPORTANT): Initialize CenterLatitude and CenterLongitude to GPS fix: 36.708970 arcdeg , -122.205092 arcdeg .
2019-10-04T17:04:55.328Z,1570208695.328 [Smear:Cylinder:CylinderYoYo:A](IMPORTANT): Yoyo profile on a cylinder around location 36.708970 arcdeg , -122.205092 arcdeg , at radius = 20.000000 m .
2019-10-04T17:08:25.520Z,1570208905.520 [Smear:TakeSamples:Firing:B](IMPORTANT): Taking ESP sample No. 1.000000 count .
2019-10-04T17:08:26.749Z,1570208906.749 [Smear:InsertWait:A](IMPORTANT): Wait 5.000000 min before firing sample.
2019-10-04T17:13:29.351Z,1570209209.351 [Smear:ESPSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 45.431587 m , 11.498499 degC , nan ug/l .
2019-10-04T17:13:31.051Z,1570209211.051 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.12.2:10.89.12.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2019-10-04T17:13:31.386Z,1570209211.386 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2019-10-04T17:14:07.160Z,1570209247.160 [ESPComponent](IMPORTANT): ESP has connected as client
2019-10-04T17:14:08.029Z,1570209248.029 [ESPComponent](IMPORTANT): [sample #2] Explicit cartridge argument not given
2019-10-04T17:14:08.029Z,1570209248.029 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2019-10-04T17:14:08.413Z,1570209248.413 [Smear:ESPSampling:TriggerESP:F](IMPORTANT): Wait for ESP sampling to complete.
2019-10-04T17:14:08.777Z,1570209248.777 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_LOG (@0.0)
2019-10-04T17:14:09.182Z,1570209249.182 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_STATUS (@0.0)
2019-10-04T17:14:11.207Z,1570209251.207 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_LOADING_CARTRIDGE (@0.0)
2019-10-04T17:14:43.936Z,1570209283.936 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PRIMING (@57,archive_bac)
2019-10-04T17:14:45.542Z,1570209285.542 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PRIMING (@100.0)
2019-10-04T17:14:46.356Z,1570209286.356 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2019-10-04T17:16:06.364Z,1570209366.364 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPING (@0.0)
2019-10-04T17:16:08.373Z,1570209368.373 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs &
2019-10-04T17:16:08.793Z,1570209368.793 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_ERROR (@0.0)
2019-10-04T17:21:08.574Z,1570209668.574 [ESPComponent](CRITICAL): [sample #2] ESP sampling sequence terminated with error: Unexpected ESP state ESP_STATE_FILTERING_ERR. Expecting one of: ESP_STATE_PRIMING, ESP_STATE_FILTERING
2019-10-04T17:21:08.673Z,1570209668.673 [CommandLine](FAULT): Scheduling is paused
2019-10-04T17:21:08.970Z,1570209668.970 [ESPComponent](IMPORTANT): [sample #2] ESP log summary report (8 messages):
@10:14:20.69 Selecting Cartridge 57
@10:15:02.61 Cartridge::Sampler::Leak in FILTERING -- Serious Leak or Stall -- 0.54ml/s made only -4.7psi vacuum
@10:15:02.62 Retry #1 of 2
@10:15:02.67 Selecting Cartridge 56
@10:15:33.18 Cartridge::Sampler::Leak in FILTERING -- Serious Leak or Stall -- 0.91ml/s made only -13.1psi vacuum
@10:15:33.20 Retry #2 of 2
@10:15:33.24 Selecting Cartridge 55
@10:16:03.14 Cartridge::Sampler::Leak in FILTERING -- Serious Leak or Stall -- 0.45ml/s made only -6.8psi vacuum

2019-10-04T17:21:09.778Z,1570209669.778 [MissionManager](IMPORTANT): Started mission Default
2019-10-04T17:21:10.463Z,1570209670.463 [BuoyancyServo](FAULT): Buoyancy getPosition uart error.serial timeout
2019-10-04T17:29:24.071Z,1570210164.071 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 8.231387 min 
2019-10-04T17:35:32.552Z,1570210532.552 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 14.372613 min 
2019-10-04T17:41:36.871Z,1570210896.871 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 20.444869 min 
2019-10-04T17:47:31.062Z,1570211251.062 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 26.347937 min 
2019-10-04T17:53:20.385Z,1570211600.385 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 32.169849 min 
2019-10-04T17:59:05.180Z,1570211945.180 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 37.916618 min 
2019-10-04T17:59:35.590Z,1570211975.590 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2410, MT Status=1, MTMSN=75
2019-10-04T17:59:36.188Z,1570211976.188 [CommandLine](IMPORTANT): got command ! 'ESP.ready!; Sampler.new.refill; Sampler.new.refill' | onESP espclient preston
2019-10-04T18:00:40.032Z,1570212040.032 [CommandLine](FAULT): Command 'ESP.ready!; Sampler.new.refill; Sampler.new.refill' | onESP espclient preston timed out
2019-10-04T18:07:34.861Z,1570212454.861 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 46.411210 min 
2019-10-04T18:08:17.706Z,1570212497.706 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2416, MT Status=1, MTMSN=76
2019-10-04T18:08:18.359Z,1570212498.359 [CommandLine](IMPORTANT): got command ! echo 'ESP.ready!; Sampler.new.refill; Sampler.new.refill' | onESP espclient -w preston
2019-10-04T18:09:22.991Z,1570212562.991 [CommandLine](FAULT): Command echo 'ESP.ready!; Sampler.new.refill; Sampler.new.refill' | onESP espclient -w preston timed out
2019-10-04T18:14:48.545Z,1570212888.545 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 53.639303 min 
2019-10-04T18:20:33.103Z,1570213233.103 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 59.382092 min 
2019-10-04T18:20:57.527Z,1570213257.527 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2425, MT Status=1, MTMSN=77
2019-10-04T18:20:58.025Z,1570213258.025 [CommandLine](IMPORTANT): got command ! onESP --offNow
2019-10-04T18:27:08.867Z,1570213628.867 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 65.978133 min 
2019-10-04T18:33:05.636Z,1570213985.636 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 71.924146 min 
2019-10-04T18:33:30.366Z,1570214010.366 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=2434, MT Status=1, MTMSN=78
2019-10-04T18:33:30.888Z,1570214010.888 [CommandLine](IMPORTANT): got command restart system