triton Path

trajectory

20191004T045531 [MissionManager]:Started mission Default

20191004T045759 [BPC1]:BPC1A: No match for serial number 1717 in BPC1A's battery stick inventory (sticks 1-32 in onboard configuration file).

20191004T045828 [BPC1]:BPC1B got IPBS message with 6 sticks (min is 7).

20191004T045834 [BPC1]:BPC1B got IPBS message with 6 sticks (min is 7).

20191004T045849 [BPC1]:BPC1B got IPBS message with 6 sticks (min is 7).

20191004T050157 [Default:CheckIn:E]:Default mission has been running for 6.413885 min

20191004T050226 [CommandLine]:got command schedule asap "load Science/smear_yoyo_sampling.xml;set Smear.MissionTimeout 6 hour;set Smear.MaxWaitNoFiring 2.5 hour;set Smear.SpeedSampling 0.8 meter_per_second;set Smear.MaxDepth 295 meter;set Smear.ShallowBoundSmear1 50 meter" 3rkim 1 3.000000

20191004T050226 [CommandLine]:Scheduling command #1 of 3 with id=3rkim

20191004T050226 [CommandLine]:Scheduled #1 (#1 of 3 with id='3rkim'): "load Science/smear_yoyo_sampling.xml;set Smear.MissionTimeout 6 hour;set Smear.MaxWaitNoFiring 2.5 hour;set Smear.SpeedSampling 0.8 meter_per_second;set Smear.MaxDepth 295 meter;set Smear.ShallowBoundSmear1 50 meter" ASAP

20191004T050247 [CommandLine]:got command schedule asap "set Smear.ShallowBoundSmear2 160 meter;set Smear.ShallowBoundSmear3 230 meter;set Smear.ThicknessSmear1 5 meter;set Smear.ThicknessSmear2 5 meter;set Smear.ThicknessSmear3 5 meter;set Smear.Wait1 5 minute;set Smear.Wait2 0 minute" 3rkim 2 3.000000

20191004T050247 [CommandLine]:Scheduling command #2 of 3 with id=3rkim

20191004T050247 [CommandLine]:Scheduled #2 (#2 of 3 with id='3rkim'): "set Smear.ShallowBoundSmear2 160 meter;set Smear.ShallowBoundSmear3 230 meter;set Smear.ThicknessSmear1 5 meter;set Smear.ThicknessSmear2 5 meter;set Smear.ThicknessSmear3 5 meter;set Smear.Wait1 5 minute;set Smear.Wait2 0 minute" ASAP

20191004T050257 [CommandLine]:got command schedule asap "set Smear.Wait3 0 minute;run " 3rkim 3 3.000000

20191004T050257 [CommandLine]:Scheduling command #3 of 3 with id=3rkim

20191004T050257 [CommandLine]:Scheduled #3 (#3 of 3 with id='3rkim'): "set Smear.Wait3 0 minute;run " ASAP

20191004T050257 [CommandLine]:got command load ./Missions/Science/smear_yoyo_sampling.xml

20191004T050310 [CommandLine]:Loaded ./Missions/Science/smear_yoyo_sampling.xml

20191004T050322 [CommandLine]:got command set Smear.MissionTimeout 6.000000 hour

20191004T050322 [CommandLine]:got command set Smear.MaxWaitNoFiring 2.500000 hour

20191004T050322 [CommandLine]:got command set Smear.SpeedSampling 0.800000 meter_per_second

20191004T050322 [CommandLine]:got command set Smear.MaxDepth 295.000000 meter

20191004T050322 [CommandLine]:got command set Smear.ShallowBoundSmear1 50.000000 meter

20191004T050336 [CommandLine]:got command set Smear.ShallowBoundSmear2 160.000000 meter

20191004T050336 [CommandLine]:got command set Smear.ShallowBoundSmear3 230.000000 meter

20191004T050336 [CommandLine]:got command set Smear.ThicknessSmear1 5.000000 meter

20191004T050336 [CommandLine]:got command set Smear.ThicknessSmear2 5.000000 meter

20191004T050336 [CommandLine]:got command set Smear.ThicknessSmear3 5.000000 meter

20191004T050336 [CommandLine]:got command set Smear.Wait1 5.000000 minute

20191004T050336 [CommandLine]:got command set Smear.Wait2 0.000000 minute

20191004T050338 [CommandLine]:got command set Smear.Wait3 0.000000 minute

20191004T050338 [CommandLine]:got command run

20191004T050338 [CommandLine]:Running

20191004T050338 [MissionManager]:Started mission Smear

20191004T050338 [Smear:AbortDrift:B.AbortDrift]:Acoustic timeout set to: 21.00 hours.

20191004T050339 [Smear:InitializeWithGPSlatlon:C]:Initialize CenterLatitude and CenterLongitude to GPS fix: 36.710593 arcdeg , -122.215301 arcdeg .

20191004T050339 [Smear:I.AltitudeEnvelope]:Altitude Measurement is not Active.

20191004T050339 [Smear:StandardEnvelopes:A.AltitudeEnvelope]:Altitude Measurement is not Active.

20191004T050341 [CTD_Seabird]:Failed to parse device response: #

20191004T050411 [NAL9602]:Failed to initiate SBD session. Error code: 2

20191004T050431 [NAL9602]:Failed to initiate SBD session. Error code: 2

20191004T050556 [Smear:Cylinder:CylinderYoYo:A]:Yoyo profile on a cylinder around location 36.710593 arcdeg , -122.215301 arcdeg , at radius = 20.000000 m .

20191004T051035 [Smear:TakeSamples:Firing:B]:Taking ESP sample No. 1.000000 count .

20191004T051036 [Smear:InsertWait:A]:Wait 5.000000 min before firing sample.

20191004T051539 [Smear:ESPSampling:TriggerESP:D]:Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 55.628860 m , 10.879510 degC , nan ug/l .

20191004T051540 [ESPComponent]:Setting regex for ESP Log summary: 'Selecting

20191004T051540 [ESPComponent]:Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.12.2:10.89.12.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8

20191004T051541 [ESPComponent]:Waiting for ESP to connect (timeout=150.0000)

20191004T051616 [ESPComponent]:ESP has connected as client

20191004T051617 [ESPComponent]:[sample #1] Explicit cartridge argument not given

20191004T051617 [ESPComponent]:[sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT

20191004T051618 [Smear:ESPSampling:TriggerESP:F]:Wait for ESP sampling to complete.

20191004T051618 [ESPComponent]:[sample #1] ESP sampling state: S_PREPARING_SHOW_LOG

20191004T051619 [ESPComponent]:[sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS

20191004T051620 [ESPComponent]:[sample #1] ESP sampling state: S_LOADING_CARTRIDGE

20191004T051653 [ESPComponent]:[sample #1] ESP sampling state: S_WAITING_FOR_PRIMING (@59,archive_bac)

20191004T051655 [ESPComponent]:[sample #1] ESP sampling state: S_PRIMING (@100.0)

20191004T051656 [ESPComponent]:[sample #1] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)

20191004T051806 [ESPComponent]:Unexpected ESP state ESP_STATE_FILTERING_ERR. Expecting one of: ESP_STATE_PRIMING, ESP_STATE_FILTERING

20191004T051806 [ESPComponent]:[sample #1] ESP sampling state: S_STOPPING (@0.0)

20191004T051808 [ESPComponent]:In state S_STOPPING got exception while awaiting result for cmd='Cmd.stop' exception=<>. Elapsed time since command issued: 2.4386

20191004T051808 [ESPComponent]:Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs &

20191004T051809 [ESPComponent]:[sample #1] ESP sampling state: S_ERROR (@0.0)

20191004T052308 [ESPComponent]:[sample #1] ESP sampling sequence terminated with error: Unexpected ESP state ESP_STATE_FILTERING_ERR. Expecting one of: ESP_STATE_PRIMING, ESP_STATE_FILTERING

20191004T052308 [ESPComponent]:Communications Fault

20191004T052309 [CommandLine]:Scheduling is paused

20191004T052309 [CBIT]:Communications Fault in component: ESPComponent

20191004T052309 [ESPComponent]:[sample #1] ESP log summary report (8 messages):#@22:16:31.00 Selecting Cartridge 59#@22:17:00.15 Cartridge::Sampler::Leak in FILTERING -- Isolated toroid pressure fell by 22% to 72.6psia#@22:17:00.17 Retry #1 of 2#@22:17:00.21 Selecting Cartridge 58#@22:17:31.72 Cartridge::Sampler::Leak in FILTERING -- Serious Leak or Stall -- 0.90ml/s made only -4.1psi vacuum#@22:17:31.73 Retry #2 of 2#@22:17:31.78 Selecting Cartridge 57#@22:18:04.79 Cartridge::Sampler::Leak in FILTERING -- Serious Leak or Stall -- 0.93ml/s made only -0.3psi vacuum#

20191004T052310 [MissionManager]:Started mission Default

20191004T052311 [BuoyancyServo]:getPosition uart error serial timeout

20191004T052311 [BuoyancyServo]:Buoyancy getPosition uart error.serial timeout

20191004T052311 [BuoyancyServo]:Communications Fault

20191004T052311 [CBIT]:Communications Fault in component: BuoyancyServo

20191004T052447 [Default:B.GoToSurface]:Pitch down timeout. Pitch: -0.88

20191004T053121 [CommandLine]:got command schedule "load Science/profile_station.xml;set profile_station.MissionTimeout 10 hour;set profile_station.Lat 36.712110 degree;set profile_station.Lon -122.187028 degree;set profile_station.Radius 2000 meter;run "

20191004T053121 [CommandLine]:Scheduled #4: "load Science/profile_station.xml;set profile_station.MissionTimeout 10 hour;set profile_station.Lat 36.712110 degree;set profile_station.Lon -122.187028 degree;set profile_station.Radius 2000 meter;run "

20191004T053121 [CommandLine]:Scheduling was paused by an error at 2019-10-04T05:23:08Z

20191004T053259 [NAL9602]:Failed to initiate SBD session. Error code: 2

20191004T054253 [Default:CheckIn:E]:Default mission has been running for 19.708329 min

20191004T054314 [CommandLine]:got command schedule clear

20191004T054314 [CommandLine]:#Cleared scheduled commands:1

20191004T054314 [CommandLine]:got command schedule resume

20191004T054314 [CommandLine]:Scheduling is resumed

20191004T054337 [CommandLine]:got command load ./Missions/Science/profile_station.xml

20191004T054339 [CommandLine]:Loaded ./Missions/Science/profile_station.xml

20191004T054347 [CommandLine]:got command set profile_station.MissionTimeout 10.000000 hour

20191004T054347 [CommandLine]:got command set profile_station.Lat 36.712109 degree

20191004T054347 [CommandLine]:got command set profile_station.Lon -122.187027 degree

20191004T054347 [CommandLine]:got command set profile_station.Radius 2000.000000 meter

20191004T054347 [CommandLine]:got command run

20191004T054347 [CommandLine]:Running

20191004T054347 [MissionManager]:Started mission profile_station

20191004T054348 [BuoyancyServo]:getPosition uart error serial timeout

20191004T054348 [BuoyancyServo]:Buoyancy getPosition uart error.serial timeout

20191004T054348 [BuoyancyServo]:Communications Fault

20191004T054348 [CBIT]:Communications Fault in component: BuoyancyServo

20191004T054349 [profile_station:M.AltitudeEnvelope]:Altitude Measurement is not Active.

20191004T054351 [CTD_Seabird]:Failed to parse device response: #

20191004T062643 [CTD_Seabird]:Failed to parse device response: .22#

20191004T065215 [CTD_Seabird]:Failed to parse device response: .05#

20191004T065418 [CTD_Seabird]:Salinity reading out of range: 9.450212 psu

20191004T065608 [CommandLine]:got command schedule asap "load Science/profile_station.xml;set profile_station.MissionTimeout 10 hour;set profile_station.Lat 36.712110 degree;set profile_station.Lon -122.187028 degree;set profile_station.Radius 2000 meter" 3rmxe 1 2.000000

20191004T065608 [CommandLine]:Scheduling command #1 of 2 with id=3rmxe

20191004T065608 [CommandLine]:Scheduled #5 (#1 of 2 with id='3rmxe'): "load Science/profile_station.xml;set profile_station.MissionTimeout 10 hour;set profile_station.Lat 36.712110 degree;set profile_station.Lon -122.187028 degree;set profile_station.Radius 2000 meter" ASAP

20191004T065611 [NAL9602]:parseGSV uart error: serial buffer full

20191004T065637 [CommandLine]:got command schedule asap "set profile_station.Speed 0.8 meter_per_second;run " 3rmxe 2 2.000000

20191004T065637 [CommandLine]:Scheduling command #2 of 2 with id=3rmxe

20191004T065637 [CommandLine]:Scheduled #6 (#2 of 2 with id='3rmxe'): "set profile_station.Speed 0.8 meter_per_second;run " ASAP

20191004T065637 [CommandLine]:got command load ./Missions/Science/profile_station.xml

20191004T065638 [CommandLine]:Loaded ./Missions/Science/profile_station.xml

20191004T065638 [MissionManager]:Started mission Default

20191004T065648 [CommandLine]:got command set profile_station.MissionTimeout 10.000000 hour

20191004T065648 [CommandLine]:got command set profile_station.Lat 36.712109 degree

20191004T065648 [CommandLine]:got command set profile_station.Lon -122.187027 degree

20191004T065648 [CommandLine]:got command set profile_station.Radius 2000.000000 meter

20191004T065650 [CommandLine]:got command set profile_station.Speed 0.800000 meter_per_second

20191004T065650 [CommandLine]:got command run

20191004T065650 [CommandLine]:Running

20191004T065650 [MissionManager]:Started mission profile_station

20191004T065652 [profile_station:M.AltitudeEnvelope]:Altitude Measurement is not Active.

20191004T065653 [CTD_Seabird]:Failed to parse device response: #

20191004T065655 [CTD_Seabird]:Salinity reading out of range: 25.286215 psu

20191004T065655 [NAL9602]:parseGSV uart error: serial buffer full

20191004T065912 [NAL9602]:parseGSV uart error: serial buffer full

20191004T080026 [CTD_Seabird]:Salinity reading out of range: 13.455257 psu

20191004T080204 [CTD_Seabird]:Failed to parse device response: 7,4.07284,3519.79#

20191004T082455 [CTD_Seabird]:Failed to parse device response: 6,3.67807,1894.35#

20191004T090328 [CTD_Seabird]:Failed to parse device response: 53#

20191004T090345 [CTD_Seabird]:Failed to parse device response: 34#

20191004T090531 [BuoyancyServo]:getPosition uart error serial timeout

20191004T090531 [BuoyancyServo]:Buoyancy getPosition uart error.serial timeout

20191004T090531 [BuoyancyServo]:Communications Fault

20191004T090531 [CBIT]:Communications Fault in component: BuoyancyServo

20191004T090550 [CTD_Seabird]:Failed to parse device response: 2.48,14.3182,1#

20191004T092816 [BPC1]:BPC1B: No match for serial number FF8A in BPC1B's battery stick inventory (sticks 32-63 in onboard configuration file).

20191004T100935 [CTD_Seabird]:Failed to parse device response: 6.74,14.3467,#

20191004T101457 [CTD_Seabird]:Failed to parse device response: 0,3.71598,2122.53#

20191004T104622 [CTD_Seabird]:Failed to parse device response: .93#

20191004T105316 [CBIT]:Beginning ground fault scan

20191004T105527 [CTD_Seabird]:Failed to parse device response: 07,1577.72#

20191004T110958 [ThrusterServo]:getVelocity uart error serial timeout

20191004T110958 [ThrusterServo]:Thruster uart error: serial timeout

20191004T110958 [ThrusterServo]:Communications Fault

20191004T110958 [CBIT]:Communications Fault in component: ThrusterServo

20191004T132305 [ElevatorOffsetCalculator]:Completed estimation for commanded vars: speed 0.80 m/s, pitch 20.00 deg, mass-position 3.70 mm. Average elevator angle=-2.201607 +/- 0.092644 deg (conf. level 99.90%, sigma: 0.310607 deg).

20191004T135955 [BPC1]:BPC1A: No match for serial number 1717 in BPC1A's battery stick inventory (sticks 1-32 in onboard configuration file).

20191004T142419 [ThrusterServo]:Thruster uart error: serial timeout

20191004T142419 [ThrusterServo]:Communications Fault

20191004T142419 [CBIT]:Communications Fault in component: ThrusterServo

20191004T142521 [BuoyancyServo]:LCB fault: Current Limiter Activated.

20191004T142521 [BuoyancyServo]:Hardware Fault

20191004T142718 [ElevatorOffsetCalculator]:Completed estimation for commanded vars: speed 0.80 m/s, pitch -20.00 deg, mass-position 3.70 mm. Average elevator angle=2.612916 +/- 0.085910 deg (conf. level 99.90%, sigma: 0.346698 deg).

20191004T160233 [ElevatorOffsetCalculator]:Completed estimation for commanded vars: speed 0.80 m/s, pitch 20.00 deg, mass-position 3.70 mm. Average elevator angle=-2.194631 +/- 0.098448 deg (conf. level 99.90%, sigma: 0.302497 deg).

20191004T161801 [CTD_Seabird]:Failed to parse device response: 97,1580.98#

20191004T163349 [CommandLine]:got command schedule clear

20191004T163349 [CommandLine]:#Cleared scheduled commands:0

20191004T163349 [CommandLine]:got command schedule resume

20191004T163450 [CommandLine]:got command schedule 20191004T170000 "load Science/smear_yoyo_sampling.xml;set Smear.MissionTimeout 6 hour;set Smear.MaxWaitNoFiring 2.5 hour;set Smear.SpeedSampling 0.8 meter_per_second;set Smear.MaxDepth 295 meter;set Smear.ShallowBoundSmear1 40 meter" 3se29 1 3.000000

20191004T163450 [CommandLine]:Scheduling command #1 of 3 with id=3se29

20191004T163450 [CommandLine]:Scheduled #7 (#1 of 3 with id='3se29'): "load Science/smear_yoyo_sampling.xml;set Smear.MissionTimeout 6 hour;set Smear.MaxWaitNoFiring 2.5 hour;set Smear.SpeedSampling 0.8 meter_per_second;set Smear.MaxDepth 295 meter;set Smear.ShallowBoundSmear1 40 meter" at 2019-10-04T17:00:00Z

20191004T163513 [CommandLine]:got command schedule 20191004T170000 "set Smear.ShallowBoundSmear2 100 meter;set Smear.ShallowBoundSmear3 220 meter;set Smear.ThicknessSmear1 5 meter;set Smear.ThicknessSmear2 5 meter;set Smear.ThicknessSmear3 5 meter;set Smear.Wait1 5 minute" 3se29 2 3.000000

20191004T163513 [CommandLine]:Scheduling command #2 of 3 with id=3se29

20191004T163513 [CommandLine]:Scheduled #8 (#2 of 3 with id='3se29'): "set Smear.ShallowBoundSmear2 100 meter;set Smear.ShallowBoundSmear3 220 meter;set Smear.ThicknessSmear1 5 meter;set Smear.ThicknessSmear2 5 meter;set Smear.ThicknessSmear3 5 meter;set Smear.Wait1 5 minute" at 2019-10-04T17:00:00Z

20191004T163535 [CommandLine]:got command schedule 20191004T170000 "set Smear.Wait2 0 minute;set Smear.Wait3 0 minute;run " 3se29 3 3.000000

20191004T163535 [CommandLine]:Scheduling command #3 of 3 with id=3se29

20191004T163535 [CommandLine]:Scheduled #9 (#3 of 3 with id='3se29'): "set Smear.Wait2 0 minute;set Smear.Wait3 0 minute;run " at 2019-10-04T17:00:00Z

20191004T163555 [CommandLine]:got command stop

20191004T163555 [CommandLine]:Scheduling is paused for 3 commands

20191004T163556 [WetLabsBB2FL]:LCB fault: Software Overcurrent.

20191004T163556 [WetLabsBB2FL]:Hardware Fault

20191004T163556 [CBIT]:Hardware Fault in component: WetLabsBB2FL

20191004T164328 [Default:CheckIn:E]:Default mission has been running for 7.543964 min

20191004T165305 [CommandLine]:got command schedule clear

20191004T165305 [CommandLine]:#Cleared scheduled commands:3

20191004T165305 [CommandLine]:got command schedule resume

20191004T165305 [CommandLine]:Scheduling is resumed

20191004T165326 [CBIT]:Beginning ground fault scan

20191004T170118 [CommandLine]:got command schedule asap "load Science/smear_yoyo_sampling.xml;set Smear.MissionTimeout 6 hour;set Smear.MaxWaitNoFiring 2.5 hour;set Smear.SpeedSampling 0.8 meter_per_second;set Smear.MaxDepth 295 meter;set Smear.ShallowBoundSmear1 40 meter" 3shm1 1 3.000000

20191004T170118 [CommandLine]:Scheduling command #1 of 3 with id=3shm1

20191004T170118 [CommandLine]:Scheduled #10 (#1 of 3 with id='3shm1'): "load Science/smear_yoyo_sampling.xml;set Smear.MissionTimeout 6 hour;set Smear.MaxWaitNoFiring 2.5 hour;set Smear.SpeedSampling 0.8 meter_per_second;set Smear.MaxDepth 295 meter;set Smear.ShallowBoundSmear1 40 meter" ASAP

20191004T170213 [CommandLine]:got command schedule asap "set Smear.ShallowBoundSmear2 100 meter;set Smear.ShallowBoundSmear3 220 meter;set Smear.ThicknessSmear1 5 meter;set Smear.ThicknessSmear2 5 meter;set Smear.ThicknessSmear3 5 meter;set Smear.Wait1 5 minute;set Smear.Wait2 0 minute" 3shm1 2 3.000000

20191004T170213 [CommandLine]:Scheduling command #2 of 3 with id=3shm1

20191004T170213 [CommandLine]:Scheduled #11 (#2 of 3 with id='3shm1'): "set Smear.ShallowBoundSmear2 100 meter;set Smear.ShallowBoundSmear3 220 meter;set Smear.ThicknessSmear1 5 meter;set Smear.ThicknessSmear2 5 meter;set Smear.ThicknessSmear3 5 meter;set Smear.Wait1 5 minute;set Smear.Wait2 0 minute" ASAP

20191004T170219 [NAL9602]:Inadequate Iridium signal strength reported: 0

20191004T170235 [CommandLine]:got command schedule asap "set Smear.Wait3 0 minute;run " 3shm1 3 3.000000

20191004T170235 [CommandLine]:Scheduling command #3 of 3 with id=3shm1

20191004T170235 [CommandLine]:Scheduled #12 (#3 of 3 with id='3shm1'): "set Smear.Wait3 0 minute;run " ASAP

20191004T170235 [CommandLine]:got command load ./Missions/Science/smear_yoyo_sampling.xml

20191004T170246 [CommandLine]:Loaded ./Missions/Science/smear_yoyo_sampling.xml

20191004T170256 [CommandLine]:got command set Smear.MissionTimeout 6.000000 hour

20191004T170256 [CommandLine]:got command set Smear.MaxWaitNoFiring 2.500000 hour

20191004T170256 [CommandLine]:got command set Smear.SpeedSampling 0.800000 meter_per_second

20191004T170256 [CommandLine]:got command set Smear.MaxDepth 295.000000 meter

20191004T170314 [MissionManager]:Started mission Smear

20191004T170314 [Smear:AbortDrift:B.AbortDrift]:Acoustic timeout set to: 21.00 hours.

20191004T170315 [Smear:InitializeWithGPSlatlon:C]:Initialize CenterLatitude and CenterLongitude to GPS fix: 36.708970 arcdeg , -122.205092 arcdeg .

20191004T170315 [Smear:I.AltitudeEnvelope]:Altitude Measurement is not Active.

20191004T170315 [Smear:StandardEnvelopes:A.AltitudeEnvelope]:Altitude Measurement is not Active.

20191004T170455 [Smear:Cylinder:CylinderYoYo:A]:Yoyo profile on a cylinder around location 36.708970 arcdeg , -122.205092 arcdeg , at radius = 20.000000 m .

20191004T170825 [Smear:TakeSamples:Firing:B]:Taking ESP sample No. 1.000000 count .

20191004T170826 [Smear:InsertWait:A]:Wait 5.000000 min before firing sample.

20191004T171329 [Smear:ESPSampling:TriggerESP:D]:Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 45.431587 m , 11.498499 degC , nan ug/l .

20191004T171331 [ESPComponent]:Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.12.2:10.89.12.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8

20191004T171331 [ESPComponent]:Waiting for ESP to connect (timeout=150.0000)

20191004T171407 [ESPComponent]:ESP has connected as client

20191004T171408 [ESPComponent]:[sample #2] Explicit cartridge argument not given

20191004T171408 [ESPComponent]:[sample #2] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT

20191004T171408 [Smear:ESPSampling:TriggerESP:F]:Wait for ESP sampling to complete.

20191004T171408 [ESPComponent]:[sample #2] ESP sampling state: S_PREPARING_SHOW_LOG (@0.0)

20191004T171409 [ESPComponent]:[sample #2] ESP sampling state: S_PREPARING_SHOW_STATUS (@0.0)

20191004T171411 [ESPComponent]:[sample #2] ESP sampling state: S_LOADING_CARTRIDGE (@0.0)

20191004T171443 [ESPComponent]:[sample #2] ESP sampling state: S_WAITING_FOR_PRIMING (@57,archive_bac)

20191004T171445 [ESPComponent]:[sample #2] ESP sampling state: S_PRIMING (@100.0)

20191004T171446 [ESPComponent]:[sample #2] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)

20191004T171605 [ESPComponent]:Unexpected ESP state ESP_STATE_FILTERING_ERR. Expecting one of: ESP_STATE_PRIMING, ESP_STATE_FILTERING

20191004T171606 [ESPComponent]:[sample #2] ESP sampling state: S_STOPPING (@0.0)

20191004T171608 [ESPComponent]:In state S_STOPPING got exception while awaiting result for cmd='Cmd.stop' exception=<>. Elapsed time since command issued: 2.4181

20191004T171608 [ESPComponent]:Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs &

20191004T171608 [ESPComponent]:[sample #2] ESP sampling state: S_ERROR (@0.0)

20191004T172108 [ESPComponent]:[sample #2] ESP sampling sequence terminated with error: Unexpected ESP state ESP_STATE_FILTERING_ERR. Expecting one of: ESP_STATE_PRIMING, ESP_STATE_FILTERING

20191004T172108 [ESPComponent]:Communications Fault

20191004T172108 [CommandLine]:Scheduling is paused

20191004T172108 [CBIT]:Communications Fault in component: ESPComponent

20191004T172108 [ESPComponent]:[sample #2] ESP log summary report (8 messages):#@10:14:20.69 Selecting Cartridge 57#@10:15:02.61 Cartridge::Sampler::Leak in FILTERING -- Serious Leak or Stall -- 0.54ml/s made only -4.7psi vacuum#@10:15:02.62 Retry #1 of 2#@10:15:02.67 Selecting Cartridge 56#@10:15:33.18 Cartridge::Sampler::Leak in FILTERING -- Serious Leak or Stall -- 0.91ml/s made only -13.1psi vacuum#@10:15:33.20 Retry #2 of 2#@10:15:33.24 Selecting Cartridge 55#@10:16:03.14 Cartridge::Sampler::Leak in FILTERING -- Serious Leak or Stall -- 0.45ml/s made only -6.8psi vacuum#

20191004T175936 [CommandLine]:got command ! 'ESP.ready!; Sampler.new.refill; Sampler.new.refill' | onESP espclient preston

20191004T180040 [CommandLine]:Command 'ESP.ready!; Sampler.new.refill; Sampler.new.refill' | onESP espclient preston timed out

20191004T180818 [CommandLine]:got command ! echo 'ESP.ready!; Sampler.new.refill; Sampler.new.refill' | onESP espclient -w preston

20191004T180922 [CommandLine]:Command echo 'ESP.ready!; Sampler.new.refill; Sampler.new.refill' | onESP espclient -w preston timed out

20191004T182058 [CommandLine]:got command ! onESP --offNow

20191004T183330 [CommandLine]:got command restart system