2020-07-24T15:38:34.529Z,1595605114.529 [CommandLine](IMPORTANT): got command restart logs 2020-07-24T15:47:29.035Z,1595605649.035 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:A](IMPORTANT): Requesting ESP sample with cartridge type -6.000000 count 2020-07-24T15:47:31.137Z,1595605651.137 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-24T15:47:31.297Z,1595605651.297 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-24T15:48:08.613Z,1595605688.613 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-24T15:48:09.428Z,1595605689.428 [ESPComponent](IMPORTANT): [sample #20] Setting cartridge argument to -6 2020-07-24T15:48:09.428Z,1595605689.428 [ESPComponent](IMPORTANT): [sample #20] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-24T15:48:09.873Z,1595605689.873 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:D](IMPORTANT): ESP sampling at 11.467604 m in 13.172724 degC water with 3.253270 ug/l chlorophyll fluorescence. 2020-07-24T15:48:10.232Z,1595605690.232 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-24T15:48:10.634Z,1595605690.634 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-24T15:48:12.654Z,1595605692.654 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-24T15:48:45.386Z,1595605725.386 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_WAITING_FOR_PRIMING (@33,archive_bac) 2020-07-24T15:48:47.001Z,1595605727.001 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_PRIMING (@100.0) 2020-07-24T15:48:47.809Z,1595605727.809 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-24T15:51:28.613Z,1595605888.613 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_FILTERING (@0.0) 2020-07-24T15:51:29.014Z,1595605889.014 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-24T16:16:17.570Z,1595607377.570 [CBIT](IMPORTANT): Beginning ground fault scan 2020-07-24T16:16:28.469Z,1595607388.469 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.085319 CHAN A1 (24V): -0.003842 CHAN A2 (12V): 0.061678 CHAN A3 (5V): 0.012895 CHAN B0 (3.3V): 0.007548 CHAN B1 (3.15aV): 0.007708 CHAN B2 (3.15bV): 0.009800 CHAN B3 (GND): -0.004483 OPEN: 0.014355 Full Scale Calc: 4.765 mA, -1.589 mA 2020-07-24T16:40:04.858Z,1595608804.858 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_PAUSED (@1000.0) 2020-07-24T16:40:05.264Z,1595608805.264 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_PROCESSING (@1000.0) 2020-07-24T16:40:07.686Z,1595608807.686 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_WAITING_FOR_PROCESSED (@33,archive_bac) 2020-07-24T16:52:10.899Z,1595609530.899 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_STOPPING (@33,archive_bac) 2020-07-24T16:52:36.349Z,1595609556.349 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-24T16:52:36.751Z,1595609556.751 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_STOPPED 2020-07-24T16:57:36.525Z,1595609856.525 [ESPComponent](IMPORTANT): [sample #20] ESP sampling sequence completed normally. 2020-07-24T16:57:36.934Z,1595609856.934 [ESPComponent](IMPORTANT): [sample #20] ESP log summary report (2 messages): @08:48:22.48 Selecting Cartridge 33 @09:40:03.34 Sampled 1000.0ml 2020-07-24T17:08:14.003Z,1595610494.003 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.797000 arcdeg , -121.847000 arcdeg 2020-07-24T19:20:46.392Z,1595618446.392 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:D.Waypoint](IMPORTANT): Reached Waypoint: 36.797000,-121.847000 2020-07-24T19:29:03.112Z,1595618943.112 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:A](IMPORTANT): Requesting ESP sample with cartridge type -6.000000 count 2020-07-24T19:29:05.215Z,1595618945.215 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-24T19:29:05.352Z,1595618945.352 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-24T19:29:42.681Z,1595618982.681 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-24T19:29:43.496Z,1595618983.496 [ESPComponent](IMPORTANT): [sample #21] Setting cartridge argument to -6 2020-07-24T19:29:43.496Z,1595618983.496 [ESPComponent](IMPORTANT): [sample #21] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-24T19:29:43.930Z,1595618983.930 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:D](IMPORTANT): ESP sampling at 14.607838 m in 12.514246 degC water with 1.748110 ug/l chlorophyll fluorescence. 2020-07-24T19:29:44.294Z,1595618984.294 [ESPComponent](IMPORTANT): [sample #21] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-24T19:29:44.700Z,1595618984.700 [ESPComponent](IMPORTANT): [sample #21] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-24T19:29:46.720Z,1595618986.720 [ESPComponent](IMPORTANT): [sample #21] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-24T19:30:19.445Z,1595619019.445 [ESPComponent](IMPORTANT): [sample #21] ESP sampling state: S_WAITING_FOR_PRIMING (@32,archive_bac) 2020-07-24T19:30:21.068Z,1595619021.068 [ESPComponent](IMPORTANT): [sample #21] ESP sampling state: S_PRIMING (@100.0) 2020-07-24T19:30:22.678Z,1595619022.678 [ESPComponent](IMPORTANT): [sample #21] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-24T19:33:02.670Z,1595619182.670 [ESPComponent](IMPORTANT): [sample #21] ESP sampling state: S_FILTERING (@0.0) 2020-07-24T19:33:03.077Z,1595619183.077 [ESPComponent](IMPORTANT): [sample #21] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-24T20:20:22.940Z,1595622022.940 [ESPComponent](IMPORTANT): [sample #21] ESP sampling state: S_PAUSED (@1000.0) 2020-07-24T20:20:23.342Z,1595622023.342 [ESPComponent](IMPORTANT): [sample #21] ESP sampling state: S_PROCESSING (@1000.0) 2020-07-24T20:20:25.766Z,1595622025.766 [ESPComponent](IMPORTANT): [sample #21] ESP sampling state: S_WAITING_FOR_PROCESSED (@32,archive_bac) 2020-07-24T20:32:28.969Z,1595622748.969 [ESPComponent](IMPORTANT): [sample #21] ESP sampling state: S_STOPPING (@32,archive_bac) 2020-07-24T20:32:54.421Z,1595622774.421 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-24T20:32:54.822Z,1595622774.822 [ESPComponent](IMPORTANT): [sample #21] ESP sampling state: S_STOPPED 2020-07-24T20:37:54.608Z,1595623074.608 [ESPComponent](IMPORTANT): [sample #21] ESP sampling sequence completed normally. 2020-07-24T20:37:55.010Z,1595623075.010 [ESPComponent](IMPORTANT): [sample #21] ESP log summary report (2 messages): @12:29:56.91 Selecting Cartridge 32 @13:20:21.21 Sampled 1000.0ml 2020-07-24T20:45:01.489Z,1595623501.489 [MissionManager](IMPORTANT): Started mission Default 2020-07-24T20:50:45.267Z,1595623845.267 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 5.723007 min 2020-07-24T20:55:24.398Z,1595624124.398 [DataOverHttps](IMPORTANT): SBD MTMSN=20200724T205522 2020-07-24T20:55:31.857Z,1595624131.857 [CommandLine](IMPORTANT): got command schedule list 2020-07-24T20:55:31.861Z,1595624131.861 [CommandLine](IMPORTANT): Scheduled #76 (#1 of 2 with id='3h745'): "load Science/esp_sample_station.xml;set esp_sample_station.MissionTimeout 30 hour;set esp_sample_station.NeedCommsTime 60 minute;set esp_sample_station.LapRepeat 2 count;set esp_sample_station.Lat1 NaN degree" 2020-07-24T20:55:31.862Z,1595624131.862 [CommandLine](IMPORTANT): Scheduled #77 (#2 of 2 with id='3h745'): "set esp_sample_station.Lon1 NaN degree;set esp_sample_station.Speed 0.65 meter_per_second;set esp_sample_station.MaxDepth 60 meter;run " 2020-07-24T20:55:31.862Z,1595624131.862 [CommandLine](FAULT): Scheduling was paused by a command at 2020-07-23T19:44:54Z 2020-07-24T20:56:15.381Z,1595624175.381 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.225023 min 2020-07-24T20:59:40.734Z,1595624380.734 [DataOverHttps](IMPORTANT): SBD MTMSN=20200724T205939 2020-07-24T20:59:48.030Z,1595624388.030 [CommandLine](IMPORTANT): got command schedule resume 2020-07-24T20:59:48.030Z,1595624388.030 [CommandLine](IMPORTANT): Scheduling is resumed 2020-07-24T20:59:48.184Z,1595624388.184 [CommandLine](IMPORTANT): got command load ./Missions/Science/esp_sample_station.xml 2020-07-24T20:59:49.757Z,1595624389.757 [CommandLine](IMPORTANT): Loaded ./Missions/Science/esp_sample_station.xml 2020-07-24T21:00:01.856Z,1595624401.856 [CommandLine](IMPORTANT): got command set esp_sample_station.MissionTimeout 30.000000 hour 2020-07-24T21:00:01.856Z,1595624401.856 [CommandLine](IMPORTANT): got command set esp_sample_station.NeedCommsTime 60.000000 minute 2020-07-24T21:00:01.857Z,1595624401.857 [CommandLine](IMPORTANT): got command set esp_sample_station.LapRepeat 2.000000 count 2020-07-24T21:00:01.858Z,1595624401.858 [CommandLine](IMPORTANT): got command set esp_sample_station.Lat1 nan degree 2020-07-24T21:00:09.800Z,1595624409.800 [CommandLine](IMPORTANT): got command set esp_sample_station.Lon1 nan degree 2020-07-24T21:00:09.801Z,1595624409.801 [CommandLine](IMPORTANT): got command set esp_sample_station.Speed 0.650000 meter_per_second 2020-07-24T21:00:09.801Z,1595624409.801 [CommandLine](IMPORTANT): got command set esp_sample_station.MaxDepth 60.000000 meter 2020-07-24T21:00:09.802Z,1595624409.802 [CommandLine](IMPORTANT): got command run 2020-07-24T21:00:09.804Z,1595624409.804 [CommandLine](IMPORTANT): Running 2020-07-24T21:00:10.105Z,1595624410.105 [MissionManager](IMPORTANT): Started mission esp_sample_station 2020-07-24T21:01:20.555Z,1595624480.555 [esp_sample_station:Lap:A](IMPORTANT): Starting Lap 2020-07-24T21:01:20.970Z,1595624480.970 [esp_sample_station:Lap:B](IMPORTANT): Lat[1] = nan arcdeg Lon[1] = nan arcdeg 2020-07-24T21:01:21.353Z,1595624481.353 [esp_sample_station:Lap:C](IMPORTANT): Lat[2] = 36.821900 arcdeg Lon[2] = -121.885600 arcdeg 2020-07-24T21:01:21.755Z,1595624481.755 [esp_sample_station:Lap:D](IMPORTANT): Lat[3] = 36.766000 arcdeg Lon[3] = -121.864900 arcdeg 2020-07-24T21:01:22.170Z,1595624482.170 [esp_sample_station:Lap:E](IMPORTANT): Lat[4] = 36.797000 arcdeg Lon[4] = -121.847000 arcdeg 2020-07-24T21:01:29.816Z,1595624489.816 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.821900 arcdeg , -121.885600 arcdeg 2020-07-24T22:16:28.689Z,1595628988.689 [CBIT](IMPORTANT): Beginning ground fault scan 2020-07-24T22:16:39.596Z,1595628999.596 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.108227 CHAN A1 (24V): -0.002309 CHAN A2 (12V): -0.001932 CHAN A3 (5V): -0.003240 CHAN B0 (3.3V): -0.001373 CHAN B1 (3.15aV): -0.001293 CHAN B2 (3.15bV): 0.020436 CHAN B3 (GND): -0.001813 OPEN: 0.012380 Full Scale Calc: 4.765 mA, -1.589 mA 2020-07-25T00:00:29.664Z,1595635229.664 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:D.Waypoint](IMPORTANT): Reached Waypoint: 36.821900,-121.885600 2020-07-25T00:06:25.265Z,1595635585.265 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:A](IMPORTANT): Requesting ESP sample with cartridge type -6.000000 count 2020-07-25T00:06:27.357Z,1595635587.357 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-25T00:06:27.483Z,1595635587.483 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-25T00:07:04.453Z,1595635624.453 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-25T00:07:05.260Z,1595635625.260 [ESPComponent](IMPORTANT): [sample #22] Setting cartridge argument to -6 2020-07-25T00:07:05.261Z,1595635625.261 [ESPComponent](IMPORTANT): [sample #22] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-25T00:07:05.703Z,1595635625.703 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:D](IMPORTANT): ESP sampling at 10.218708 m in 14.559473 degC water with 6.429700 ug/l chlorophyll fluorescence. 2020-07-25T00:07:06.069Z,1595635626.069 [ESPComponent](IMPORTANT): [sample #22] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-25T00:07:06.471Z,1595635626.471 [ESPComponent](IMPORTANT): [sample #22] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-25T00:07:08.489Z,1595635628.489 [ESPComponent](IMPORTANT): [sample #22] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-25T00:07:41.214Z,1595635661.214 [ESPComponent](IMPORTANT): [sample #22] ESP sampling state: S_WAITING_FOR_PRIMING (@31,archive_bac) 2020-07-25T00:07:42.833Z,1595635662.833 [ESPComponent](IMPORTANT): [sample #22] ESP sampling state: S_PRIMING (@100.0) 2020-07-25T00:07:43.641Z,1595635663.641 [ESPComponent](IMPORTANT): [sample #22] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-25T00:10:55.144Z,1595635855.144 [ESPComponent](IMPORTANT): [sample #22] ESP sampling state: S_FILTERING (@0.0) 2020-07-25T00:10:55.546Z,1595635855.546 [ESPComponent](IMPORTANT): [sample #22] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-25T00:56:50.753Z,1595638610.753 [ThrusterServo](FAULT): getVelocity uart error serial timeout 2020-07-25T00:56:50.753Z,1595638610.753 [ThrusterServo](FAULT): Thruster uart error: serial timeout 2020-07-25T01:07:42.708Z,1595639262.708 [ESPComponent](IMPORTANT): [sample #22] ESP sampling state: S_PAUSED (@1000.0) 2020-07-25T01:07:43.113Z,1595639263.113 [ESPComponent](IMPORTANT): [sample #22] ESP sampling state: S_PROCESSING (@1000.0) 2020-07-25T01:07:45.535Z,1595639265.535 [ESPComponent](IMPORTANT): [sample #22] ESP sampling state: S_WAITING_FOR_PROCESSED (@30,archive_bac) 2020-07-25T01:19:48.729Z,1595639988.729 [ESPComponent](IMPORTANT): [sample #22] ESP sampling state: S_STOPPING (@30,archive_bac) 2020-07-25T01:20:14.583Z,1595640014.583 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-25T01:20:14.986Z,1595640014.986 [ESPComponent](IMPORTANT): [sample #22] ESP sampling state: S_STOPPED 2020-07-25T01:25:14.774Z,1595640314.774 [ESPComponent](IMPORTANT): [sample #22] ESP sampling sequence completed normally. 2020-07-25T01:25:15.175Z,1595640315.175 [ESPComponent](IMPORTANT): [sample #22] ESP log summary report (5 messages): @17:07:18.55 Selecting Cartridge 31 @17:10:22.88 Cartridge::Sampler::Leak in FILTERING -- Isolated cartridge pressure fell by 15% to 58.6psia @17:10:22.89 Retry #1 of 2 @17:10:22.94 Selecting Cartridge 30 @18:07:41.18 Sampled 1000.0ml 2020-07-25T01:29:50.179Z,1595640590.179 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.766000 arcdeg , -121.864900 arcdeg 2020-07-25T02:40:31.182Z,1595644831.182 [DataOverHttps](IMPORTANT): SBD MTMSN=20200725T024029 2020-07-25T02:40:39.574Z,1595644839.574 [CommandLine](IMPORTANT): got command stop 2020-07-25T02:40:39.574Z,1595644839.574 [CommandLine](IMPORTANT): Scheduling is paused 2020-07-25T02:40:40.022Z,1595644840.022 [MissionManager](IMPORTANT): Started mission Default 2020-07-25T02:40:40.781Z,1595644840.781 [Aanderaa_O2](FAULT): LCB fault: Software Overcurrent. 2020-07-25T02:48:04.485Z,1595645284.485 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 7.401253 min 2020-07-25T02:48:15.284Z,1595645295.284 [DataOverHttps](IMPORTANT): SBD MOMSN=12469254, MTMSN=20200725T024813 2020-07-25T02:48:22.622Z,1595645302.622 [CommandLine](IMPORTANT): got command ! start onESPclient brent -- slots archive_bac:5 2020-07-25T02:48:22.974Z,1595645302.974 [CommandLine](IMPORTANT): /mnt/mmc/started/2020-07-25UTC024822_onESPclient 2020-07-25T02:50:16.510Z,1595645416.510 [DataOverHttps](IMPORTANT): SBD MTMSN=20200725T025014 2020-07-25T02:50:23.890Z,1595645423.890 [CommandLine](IMPORTANT): got command ! check 2020-07-25T02:50:24.128Z,1595645424.128 [CommandLine](IMPORTANT): State: :processed, filtered: 677.111}, archive_bac: 5, [60, 57, 56, 54, 53, 51..42, 40..37, 35..32, 30] => { Type: :archive_bac, State: :processed, filtered: 1000}, 58 => { Type: :archive_bac, State: :processed, filtered: 452.305}} Sat Jul 25 02:49:06 UTC 2020 -- Shutting down ESP in 20 seconds ... shutting ESP off 2020-07-25T02:54:10.131Z,1595645650.131 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 13.495024 min 2020-07-25T02:56:37.046Z,1595645797.046 [DataOverHttps](IMPORTANT): SBD MTMSN=20200725T025635 2020-07-25T02:56:45.666Z,1595645805.666 [CommandLine](IMPORTANT): got command resume 2020-07-25T02:56:47.442Z,1595645807.442 [MissionManager](IMPORTANT): Resuming from info in Logs/20200724T153834/Science_esp_sample_station_xml.state 2020-07-25T02:56:47.499Z,1595645807.499 [CommandLine](IMPORTANT): Resuming mission and schedule 2020-07-25T02:56:47.500Z,1595645807.500 [CommandLine](IMPORTANT): Scheduling is resumed 2020-07-25T02:56:47.745Z,1595645807.745 [MissionManager](IMPORTANT): Started mission esp_sample_station 2020-07-25T04:16:39.808Z,1595650599.808 [CBIT](IMPORTANT): Beginning ground fault scan 2020-07-25T04:16:50.708Z,1595650610.708 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.091587 CHAN A1 (24V): -0.004767 CHAN A2 (12V): 0.064526 CHAN A3 (5V): 0.014614 CHAN B0 (3.3V): 0.005934 CHAN B1 (3.15aV): 0.006894 CHAN B2 (3.15bV): 0.008804 CHAN B3 (GND): -0.005082 OPEN: 0.014475 Full Scale Calc: 4.765 mA, -1.589 mA 2020-07-25T04:26:48.998Z,1595651208.998 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:D.Waypoint](IMPORTANT): Reached Waypoint: 36.766000,-121.864905 2020-07-25T04:34:52.154Z,1595651692.154 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:A](IMPORTANT): Requesting ESP sample with cartridge type -6.000000 count 2020-07-25T04:34:54.253Z,1595651694.253 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-25T04:34:54.418Z,1595651694.418 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-25T04:35:32.186Z,1595651732.186 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-25T04:35:32.999Z,1595651732.999 [ESPComponent](IMPORTANT): [sample #23] Setting cartridge argument to -6 2020-07-25T04:35:32.000Z,1595651733.000 [ESPComponent](IMPORTANT): [sample #23] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-25T04:35:33.446Z,1595651733.446 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:D](IMPORTANT): ESP sampling at 14.472801 m in 14.585718 degC water with 5.576550 ug/l chlorophyll fluorescence. 2020-07-25T04:35:33.802Z,1595651733.802 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-25T04:35:34.207Z,1595651734.207 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-25T04:35:36.225Z,1595651736.225 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-25T04:36:08.962Z,1595651768.962 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_WAITING_FOR_PRIMING (@29,archive_bac) 2020-07-25T04:36:10.573Z,1595651770.573 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_PRIMING (@100.0) 2020-07-25T04:36:12.189Z,1595651772.189 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-25T04:38:51.777Z,1595651931.777 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_FILTERING (@0.0) 2020-07-25T04:38:52.178Z,1595651932.178 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-25T05:29:04.581Z,1595654944.581 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_PAUSED (@872.296) 2020-07-25T05:29:04.984Z,1595654944.984 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_PROCESSING (@872.296) 2020-07-25T05:29:07.407Z,1595654947.407 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_WAITING_FOR_PROCESSED (@29,archive_bac) 2020-07-25T05:41:10.617Z,1595655670.617 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_STOPPING (@29,archive_bac) 2020-07-25T05:41:36.072Z,1595655696.072 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-25T05:41:36.471Z,1595655696.471 [ESPComponent](IMPORTANT): [sample #23] ESP sampling state: S_STOPPED 2020-07-25T05:46:36.279Z,1595655996.279 [ESPComponent](IMPORTANT): [sample #23] ESP sampling sequence completed normally. 2020-07-25T05:46:36.679Z,1595655996.679 [ESPComponent](IMPORTANT): [sample #23] ESP log summary report (3 messages): @21:35:45.54 Selecting Cartridge 29 @22:29:01.26 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @22:29:01.45 Sampled 872.3ml 2020-07-25T05:55:04.984Z,1595656504.984 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.797000 arcdeg , -121.847000 arcdeg