2020-10-12T03:59:56.233Z,1602475196.233 [CommandLine](IMPORTANT): got command restart logs
2020-10-12T04:00:45.088Z,1602475245.088 [esp_sample_station:Lap:A](IMPORTANT): Starting Lap
2020-10-12T04:00:45.430Z,1602475245.430 [esp_sample_station:Lap:B](IMPORTANT): Lat[1] = 36.797000 arcdeg Lon[1] = -121.847000 arcdeg 
2020-10-12T04:00:45.913Z,1602475245.913 [esp_sample_station:Lap:C](IMPORTANT): Lat[2] = 36.821900 arcdeg Lon[2] = -121.885600 arcdeg 
2020-10-12T04:00:46.354Z,1602475246.354 [esp_sample_station:Lap:D](IMPORTANT): Lat[3] = 36.766000 arcdeg Lon[3] = -121.864900 arcdeg 
2020-10-12T04:00:46.715Z,1602475246.715 [esp_sample_station:Lap:E](IMPORTANT): Lat[4] = nan arcdeg Lon[4] = nan arcdeg 
2020-10-12T04:00:51.108Z,1602475251.108 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.821900 arcdeg , -121.885600 arcdeg 
2020-10-12T04:52:44.973Z,1602478364.973 [CBIT](IMPORTANT): Beginning ground fault scan
2020-10-12T04:52:56.264Z,1602478376.264 [CBIT](IMPORTANT): No ground fault detected
mA:
CHAN A0 (Batt): -0.005523
CHAN A1 (24V): 0.003223
CHAN A2 (12V): -0.004490
CHAN A3 (5V): -0.002572
CHAN B0 (3.3V): -0.000866
CHAN B1 (3.15aV): -0.001094
CHAN B2 (3.15bV): -0.001199
CHAN B3 (GND): 0.000026
OPEN: 0.007330
Full Scale Calc: 4.765 mA, -1.589 mA
2020-10-12T06:03:04.885Z,1602482584.885 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:D.Waypoint](IMPORTANT): Reached Waypoint: 36.821900,-121.885600
2020-10-12T06:08:55.366Z,1602482935.366 [esp_sample_station:Sample:SampleWrapper:ESP:AcquireESP:SelectESPCartridge:A](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 
2020-10-12T06:09:07.150Z,1602482947.150 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2020-10-12T06:09:07.464Z,1602482947.464 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2020-10-12T06:09:45.198Z,1602482985.198 [ESPComponent](IMPORTANT): ESP has connected as client
2020-10-12T06:09:46.009Z,1602482986.009 [ESPComponent](IMPORTANT): [sample #10] Setting cartridge argument to -6
2020-10-12T06:09:46.009Z,1602482986.009 [ESPComponent](IMPORTANT): [sample #10] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2020-10-12T06:09:46.562Z,1602482986.562 [esp_sample_station:Sample:SampleWrapper:ESP:AcquireESP:C](IMPORTANT): ESP sampling at 17.620117 m in 12.458704 degC water with 0.971800 ug/l chlorophyll fluorescence.
2020-10-12T06:09:46.813Z,1602482986.813 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PREPARING_SHOW_LOG
2020-10-12T06:09:47.218Z,1602482987.218 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PREPARING_SHOW_STATUS
2020-10-12T06:09:49.238Z,1602482989.238 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_LOADING_CARTRIDGE
2020-10-12T06:10:22.370Z,1602483022.370 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PRIMING (@35,archive_bac)
2020-10-12T06:10:23.986Z,1602483023.986 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PRIMING (@100.0)
2020-10-12T06:10:25.601Z,1602483025.601 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2020-10-12T06:12:53.469Z,1602483173.469 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_FILTERING (@0.0)
2020-10-12T06:12:53.874Z,1602483173.874 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2020-10-12T07:01:13.945Z,1602486073.945 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PAUSED (@812.336)
2020-10-12T07:01:14.350Z,1602486074.350 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PROCESSING (@812.336)
2020-10-12T07:01:16.776Z,1602486076.776 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PROCESSED (@35,archive_bac)
2020-10-12T07:13:20.366Z,1602486800.366 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_STOPPING (@35,archive_bac)
2020-10-12T07:13:45.818Z,1602486825.818 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs &
2020-10-12T07:13:46.222Z,1602486826.222 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_STOPPED
2020-10-12T07:18:46.013Z,1602487126.013 [ESPComponent](IMPORTANT): [sample #10] ESP sampling sequence completed normally.
2020-10-12T07:18:46.418Z,1602487126.418 [ESPComponent](IMPORTANT): [sample #10] ESP log summary report (3 messages):
@23:09:58.56 Selecting Cartridge 35
@00:01:11.22 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged
@00:01:11.41 Sampled  812.3ml

2020-10-12T07:29:24.758Z,1602487764.758 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.766000 arcdeg , -121.864900 arcdeg 
2020-10-12T10:52:56.365Z,1602499976.365 [CBIT](IMPORTANT): Beginning ground fault scan
2020-10-12T10:53:07.292Z,1602499987.292 [CBIT](IMPORTANT): No ground fault detected
mA:
CHAN A0 (Batt): -0.005392
CHAN A1 (24V): 0.003405
CHAN A2 (12V): -0.004410
CHAN A3 (5V): -0.002351
CHAN B0 (3.3V): -0.000817
CHAN B1 (3.15aV): -0.001131
CHAN B2 (3.15bV): -0.000900
CHAN B3 (GND): 0.000080
OPEN: 0.007569
Full Scale Calc: 4.765 mA, -1.589 mA
2020-10-12T11:01:08.811Z,1602500468.811 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:D.Waypoint](IMPORTANT): Reached Waypoint: 36.766000,-121.864900
2020-10-12T11:07:24.115Z,1602500844.115 [esp_sample_station:Sample:SampleWrapper:ESP:AcquireESP:SelectESPCartridge:A](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 
2020-10-12T11:07:35.905Z,1602500855.905 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2020-10-12T11:07:36.182Z,1602500856.182 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2020-10-12T11:10:06.302Z,1602501006.302 [ESPComponent](FAULT): Timeout while waiting for ESP to connect (elapsed=150.1200)
2020-10-12T11:10:18.129Z,1602501018.129 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2020-10-12T11:10:18.272Z,1602501018.272 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2020-10-12T11:10:56.418Z,1602501056.418 [ESPComponent](IMPORTANT): ESP has connected as client
2020-10-12T11:10:57.231Z,1602501057.231 [ESPComponent](IMPORTANT): [sample #11] Setting cartridge argument to -6
2020-10-12T11:10:57.231Z,1602501057.231 [ESPComponent](IMPORTANT): [sample #11] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2020-10-12T11:10:57.673Z,1602501057.673 [esp_sample_station:Sample:SampleWrapper:ESP:AcquireESP:C](IMPORTANT): ESP sampling at 48.421246 m in 11.524408 degC water with 0.327700 ug/l chlorophyll fluorescence.
2020-10-12T11:10:58.033Z,1602501058.033 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PREPARING_SHOW_LOG
2020-10-12T11:10:58.437Z,1602501058.437 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PREPARING_SHOW_STATUS
2020-10-12T11:11:00.458Z,1602501060.458 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_LOADING_CARTRIDGE
2020-10-12T11:11:33.586Z,1602501093.586 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PRIMING (@34,archive_bac)
2020-10-12T11:11:35.204Z,1602501095.204 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PRIMING (@100.0)
2020-10-12T11:11:36.013Z,1602501096.013 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2020-10-12T11:14:04.282Z,1602501244.282 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_FILTERING (@0.0)
2020-10-12T11:14:04.685Z,1602501244.685 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2020-10-12T12:09:03.130Z,1602504543.130 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PAUSED (@909.074)
2020-10-12T12:09:03.534Z,1602504543.534 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PROCESSING (@909.074)
2020-10-12T12:09:05.957Z,1602504545.957 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PROCESSED (@34,archive_bac)
2020-10-12T12:21:09.586Z,1602505269.586 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_STOPPING (@34,archive_bac)
2020-10-12T12:21:35.039Z,1602505295.039 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs &
2020-10-12T12:21:35.449Z,1602505295.449 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_STOPPED
2020-10-12T12:26:35.233Z,1602505595.233 [ESPComponent](IMPORTANT): [sample #11] ESP sampling sequence completed normally.
2020-10-12T12:26:35.634Z,1602505595.634 [ESPComponent](IMPORTANT): [sample #11] ESP log summary report (3 messages):
@04:11:10.08 Selecting Cartridge 34
@05:09:00.46 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged
@05:09:00.66 Sampled  909.1ml

2020-10-12T12:32:04.996Z,1602505924.996 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.797000 arcdeg , -121.847000 arcdeg