2020-07-23T05:41:15.345Z,1595482875.345 [CommandLine](IMPORTANT): got command restart logs 2020-07-23T05:45:01.455Z,1595483101.455 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 5.716743 min 2020-07-23T05:51:20.815Z,1595483480.815 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 12.039259 min 2020-07-23T05:56:50.084Z,1595483810.084 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 17.527096 min 2020-07-23T06:01:28.135Z,1595484088.135 [DataOverHttps](IMPORTANT): SBD MTMSN=20200723T060126 2020-07-23T06:01:35.583Z,1595484095.583 [CommandLine](IMPORTANT): got command schedule asap "load Science/esp_sample_station.xml;set esp_sample_station.MissionTimeout 18 hour;set esp_sample_station.NeedCommsTime 60 minute;set esp_sample_station.Lat1 NaN degree;set esp_sample_station.Lon1 NaN degree" 3eops 1 2.000000 2020-07-23T06:01:35.583Z,1595484095.583 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=3eops 2020-07-23T06:01:35.584Z,1595484095.584 [CommandLine](IMPORTANT): Scheduled #61 (#1 of 2 with id='3eops'): "load Science/esp_sample_station.xml;set esp_sample_station.MissionTimeout 18 hour;set esp_sample_station.NeedCommsTime 60 minute;set esp_sample_station.Lat1 NaN degree;set esp_sample_station.Lon1 NaN degree" ASAP 2020-07-23T06:01:36.570Z,1595484096.570 [DataOverHttps](IMPORTANT): SBD MTMSN=20200723T060135 2020-07-23T06:01:43.803Z,1595484103.803 [CommandLine](IMPORTANT): got command schedule asap "set esp_sample_station.Lat3 36.7660 degree;set esp_sample_station.Lat4 36.7970 degree;set esp_sample_station.Lon4 -121.8470 degree;set esp_sample_station.Speed 0.65 meter_per_second;set esp_sample_station.MaxDepth 60 meter;run " 3eops 2 2.000000 2020-07-23T06:01:43.803Z,1595484103.803 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=3eops 2020-07-23T06:01:43.804Z,1595484103.804 [CommandLine](IMPORTANT): Scheduled #62 (#2 of 2 with id='3eops'): "set esp_sample_station.Lat3 36.7660 degree;set esp_sample_station.Lat4 36.7970 degree;set esp_sample_station.Lon4 -121.8470 degree;set esp_sample_station.Speed 0.65 meter_per_second;set esp_sample_station.MaxDepth 60 meter;run " ASAP 2020-07-23T06:01:43.909Z,1595484103.909 [CommandLine](IMPORTANT): got command load ./Missions/Science/esp_sample_station.xml 2020-07-23T06:01:45.489Z,1595484105.489 [CommandLine](IMPORTANT): Loaded ./Missions/Science/esp_sample_station.xml 2020-07-23T06:01:57.029Z,1595484117.029 [CommandLine](IMPORTANT): got command set esp_sample_station.MissionTimeout 18.000000 hour 2020-07-23T06:01:57.030Z,1595484117.030 [CommandLine](IMPORTANT): got command set esp_sample_station.NeedCommsTime 60.000000 minute 2020-07-23T06:01:57.030Z,1595484117.030 [CommandLine](IMPORTANT): got command set esp_sample_station.Lat1 nan degree 2020-07-23T06:01:57.031Z,1595484117.031 [CommandLine](IMPORTANT): got command set esp_sample_station.Lon1 nan degree 2020-07-23T06:02:10.026Z,1595484130.026 [CommandLine](IMPORTANT): got command set esp_sample_station.Lat3 36.765999 degree 2020-07-23T06:02:10.027Z,1595484130.027 [CommandLine](IMPORTANT): got command set esp_sample_station.Lat4 36.797001 degree 2020-07-23T06:02:10.028Z,1595484130.028 [CommandLine](IMPORTANT): got command set esp_sample_station.Lon4 -121.847000 degree 2020-07-23T06:02:10.028Z,1595484130.028 [CommandLine](IMPORTANT): got command set esp_sample_station.Speed 0.650000 meter_per_second 2020-07-23T06:02:10.056Z,1595484130.056 [CommandLine](IMPORTANT): got command set esp_sample_station.MaxDepth 60.000000 meter 2020-07-23T06:02:10.097Z,1595484130.097 [CommandLine](IMPORTANT): got command run 2020-07-23T06:02:10.099Z,1595484130.099 [CommandLine](IMPORTANT): Running 2020-07-23T06:02:10.125Z,1595484130.125 [MissionManager](IMPORTANT): Started mission esp_sample_station 2020-07-23T06:02:37.974Z,1595484157.974 [esp_sample_station:Lap:A](IMPORTANT): Starting Lap 2020-07-23T06:02:38.402Z,1595484158.402 [esp_sample_station:Lap:B](IMPORTANT): Lat[1] = nan arcdeg Lon[1] = nan arcdeg 2020-07-23T06:02:38.809Z,1595484158.809 [esp_sample_station:Lap:C](IMPORTANT): Lat[2] = 36.821900 arcdeg Lon[2] = -121.885600 arcdeg 2020-07-23T06:02:39.220Z,1595484159.220 [esp_sample_station:Lap:D](IMPORTANT): Lat[3] = 36.766000 arcdeg Lon[3] = -121.864900 arcdeg 2020-07-23T06:02:39.638Z,1595484159.638 [esp_sample_station:Lap:E](IMPORTANT): Lat[4] = 36.797002 arcdeg Lon[4] = -121.847000 arcdeg 2020-07-23T06:02:44.895Z,1595484164.895 [MissionManager](IMPORTANT): Started mission Default 2020-07-23T06:08:28.255Z,1595484508.255 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 5.716138 min 2020-07-23T06:13:59.151Z,1595484839.151 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.230739 min 2020-07-23T06:19:28.049Z,1595485168.049 [CommandLine](IMPORTANT): got command show stack 2020-07-23T06:19:28.049Z,1595485168.049 [CommandLine](IMPORTANT): Behavior Stack: 2020-07-23T06:19:28.049Z,1595485168.049 [Default](IMPORTANT): Priority 0: Default:B.GoToSurface 2020-07-23T06:19:28.049Z,1595485168.049 [Default:CheckIn](IMPORTANT): Priority 1: Default:CheckIn:C.Wait 2020-07-23T06:19:28.871Z,1595485168.871 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 16.726319 min 2020-07-23T06:22:06.335Z,1595485326.335 [DataOverHttps](IMPORTANT): SBD MTMSN=20200723T062204 2020-07-23T06:22:13.610Z,1595485333.610 [CommandLine](IMPORTANT): got command schedule asap "load Science/esp_sample_station.xml;set esp_sample_station.MissionTimeout 18 hour;set esp_sample_station.Lat1 NaN degree;set esp_sample_station.Lon1 NaN degree;set esp_sample_station.Speed 0.65 meter_per_second" 3epob 1 2.000000 2020-07-23T06:22:13.611Z,1595485333.611 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=3epob 2020-07-23T06:22:13.612Z,1595485333.612 [CommandLine](IMPORTANT): Scheduled #63 (#1 of 2 with id='3epob'): "load Science/esp_sample_station.xml;set esp_sample_station.MissionTimeout 18 hour;set esp_sample_station.Lat1 NaN degree;set esp_sample_station.Lon1 NaN degree;set esp_sample_station.Speed 0.65 meter_per_second" ASAP 2020-07-23T06:22:14.570Z,1595485334.570 [DataOverHttps](IMPORTANT): SBD MTMSN=20200723T062213 2020-07-23T06:22:22.026Z,1595485342.026 [CommandLine](IMPORTANT): got command schedule asap "set esp_sample_station.MaxDepth 60 meter;run " 3epob 2 2.000000 2020-07-23T06:22:22.026Z,1595485342.026 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=3epob 2020-07-23T06:22:22.027Z,1595485342.027 [CommandLine](IMPORTANT): Scheduled #64 (#2 of 2 with id='3epob'): "set esp_sample_station.MaxDepth 60 meter;run " ASAP 2020-07-23T06:22:22.123Z,1595485342.123 [CommandLine](IMPORTANT): got command load ./Missions/Science/esp_sample_station.xml 2020-07-23T06:22:24.321Z,1595485344.321 [CommandLine](IMPORTANT): Loaded ./Missions/Science/esp_sample_station.xml 2020-07-23T06:22:34.994Z,1595485354.994 [CommandLine](IMPORTANT): got command set esp_sample_station.MissionTimeout 18.000000 hour 2020-07-23T06:22:34.995Z,1595485354.995 [CommandLine](IMPORTANT): got command set esp_sample_station.Lat1 nan degree 2020-07-23T06:22:34.995Z,1595485354.995 [CommandLine](IMPORTANT): got command set esp_sample_station.Lon1 nan degree 2020-07-23T06:22:34.996Z,1595485354.996 [CommandLine](IMPORTANT): got command set esp_sample_station.Speed 0.650000 meter_per_second 2020-07-23T06:22:38.057Z,1595485358.057 [CommandLine](IMPORTANT): got command set esp_sample_station.MaxDepth 60.000000 meter 2020-07-23T06:22:38.058Z,1595485358.058 [CommandLine](IMPORTANT): got command run 2020-07-23T06:22:38.059Z,1595485358.059 [CommandLine](IMPORTANT): Running 2020-07-23T06:22:38.369Z,1595485358.369 [MissionManager](IMPORTANT): Started mission esp_sample_station 2020-07-23T06:23:13.094Z,1595485393.094 [esp_sample_station:Lap:A](IMPORTANT): Starting Lap 2020-07-23T06:23:13.510Z,1595485393.510 [esp_sample_station:Lap:B](IMPORTANT): Lat[1] = nan arcdeg Lon[1] = nan arcdeg 2020-07-23T06:23:13.908Z,1595485393.908 [esp_sample_station:Lap:C](IMPORTANT): Lat[2] = 36.821900 arcdeg Lon[2] = -121.885600 arcdeg 2020-07-23T06:23:14.337Z,1595485394.337 [esp_sample_station:Lap:D](IMPORTANT): Lat[3] = 36.766000 arcdeg Lon[3] = -121.864900 arcdeg 2020-07-23T06:23:14.714Z,1595485394.714 [esp_sample_station:Lap:E](IMPORTANT): Lat[4] = 36.797000 arcdeg Lon[4] = -121.847000 arcdeg 2020-07-23T06:23:19.947Z,1595485399.947 [MissionManager](IMPORTANT): Started mission Default 2020-07-23T06:25:40.155Z,1595485540.155 [DataOverHttps](IMPORTANT): SBD MTMSN=20200723T062538 2020-07-23T06:25:47.455Z,1595485547.455 [CommandLine](IMPORTANT): got command schedule asap "load Science/esp_sample_station.xml;set esp_sample_station.MissionTimeout 18 hour;set esp_sample_station.Lat1 36.8219 degree;set esp_sample_station.Lon1 -121.8856 degree;set esp_sample_station.Lat2 36.766 degree" 3epuq 1 3.000000 2020-07-23T06:25:47.455Z,1595485547.455 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=3epuq 2020-07-23T06:25:47.456Z,1595485547.456 [CommandLine](IMPORTANT): Scheduled #65 (#1 of 3 with id='3epuq'): "load Science/esp_sample_station.xml;set esp_sample_station.MissionTimeout 18 hour;set esp_sample_station.Lat1 36.8219 degree;set esp_sample_station.Lon1 -121.8856 degree;set esp_sample_station.Lat2 36.766 degree" ASAP 2020-07-23T06:25:48.379Z,1595485548.379 [DataOverHttps](IMPORTANT): SBD MTMSN=20200723T062546 2020-07-23T06:25:55.858Z,1595485555.858 [CommandLine](IMPORTANT): got command schedule asap "set esp_sample_station.Lon2 -121.8649 degree;set esp_sample_station.Lat3 36.797 degree;set esp_sample_station.Lon3 -121.847 degree;set esp_sample_station.Lat4 NaN degree;set esp_sample_station.Lon4 NaN degree" 3epuq 2 3.000000 2020-07-23T06:25:55.858Z,1595485555.858 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=3epuq 2020-07-23T06:25:55.859Z,1595485555.859 [CommandLine](IMPORTANT): Scheduled #66 (#2 of 3 with id='3epuq'): "set esp_sample_station.Lon2 -121.8649 degree;set esp_sample_station.Lat3 36.797 degree;set esp_sample_station.Lon3 -121.847 degree;set esp_sample_station.Lat4 NaN degree;set esp_sample_station.Lon4 NaN degree" ASAP 2020-07-23T06:25:56.803Z,1595485556.803 [DataOverHttps](IMPORTANT): SBD MTMSN=20200723T062555 2020-07-23T06:26:04.061Z,1595485564.061 [CommandLine](IMPORTANT): got command schedule asap "set esp_sample_station.Speed 0.65 meter_per_second;set esp_sample_station.MaxDepth 60 meter;run " 3epuq 3 3.000000 2020-07-23T06:26:04.062Z,1595485564.062 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=3epuq 2020-07-23T06:26:04.063Z,1595485564.063 [CommandLine](IMPORTANT): Scheduled #67 (#3 of 3 with id='3epuq'): "set esp_sample_station.Speed 0.65 meter_per_second;set esp_sample_station.MaxDepth 60 meter;run " ASAP 2020-07-23T06:26:04.296Z,1595485564.296 [CommandLine](IMPORTANT): got command load ./Missions/Science/esp_sample_station.xml 2020-07-23T06:26:06.571Z,1595485566.571 [CommandLine](IMPORTANT): Loaded ./Missions/Science/esp_sample_station.xml 2020-07-23T06:26:17.112Z,1595485577.112 [CommandLine](IMPORTANT): got command set esp_sample_station.MissionTimeout 18.000000 hour 2020-07-23T06:26:17.113Z,1595485577.113 [CommandLine](IMPORTANT): got command set esp_sample_station.Lat1 36.821899 degree 2020-07-23T06:26:17.113Z,1595485577.113 [CommandLine](IMPORTANT): got command set esp_sample_station.Lon1 -121.885597 degree 2020-07-23T06:26:17.114Z,1595485577.114 [CommandLine](IMPORTANT): got command set esp_sample_station.Lat2 36.765999 degree 2020-07-23T06:26:29.330Z,1595485589.330 [CommandLine](IMPORTANT): got command set esp_sample_station.Lon2 -121.864899 degree 2020-07-23T06:26:29.331Z,1595485589.331 [CommandLine](IMPORTANT): got command set esp_sample_station.Lat3 36.797001 degree 2020-07-23T06:26:29.331Z,1595485589.331 [CommandLine](IMPORTANT): got command set esp_sample_station.Lon3 -121.847000 degree 2020-07-23T06:26:29.332Z,1595485589.332 [CommandLine](IMPORTANT): got command set esp_sample_station.Lat4 nan degree 2020-07-23T06:26:29.333Z,1595485589.333 [CommandLine](IMPORTANT): got command set esp_sample_station.Lon4 nan degree 2020-07-23T06:26:38.118Z,1595485598.118 [CommandLine](IMPORTANT): got command set esp_sample_station.Speed 0.650000 meter_per_second 2020-07-23T06:26:38.119Z,1595485598.119 [CommandLine](IMPORTANT): got command set esp_sample_station.MaxDepth 60.000000 meter 2020-07-23T06:26:38.120Z,1595485598.120 [CommandLine](IMPORTANT): got command run 2020-07-23T06:26:38.125Z,1595485598.125 [CommandLine](IMPORTANT): Running 2020-07-23T06:26:38.322Z,1595485598.322 [MissionManager](IMPORTANT): Started mission esp_sample_station 2020-07-23T06:27:30.941Z,1595485650.941 [esp_sample_station:Lap:A](IMPORTANT): Starting Lap 2020-07-23T06:27:31.406Z,1595485651.406 [esp_sample_station:Lap:B](IMPORTANT): Lat[1] = 36.821898 arcdeg Lon[1] = -121.885600 arcdeg 2020-07-23T06:27:31.745Z,1595485651.745 [esp_sample_station:Lap:C](IMPORTANT): Lat[2] = 36.766000 arcdeg Lon[2] = -121.864905 arcdeg 2020-07-23T06:27:32.170Z,1595485652.170 [esp_sample_station:Lap:D](IMPORTANT): Lat[3] = 36.797002 arcdeg Lon[3] = -121.846996 arcdeg 2020-07-23T06:27:32.570Z,1595485652.570 [esp_sample_station:Lap:E](IMPORTANT): Lat[4] = nan arcdeg Lon[4] = nan arcdeg 2020-07-23T06:27:36.586Z,1595485656.586 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.821898 arcdeg , -121.885600 arcdeg 2020-07-23T07:13:45.335Z,1595488425.335 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=37400, MT Status=1, MTMSN=2705 2020-07-23T07:13:45.870Z,1595488425.870 [CommandLine](IMPORTANT): got command stop 2020-07-23T07:13:45.870Z,1595488425.870 [CommandLine](IMPORTANT): Scheduling is paused 2020-07-23T07:13:46.590Z,1595488426.590 [MissionManager](IMPORTANT): Started mission Default 2020-07-23T07:21:49.379Z,1595488909.379 [DataOverHttps](IMPORTANT): SBD MTMSN=20200723T072147 2020-07-23T07:21:56.722Z,1595488916.722 [CommandLine](IMPORTANT): got command schedule asap "load Science/esp_sample_station.xml;set esp_sample_station.MissionTimeout 18 hour;set esp_sample_station.NeedCommsTime 60 minute;set esp_sample_station.Lat1 NaN degree;set esp_sample_station.Lon1 NaN degree" 3esfk 1 2.000000 2020-07-23T07:21:56.723Z,1595488916.723 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=3esfk 2020-07-23T07:21:56.724Z,1595488916.724 [CommandLine](IMPORTANT): Scheduled #68 (#1 of 2 with id='3esfk'): "load Science/esp_sample_station.xml;set esp_sample_station.MissionTimeout 18 hour;set esp_sample_station.NeedCommsTime 60 minute;set esp_sample_station.Lat1 NaN degree;set esp_sample_station.Lon1 NaN degree" ASAP 2020-07-23T07:21:57.631Z,1595488917.631 [DataOverHttps](IMPORTANT): SBD MTMSN=20200723T072156 2020-07-23T07:22:05.137Z,1595488925.137 [CommandLine](IMPORTANT): got command schedule asap "set esp_sample_station.Speed 0.65 meter_per_second;set esp_sample_station.MaxDepth 60 meter;run " 3esfk 2 2.000000 2020-07-23T07:22:05.137Z,1595488925.137 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=3esfk 2020-07-23T07:22:05.138Z,1595488925.138 [CommandLine](IMPORTANT): Scheduled #69 (#2 of 2 with id='3esfk'): "set esp_sample_station.Speed 0.65 meter_per_second;set esp_sample_station.MaxDepth 60 meter;run " ASAP 2020-07-23T07:22:05.234Z,1595488925.234 [CommandLine](IMPORTANT): got command load ./Missions/Science/esp_sample_station.xml 2020-07-23T07:22:07.384Z,1595488927.384 [CommandLine](IMPORTANT): Loaded ./Missions/Science/esp_sample_station.xml 2020-07-23T07:22:19.077Z,1595488939.077 [CommandLine](IMPORTANT): got command set esp_sample_station.MissionTimeout 18.000000 hour 2020-07-23T07:22:19.078Z,1595488939.078 [CommandLine](IMPORTANT): got command set esp_sample_station.NeedCommsTime 60.000000 minute 2020-07-23T07:22:19.079Z,1595488939.079 [CommandLine](IMPORTANT): got command set esp_sample_station.Lat1 nan degree 2020-07-23T07:22:19.079Z,1595488939.079 [CommandLine](IMPORTANT): got command set esp_sample_station.Lon1 nan degree 2020-07-23T07:22:24.653Z,1595488944.653 [CommandLine](IMPORTANT): got command set esp_sample_station.Speed 0.650000 meter_per_second 2020-07-23T07:22:24.653Z,1595488944.653 [CommandLine](IMPORTANT): got command set esp_sample_station.MaxDepth 60.000000 meter 2020-07-23T07:22:24.654Z,1595488944.654 [CommandLine](IMPORTANT): got command run 2020-07-23T07:22:24.656Z,1595488944.656 [CommandLine](IMPORTANT): Running 2020-07-23T07:22:24.825Z,1595488944.825 [MissionManager](IMPORTANT): Started mission esp_sample_station 2020-07-23T07:23:18.993Z,1595488998.993 [esp_sample_station:Lap:A](IMPORTANT): Starting Lap 2020-07-23T07:23:19.606Z,1595488999.606 [esp_sample_station:Lap:B](IMPORTANT): Lat[1] = nan arcdeg Lon[1] = nan arcdeg 2020-07-23T07:23:19.831Z,1595488999.831 [esp_sample_station:Lap:C](IMPORTANT): Lat[2] = 36.821900 arcdeg Lon[2] = -121.885600 arcdeg 2020-07-23T07:23:20.243Z,1595489000.243 [esp_sample_station:Lap:D](IMPORTANT): Lat[3] = 36.766000 arcdeg Lon[3] = -121.864900 arcdeg 2020-07-23T07:23:20.623Z,1595489000.623 [esp_sample_station:Lap:E](IMPORTANT): Lat[4] = 36.797000 arcdeg Lon[4] = -121.847000 arcdeg 2020-07-23T07:23:28.256Z,1595489008.256 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.821900 arcdeg , -121.885600 arcdeg 2020-07-23T09:09:18.833Z,1595495358.833 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:D.Waypoint](IMPORTANT): Reached Waypoint: 36.821900,-121.885600 2020-07-23T09:15:46.686Z,1595495746.686 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:A](IMPORTANT): Requesting ESP sample with cartridge type -6.000000 count 2020-07-23T09:15:48.781Z,1595495748.781 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-23T09:15:48.958Z,1595495748.958 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-23T09:16:25.463Z,1595495785.463 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-23T09:16:26.301Z,1595495786.301 [ESPComponent](IMPORTANT): [sample #13] Setting cartridge argument to -6 2020-07-23T09:16:26.301Z,1595495786.301 [ESPComponent](IMPORTANT): [sample #13] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-23T09:16:26.730Z,1595495786.730 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:D](IMPORTANT): ESP sampling at 14.423818 m in 12.910303 degC water with 1.542450 ug/l chlorophyll fluorescence. 2020-07-23T09:16:27.079Z,1595495787.079 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-23T09:16:27.484Z,1595495787.484 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-23T09:16:29.505Z,1595495789.505 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-23T09:17:02.228Z,1595495822.228 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_PRIMING (@41,archive_bac) 2020-07-23T09:17:03.842Z,1595495823.842 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PRIMING (@100.0) 2020-07-23T09:17:05.458Z,1595495825.458 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-23T09:20:29.486Z,1595496029.486 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_FILTERING (@0.0) 2020-07-23T09:20:29.893Z,1595496029.893 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-23T10:15:20.762Z,1595499320.762 [CBIT](IMPORTANT): Beginning ground fault scan 2020-07-23T10:15:31.665Z,1595499331.665 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.097248 CHAN A1 (24V): -0.003204 CHAN A2 (12V): 0.066654 CHAN A3 (5V): 0.014493 CHAN B0 (3.3V): 0.009437 CHAN B1 (3.15aV): 0.006952 CHAN B2 (3.15bV): 0.008102 CHAN B3 (GND): -0.003140 OPEN: 0.014532 Full Scale Calc: 4.765 mA, -1.589 mA 2020-07-23T10:15:52.182Z,1595499352.182 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PAUSED (@1000.0) 2020-07-23T10:15:52.589Z,1595499352.589 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PROCESSING (@1000.0) 2020-07-23T10:15:55.009Z,1595499355.009 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_PROCESSED (@40,archive_bac) 2020-07-23T10:27:58.201Z,1595500078.201 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_STOPPING (@40,archive_bac) 2020-07-23T10:28:24.054Z,1595500104.054 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-23T10:28:24.465Z,1595500104.465 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_STOPPED 2020-07-23T10:33:24.246Z,1595500404.246 [ESPComponent](IMPORTANT): [sample #13] ESP sampling sequence completed normally. 2020-07-23T10:33:24.650Z,1595500404.650 [ESPComponent](IMPORTANT): [sample #13] ESP log summary report (5 messages): @02:16:39.24 Selecting Cartridge 41 @02:19:56.91 Cartridge::Sampler::Leak in FILTERING -- Isolated cartridge pressure fell by 15% to 72.7psia @02:19:56.92 Retry #1 of 2 @02:19:56.97 Selecting Cartridge 40 @03:15:50.25 Sampled 1000.0ml 2020-07-23T10:40:30.484Z,1595500830.484 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.766000 arcdeg , -121.864900 arcdeg 2020-07-23T14:28:01.967Z,1595514481.967 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:D.Waypoint](IMPORTANT): Reached Waypoint: 36.766000,-121.864900 2020-07-23T14:34:18.857Z,1595514858.857 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:A](IMPORTANT): Requesting ESP sample with cartridge type -6.000000 count 2020-07-23T14:34:20.941Z,1595514860.941 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-23T14:34:21.238Z,1595514861.238 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-23T14:34:58.556Z,1595514898.556 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-23T14:34:59.371Z,1595514899.371 [ESPComponent](IMPORTANT): [sample #14] Setting cartridge argument to -6 2020-07-23T14:34:59.372Z,1595514899.372 [ESPComponent](IMPORTANT): [sample #14] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-23T14:34:59.820Z,1595514899.820 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:D](IMPORTANT): ESP sampling at 12.659906 m in 12.671747 degC water with 3.296210 ug/l chlorophyll fluorescence. 2020-07-23T14:35:00.170Z,1595514900.170 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-23T14:35:00.577Z,1595514900.577 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-23T14:35:02.596Z,1595514902.596 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-23T14:35:35.325Z,1595514935.325 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_WAITING_FOR_PRIMING (@39,archive_bac) 2020-07-23T14:35:36.943Z,1595514936.943 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PRIMING (@100.0) 2020-07-23T14:35:37.750Z,1595514937.750 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-23T14:38:17.749Z,1595515097.749 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_FILTERING (@0.0) 2020-07-23T14:38:18.156Z,1595515098.156 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-23T15:27:16.615Z,1595518036.615 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PAUSED (@1000.0) 2020-07-23T15:27:17.014Z,1595518037.014 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PROCESSING (@1000.0) 2020-07-23T15:27:20.246Z,1595518040.246 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_WAITING_FOR_PROCESSED (@39,archive_bac) 2020-07-23T15:39:22.645Z,1595518762.645 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_STOPPING (@39,archive_bac) 2020-07-23T15:39:48.098Z,1595518788.098 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-23T15:39:48.500Z,1595518788.500 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_STOPPED 2020-07-23T15:44:48.276Z,1595519088.276 [ESPComponent](IMPORTANT): [sample #14] ESP sampling sequence completed normally. 2020-07-23T15:44:48.678Z,1595519088.678 [ESPComponent](IMPORTANT): [sample #14] ESP log summary report (2 messages): @07:35:12.82 Selecting Cartridge 39 @08:27:14.93 Sampled 1000.0ml 2020-07-23T15:50:53.023Z,1595519453.023 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.797000 arcdeg , -121.847000 arcdeg 2020-07-23T16:15:31.885Z,1595520931.885 [CBIT](IMPORTANT): Beginning ground fault scan 2020-07-23T16:15:42.802Z,1595520942.802 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.073946 CHAN A1 (24V): -0.002225 CHAN A2 (12V): 0.057379 CHAN A3 (5V): 0.013664 CHAN B0 (3.3V): 0.006915 CHAN B1 (3.15aV): 0.006814 CHAN B2 (3.15bV): 0.006316 CHAN B3 (GND): -0.003575 OPEN: 0.015078 Full Scale Calc: 4.765 mA, -1.589 mA 2020-07-23T16:58:54.452Z,1595523534.452 [DataOverHttps](IMPORTANT): SBD MOMSN=12466424, MTMSN=20200723T165853 2020-07-23T16:59:02.645Z,1595523542.645 [CommandLine](IMPORTANT): got command ! start onESPclient presto -- slots archive_bac:3 2020-07-23T17:51:59.227Z,1595526719.227 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:D.Waypoint](IMPORTANT): Reached Waypoint: 36.797000,-121.847000 2020-07-23T17:54:08.510Z,1595526848.510 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=37538, MT Status=1, MTMSN=2706 2020-07-23T17:54:09.247Z,1595526849.247 [CommandLine](IMPORTANT): got command schedule "load Science/esp_sample_station.xml;set esp_sample_station.MissionTimeout 18 hour;set esp_sample_station.NeedCommsTime 60 minute;set esp_sample_station.LapRepeat 2 count;set esp_sample_station.Lat1 NaN degree" 3fkn6 1 2.000000 2020-07-23T17:54:09.248Z,1595526849.248 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=3fkn6 2020-07-23T17:54:09.248Z,1595526849.248 [CommandLine](IMPORTANT): Scheduled #70 (#1 of 2 with id='3fkn6'): "load Science/esp_sample_station.xml;set esp_sample_station.MissionTimeout 18 hour;set esp_sample_station.NeedCommsTime 60 minute;set esp_sample_station.LapRepeat 2 count;set esp_sample_station.Lat1 NaN degree" 2020-07-23T17:54:09.249Z,1595526849.249 [CommandLine](FAULT): Scheduling was paused by a command at 2020-07-23T07:13:45Z 2020-07-23T17:54:22.067Z,1595526862.067 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=37539, MT Status=1, MTMSN=2707 2020-07-23T17:54:22.770Z,1595526862.770 [CommandLine](IMPORTANT): got command schedule "set esp_sample_station.Lon1 NaN degree;set esp_sample_station.Speed 0.65 meter_per_second;set esp_sample_station.MaxDepth 60 meter;run " 3fkn6 2 2.000000 2020-07-23T17:54:22.771Z,1595526862.771 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=3fkn6 2020-07-23T17:54:22.772Z,1595526862.772 [CommandLine](IMPORTANT): Scheduled #71 (#2 of 2 with id='3fkn6'): "set esp_sample_station.Lon1 NaN degree;set esp_sample_station.Speed 0.65 meter_per_second;set esp_sample_station.MaxDepth 60 meter;run " 2020-07-23T17:54:22.772Z,1595526862.772 [CommandLine](FAULT): Scheduling was paused by a command at 2020-07-23T07:13:45Z 2020-07-23T18:02:40.604Z,1595527360.604 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:A](IMPORTANT): Requesting ESP sample with cartridge type -6.000000 count 2020-07-23T18:02:42.701Z,1595527362.701 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-23T18:02:42.857Z,1595527362.857 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-23T18:03:19.389Z,1595527399.389 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-23T18:03:20.205Z,1595527400.205 [ESPComponent](IMPORTANT): [sample #15] Setting cartridge argument to -6 2020-07-23T18:03:20.205Z,1595527400.205 [ESPComponent](IMPORTANT): [sample #15] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-23T18:03:20.642Z,1595527400.642 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:D](IMPORTANT): ESP sampling at 16.846104 m in 12.424189 degC water with 2.028350 ug/l chlorophyll fluorescence. 2020-07-23T18:03:21.008Z,1595527401.008 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-23T18:03:21.410Z,1595527401.410 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-23T18:03:23.430Z,1595527403.430 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-23T18:03:56.154Z,1595527436.154 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_WAITING_FOR_PRIMING (@38,archive_bac) 2020-07-23T18:03:57.770Z,1595527437.770 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_PRIMING (@100.0) 2020-07-23T18:03:58.582Z,1595527438.582 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-23T18:06:38.568Z,1595527598.568 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_FILTERING (@0.0) 2020-07-23T18:06:38.970Z,1595527598.970 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-23T18:59:02.692Z,1595530742.692 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_PAUSED (@1000.0) 2020-07-23T18:59:03.094Z,1595530743.094 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_PROCESSING (@1000.0) 2020-07-23T18:59:05.518Z,1595530745.518 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_WAITING_FOR_PROCESSED (@38,archive_bac) 2020-07-23T19:11:08.732Z,1595531468.732 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_STOPPING (@38,archive_bac) 2020-07-23T19:11:34.190Z,1595531494.190 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-23T19:11:34.591Z,1595531494.591 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_STOPPED 2020-07-23T19:16:34.388Z,1595531794.388 [ESPComponent](IMPORTANT): [sample #15] ESP sampling sequence completed normally. 2020-07-23T19:16:34.792Z,1595531794.792 [ESPComponent](IMPORTANT): [sample #15] ESP log summary report (2 messages): @11:03:32.80 Selecting Cartridge 38 @11:59:00.63 Sampled 1000.0ml 2020-07-23T19:17:44.698Z,1595531864.698 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=37553, MT Status=1, MTMSN=2708 2020-07-23T19:17:45.226Z,1595531865.226 [CommandLine](IMPORTANT): got command schedule resume 2020-07-23T19:17:45.226Z,1595531865.226 [CommandLine](IMPORTANT): Scheduling is resumed 2020-07-23T19:22:05.030Z,1595532125.030 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=37568, MT Status=1, MTMSN=2709 2020-07-23T19:22:05.550Z,1595532125.550 [CommandLine](IMPORTANT): got command ! check 2020-07-23T19:22:10.526Z,1595532130.526 [CommandLine](IMPORTANT): got command load ./Missions/Science/esp_sample_station.xml 2020-07-23T19:22:12.536Z,1595532132.536 [CommandLine](IMPORTANT): Loaded ./Missions/Science/esp_sample_station.xml 2020-07-23T19:22:12.736Z,1595532132.736 [MissionManager](IMPORTANT): Started mission Default 2020-07-23T19:22:24.476Z,1595532144.476 [CommandLine](IMPORTANT): got command set esp_sample_station.MissionTimeout 18.000000 hour 2020-07-23T19:22:24.506Z,1595532144.506 [CommandLine](IMPORTANT): got command set esp_sample_station.NeedCommsTime 60.000000 minute 2020-07-23T19:22:24.507Z,1595532144.507 [CommandLine](IMPORTANT): got command set esp_sample_station.LapRepeat 2.000000 count 2020-07-23T19:22:24.507Z,1595532144.507 [CommandLine](IMPORTANT): got command set esp_sample_station.Lat1 nan degree 2020-07-23T19:22:36.511Z,1595532156.511 [DataOverHttps](IMPORTANT): SBD MOMSN=12466754, MTMSN=20200723T192235 2020-07-23T19:22:37.122Z,1595532157.122 [CommandLine](IMPORTANT): got command set esp_sample_station.Lon1 nan degree 2020-07-23T19:22:37.123Z,1595532157.123 [CommandLine](IMPORTANT): got command set esp_sample_station.Speed 0.650000 meter_per_second 2020-07-23T19:22:37.124Z,1595532157.124 [CommandLine](IMPORTANT): got command set esp_sample_station.MaxDepth 60.000000 meter 2020-07-23T19:22:37.124Z,1595532157.124 [CommandLine](IMPORTANT): got command run 2020-07-23T19:22:37.126Z,1595532157.126 [CommandLine](IMPORTANT): Running 2020-07-23T19:22:37.236Z,1595532157.236 [MissionManager](IMPORTANT): Started mission esp_sample_station 2020-07-23T19:22:45.005Z,1595532165.005 [CommandLine](IMPORTANT): got command ! check 2020-07-23T19:23:47.979Z,1595532227.979 [DataOverHttps](IMPORTANT): SBD MOMSN=12466776, MTMSN=20200723T192346 2020-07-23T19:23:55.873Z,1595532235.873 [CommandLine](IMPORTANT): got command stop 2020-07-23T19:23:55.873Z,1595532235.873 [CommandLine](IMPORTANT): Scheduling is paused 2020-07-23T19:23:56.541Z,1595532236.541 [MissionManager](IMPORTANT): Started mission Default 2020-07-23T19:30:06.217Z,1595532606.217 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 6.154613 min 2020-07-23T19:35:36.304Z,1595532936.304 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.656014 min 2020-07-23T19:41:05.586Z,1595533265.586 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 17.144004 min 2020-07-23T19:42:42.555Z,1595533362.555 [DataOverHttps](IMPORTANT): SBD MTMSN=20200723T194241 2020-07-23T19:42:50.038Z,1595533370.038 [CommandLine](IMPORTANT): got command schedule asap "load Science/esp_sample_station.xml;set esp_sample_station.MissionTimeout 30 hour;set esp_sample_station.NeedCommsTime 60 minute;set esp_sample_station.LapRepeat 2 count;set esp_sample_station.Lat1 NaN degree" 3fqqz 1 2.000000 2020-07-23T19:42:50.038Z,1595533370.038 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=3fqqz 2020-07-23T19:42:50.039Z,1595533370.039 [CommandLine](IMPORTANT): Scheduled #72 (#1 of 2 with id='3fqqz'): "load Science/esp_sample_station.xml;set esp_sample_station.MissionTimeout 30 hour;set esp_sample_station.NeedCommsTime 60 minute;set esp_sample_station.LapRepeat 2 count;set esp_sample_station.Lat1 NaN degree" ASAP 2020-07-23T19:42:50.982Z,1595533370.982 [DataOverHttps](IMPORTANT): SBD MTMSN=20200723T194249 2020-07-23T19:42:58.346Z,1595533378.346 [CommandLine](IMPORTANT): got command schedule asap "set esp_sample_station.Lon1 NaN degree;set esp_sample_station.Speed 0.65 meter_per_second;set esp_sample_station.MaxDepth 60 meter;run " 3fqqz 2 2.000000 2020-07-23T19:42:58.346Z,1595533378.346 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=3fqqz 2020-07-23T19:42:58.347Z,1595533378.347 [CommandLine](IMPORTANT): Scheduled #73 (#2 of 2 with id='3fqqz'): "set esp_sample_station.Lon1 NaN degree;set esp_sample_station.Speed 0.65 meter_per_second;set esp_sample_station.MaxDepth 60 meter;run " ASAP 2020-07-23T19:42:58.518Z,1595533378.518 [CommandLine](IMPORTANT): got command load ./Missions/Science/esp_sample_station.xml 2020-07-23T19:43:00.069Z,1595533380.069 [CommandLine](IMPORTANT): Loaded ./Missions/Science/esp_sample_station.xml 2020-07-23T19:43:21.801Z,1595533401.801 [CommandLine](IMPORTANT): got command set esp_sample_station.MissionTimeout 30.000000 hour 2020-07-23T19:43:21.802Z,1595533401.802 [CommandLine](IMPORTANT): got command set esp_sample_station.NeedCommsTime 60.000000 minute 2020-07-23T19:43:21.802Z,1595533401.802 [CommandLine](IMPORTANT): got command set esp_sample_station.LapRepeat 2.000000 count 2020-07-23T19:43:21.803Z,1595533401.803 [CommandLine](IMPORTANT): got command set esp_sample_station.Lat1 nan degree 2020-07-23T19:43:35.177Z,1595533415.177 [CommandLine](IMPORTANT): got command set esp_sample_station.Lon1 nan degree 2020-07-23T19:43:35.177Z,1595533415.177 [CommandLine](IMPORTANT): got command set esp_sample_station.Speed 0.650000 meter_per_second 2020-07-23T19:43:35.178Z,1595533415.178 [CommandLine](IMPORTANT): got command set esp_sample_station.MaxDepth 60.000000 meter 2020-07-23T19:43:35.178Z,1595533415.178 [CommandLine](IMPORTANT): got command run 2020-07-23T19:43:35.180Z,1595533415.180 [CommandLine](IMPORTANT): Running 2020-07-23T19:43:35.271Z,1595533415.271 [MissionManager](IMPORTANT): Started mission esp_sample_station 2020-07-23T19:44:10.082Z,1595533450.082 [esp_sample_station:Lap:A](IMPORTANT): Starting Lap 2020-07-23T19:44:10.574Z,1595533450.574 [esp_sample_station:Lap:B](IMPORTANT): Lat[1] = nan arcdeg Lon[1] = nan arcdeg 2020-07-23T19:44:10.920Z,1595533450.920 [esp_sample_station:Lap:C](IMPORTANT): Lat[2] = 36.821900 arcdeg Lon[2] = -121.885600 arcdeg 2020-07-23T19:44:11.338Z,1595533451.338 [esp_sample_station:Lap:D](IMPORTANT): Lat[3] = 36.766000 arcdeg Lon[3] = -121.864900 arcdeg 2020-07-23T19:44:11.711Z,1595533451.711 [esp_sample_station:Lap:E](IMPORTANT): Lat[4] = 36.797000 arcdeg Lon[4] = -121.847000 arcdeg 2020-07-23T19:44:19.348Z,1595533459.348 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.821900 arcdeg , -121.885600 arcdeg 2020-07-23T19:44:48.682Z,1595533488.682 [DataOverHttps](IMPORTANT): SBD MTMSN=20200723T194447 2020-07-23T19:44:54.439Z,1595533494.439 [CommandLine](IMPORTANT): got command stop 2020-07-23T19:44:55.031Z,1595533495.031 [MissionManager](IMPORTANT): Started mission Default 2020-07-23T19:44:57.451Z,1595533497.451 [CommandLine](IMPORTANT): got command ! check 2020-07-23T19:53:44.163Z,1595534024.163 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 8.812413 min 2020-07-23T19:53:45.958Z,1595534025.958 [DataOverHttps](IMPORTANT): SBD MTMSN=20200723T195344 2020-07-23T19:53:53.494Z,1595534033.494 [CommandLine](IMPORTANT): got command schedule asap "load Science/esp_sample_station.xml;set esp_sample_station.MissionTimeout 30 hour;set esp_sample_station.NeedCommsTime 60 minute;set esp_sample_station.LapRepeat 2 count;set esp_sample_station.Lat1 NaN degree" 3fr9d 1 2.000000 2020-07-23T19:53:53.495Z,1595534033.495 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=3fr9d 2020-07-23T19:53:53.495Z,1595534033.495 [CommandLine](IMPORTANT): Scheduled #74 (#1 of 2 with id='3fr9d'): "load Science/esp_sample_station.xml;set esp_sample_station.MissionTimeout 30 hour;set esp_sample_station.NeedCommsTime 60 minute;set esp_sample_station.LapRepeat 2 count;set esp_sample_station.Lat1 NaN degree" ASAP 2020-07-23T19:53:54.625Z,1595534034.625 [DataOverHttps](IMPORTANT): SBD MOMSN=12466903, MTMSN=20200723T195353 2020-07-23T19:54:01.902Z,1595534041.902 [CommandLine](IMPORTANT): got command schedule asap "set esp_sample_station.Lon1 NaN degree;set esp_sample_station.Speed 0.65 meter_per_second;set esp_sample_station.MaxDepth 60 meter;run " 3fr9d 2 2.000000 2020-07-23T19:54:01.903Z,1595534041.903 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=3fr9d 2020-07-23T19:54:01.903Z,1595534041.903 [CommandLine](IMPORTANT): Scheduled #75 (#2 of 2 with id='3fr9d'): "set esp_sample_station.Lon1 NaN degree;set esp_sample_station.Speed 0.65 meter_per_second;set esp_sample_station.MaxDepth 60 meter;run " ASAP 2020-07-23T19:54:02.029Z,1595534042.029 [CommandLine](IMPORTANT): got command load ./Missions/Science/esp_sample_station.xml 2020-07-23T19:54:04.508Z,1595534044.508 [CommandLine](IMPORTANT): Loaded ./Missions/Science/esp_sample_station.xml 2020-07-23T19:54:22.370Z,1595534062.370 [CommandLine](IMPORTANT): got command set esp_sample_station.MissionTimeout 30.000000 hour 2020-07-23T19:54:22.371Z,1595534062.371 [CommandLine](IMPORTANT): got command set esp_sample_station.NeedCommsTime 60.000000 minute 2020-07-23T19:54:22.371Z,1595534062.371 [CommandLine](IMPORTANT): got command set esp_sample_station.LapRepeat 2.000000 count 2020-07-23T19:54:22.372Z,1595534062.372 [CommandLine](IMPORTANT): got command set esp_sample_station.Lat1 nan degree 2020-07-23T19:54:33.420Z,1595534073.420 [CommandLine](IMPORTANT): got command set esp_sample_station.Lon1 nan degree 2020-07-23T19:54:33.477Z,1595534073.477 [CommandLine](IMPORTANT): got command set esp_sample_station.Speed 0.650000 meter_per_second 2020-07-23T19:54:33.477Z,1595534073.477 [CommandLine](IMPORTANT): got command set esp_sample_station.MaxDepth 60.000000 meter 2020-07-23T19:54:33.478Z,1595534073.478 [CommandLine](IMPORTANT): got command run 2020-07-23T19:54:33.480Z,1595534073.480 [CommandLine](IMPORTANT): Running 2020-07-23T19:54:33.490Z,1595534073.490 [MissionManager](IMPORTANT): Started mission esp_sample_station 2020-07-23T19:56:22.654Z,1595534182.654 [esp_sample_station:Lap:A](IMPORTANT): Starting Lap 2020-07-23T19:56:23.085Z,1595534183.085 [esp_sample_station:Lap:B](IMPORTANT): Lat[1] = nan arcdeg Lon[1] = nan arcdeg 2020-07-23T19:56:23.485Z,1595534183.485 [esp_sample_station:Lap:C](IMPORTANT): Lat[2] = 36.821900 arcdeg Lon[2] = -121.885600 arcdeg 2020-07-23T19:56:23.898Z,1595534183.898 [esp_sample_station:Lap:D](IMPORTANT): Lat[3] = 36.766000 arcdeg Lon[3] = -121.864900 arcdeg 2020-07-23T19:56:24.280Z,1595534184.280 [esp_sample_station:Lap:E](IMPORTANT): Lat[4] = 36.797000 arcdeg Lon[4] = -121.847000 arcdeg 2020-07-23T19:56:31.930Z,1595534191.930 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.821900 arcdeg , -121.885600 arcdeg 2020-07-23T22:15:44.598Z,1595542544.598 [CBIT](IMPORTANT): Beginning ground fault scan 2020-07-23T22:15:55.205Z,1595542555.205 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.005039 CHAN A1 (24V): -0.002332 CHAN A2 (12V): -0.003313 CHAN A3 (5V): -0.002948 CHAN B0 (3.3V): -0.001482 CHAN B1 (3.15aV): -0.001132 CHAN B2 (3.15bV): -0.001020 CHAN B3 (GND): -0.001084 OPEN: 0.012056 Full Scale Calc: 4.765 mA, -1.589 mA 2020-07-23T23:14:23.482Z,1595546063.482 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:D.Waypoint](IMPORTANT): Reached Waypoint: 36.821900,-121.885600 2020-07-23T23:24:40.936Z,1595546680.936 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:A](IMPORTANT): Requesting ESP sample with cartridge type -6.000000 count 2020-07-23T23:24:43.041Z,1595546683.041 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-23T23:24:43.327Z,1595546683.327 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-23T23:25:19.085Z,1595546719.085 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-23T23:25:19.900Z,1595546719.900 [ESPComponent](IMPORTANT): [sample #16] Setting cartridge argument to -6 2020-07-23T23:25:19.901Z,1595546719.901 [ESPComponent](IMPORTANT): [sample #16] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-23T23:25:20.331Z,1595546720.331 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:D](IMPORTANT): ESP sampling at 12.284705 m in 13.327936 degC water with 4.804760 ug/l chlorophyll fluorescence. 2020-07-23T23:25:20.705Z,1595546720.705 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-23T23:25:21.105Z,1595546721.105 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-23T23:25:23.126Z,1595546723.126 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-23T23:25:55.850Z,1595546755.850 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_WAITING_FOR_PRIMING (@37,archive_bac) 2020-07-23T23:25:57.473Z,1595546757.473 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_PRIMING (@100.0) 2020-07-23T23:25:59.083Z,1595546759.083 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-23T23:28:38.268Z,1595546918.268 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_FILTERING (@0.0) 2020-07-23T23:28:38.670Z,1595546918.670 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-24T00:14:10.285Z,1595549650.285 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_PAUSED (@1000.0) 2020-07-24T00:14:10.683Z,1595549650.683 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_PROCESSING (@1000.0) 2020-07-24T00:14:13.108Z,1595549653.108 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_WAITING_FOR_PROCESSED (@37,archive_bac) 2020-07-24T00:26:16.305Z,1595550376.305 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_STOPPING (@37,archive_bac) 2020-07-24T00:26:41.756Z,1595550401.756 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-24T00:26:42.161Z,1595550402.161 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_STOPPED 2020-07-24T00:31:41.935Z,1595550701.935 [ESPComponent](IMPORTANT): [sample #16] ESP sampling sequence completed normally. 2020-07-24T00:31:42.334Z,1595550702.334 [ESPComponent](IMPORTANT): [sample #16] ESP log summary report (2 messages): @16:25:32.40 Selecting Cartridge 37 @17:14:08.23 Sampled 1000.0ml 2020-07-24T00:36:23.147Z,1595550983.147 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=37624, MT Status=1, MTMSN=2710 2020-07-24T00:36:23.686Z,1595550983.686 [CommandLine](IMPORTANT): got command failComponent 2020-07-24T00:36:23.686Z,1595550983.686 [CommandLine](IMPORTANT): Failed components: 2020-07-24T00:36:23.686Z,1595550983.686 [CommandLine](IMPORTANT): No failed Components. 2020-07-24T00:41:52.232Z,1595551312.232 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.766000 arcdeg , -121.864900 arcdeg 2020-07-24T00:42:24.689Z,1595551344.689 [BuoyancyServo](FAULT): Buoyancy getPosition uart error.serial timeout 2020-07-24T03:34:52.668Z,1595561692.668 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:D.Waypoint](IMPORTANT): Reached Waypoint: 36.766000,-121.864900 2020-07-24T03:41:40.782Z,1595562100.782 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:A](IMPORTANT): Requesting ESP sample with cartridge type -6.000000 count 2020-07-24T03:41:42.876Z,1595562102.876 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-24T03:41:43.001Z,1595562103.001 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-24T03:42:19.105Z,1595562139.105 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-24T03:42:19.920Z,1595562139.920 [ESPComponent](IMPORTANT): [sample #17] Setting cartridge argument to -6 2020-07-24T03:42:19.921Z,1595562139.921 [ESPComponent](IMPORTANT): [sample #17] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-24T03:42:20.364Z,1595562140.364 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:D](IMPORTANT): ESP sampling at 14.114711 m in 14.534052 degC water with 5.638700 ug/l chlorophyll fluorescence. 2020-07-24T03:42:20.724Z,1595562140.724 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-24T03:42:21.126Z,1595562141.126 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-24T03:42:23.145Z,1595562143.145 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-24T03:42:55.873Z,1595562175.873 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_WAITING_FOR_PRIMING (@36,archive_bac) 2020-07-24T03:42:57.489Z,1595562177.489 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_PRIMING (@100.0) 2020-07-24T03:42:59.109Z,1595562179.109 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-24T03:45:38.290Z,1595562338.290 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_FILTERING (@0.0) 2020-07-24T03:45:38.694Z,1595562338.694 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-24T04:15:55.237Z,1595564155.237 [CBIT](IMPORTANT): Beginning ground fault scan 2020-07-24T04:16:06.184Z,1595564166.184 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.213017 CHAN A1 (24V): -0.033003 CHAN A2 (12V): 0.070486 CHAN A3 (5V): 0.015268 CHAN B0 (3.3V): 0.008124 CHAN B1 (3.15aV): 0.008188 CHAN B2 (3.15bV): 0.008274 CHAN B3 (GND): -0.003611 OPEN: 0.014646 Full Scale Calc: 4.765 mA, -1.589 mA 2020-07-24T04:36:42.791Z,1595565402.791 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_PAUSED (@828.961) 2020-07-24T04:36:43.196Z,1595565403.196 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_PROCESSING (@828.961) 2020-07-24T04:36:45.614Z,1595565405.614 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_WAITING_FOR_PROCESSED (@36,archive_bac) 2020-07-24T04:48:48.801Z,1595566128.801 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_STOPPING (@36,archive_bac) 2020-07-24T04:49:14.257Z,1595566154.257 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-24T04:49:14.664Z,1595566154.664 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_STOPPED 2020-07-24T04:54:14.457Z,1595566454.457 [ESPComponent](IMPORTANT): [sample #17] ESP sampling sequence completed normally. 2020-07-24T04:54:14.856Z,1595566454.856 [ESPComponent](IMPORTANT): [sample #17] ESP log summary report (3 messages): @20:42:32.72 Selecting Cartridge 36 @21:36:39.78 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @21:36:39.98 Sampled 829.0ml 2020-07-24T05:06:48.046Z,1595567208.046 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.797000 arcdeg , -121.847000 arcdeg 2020-07-24T06:58:37.826Z,1595573917.826 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:D.Waypoint](IMPORTANT): Reached Waypoint: 36.797000,-121.847000 2020-07-24T07:04:10.449Z,1595574250.449 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:A](IMPORTANT): Requesting ESP sample with cartridge type -6.000000 count 2020-07-24T07:04:12.546Z,1595574252.546 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-24T07:04:12.673Z,1595574252.673 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-24T07:04:49.608Z,1595574289.608 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-24T07:04:50.417Z,1595574290.417 [ESPComponent](IMPORTANT): [sample #18] Setting cartridge argument to -6 2020-07-24T07:04:50.418Z,1595574290.418 [ESPComponent](IMPORTANT): [sample #18] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-24T07:04:50.862Z,1595574290.862 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:D](IMPORTANT): ESP sampling at 10.232639 m in 14.972528 degC water with 5.548300 ug/l chlorophyll fluorescence. 2020-07-24T07:04:51.222Z,1595574291.222 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-24T07:04:51.629Z,1595574291.629 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-24T07:04:53.649Z,1595574293.649 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-24T07:05:26.381Z,1595574326.381 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_WAITING_FOR_PRIMING (@35,archive_bac) 2020-07-24T07:05:27.994Z,1595574327.994 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_PRIMING (@100.0) 2020-07-24T07:05:28.802Z,1595574328.802 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-24T07:08:08.403Z,1595574488.403 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_FILTERING (@0.0) 2020-07-24T07:08:08.802Z,1595574488.802 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-24T08:02:08.694Z,1595577728.694 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_PAUSED (@1000.0) 2020-07-24T08:02:09.099Z,1595577729.099 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_PROCESSING (@1000.0) 2020-07-24T08:02:11.528Z,1595577731.528 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_WAITING_FOR_PROCESSED (@35,archive_bac) 2020-07-24T08:14:14.730Z,1595578454.730 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_STOPPING (@35,archive_bac) 2020-07-24T08:14:40.182Z,1595578480.182 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-24T08:14:40.590Z,1595578480.590 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_STOPPED 2020-07-24T08:19:40.477Z,1595578780.477 [ESPComponent](IMPORTANT): [sample #18] ESP sampling sequence completed normally. 2020-07-24T08:19:40.885Z,1595578780.885 [ESPComponent](IMPORTANT): [sample #18] ESP log summary report (2 messages): @00:05:03.51 Selecting Cartridge 35 @01:02:06.76 Sampled 1000.0ml 2020-07-24T08:24:17.500Z,1595579057.500 [esp_sample_station:Lap:A](IMPORTANT): Starting Lap 2020-07-24T08:24:17.905Z,1595579057.905 [esp_sample_station:Lap:B](IMPORTANT): Lat[1] = nan arcdeg Lon[1] = nan arcdeg 2020-07-24T08:24:18.314Z,1595579058.314 [esp_sample_station:Lap:C](IMPORTANT): Lat[2] = 36.821900 arcdeg Lon[2] = -121.885600 arcdeg 2020-07-24T08:24:18.708Z,1595579058.708 [esp_sample_station:Lap:D](IMPORTANT): Lat[3] = 36.766000 arcdeg Lon[3] = -121.864900 arcdeg 2020-07-24T08:24:19.115Z,1595579059.115 [esp_sample_station:Lap:E](IMPORTANT): Lat[4] = 36.797000 arcdeg Lon[4] = -121.847000 arcdeg 2020-07-24T08:24:26.796Z,1595579066.796 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.821900 arcdeg , -121.885600 arcdeg 2020-07-24T10:16:06.232Z,1595585766.232 [CBIT](IMPORTANT): Beginning ground fault scan 2020-07-24T10:16:17.173Z,1595585777.173 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.098767 CHAN A1 (24V): -0.003843 CHAN A2 (12V): 0.070397 CHAN A3 (5V): 0.023190 CHAN B0 (3.3V): 0.015492 CHAN B1 (3.15aV): 0.015595 CHAN B2 (3.15bV): 0.015615 CHAN B3 (GND): -0.002928 OPEN: 0.014694 Full Scale Calc: 4.765 mA, -1.589 mA 2020-07-24T10:38:01.057Z,1595587081.057 [ThrusterServo](FAULT): Invalid EZ Servo response:"" 2020-07-24T10:59:25.888Z,1595588365.888 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:D.Waypoint](IMPORTANT): Reached Waypoint: 36.821900,-121.885600 2020-07-24T11:04:05.564Z,1595588645.564 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:A](IMPORTANT): Requesting ESP sample with cartridge type -6.000000 count 2020-07-24T11:04:07.657Z,1595588647.657 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-24T11:04:07.776Z,1595588647.776 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-24T11:04:29.081Z,1595588669.081 [Radio_Surface](FAULT): LCB fault: Invalid Command. Hardware Overcurrent Shutdown. 2020-07-24T11:04:44.323Z,1595588684.323 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-24T11:04:45.127Z,1595588685.127 [ESPComponent](IMPORTANT): [sample #19] Setting cartridge argument to -6 2020-07-24T11:04:45.128Z,1595588685.128 [ESPComponent](IMPORTANT): [sample #19] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-24T11:04:45.560Z,1595588685.560 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:D](IMPORTANT): ESP sampling at 9.321218 m in 13.205408 degC water with 4.349370 ug/l chlorophyll fluorescence. 2020-07-24T11:04:45.930Z,1595588685.930 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-24T11:04:46.337Z,1595588686.337 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-24T11:04:48.361Z,1595588688.361 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-24T11:05:21.086Z,1595588721.086 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_WAITING_FOR_PRIMING (@34,archive_bac) 2020-07-24T11:05:22.699Z,1595588722.699 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_PRIMING (@100.0) 2020-07-24T11:05:23.506Z,1595588723.506 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-24T11:08:03.909Z,1595588883.909 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_FILTERING (@0.0) 2020-07-24T11:08:04.309Z,1595588884.309 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-24T11:54:57.966Z,1595591697.966 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_PAUSED (@1000.0) 2020-07-24T11:54:58.375Z,1595591698.375 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_PROCESSING (@1000.0) 2020-07-24T11:55:00.798Z,1595591700.798 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_WAITING_FOR_PROCESSED (@34,archive_bac) 2020-07-24T12:07:04.002Z,1595592424.002 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_STOPPING (@34,archive_bac) 2020-07-24T12:07:29.460Z,1595592449.460 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-24T12:07:29.869Z,1595592449.869 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_STOPPED 2020-07-24T12:12:29.650Z,1595592749.650 [ESPComponent](IMPORTANT): [sample #19] ESP sampling sequence completed normally. 2020-07-24T12:12:30.055Z,1595592750.055 [ESPComponent](IMPORTANT): [sample #19] ESP log summary report (2 messages): @04:04:58.10 Selecting Cartridge 34 @04:54:55.80 Sampled 1000.0ml 2020-07-24T12:17:32.743Z,1595593052.743 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.766000 arcdeg , -121.864900 arcdeg 2020-07-24T14:16:37.063Z,1595600197.063 [BPC1](FAULT): Failed to receive data from 2 sticks prior to timeout. Missing stick IDs are: 38, 39. 2020-07-24T14:33:45.779Z,1595601225.779 [DataOverHttps](IMPORTANT): SBD MTMSN=20200724T143344 2020-07-24T14:33:54.577Z,1595601234.577 [CommandLine](IMPORTANT): got command schedule "load Science/esp_sample_station.xml;set esp_sample_station.MissionTimeout 30 hour;set esp_sample_station.NeedCommsTime 60 minute;set esp_sample_station.LapRepeat 2 count;set esp_sample_station.Lat1 NaN degree" 3h745 1 2.000000 2020-07-24T14:33:54.577Z,1595601234.577 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=3h745 2020-07-24T14:33:54.578Z,1595601234.578 [CommandLine](IMPORTANT): Scheduled #76 (#1 of 2 with id='3h745'): "load Science/esp_sample_station.xml;set esp_sample_station.MissionTimeout 30 hour;set esp_sample_station.NeedCommsTime 60 minute;set esp_sample_station.LapRepeat 2 count;set esp_sample_station.Lat1 NaN degree" 2020-07-24T14:33:54.579Z,1595601234.579 [CommandLine](FAULT): Scheduling was paused by a command at 2020-07-23T19:44:54Z 2020-07-24T14:33:55.515Z,1595601235.515 [DataOverHttps](IMPORTANT): SBD MTMSN=20200724T143353 2020-07-24T14:34:04.004Z,1595601244.004 [CommandLine](IMPORTANT): got command schedule "set esp_sample_station.Lon1 NaN degree;set esp_sample_station.Speed 0.65 meter_per_second;set esp_sample_station.MaxDepth 60 meter;run " 3h745 2 2.000000 2020-07-24T14:34:04.004Z,1595601244.004 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=3h745 2020-07-24T14:34:04.005Z,1595601244.005 [CommandLine](IMPORTANT): Scheduled #77 (#2 of 2 with id='3h745'): "set esp_sample_station.Lon1 NaN degree;set esp_sample_station.Speed 0.65 meter_per_second;set esp_sample_station.MaxDepth 60 meter;run " 2020-07-24T14:34:04.006Z,1595601244.006 [CommandLine](FAULT): Scheduling was paused by a command at 2020-07-23T19:44:54Z 2020-07-24T15:00:45.685Z,1595602845.685 [ElevatorServo](FAULT): Elevator uart error - getPosition.serial timeout 2020-07-24T15:34:31.955Z,1595604871.955 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:D.Waypoint](IMPORTANT): Reached Waypoint: 36.766000,-121.864900 2020-07-24T15:38:33.949Z,1595605113.949 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=37766, MT Status=1, MTMSN=2711