2020-07-26T09:43:59.644Z,1595756639.644 [Supervisor](IMPORTANT): Reading configuration overrides from Data/persisted.cfg
2020-07-26T09:44:05.075Z,1595756645.075 [SBIT](IMPORTANT): git: 2020-07-18a
2020-07-26T09:44:05.076Z,1595756645.076 [SBIT](IMPORTANT): Kernel Release: 2.6.27.8
2020-07-26T09:45:06.800Z,1595756706.800 [SBIT](IMPORTANT): Beginning Startup BIT
2020-07-26T09:45:06.804Z,1595756706.804 [CBIT](IMPORTANT): Beginning ground fault scan
2020-07-26T09:45:17.693Z,1595756717.693 [CBIT](IMPORTANT): No ground fault detected
mA:
CHAN A0 (Batt): -0.001002
CHAN A1 (24V): -0.001997
CHAN A2 (12V): -0.000094
CHAN A3 (5V): -0.002386
CHAN B0 (3.3V): -0.000725
CHAN B1 (3.15aV): -0.000522
CHAN B2 (3.15bV): -0.000875
CHAN B3 (GND): -0.001189
OPEN: 0.012330
Full Scale Calc: 4.765 mA, -1.589 mA
2020-07-26T09:46:00.944Z,1595756760.944 [SBIT](IMPORTANT): SBIT PASSED
2020-07-26T09:46:00.944Z,1595756760.944 [SBIT](IMPORTANT): Listing configuration overrides from Data/persisted.cfg
2020-07-26T09:46:00.945Z,1595756760.945 [SBIT](IMPORTANT): BPC1.batteryMissingStickThreshold=2 count;

2020-07-26T09:46:00.945Z,1595756760.945 [SBIT](IMPORTANT): CBIT.gf24Offset=-26 microampere;

2020-07-26T09:46:00.945Z,1595756760.945 [SBIT](IMPORTANT): DVL_micro.loadAtStartup=0 bool;

2020-07-26T09:46:00.945Z,1595756760.945 [SBIT](IMPORTANT): VerticalControl.buoyancyNeutral=230 cubic_centimeter;

2020-07-26T09:46:00.946Z,1595756760.946 [SBIT](IMPORTANT): VerticalControl.massDefault=10.3 millimeter;

2020-07-26T09:46:01.334Z,1595756761.334 [MissionManager](IMPORTANT): Started mission Startup
2020-07-26T09:48:01.700Z,1595756881.700 [MissionManager](IMPORTANT): Started mission Default
2020-07-26T09:57:01.479Z,1595757421.479 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 8.990076 min 
2020-07-26T10:03:10.584Z,1595757790.584 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 15.141479 min 
2020-07-26T10:03:37.313Z,1595757817.313 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=38173, MT Status=1, MTMSN=2724
2020-07-26T10:03:38.212Z,1595757818.212 [CommandLine](IMPORTANT): got command schedule asap "load Science/canon_esp_box.xml;set canon_esp_box.MissionTimeout 30 hour;set canon_esp_box.NeedCommsTime 2.5 hour;set canon_esp_box.SampleInterval 45 minute;set canon_esp_box.Lat1 36.7825 degree" 3kjr3 1 6.000000
2020-07-26T10:03:38.212Z,1595757818.212 [CommandLine](IMPORTANT): Scheduling command #1 of 6 with id=3kjr3
2020-07-26T10:03:38.213Z,1595757818.213 [CommandLine](IMPORTANT): Scheduled #1 (#1 of 6 with id='3kjr3'): "load Science/canon_esp_box.xml;set canon_esp_box.MissionTimeout 30 hour;set canon_esp_box.NeedCommsTime 2.5 hour;set canon_esp_box.SampleInterval 45 minute;set canon_esp_box.Lat1 36.7825 degree" ASAP
2020-07-26T10:03:59.732Z,1595757839.732 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=38174, MT Status=1, MTMSN=2725
2020-07-26T10:04:00.653Z,1595757840.653 [CommandLine](IMPORTANT): got command schedule asap "set canon_esp_box.Lon1 -122.018 degree;set canon_esp_box.Lat2 36.7117 degree;set canon_esp_box.Lon2 -122.1919 degree;set canon_esp_box.Lat3 36.6978 degree;set canon_esp_box.Lon3 -122.0562 degree;set canon_esp_box.Lat4 36.754 degree" 3kjr3 2 6.000000
2020-07-26T10:04:00.653Z,1595757840.653 [CommandLine](IMPORTANT): Scheduling command #2 of 6 with id=3kjr3
2020-07-26T10:04:00.654Z,1595757840.654 [CommandLine](IMPORTANT): Scheduled #2 (#2 of 6 with id='3kjr3'): "set canon_esp_box.Lon1 -122.018 degree;set canon_esp_box.Lat2 36.7117 degree;set canon_esp_box.Lon2 -122.1919 degree;set canon_esp_box.Lat3 36.6978 degree;set canon_esp_box.Lon3 -122.0562 degree;set canon_esp_box.Lat4 36.754 degree" ASAP
2020-07-26T10:08:52.752Z,1595758132.752 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 20.844460 min 
2020-07-26T10:10:00.373Z,1595758200.373 [CommandLine](IMPORTANT): got command schedule clear
2020-07-26T10:10:00.374Z,1595758200.374 [CommandLine](IMPORTANT): #Cleared scheduled commands:2
2020-07-26T10:10:11.933Z,1595758211.933 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=38175, MT Status=1, MTMSN=2726
2020-07-26T10:10:12.804Z,1595758212.804 [CommandLine](IMPORTANT): got command schedule asap "set canon_esp_box.Lon4 -122.0155 degree;set canon_esp_box.Lat5 NaN degree;set canon_esp_box.Lon5 NaN degree;set canon_esp_box.Lat6 NaN degree;set canon_esp_box.Lon6 NaN degree;set canon_esp_box.Lat7 NaN degree" 3kjr3 3 6.000000
2020-07-26T10:10:12.804Z,1595758212.804 [CommandLine](IMPORTANT): Scheduling command #3 of 6 with id=3kjr3
2020-07-26T10:10:12.805Z,1595758212.805 [CommandLine](IMPORTANT): Scheduled #3 (#3 of 6 with id='3kjr3'): "set canon_esp_box.Lon4 -122.0155 degree;set canon_esp_box.Lat5 NaN degree;set canon_esp_box.Lon5 NaN degree;set canon_esp_box.Lat6 NaN degree;set canon_esp_box.Lon6 NaN degree;set canon_esp_box.Lat7 NaN degree" ASAP
2020-07-26T10:10:27.989Z,1595758227.989 [DataOverHttps](IMPORTANT): SBD MTMSN=20200726T100939
2020-07-26T10:10:35.244Z,1595758235.244 [CommandLine](IMPORTANT): got command schedule asap "load Science/canon_esp_box.xml;set canon_esp_box.MissionTimeout 30 hour;set canon_esp_box.NeedCommsTime 2.5 hour;set canon_esp_box.SampleInterval 45 minute;set canon_esp_box.Lat1 36.7825 degree" 3kk7v 1 6.000000
2020-07-26T10:10:35.244Z,1595758235.244 [CommandLine](IMPORTANT): Scheduling command #1 of 6 with id=3kk7v
2020-07-26T10:10:35.245Z,1595758235.245 [CommandLine](IMPORTANT): Scheduled #4 (#1 of 6 with id='3kk7v'): "load Science/canon_esp_box.xml;set canon_esp_box.MissionTimeout 30 hour;set canon_esp_box.NeedCommsTime 2.5 hour;set canon_esp_box.SampleInterval 45 minute;set canon_esp_box.Lat1 36.7825 degree" ASAP
2020-07-26T10:10:36.205Z,1595758236.205 [DataOverHttps](IMPORTANT): SBD MTMSN=20200726T100948
2020-07-26T10:10:43.464Z,1595758243.464 [CommandLine](IMPORTANT): got command schedule asap "set canon_esp_box.Lon1 -122.018 degree;set canon_esp_box.Lat2 36.7117 degree;set canon_esp_box.Lon2 -122.1919 degree;set canon_esp_box.Lat3 36.6978 degree;set canon_esp_box.Lon3 -122.0562 degree;set canon_esp_box.Lat4 36.754 degree" 3kk7v 2 6.000000
2020-07-26T10:10:43.464Z,1595758243.464 [CommandLine](IMPORTANT): Scheduling command #2 of 6 with id=3kk7v
2020-07-26T10:10:43.465Z,1595758243.465 [CommandLine](IMPORTANT): Scheduled #5 (#2 of 6 with id='3kk7v'): "set canon_esp_box.Lon1 -122.018 degree;set canon_esp_box.Lat2 36.7117 degree;set canon_esp_box.Lon2 -122.1919 degree;set canon_esp_box.Lat3 36.6978 degree;set canon_esp_box.Lon3 -122.0562 degree;set canon_esp_box.Lat4 36.754 degree" ASAP
2020-07-26T10:10:44.393Z,1595758244.393 [DataOverHttps](IMPORTANT): SBD MTMSN=20200726T100956
2020-07-26T10:10:51.691Z,1595758251.691 [CommandLine](IMPORTANT): got command schedule asap "set canon_esp_box.Lon4 -122.0155 degree;set canon_esp_box.Lat5 NaN degree;set canon_esp_box.Lon5 NaN degree;set canon_esp_box.Lat6 NaN degree;set canon_esp_box.Lon6 NaN degree;set canon_esp_box.Lat7 NaN degree" 3kk7v 3 6.000000
2020-07-26T10:10:51.691Z,1595758251.691 [CommandLine](IMPORTANT): Scheduling command #3 of 6 with id=3kk7v
2020-07-26T10:10:51.692Z,1595758251.692 [CommandLine](IMPORTANT): Scheduled #6 (#3 of 6 with id='3kk7v'): "set canon_esp_box.Lon4 -122.0155 degree;set canon_esp_box.Lat5 NaN degree;set canon_esp_box.Lon5 NaN degree;set canon_esp_box.Lat6 NaN degree;set canon_esp_box.Lon6 NaN degree;set canon_esp_box.Lat7 NaN degree" ASAP
2020-07-26T10:10:52.612Z,1595758252.612 [DataOverHttps](IMPORTANT): SBD MTMSN=20200726T101004
2020-07-26T10:10:59.904Z,1595758259.904 [CommandLine](IMPORTANT): got command schedule asap "set canon_esp_box.Lon7 NaN degree;set canon_esp_box.Lat8 NaN degree;set canon_esp_box.Lon8 NaN degree;set canon_esp_box.Lat9 NaN degree;set canon_esp_box.Lon9 NaN degree;set canon_esp_box.Lat10 NaN degree" 3kk7v 4 6.000000
2020-07-26T10:10:59.904Z,1595758259.904 [CommandLine](IMPORTANT): Scheduling command #4 of 6 with id=3kk7v
2020-07-26T10:10:59.905Z,1595758259.905 [CommandLine](IMPORTANT): Scheduled #7 (#4 of 6 with id='3kk7v'): "set canon_esp_box.Lon7 NaN degree;set canon_esp_box.Lat8 NaN degree;set canon_esp_box.Lon8 NaN degree;set canon_esp_box.Lat9 NaN degree;set canon_esp_box.Lon9 NaN degree;set canon_esp_box.Lat10 NaN degree" ASAP
2020-07-26T10:11:00.849Z,1595758260.849 [DataOverHttps](IMPORTANT): SBD MTMSN=20200726T101012
2020-07-26T10:11:08.113Z,1595758268.113 [CommandLine](IMPORTANT): got command schedule asap "set canon_esp_box.Lon10 NaN degree;set canon_esp_box.Lat11 NaN degree;set canon_esp_box.Lon11 NaN degree;set canon_esp_box.Speed 0.65 meter_per_second;set canon_esp_box.YoYoMaxDepth1 50 meter" 3kk7v 5 6.000000
2020-07-26T10:11:08.114Z,1595758268.114 [CommandLine](IMPORTANT): Scheduling command #5 of 6 with id=3kk7v
2020-07-26T10:11:08.114Z,1595758268.114 [CommandLine](IMPORTANT): Scheduled #8 (#5 of 6 with id='3kk7v'): "set canon_esp_box.Lon10 NaN degree;set canon_esp_box.Lat11 NaN degree;set canon_esp_box.Lon11 NaN degree;set canon_esp_box.Speed 0.65 meter_per_second;set canon_esp_box.YoYoMaxDepth1 50 meter" ASAP
2020-07-26T10:11:09.104Z,1595758269.104 [DataOverHttps](IMPORTANT): SBD MTMSN=20200726T101021
2020-07-26T10:11:16.344Z,1595758276.344 [CommandLine](IMPORTANT): got command schedule asap "set canon_esp_box.YoYoMaxDepth2 50 meter;set canon_esp_box.YoYoMaxDepth3 50 meter;set canon_esp_box.YoYoMaxDepth4 50 meter;set canon_esp_box.MaxDepth 65 meter;run " 3kk7v 6 6.000000
2020-07-26T10:11:16.344Z,1595758276.344 [CommandLine](IMPORTANT): Scheduling command #6 of 6 with id=3kk7v
2020-07-26T10:11:16.345Z,1595758276.345 [CommandLine](IMPORTANT): Scheduled #9 (#6 of 6 with id='3kk7v'): "set canon_esp_box.YoYoMaxDepth2 50 meter;set canon_esp_box.YoYoMaxDepth3 50 meter;set canon_esp_box.YoYoMaxDepth4 50 meter;set canon_esp_box.MaxDepth 65 meter;run " ASAP
2020-07-26T10:11:16.443Z,1595758276.443 [CommandLine](IMPORTANT): got command load ./Missions/Science/canon_esp_box.xml
2020-07-26T10:11:20.227Z,1595758280.227 [CommandLine](IMPORTANT): Loaded ./Missions/Science/canon_esp_box.xml
2020-07-26T10:11:29.337Z,1595758289.337 [CommandLine](IMPORTANT): got command set canon_esp_box.MissionTimeout 30.000000 hour
2020-07-26T10:11:29.338Z,1595758289.338 [CommandLine](IMPORTANT): got command set canon_esp_box.NeedCommsTime 2.500000 hour
2020-07-26T10:11:29.375Z,1595758289.375 [CommandLine](IMPORTANT): got command set canon_esp_box.SampleInterval 45.000000 minute
2020-07-26T10:11:29.376Z,1595758289.376 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat1 36.782501 degree
2020-07-26T10:11:39.892Z,1595758299.892 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon1 -122.017998 degree
2020-07-26T10:11:39.893Z,1595758299.893 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat2 36.711700 degree
2020-07-26T10:11:39.893Z,1595758299.893 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon2 -122.191902 degree
2020-07-26T10:11:39.894Z,1595758299.894 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat3 36.697800 degree
2020-07-26T10:11:39.895Z,1595758299.895 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon3 -122.056198 degree
2020-07-26T10:11:39.896Z,1595758299.896 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat4 36.754002 degree
2020-07-26T10:11:52.145Z,1595758312.145 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon4 -122.015503 degree
2020-07-26T10:11:52.146Z,1595758312.146 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat5 nan degree
2020-07-26T10:11:52.146Z,1595758312.146 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon5 nan degree
2020-07-26T10:11:52.147Z,1595758312.147 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat6 nan degree
2020-07-26T10:11:52.148Z,1595758312.148 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon6 nan degree
2020-07-26T10:11:52.148Z,1595758312.148 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat7 nan degree
2020-07-26T10:12:01.108Z,1595758321.108 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon7 nan degree
2020-07-26T10:12:01.109Z,1595758321.109 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat8 nan degree
2020-07-26T10:12:01.110Z,1595758321.110 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon8 nan degree
2020-07-26T10:12:01.110Z,1595758321.110 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat9 nan degree
2020-07-26T10:12:01.111Z,1595758321.111 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon9 nan degree
2020-07-26T10:12:01.112Z,1595758321.112 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat10 nan degree
2020-07-26T10:12:09.311Z,1595758329.311 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon10 nan degree
2020-07-26T10:12:09.312Z,1595758329.312 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat11 nan degree
2020-07-26T10:12:09.312Z,1595758329.312 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon11 nan degree
2020-07-26T10:12:09.313Z,1595758329.313 [CommandLine](IMPORTANT): got command set canon_esp_box.Speed 0.650000 meter_per_second
2020-07-26T10:12:09.314Z,1595758329.314 [CommandLine](IMPORTANT): got command set canon_esp_box.YoYoMaxDepth1 50.000000 meter
2020-07-26T10:12:20.873Z,1595758340.873 [CommandLine](IMPORTANT): got command set canon_esp_box.YoYoMaxDepth2 50.000000 meter
2020-07-26T10:12:20.873Z,1595758340.873 [CommandLine](IMPORTANT): got command set canon_esp_box.YoYoMaxDepth3 50.000000 meter
2020-07-26T10:12:20.874Z,1595758340.874 [CommandLine](IMPORTANT): got command set canon_esp_box.YoYoMaxDepth4 50.000000 meter
2020-07-26T10:12:20.876Z,1595758340.876 [CommandLine](IMPORTANT): got command set canon_esp_box.MaxDepth 65.000000 meter
2020-07-26T10:12:20.876Z,1595758340.876 [CommandLine](IMPORTANT): got command run 
2020-07-26T10:12:20.880Z,1595758340.880 [CommandLine](IMPORTANT): Running 
2020-07-26T10:12:21.003Z,1595758341.003 [MissionManager](IMPORTANT): Started mission canon_esp_box
2020-07-26T10:12:39.305Z,1595758359.305 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=38176, MT Status=1, MTMSN=2727
2020-07-26T10:12:40.073Z,1595758360.073 [CommandLine](IMPORTANT): got command schedule asap "set canon_esp_box.Lon7 NaN degree;set canon_esp_box.Lat8 NaN degree;set canon_esp_box.Lon8 NaN degree;set canon_esp_box.Lat9 NaN degree;set canon_esp_box.Lon9 NaN degree;set canon_esp_box.Lat10 NaN degree" 3kjr3 4 6.000000
2020-07-26T10:12:40.073Z,1595758360.073 [CommandLine](IMPORTANT): Scheduling command #4 of 6 with id=3kjr3
2020-07-26T10:12:40.074Z,1595758360.074 [CommandLine](IMPORTANT): Scheduled #10 (#4 of 6 with id='3kjr3'): "set canon_esp_box.Lon7 NaN degree;set canon_esp_box.Lat8 NaN degree;set canon_esp_box.Lon8 NaN degree;set canon_esp_box.Lat9 NaN degree;set canon_esp_box.Lon9 NaN degree;set canon_esp_box.Lat10 NaN degree" ASAP
2020-07-26T10:13:00.439Z,1595758380.439 [canon_esp_box:Lap:A](IMPORTANT): Starting Lap
2020-07-26T10:13:00.840Z,1595758380.840 [canon_esp_box:Lap:B](IMPORTANT): Lat[1] = 36.782502 arcdeg Lon[1] = -122.017996 arcdeg 
2020-07-26T10:13:01.230Z,1595758381.230 [canon_esp_box:Lap:C](IMPORTANT): Lat[2] = 36.711700 arcdeg Lon[2] = -122.191907 arcdeg 
2020-07-26T10:13:01.641Z,1595758381.641 [canon_esp_box:Lap:D](IMPORTANT): Lat[3] = 36.697800 arcdeg Lon[3] = -122.056204 arcdeg 
2020-07-26T10:13:02.039Z,1595758382.039 [canon_esp_box:Lap:E](IMPORTANT): Lat[4] = 36.754003 arcdeg Lon[4] = -122.015497 arcdeg 
2020-07-26T10:13:02.451Z,1595758382.451 [canon_esp_box:Lap:F](IMPORTANT): Lat[5] = nan arcdeg Lon[5] = nan arcdeg 
2020-07-26T10:13:02.865Z,1595758382.865 [canon_esp_box:Lap:G](IMPORTANT): Lat[6] = nan arcdeg Lon[6] = nan arcdeg 
2020-07-26T10:13:03.253Z,1595758383.253 [canon_esp_box:Lap:H](IMPORTANT): Lat[7] = nan arcdeg Lon[7] = nan arcdeg 
2020-07-26T10:13:03.655Z,1595758383.655 [canon_esp_box:Lap:I](IMPORTANT): Lat[8] = nan arcdeg Lon[8] = nan arcdeg 
2020-07-26T10:13:04.063Z,1595758384.063 [canon_esp_box:Lap:J](IMPORTANT): Lat[9] = nan arcdeg Lon[9] = nan arcdeg 
2020-07-26T10:13:04.466Z,1595758384.466 [canon_esp_box:Lap:K](IMPORTANT): Lat[10] = nan arcdeg Lon[10] = nan arcdeg 
2020-07-26T10:13:04.872Z,1595758384.872 [canon_esp_box:Lap:L](IMPORTANT): Lat[11] = nan arcdeg Lon[11] = nan arcdeg 
2020-07-26T10:13:05.274Z,1595758385.274 [canon_esp_box:Lap:M](IMPORTANT): Lat[12] = nan arcdeg Lon[12] = nan arcdeg 
2020-07-26T10:13:06.081Z,1595758386.081 [canon_esp_box:Lap:Wpt1:A](IMPORTANT): Navigating to box start WP. YoYoMaxDepth: 50.000000 m 
2020-07-26T10:13:06.495Z,1595758386.495 [canon_esp_box:SampleTimer:SampleESP:B](IMPORTANT): Pre-sample comms. Elapsed time since last ESP sample: 0.030213 h 
2020-07-26T10:15:00.459Z,1595758500.459 [canon_esp_box:SampleTimer:SampleESP:SampleESP:B](IMPORTANT): Sampling ESP cartridge type -6.000000 count 
2020-07-26T10:15:02.047Z,1595758502.047 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::'
2020-07-26T10:15:02.484Z,1595758502.484 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2020-07-26T10:15:02.631Z,1595758502.631 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2020-07-26T10:15:41.240Z,1595758541.240 [ESPComponent](IMPORTANT): ESP has connected as client
2020-07-26T10:15:42.053Z,1595758542.053 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -6
2020-07-26T10:15:42.054Z,1595758542.054 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2020-07-26T10:15:43.260Z,1595758543.260 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG
2020-07-26T10:15:43.667Z,1595758543.667 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS
2020-07-26T10:15:45.280Z,1595758545.280 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE
2020-07-26T10:16:18.012Z,1595758578.012 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PRIMING (@21,archive_bac)
2020-07-26T10:16:19.627Z,1595758579.627 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PRIMING (@100.0)
2020-07-26T10:16:20.432Z,1595758580.432 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2020-07-26T10:19:01.230Z,1595758741.230 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_FILTERING (@0.0)
2020-07-26T10:19:01.632Z,1595758741.632 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2020-07-26T11:13:52.815Z,1595762032.815 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PAUSED (@1000.001)
2020-07-26T11:13:53.216Z,1595762033.216 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PROCESSING (@1000.001)
2020-07-26T11:13:55.640Z,1595762035.640 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PROCESSED (@21,archive_bac)
2020-07-26T11:25:58.840Z,1595762758.840 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING (@21,archive_bac)
2020-07-26T11:26:24.292Z,1595762784.292 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs &
2020-07-26T11:26:24.692Z,1595762784.692 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED
2020-07-26T11:31:24.488Z,1595763084.488 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence completed normally.
2020-07-26T11:31:24.888Z,1595763084.888 [ESPComponent](IMPORTANT): [sample #1] ESP log summary report (2 messages):
@03:15:55.31 Selecting Cartridge 21
@04:13:51.21 Sampled  1000.0ml

2020-07-26T11:33:15.604Z,1595763195.604 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=38177, MT Status=1, MTMSN=2728
2020-07-26T11:33:16.353Z,1595763196.353 [CommandLine](IMPORTANT): got command schedule asap "set canon_esp_box.Lon10 NaN degree;set canon_esp_box.Lat11 NaN degree;set canon_esp_box.Lon11 NaN degree;set canon_esp_box.Speed 0.65 meter_per_second;set canon_esp_box.YoYoMaxDepth1 50 meter" 3kjr3 5 6.000000
2020-07-26T11:33:16.353Z,1595763196.353 [CommandLine](IMPORTANT): Scheduling command #5 of 6 with id=3kjr3
2020-07-26T11:33:16.354Z,1595763196.354 [CommandLine](IMPORTANT): Scheduled #11 (#5 of 6 with id='3kjr3'): "set canon_esp_box.Lon10 NaN degree;set canon_esp_box.Lat11 NaN degree;set canon_esp_box.Lon11 NaN degree;set canon_esp_box.Speed 0.65 meter_per_second;set canon_esp_box.YoYoMaxDepth1 50 meter" ASAP
2020-07-26T11:36:26.199Z,1595763386.199 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=38178, MT Status=1, MTMSN=2729
2020-07-26T11:36:27.044Z,1595763387.044 [CommandLine](IMPORTANT): got command schedule asap "set canon_esp_box.YoYoMaxDepth2 50 meter;set canon_esp_box.YoYoMaxDepth3 50 meter;set canon_esp_box.YoYoMaxDepth4 50 meter;set canon_esp_box.MaxDepth 65 meter;run " 3kjr3 6 6.000000
2020-07-26T11:36:27.044Z,1595763387.044 [CommandLine](IMPORTANT): Scheduling command #6 of 6 with id=3kjr3
2020-07-26T11:36:27.045Z,1595763387.045 [CommandLine](IMPORTANT): Scheduled #12 (#6 of 6 with id='3kjr3'): "set canon_esp_box.YoYoMaxDepth2 50 meter;set canon_esp_box.YoYoMaxDepth3 50 meter;set canon_esp_box.YoYoMaxDepth4 50 meter;set canon_esp_box.MaxDepth 65 meter;run " ASAP
2020-07-26T11:36:38.928Z,1595763398.928 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=38179, MT Status=1, MTMSN=2730
2020-07-26T11:36:39.647Z,1595763399.647 [CommandLine](IMPORTANT): got command schedule clear
2020-07-26T11:36:39.647Z,1595763399.647 [CommandLine](IMPORTANT): #Cleared scheduled commands:4
2020-07-26T12:10:12.970Z,1595765412.970 [canon_esp_box:Lap:Wpt1:C.Waypoint](IMPORTANT): Reached Waypoint: 36.782502,-122.017996
2020-07-26T12:10:13.354Z,1595765413.354 [canon_esp_box:Lap:Wpt2:A](IMPORTANT): Navigating to WP2. YoYoMaxDepth: 50.000000 m 
2020-07-26T12:31:26.036Z,1595766686.036 [canon_esp_box:SampleTimer:SampleESP:B](IMPORTANT): Pre-sample comms. Elapsed time since last ESP sample: 0.750023 h 
2020-07-26T12:38:55.269Z,1595767135.269 [canon_esp_box:SampleTimer:SampleESP:SampleESP:B](IMPORTANT): Sampling ESP cartridge type -6.000000 count 
2020-07-26T12:38:57.359Z,1595767137.359 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2020-07-26T12:38:57.458Z,1595767137.458 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2020-07-26T12:39:34.450Z,1595767174.450 [ESPComponent](IMPORTANT): ESP has connected as client
2020-07-26T12:39:35.261Z,1595767175.261 [ESPComponent](IMPORTANT): [sample #2] Setting cartridge argument to -6
2020-07-26T12:39:35.261Z,1595767175.261 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2020-07-26T12:39:36.059Z,1595767176.059 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_LOG
2020-07-26T12:39:36.470Z,1595767176.470 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_STATUS
2020-07-26T12:39:38.489Z,1595767178.489 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_LOADING_CARTRIDGE
2020-07-26T12:40:11.219Z,1595767211.219 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PRIMING (@20,archive_bac)
2020-07-26T12:40:12.827Z,1595767212.827 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PRIMING (@100.0)
2020-07-26T12:40:13.636Z,1595767213.636 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2020-07-26T12:42:54.031Z,1595767374.031 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_FILTERING (@0.0)
2020-07-26T12:42:54.432Z,1595767374.432 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2020-07-26T13:34:56.283Z,1595770496.283 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PAUSED (@1000.0)
2020-07-26T13:34:56.687Z,1595770496.687 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PROCESSING (@1000.0)
2020-07-26T13:34:59.108Z,1595770499.108 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PROCESSED (@20,archive_bac)
2020-07-26T13:47:02.284Z,1595771222.284 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPING (@20,archive_bac)
2020-07-26T13:47:27.737Z,1595771247.737 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs &
2020-07-26T13:47:28.143Z,1595771248.143 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPED
2020-07-26T13:52:27.920Z,1595771547.920 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence completed normally.
2020-07-26T13:52:28.328Z,1595771548.328 [ESPComponent](IMPORTANT): [sample #2] ESP log summary report (2 messages):
@05:39:47.83 Selecting Cartridge 20
@06:34:54.56 Sampled  1000.0ml

2020-07-26T14:46:37.249Z,1595774797.249 [canon_esp_box:SampleTimer:SampleESP:B](IMPORTANT): Pre-sample comms. Elapsed time since last ESP sample: 0.750032 h 
2020-07-26T14:54:54.968Z,1595775294.968 [canon_esp_box:SampleTimer:SampleESP:SampleESP:B](IMPORTANT): Sampling ESP cartridge type -6.000000 count 
2020-07-26T14:54:57.059Z,1595775297.059 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2020-07-26T14:54:57.202Z,1595775297.202 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2020-07-26T14:55:34.524Z,1595775334.524 [ESPComponent](IMPORTANT): ESP has connected as client
2020-07-26T14:55:35.335Z,1595775335.335 [ESPComponent](IMPORTANT): [sample #3] Setting cartridge argument to -6
2020-07-26T14:55:35.336Z,1595775335.336 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2020-07-26T14:55:36.142Z,1595775336.142 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_LOG
2020-07-26T14:55:36.544Z,1595775336.544 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_STATUS
2020-07-26T14:55:38.563Z,1595775338.563 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_LOADING_CARTRIDGE
2020-07-26T14:56:11.292Z,1595775371.292 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PRIMING (@19,archive_bac)
2020-07-26T14:56:12.910Z,1595775372.910 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PRIMING (@100.0)
2020-07-26T14:56:14.528Z,1595775374.528 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2020-07-26T14:58:53.712Z,1595775533.712 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_FILTERING (@0.0)
2020-07-26T14:58:54.108Z,1595775534.108 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2020-07-26T15:39:10.956Z,1595777950.956 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PAUSED (@714.128)
2020-07-26T15:39:11.361Z,1595777951.361 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PROCESSING (@714.128)
2020-07-26T15:39:14.595Z,1595777954.595 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PROCESSED (@19,archive_bac)
2020-07-26T15:45:17.903Z,1595778317.903 [CBIT](IMPORTANT): Beginning ground fault scan
2020-07-26T15:45:28.825Z,1595778328.825 [CBIT](IMPORTANT): Ground fault detected
mA:
CHAN A0 (Batt): 0.195290
CHAN A1 (24V): -0.005235
CHAN A2 (12V): 0.075639
CHAN A3 (5V): 0.015103
CHAN B0 (3.3V): 0.008189
CHAN B1 (3.15aV): 0.008806
CHAN B2 (3.15bV): 0.008973
CHAN B3 (GND): -0.004373
OPEN: 0.014572
Full Scale Calc: 4.765 mA, -1.589 mA
2020-07-26T15:51:16.999Z,1595778676.999 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPING (@19,archive_bac)
2020-07-26T15:51:42.453Z,1595778702.453 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs &
2020-07-26T15:51:42.857Z,1595778702.857 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPED
2020-07-26T15:56:42.640Z,1595779002.640 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence completed normally.
2020-07-26T15:56:43.044Z,1595779003.044 [ESPComponent](IMPORTANT): [sample #3] ESP log summary report (3 messages):
@07:55:48.55 Selecting Cartridge 19
@08:39:08.74 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged
@08:39:08.94 Sampled  714.1ml

2020-07-26T16:52:01.313Z,1595782321.313 [canon_esp_box:SampleTimer:SampleESP:B](IMPORTANT): Pre-sample comms. Elapsed time since last ESP sample: 0.750037 h 
2020-07-26T17:00:48.623Z,1595782848.623 [canon_esp_box:SampleTimer:SampleESP:SampleESP:B](IMPORTANT): Sampling ESP cartridge type -6.000000 count 
2020-07-26T17:00:50.711Z,1595782850.711 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2020-07-26T17:00:50.947Z,1595782850.947 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2020-07-26T17:01:29.475Z,1595782889.475 [ESPComponent](IMPORTANT): ESP has connected as client
2020-07-26T17:01:30.278Z,1595782890.278 [ESPComponent](IMPORTANT): [sample #4] Setting cartridge argument to -6
2020-07-26T17:01:30.278Z,1595782890.278 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2020-07-26T17:01:31.080Z,1595782891.080 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_LOG
2020-07-26T17:01:31.506Z,1595782891.506 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_STATUS
2020-07-26T17:01:33.509Z,1595782893.509 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_LOADING_CARTRIDGE
2020-07-26T17:02:06.230Z,1595782926.230 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PRIMING (@18,archive_bac)
2020-07-26T17:02:07.844Z,1595782927.844 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PRIMING (@100.0)
2020-07-26T17:02:08.652Z,1595782928.652 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2020-07-26T17:04:57.540Z,1595783097.540 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_FILTERING (@0.0)
2020-07-26T17:04:57.940Z,1595783097.940 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2020-07-26T17:57:15.133Z,1595786235.133 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PAUSED (@1000.0)
2020-07-26T17:57:15.534Z,1595786235.534 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PROCESSING (@1000.0)
2020-07-26T17:57:17.956Z,1595786237.956 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PROCESSED (@18,archive_bac)
2020-07-26T18:09:21.155Z,1595786961.155 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPING (@18,archive_bac)
2020-07-26T18:09:46.607Z,1595786986.607 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs &
2020-07-26T18:09:47.008Z,1595786987.008 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPED
2020-07-26T18:14:46.792Z,1595787286.792 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence completed normally.
2020-07-26T18:14:47.199Z,1595787287.199 [ESPComponent](IMPORTANT): [sample #4] ESP log summary report (2 messages):
@10:01:42.68 Selecting Cartridge 18
@10:57:13.24 Sampled  1000.0ml

2020-07-26T19:06:50.764Z,1595790410.764 [canon_esp_box:SampleTimer:SampleESP:B](IMPORTANT): Pre-sample comms. Elapsed time since last ESP sample: 0.750036 h 
2020-07-26T19:14:08.116Z,1595790848.116 [canon_esp_box:SampleTimer:SampleESP:SampleESP:B](IMPORTANT): Sampling ESP cartridge type -6.000000 count 
2020-07-26T19:14:10.196Z,1595790850.196 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2020-07-26T19:14:10.303Z,1595790850.303 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2020-07-26T19:14:47.773Z,1595790887.773 [ESPComponent](IMPORTANT): ESP has connected as client
2020-07-26T19:14:48.579Z,1595790888.579 [ESPComponent](IMPORTANT): [sample #5] Setting cartridge argument to -6
2020-07-26T19:14:48.579Z,1595790888.579 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2020-07-26T19:14:49.387Z,1595790889.387 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_LOG
2020-07-26T19:14:49.787Z,1595790889.787 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_STATUS
2020-07-26T19:14:51.808Z,1595790891.808 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_LOADING_CARTRIDGE
2020-07-26T19:15:24.538Z,1595790924.538 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PRIMING (@17,archive_bac)
2020-07-26T19:15:26.152Z,1595790926.152 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PRIMING (@100.0)
2020-07-26T19:15:26.964Z,1595790926.964 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2020-07-26T19:18:07.348Z,1595791087.348 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_FILTERING (@0.0)
2020-07-26T19:18:07.755Z,1595791087.755 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2020-07-26T20:07:30.040Z,1595794050.040 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PAUSED (@858.666)
2020-07-26T20:07:30.451Z,1595794050.451 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PROCESSING (@858.666)
2020-07-26T20:07:33.679Z,1595794053.679 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PROCESSED (@17,archive_bac)
2020-07-26T20:19:36.065Z,1595794776.065 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPING (@17,archive_bac)
2020-07-26T20:20:01.518Z,1595794801.518 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs &
2020-07-26T20:20:01.924Z,1595794801.924 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPED
2020-07-26T20:25:01.712Z,1595795101.712 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence completed normally.
2020-07-26T20:25:02.117Z,1595795102.117 [ESPComponent](IMPORTANT): [sample #5] ESP log summary report (3 messages):
@12:15:01.47 Selecting Cartridge 17
@13:07:27.71 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged
@13:07:27.91 Sampled  858.7ml

2020-07-26T20:27:21.121Z,1595795241.121 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=38288, MT Status=1, MTMSN=2731
2020-07-26T20:27:21.716Z,1595795241.716 [CommandLine](IMPORTANT): got command ! start onESPclient CharlesN -- slots
2020-07-26T20:27:22.204Z,1595795242.204 [CommandLine](IMPORTANT): /mnt/mmc/started/2020-07-26UTC202722_onESPclient
  
2020-07-26T20:28:56.925Z,1595795336.925 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=38289, MT Status=1, MTMSN=2732
2020-07-26T20:28:57.615Z,1595795337.615 [CommandLine](IMPORTANT): got command ! check
2020-07-26T20:28:57.955Z,1595795337.955 [CommandLine](IMPORTANT): 	 State: :processed,
  	 filtered: 1000},
   58 => { Type: :archive_bac,
  	 State: :processed,
  	 filtered: 452.305},
   59 => { Type: :archive_bac,
  	 State: :processed,
  	 filtered: 677.111},
   archive_bac: 5}
  Sun Jul 26 20:28:05 UTC 2020 -- Shutting down ESP in 20 seconds ... shutting ESP off
  
2020-07-26T21:22:49.750Z,1595798569.750 [canon_esp_box:SampleTimer:SampleESP:B](IMPORTANT): Pre-sample comms. Elapsed time since last ESP sample: 0.750017 h 
2020-07-26T21:29:25.181Z,1595798965.181 [canon_esp_box:Lap:Wpt2:C.Waypoint](IMPORTANT): Reached Waypoint: 36.711700,-122.191907
2020-07-26T21:29:25.594Z,1595798965.594 [canon_esp_box:Lap:Wpt3:A](IMPORTANT): Navigating to WP3. YoYoMaxDepth: 50.000000 m 
2020-07-26T21:29:40.557Z,1595798980.557 [canon_esp_box:SampleTimer:SampleESP:SampleESP:B](IMPORTANT): Sampling ESP cartridge type -6.000000 count 
2020-07-26T21:29:42.639Z,1595798982.639 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2020-07-26T21:29:42.738Z,1595798982.738 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2020-07-26T21:30:19.699Z,1595799019.699 [ESPComponent](IMPORTANT): ESP has connected as client
2020-07-26T21:30:20.510Z,1595799020.510 [ESPComponent](IMPORTANT): [sample #6] Setting cartridge argument to -6
2020-07-26T21:30:20.511Z,1595799020.511 [ESPComponent](IMPORTANT): [sample #6] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2020-07-26T21:30:21.318Z,1595799021.318 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PREPARING_SHOW_LOG
2020-07-26T21:30:21.722Z,1595799021.722 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PREPARING_SHOW_STATUS
2020-07-26T21:30:23.739Z,1595799023.739 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_LOADING_CARTRIDGE
2020-07-26T21:30:56.465Z,1595799056.465 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PRIMING (@16,archive_bac)
2020-07-26T21:30:58.082Z,1595799058.082 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PRIMING (@100.0)
2020-07-26T21:30:59.697Z,1595799059.697 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2020-07-26T21:33:38.080Z,1595799218.080 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_FILTERING (@0.0)
2020-07-26T21:33:38.483Z,1595799218.483 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2020-07-26T21:45:28.871Z,1595799928.871 [CBIT](IMPORTANT): Beginning ground fault scan
2020-07-26T21:45:39.918Z,1595799939.918 [CBIT](IMPORTANT): Ground fault detected
mA:
CHAN A0 (Batt): 0.087324
CHAN A1 (24V): -0.005668
CHAN A2 (12V): 0.062675
CHAN A3 (5V): 0.014447
CHAN B0 (3.3V): -0.014139
CHAN B1 (3.15aV): -0.013665
CHAN B2 (3.15bV): 0.002467
CHAN B3 (GND): -0.012852
OPEN: 0.007624
Full Scale Calc: 4.765 mA, -1.589 mA
2020-07-26T21:53:18.637Z,1595800398.637 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PAUSED (@353.125)
2020-07-26T21:53:19.036Z,1595800399.036 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PROCESSING (@353.125)
2020-07-26T21:53:21.461Z,1595800401.461 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PROCESSED (@16,archive_bac)
2020-07-26T22:05:24.650Z,1595801124.650 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_STOPPING (@16,archive_bac)
2020-07-26T22:05:50.108Z,1595801150.108 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs &
2020-07-26T22:05:50.511Z,1595801150.511 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_STOPPED
2020-07-26T22:10:50.292Z,1595801450.292 [ESPComponent](IMPORTANT): [sample #6] ESP sampling sequence completed normally.
2020-07-26T22:10:50.703Z,1595801450.703 [ESPComponent](IMPORTANT): [sample #6] ESP log summary report (3 messages):
@14:30:33.40 Selecting Cartridge 16
@14:53:15.88 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged
@14:53:16.08 Sampled  353.1ml

2020-07-26T23:06:29.372Z,1595804789.372 [canon_esp_box:SampleTimer:SampleESP:B](IMPORTANT): Pre-sample comms. Elapsed time since last ESP sample: 0.750032 h 
2020-07-26T23:11:17.561Z,1595805077.561 [canon_esp_box:SampleTimer:SampleESP:SampleESP:B](IMPORTANT): Sampling ESP cartridge type -6.000000 count 
2020-07-26T23:11:19.643Z,1595805079.643 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2020-07-26T23:11:19.760Z,1595805079.760 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2020-07-26T23:11:56.709Z,1595805116.709 [ESPComponent](IMPORTANT): ESP has connected as client
2020-07-26T23:11:57.514Z,1595805117.514 [ESPComponent](IMPORTANT): [sample #7] Setting cartridge argument to -6
2020-07-26T23:11:57.515Z,1595805117.515 [ESPComponent](IMPORTANT): [sample #7] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2020-07-26T23:11:58.319Z,1595805118.319 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PREPARING_SHOW_LOG
2020-07-26T23:11:58.729Z,1595805118.729 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PREPARING_SHOW_STATUS
2020-07-26T23:12:00.746Z,1595805120.746 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_LOADING_CARTRIDGE
2020-07-26T23:12:33.471Z,1595805153.471 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PRIMING (@15,archive_bac)
2020-07-26T23:12:35.084Z,1595805155.084 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PRIMING (@100.0)
2020-07-26T23:12:36.708Z,1595805156.708 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2020-07-26T23:15:15.486Z,1595805315.486 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_FILTERING (@0.0)
2020-07-26T23:15:15.888Z,1595805315.888 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2020-07-26T23:34:37.054Z,1595806477.054 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PAUSED (@370.498)
2020-07-26T23:34:37.456Z,1595806477.456 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PROCESSING (@370.498)
2020-07-26T23:34:40.699Z,1595806480.699 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PROCESSED (@15,archive_bac)
2020-07-26T23:46:43.101Z,1595807203.101 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_STOPPING (@15,archive_bac)
2020-07-26T23:47:08.554Z,1595807228.554 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs &
2020-07-26T23:47:08.951Z,1595807228.951 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_STOPPED
2020-07-26T23:52:08.770Z,1595807528.770 [ESPComponent](IMPORTANT): [sample #7] ESP sampling sequence completed normally.
2020-07-26T23:52:09.172Z,1595807529.172 [ESPComponent](IMPORTANT): [sample #7] ESP log summary report (3 messages):
@16:12:10.07 Selecting Cartridge 15
@16:34:34.45 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged
@16:34:34.65 Sampled  370.5ml

2020-07-26T23:54:37.183Z,1595807677.183 [BuoyancyServo](FAULT): Buoyancy getPosition uart error.serial timeout
2020-07-26T23:54:39.537Z,1595807679.537 [BuoyancyServo](FAULT): LCB fault:  Current Limiter Activated.
2020-07-27T00:32:14.343Z,1595809934.343 [BPC1](FAULT): Battery stick #38 (s/n: 0139) reported TERMINATE_DISCHARGE_ALARM. Status code: 0x4AD0.
2020-07-27T00:44:34.123Z,1595810674.123 [canon_esp_box:SampleTimer:SampleESP:B](IMPORTANT): Pre-sample comms. Elapsed time since last ESP sample: 0.750110 h 
2020-07-27T00:52:57.702Z,1595811177.702 [canon_esp_box:SampleTimer:SampleESP:SampleESP:B](IMPORTANT): Sampling ESP cartridge type -6.000000 count 
2020-07-27T00:52:59.792Z,1595811179.792 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2020-07-27T00:52:59.996Z,1595811179.996 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2020-07-27T00:53:36.872Z,1595811216.872 [ESPComponent](IMPORTANT): ESP has connected as client
2020-07-27T00:53:37.685Z,1595811217.685 [ESPComponent](IMPORTANT): [sample #8] Setting cartridge argument to -6
2020-07-27T00:53:37.685Z,1595811217.685 [ESPComponent](IMPORTANT): [sample #8] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2020-07-27T00:53:38.493Z,1595811218.493 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PREPARING_SHOW_LOG
2020-07-27T00:53:38.894Z,1595811218.894 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PREPARING_SHOW_STATUS
2020-07-27T00:53:40.911Z,1595811220.911 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_LOADING_CARTRIDGE
2020-07-27T00:54:13.636Z,1595811253.636 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PRIMING (@14,archive_bac)
2020-07-27T00:54:15.254Z,1595811255.254 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PRIMING (@100.0)
2020-07-27T00:54:16.059Z,1595811256.059 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2020-07-27T00:57:04.542Z,1595811424.542 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_FILTERING (@0.0)
2020-07-27T00:57:04.940Z,1595811424.940 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2020-07-27T01:49:04.447Z,1595814544.447 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PAUSED (@1000.0)
2020-07-27T01:49:04.856Z,1595814544.856 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PROCESSING (@1000.0)
2020-07-27T01:49:07.275Z,1595814547.275 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PROCESSED (@14,archive_bac)
2020-07-27T02:01:10.477Z,1595815270.477 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_STOPPING (@14,archive_bac)
2020-07-27T02:01:35.929Z,1595815295.929 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs &
2020-07-27T02:01:36.335Z,1595815296.335 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_STOPPED
2020-07-27T02:06:36.112Z,1595815596.112 [ESPComponent](IMPORTANT): [sample #8] ESP sampling sequence completed normally.
2020-07-27T02:06:36.517Z,1595815596.517 [ESPComponent](IMPORTANT): [sample #8] ESP log summary report (2 messages):
@17:53:50.05 Selecting Cartridge 14
@18:49:02.42 Sampled  1000.0ml

2020-07-27T03:00:37.744Z,1595818837.744 [canon_esp_box:SampleTimer:SampleESP:B](IMPORTANT): Pre-sample comms. Elapsed time since last ESP sample: 0.750030 h 
2020-07-27T03:09:16.364Z,1595819356.364 [canon_esp_box:SampleTimer:SampleESP:SampleESP:B](IMPORTANT): Sampling ESP cartridge type -6.000000 count 
2020-07-27T03:09:18.459Z,1595819358.459 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2020-07-27T03:09:18.602Z,1595819358.602 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2020-07-27T03:09:55.522Z,1595819395.522 [ESPComponent](IMPORTANT): ESP has connected as client
2020-07-27T03:09:56.333Z,1595819396.333 [ESPComponent](IMPORTANT): [sample #9] Setting cartridge argument to -6
2020-07-27T03:09:56.334Z,1595819396.334 [ESPComponent](IMPORTANT): [sample #9] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2020-07-27T03:09:57.136Z,1595819397.136 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PREPARING_SHOW_LOG
2020-07-27T03:09:57.544Z,1595819397.544 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PREPARING_SHOW_STATUS
2020-07-27T03:09:59.565Z,1595819399.565 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_LOADING_CARTRIDGE
2020-07-27T03:10:32.287Z,1595819432.287 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_PRIMING (@13,archive_bac)
2020-07-27T03:10:33.899Z,1595819433.899 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PRIMING (@100.0)
2020-07-27T03:10:34.708Z,1595819434.708 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2020-07-27T03:13:14.699Z,1595819594.699 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_FILTERING (@0.0)
2020-07-27T03:13:15.106Z,1595819595.106 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2020-07-27T03:45:40.135Z,1595821540.135 [CBIT](IMPORTANT): Beginning ground fault scan
2020-07-27T03:45:51.468Z,1595821551.468 [CBIT](IMPORTANT): Ground fault detected
mA:
CHAN A0 (Batt): 0.087560
CHAN A1 (24V): -0.005469
CHAN A2 (12V): 0.062146
CHAN A3 (5V): 0.014425
CHAN B0 (3.3V): 0.008662
CHAN B1 (3.15aV): -0.014716
CHAN B2 (3.15bV): 0.010156
CHAN B3 (GND): -0.002493
OPEN: 0.014455
Full Scale Calc: 4.765 mA, -1.589 mA
2020-07-27T03:53:33.977Z,1595822013.977 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PAUSED (@711.879)
2020-07-27T03:53:34.382Z,1595822014.382 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PROCESSING (@711.879)
2020-07-27T03:53:36.804Z,1595822016.804 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_PROCESSED (@13,archive_bac)
2020-07-27T04:05:40.018Z,1595822740.018 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_STOPPING (@13,archive_bac)
2020-07-27T04:06:05.479Z,1595822765.479 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs &
2020-07-27T04:06:05.872Z,1595822765.872 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_STOPPED
2020-07-27T04:11:05.667Z,1595823065.667 [ESPComponent](IMPORTANT): [sample #9] ESP sampling sequence completed normally.
2020-07-27T04:11:06.059Z,1595823066.059 [ESPComponent](IMPORTANT): [sample #9] ESP log summary report (3 messages):
@20:10:08.91 Selecting Cartridge 13
@20:53:31.39 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged
@20:53:31.59 Sampled  711.9ml

2020-07-27T04:14:11.933Z,1595823251.933 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=38405, MT Status=1, MTMSN=2733
2020-07-27T04:14:12.527Z,1595823252.527 [CommandLine](IMPORTANT): got command stop
2020-07-27T04:14:12.538Z,1595823252.538 [CommandLine](IMPORTANT): Scheduling is paused
2020-07-27T04:14:13.178Z,1595823253.178 [MissionManager](IMPORTANT): Started mission Default
2020-07-27T04:14:13.420Z,1595823253.420 [WetLabsBB2FL](FAULT): LCB fault:  Software Overcurrent.
2020-07-27T04:26:23.128Z,1595823983.128 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 12.159083 min 
2020-07-27T04:32:00.164Z,1595824320.164 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 17.776457 min 
2020-07-27T04:37:17.365Z,1595824637.365 [DataOverHttps](IMPORTANT): SBD MTMSN=20200727T043629
2020-07-27T04:37:24.800Z,1595824644.800 [CommandLine](IMPORTANT): got command schedule asap "load Science/canon_esp_box.xml;set canon_esp_box.MissionTimeout 3 hour;set canon_esp_box.NeedCommsTime 2.5 hour;set canon_esp_box.SampleInterval 45 minute;set canon_esp_box.StartWithASample 0 bool" 3lzgk 1 6.000000
2020-07-27T04:37:24.801Z,1595824644.801 [CommandLine](IMPORTANT): Scheduling command #1 of 6 with id=3lzgk
2020-07-27T04:37:24.801Z,1595824644.801 [CommandLine](IMPORTANT): Scheduled #13 (#1 of 6 with id='3lzgk'): "load Science/canon_esp_box.xml;set canon_esp_box.MissionTimeout 3 hour;set canon_esp_box.NeedCommsTime 2.5 hour;set canon_esp_box.SampleInterval 45 minute;set canon_esp_box.StartWithASample 0 bool" ASAP
2020-07-27T04:37:25.706Z,1595824645.706 [DataOverHttps](IMPORTANT): SBD MTMSN=20200727T043637
2020-07-27T04:37:36.228Z,1595824656.228 [CommandLine](IMPORTANT): got command schedule asap "set canon_esp_box.Lat1 36.754 degree;set canon_esp_box.Lon1 -122.0155 degree;set canon_esp_box.Lat2 36.797 degree;set canon_esp_box.Lon2 -121.847 degree;set canon_esp_box.Lat3 NaN degree;set canon_esp_box.Lon3 NaN degree" 3lzgk 2 6.000000
2020-07-27T04:37:36.228Z,1595824656.228 [CommandLine](IMPORTANT): Scheduling command #2 of 6 with id=3lzgk
2020-07-27T04:37:36.229Z,1595824656.229 [CommandLine](IMPORTANT): Scheduled #14 (#2 of 6 with id='3lzgk'): "set canon_esp_box.Lat1 36.754 degree;set canon_esp_box.Lon1 -122.0155 degree;set canon_esp_box.Lat2 36.797 degree;set canon_esp_box.Lon2 -121.847 degree;set canon_esp_box.Lat3 NaN degree;set canon_esp_box.Lon3 NaN degree" ASAP
2020-07-27T04:37:37.202Z,1595824657.202 [DataOverHttps](IMPORTANT): SBD MTMSN=20200727T043648
2020-07-27T04:37:38.313Z,1595824658.313 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 23.412091 min 
2020-07-27T04:37:44.232Z,1595824664.232 [CommandLine](IMPORTANT): got command schedule asap "set canon_esp_box.Lat4 NaN degree;set canon_esp_box.Lon4 NaN degree;set canon_esp_box.Lat5 NaN degree;set canon_esp_box.Lon5 NaN degree;set canon_esp_box.Lat6 NaN degree;set canon_esp_box.Lon6 NaN degree" 3lzgk 3 6.000000
2020-07-27T04:37:44.232Z,1595824664.232 [CommandLine](IMPORTANT): Scheduling command #3 of 6 with id=3lzgk
2020-07-27T04:37:44.233Z,1595824664.233 [CommandLine](IMPORTANT): Scheduled #15 (#3 of 6 with id='3lzgk'): "set canon_esp_box.Lat4 NaN degree;set canon_esp_box.Lon4 NaN degree;set canon_esp_box.Lat5 NaN degree;set canon_esp_box.Lon5 NaN degree;set canon_esp_box.Lat6 NaN degree;set canon_esp_box.Lon6 NaN degree" ASAP
2020-07-27T04:37:45.076Z,1595824665.076 [DataOverHttps](IMPORTANT): SBD MOMSN=12473533, MTMSN=20200727T043656
2020-07-27T04:37:52.280Z,1595824672.280 [CommandLine](IMPORTANT): got command schedule asap "set canon_esp_box.Lat7 NaN degree;set canon_esp_box.Lon7 NaN degree;set canon_esp_box.Lat8 NaN degree;set canon_esp_box.Lon8 NaN degree;set canon_esp_box.Lat9 NaN degree;set canon_esp_box.Lon9 NaN degree" 3lzgk 4 6.000000
2020-07-27T04:37:52.281Z,1595824672.281 [CommandLine](IMPORTANT): Scheduling command #4 of 6 with id=3lzgk
2020-07-27T04:37:52.282Z,1595824672.282 [CommandLine](IMPORTANT): Scheduled #16 (#4 of 6 with id='3lzgk'): "set canon_esp_box.Lat7 NaN degree;set canon_esp_box.Lon7 NaN degree;set canon_esp_box.Lat8 NaN degree;set canon_esp_box.Lon8 NaN degree;set canon_esp_box.Lat9 NaN degree;set canon_esp_box.Lon9 NaN degree" ASAP
2020-07-27T04:37:53.456Z,1595824673.456 [DataOverHttps](IMPORTANT): SBD MTMSN=20200727T043704
2020-07-27T04:38:00.584Z,1595824680.584 [CommandLine](IMPORTANT): got command schedule asap "set canon_esp_box.Lat10 NaN degree;set canon_esp_box.Lon10 NaN degree;set canon_esp_box.Lat11 NaN degree;set canon_esp_box.Lon11 NaN degree;set canon_esp_box.Speed 0.65 meter_per_second;set canon_esp_box.YoYoMaxDepth1 50 meter" 3lzgk 5 6.000000
2020-07-27T04:38:00.585Z,1595824680.585 [CommandLine](IMPORTANT): Scheduling command #5 of 6 with id=3lzgk
2020-07-27T04:38:00.585Z,1595824680.585 [CommandLine](IMPORTANT): Scheduled #17 (#5 of 6 with id='3lzgk'): "set canon_esp_box.Lat10 NaN degree;set canon_esp_box.Lon10 NaN degree;set canon_esp_box.Lat11 NaN degree;set canon_esp_box.Lon11 NaN degree;set canon_esp_box.Speed 0.65 meter_per_second;set canon_esp_box.YoYoMaxDepth1 50 meter" ASAP
2020-07-27T04:38:01.734Z,1595824681.734 [DataOverHttps](IMPORTANT): SBD MTMSN=20200727T043713
2020-07-27T04:38:08.984Z,1595824688.984 [CommandLine](IMPORTANT): got command schedule asap "set canon_esp_box.YoYoMaxDepth2 50 meter;set canon_esp_box.YoYoMaxDepth3 50 meter;set canon_esp_box.YoYoMaxDepth4 50 meter;set canon_esp_box.MaxDepth 65 meter;run " 3lzgk 6 6.000000
2020-07-27T04:38:08.984Z,1595824688.984 [CommandLine](IMPORTANT): Scheduling command #6 of 6 with id=3lzgk
2020-07-27T04:38:08.985Z,1595824688.985 [CommandLine](IMPORTANT): Scheduled #18 (#6 of 6 with id='3lzgk'): "set canon_esp_box.YoYoMaxDepth2 50 meter;set canon_esp_box.YoYoMaxDepth3 50 meter;set canon_esp_box.YoYoMaxDepth4 50 meter;set canon_esp_box.MaxDepth 65 meter;run " ASAP
2020-07-27T04:38:09.095Z,1595824689.095 [CommandLine](IMPORTANT): got command load ./Missions/Science/canon_esp_box.xml
2020-07-27T04:38:11.721Z,1595824691.721 [CommandLine](IMPORTANT): Loaded ./Missions/Science/canon_esp_box.xml
2020-07-27T04:38:24.067Z,1595824704.067 [CommandLine](IMPORTANT): got command set canon_esp_box.MissionTimeout 3.000000 hour
2020-07-27T04:38:24.068Z,1595824704.068 [CommandLine](IMPORTANT): got command set canon_esp_box.NeedCommsTime 2.500000 hour
2020-07-27T04:38:24.069Z,1595824704.069 [CommandLine](IMPORTANT): got command set canon_esp_box.SampleInterval 45.000000 minute
2020-07-27T04:38:24.070Z,1595824704.070 [CommandLine](IMPORTANT): got command set canon_esp_box.StartWithASample 0.000000 bool
2020-07-27T04:38:36.895Z,1595824716.895 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat1 36.754002 degree
2020-07-27T04:38:36.896Z,1595824716.896 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon1 -122.015503 degree
2020-07-27T04:38:36.897Z,1595824716.897 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat2 36.797001 degree
2020-07-27T04:38:36.897Z,1595824716.897 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon2 -121.847000 degree
2020-07-27T04:38:36.898Z,1595824716.898 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat3 nan degree
2020-07-27T04:38:36.903Z,1595824716.903 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon3 nan degree
2020-07-27T04:38:49.773Z,1595824729.773 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat4 nan degree
2020-07-27T04:38:49.774Z,1595824729.774 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon4 nan degree
2020-07-27T04:38:49.774Z,1595824729.774 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat5 nan degree
2020-07-27T04:38:49.779Z,1595824729.779 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon5 nan degree
2020-07-27T04:38:49.780Z,1595824729.780 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat6 nan degree
2020-07-27T04:38:49.780Z,1595824729.780 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon6 nan degree
2020-07-27T04:39:03.366Z,1595824743.366 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat7 nan degree
2020-07-27T04:39:03.367Z,1595824743.367 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon7 nan degree
2020-07-27T04:39:03.393Z,1595824743.393 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat8 nan degree
2020-07-27T04:39:03.394Z,1595824743.394 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon8 nan degree
2020-07-27T04:39:03.399Z,1595824743.399 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat9 nan degree
2020-07-27T04:39:03.400Z,1595824743.400 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon9 nan degree
2020-07-27T04:39:17.851Z,1595824757.851 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat10 nan degree
2020-07-27T04:39:17.852Z,1595824757.852 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon10 nan degree
2020-07-27T04:39:17.852Z,1595824757.852 [CommandLine](IMPORTANT): got command set canon_esp_box.Lat11 nan degree
2020-07-27T04:39:17.853Z,1595824757.853 [CommandLine](IMPORTANT): got command set canon_esp_box.Lon11 nan degree
2020-07-27T04:39:17.854Z,1595824757.854 [CommandLine](IMPORTANT): got command set canon_esp_box.Speed 0.650000 meter_per_second
2020-07-27T04:39:17.855Z,1595824757.855 [CommandLine](IMPORTANT): got command set canon_esp_box.YoYoMaxDepth1 50.000000 meter
2020-07-27T04:39:30.073Z,1595824770.073 [CommandLine](IMPORTANT): got command set canon_esp_box.YoYoMaxDepth2 50.000000 meter
2020-07-27T04:39:30.074Z,1595824770.074 [CommandLine](IMPORTANT): got command set canon_esp_box.YoYoMaxDepth3 50.000000 meter
2020-07-27T04:39:30.075Z,1595824770.075 [CommandLine](IMPORTANT): got command set canon_esp_box.YoYoMaxDepth4 50.000000 meter
2020-07-27T04:39:30.076Z,1595824770.076 [CommandLine](IMPORTANT): got command set canon_esp_box.MaxDepth 65.000000 meter
2020-07-27T04:39:30.076Z,1595824770.076 [CommandLine](IMPORTANT): got command run 
2020-07-27T04:39:30.078Z,1595824770.078 [CommandLine](IMPORTANT): Running 
2020-07-27T04:39:30.305Z,1595824770.305 [MissionManager](IMPORTANT): Started mission canon_esp_box
2020-07-27T04:41:58.441Z,1595824918.441 [canon_esp_box:Lap:A](IMPORTANT): Starting Lap
2020-07-27T04:41:58.869Z,1595824918.869 [canon_esp_box:Lap:B](IMPORTANT): Lat[1] = 36.754003 arcdeg Lon[1] = -122.015497 arcdeg 
2020-07-27T04:41:59.246Z,1595824919.246 [canon_esp_box:Lap:C](IMPORTANT): Lat[2] = 36.797002 arcdeg Lon[2] = -121.846996 arcdeg 
2020-07-27T04:41:59.649Z,1595824919.649 [canon_esp_box:Lap:D](IMPORTANT): Lat[3] = nan arcdeg Lon[3] = nan arcdeg 
2020-07-27T04:42:00.057Z,1595824920.057 [canon_esp_box:Lap:E](IMPORTANT): Lat[4] = nan arcdeg Lon[4] = nan arcdeg 
2020-07-27T04:42:00.454Z,1595824920.454 [canon_esp_box:Lap:F](IMPORTANT): Lat[5] = nan arcdeg Lon[5] = nan arcdeg 
2020-07-27T04:42:00.865Z,1595824920.865 [canon_esp_box:Lap:G](IMPORTANT): Lat[6] = nan arcdeg Lon[6] = nan arcdeg 
2020-07-27T04:42:01.267Z,1595824921.267 [canon_esp_box:Lap:H](IMPORTANT): Lat[7] = nan arcdeg Lon[7] = nan arcdeg 
2020-07-27T04:42:01.732Z,1595824921.732 [canon_esp_box:Lap:I](IMPORTANT): Lat[8] = nan arcdeg Lon[8] = nan arcdeg 
2020-07-27T04:42:02.074Z,1595824922.074 [canon_esp_box:Lap:J](IMPORTANT): Lat[9] = nan arcdeg Lon[9] = nan arcdeg 
2020-07-27T04:42:02.474Z,1595824922.474 [canon_esp_box:Lap:K](IMPORTANT): Lat[10] = nan arcdeg Lon[10] = nan arcdeg 
2020-07-27T04:42:02.899Z,1595824922.899 [canon_esp_box:Lap:L](IMPORTANT): Lat[11] = nan arcdeg Lon[11] = nan arcdeg 
2020-07-27T04:42:03.304Z,1595824923.304 [canon_esp_box:Lap:M](IMPORTANT): Lat[12] = nan arcdeg Lon[12] = nan arcdeg 
2020-07-27T04:42:04.111Z,1595824924.111 [canon_esp_box:Lap:Wpt1:A](IMPORTANT): Navigating to box start WP. YoYoMaxDepth: 50.000000 m 
2020-07-27T04:46:55.772Z,1595825215.772 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2020-07-27T05:23:10.257Z,1595827390.257 [canon_esp_box:SampleTimer:SampleESP:B](IMPORTANT): Pre-sample comms. Elapsed time since last ESP sample: 0.750012 h 
2020-07-27T05:30:46.976Z,1595827846.976 [canon_esp_box:SampleTimer:SampleESP:SampleESP:B](IMPORTANT): Sampling ESP cartridge type -6.000000 count 
2020-07-27T05:30:49.068Z,1595827849.068 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2020-07-27T05:30:49.204Z,1595827849.204 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2020-07-27T05:31:26.972Z,1595827886.972 [ESPComponent](IMPORTANT): ESP has connected as client
2020-07-27T05:31:27.782Z,1595827887.782 [ESPComponent](IMPORTANT): [sample #10] Setting cartridge argument to -6
2020-07-27T05:31:27.783Z,1595827887.783 [ESPComponent](IMPORTANT): [sample #10] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2020-07-27T05:31:28.596Z,1595827888.596 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PREPARING_SHOW_LOG
2020-07-27T05:31:28.999Z,1595827888.999 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PREPARING_SHOW_STATUS
2020-07-27T05:31:31.019Z,1595827891.019 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_LOADING_CARTRIDGE
2020-07-27T05:32:03.751Z,1595827923.751 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PRIMING (@12,archive_bac)
2020-07-27T05:32:05.364Z,1595827925.364 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PRIMING (@100.0)
2020-07-27T05:32:06.173Z,1595827926.173 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0)
2020-07-27T05:34:46.168Z,1595828086.168 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_FILTERING (@0.0)
2020-07-27T05:34:46.587Z,1595828086.587 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2020-07-27T06:12:44.078Z,1595830364.078 [BPC1](FAULT): Battery stick #39 (s/n: 00F0) reported TERMINATE_DISCHARGE_ALARM. Status code: 0x4AD0.
2020-07-27T06:13:25.655Z,1595830405.655 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PAUSED (@714.448)
2020-07-27T06:13:26.062Z,1595830406.062 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PROCESSING (@714.448)
2020-07-27T06:13:28.486Z,1595830408.486 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PROCESSED (@12,archive_bac)
2020-07-27T06:25:31.676Z,1595831131.676 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_STOPPING (@12,archive_bac)
2020-07-27T06:25:57.132Z,1595831157.132 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs &
2020-07-27T06:25:57.541Z,1595831157.541 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_STOPPED
2020-07-27T06:30:57.319Z,1595831457.319 [ESPComponent](IMPORTANT): [sample #10] ESP sampling sequence completed normally.
2020-07-27T06:30:57.724Z,1595831457.724 [ESPComponent](IMPORTANT): [sample #10] ESP log summary report (3 messages):
@22:31:40.98 Selecting Cartridge 12
@23:13:23.49 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged
@23:13:23.69 Sampled  714.4ml

2020-07-27T06:33:19.553Z,1595831599.553 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=38448, MT Status=1, MTMSN=2734
2020-07-27T06:33:20.048Z,1595831600.048 [CommandLine](IMPORTANT): got command stop
2020-07-27T06:33:20.406Z,1595831600.406 [MissionManager](IMPORTANT): Started mission Default
2020-07-27T06:33:20.775Z,1595831600.775 [WetLabsBB2FL](FAULT): LCB fault: LCB Watchdog Reset. Invalid Command. Hardware Overcurrent Shutdown. Software Overcurrent.
2020-07-27T06:35:14.975Z,1595831714.975 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=38449, MT Status=1, MTMSN=2735