2020-10-14T04:59:03.861Z,1602651543.861 [CommandLine](IMPORTANT): got command stop 2020-10-14T04:59:03.862Z,1602651543.862 [CommandLine](IMPORTANT): got command restart logs 2020-10-14T04:59:04.512Z,1602651544.512 [MissionManager](IMPORTANT): Started mission Default 2020-10-14T04:59:04.751Z,1602651544.751 [WetLabsBB2FL](FAULT): LCB fault: Software Overcurrent. 2020-10-14T05:00:08.842Z,1602651608.842 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=40402, MT Status=1, MTMSN=2813 2020-10-14T05:00:09.584Z,1602651609.584 [CommandLine](IMPORTANT): got command schedule asap "load Science/canon_esp_trianguloid.xml;set canon_esp_trianguloid.leg 2 count;set canon_esp_trianguloid.Lat1 NaN degree;set canon_esp_trianguloid.Lon1 NaN degree;set canon_esp_trianguloid.Speed 0.75 meter_per_second" 2j1kx 1 2.000000 2020-10-14T05:00:09.584Z,1602651609.584 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=2j1kx 2020-10-14T05:00:09.585Z,1602651609.585 [CommandLine](IMPORTANT): Scheduled #25 (#1 of 2 with id='2j1kx'): "load Science/canon_esp_trianguloid.xml;set canon_esp_trianguloid.leg 2 count;set canon_esp_trianguloid.Lat1 NaN degree;set canon_esp_trianguloid.Lon1 NaN degree;set canon_esp_trianguloid.Speed 0.75 meter_per_second" ASAP 2020-10-14T05:00:30.056Z,1602651630.056 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=40403, MT Status=1, MTMSN=2814 2020-10-14T05:00:30.723Z,1602651630.723 [CommandLine](IMPORTANT): got command schedule asap "set canon_esp_trianguloid.YoYoMinDepth 3 meter;set canon_esp_trianguloid.YoYoMaxDepth1 50 meter;set canon_esp_trianguloid.MaxDepth 62 meter;run" 2j1kx 2 2.000000 2020-10-14T05:00:30.723Z,1602651630.723 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=2j1kx 2020-10-14T05:00:30.724Z,1602651630.724 [CommandLine](IMPORTANT): Scheduled #26 (#2 of 2 with id='2j1kx'): "set canon_esp_trianguloid.YoYoMinDepth 3 meter;set canon_esp_trianguloid.YoYoMaxDepth1 50 meter;set canon_esp_trianguloid.MaxDepth 62 meter;run" ASAP 2020-10-14T05:00:30.916Z,1602651630.916 [CommandLine](IMPORTANT): got command load ./Missions/Science/canon_esp_trianguloid.xml 2020-10-14T05:00:33.012Z,1602651633.012 [CommandLine](IMPORTANT): Loaded ./Missions/Science/canon_esp_trianguloid.xml 2020-10-14T05:00:47.314Z,1602651647.314 [CommandLine](IMPORTANT): got command set canon_esp_trianguloid.leg 2.000000 count 2020-10-14T05:00:47.314Z,1602651647.314 [CommandLine](IMPORTANT): got command set canon_esp_trianguloid.Lat1 nan degree 2020-10-14T05:00:47.315Z,1602651647.315 [CommandLine](IMPORTANT): got command set canon_esp_trianguloid.Lon1 nan degree 2020-10-14T05:00:47.316Z,1602651647.316 [CommandLine](IMPORTANT): got command set canon_esp_trianguloid.Speed 0.750000 meter_per_second 2020-10-14T05:01:00.795Z,1602651660.795 [CommandLine](IMPORTANT): got command set canon_esp_trianguloid.YoYoMinDepth 3.000000 meter 2020-10-14T05:01:00.796Z,1602651660.796 [CommandLine](IMPORTANT): got command set canon_esp_trianguloid.YoYoMaxDepth1 50.000000 meter 2020-10-14T05:01:00.797Z,1602651660.797 [CommandLine](IMPORTANT): got command set canon_esp_trianguloid.MaxDepth 62.000000 meter 2020-10-14T05:01:00.797Z,1602651660.797 [CommandLine](IMPORTANT): got command run 2020-10-14T05:01:00.850Z,1602651660.850 [CommandLine](IMPORTANT): Running 2020-10-14T05:01:00.901Z,1602651660.901 [MissionManager](IMPORTANT): Started mission canon_esp_trianguloid 2020-10-14T05:22:13.618Z,1602652933.618 [canon_esp_trianguloid:Lap:A](IMPORTANT): Starting Lap 2020-10-14T05:22:14.028Z,1602652934.028 [canon_esp_trianguloid:Lap:B](IMPORTANT): Lat[1] = nan arcdeg Lon[1] = nan arcdeg 2020-10-14T05:22:14.436Z,1602652934.436 [canon_esp_trianguloid:Lap:C](IMPORTANT): Lat[2] = 36.754000 arcdeg Lon[2] = -122.015500 arcdeg 2020-10-14T05:22:14.836Z,1602652934.836 [canon_esp_trianguloid:Lap:D](IMPORTANT): Lat[3] = 36.782500 arcdeg Lon[3] = -122.018000 arcdeg 2020-10-14T05:22:15.242Z,1602652935.242 [canon_esp_trianguloid:Lap:E](IMPORTANT): Lat[4] = 36.711700 arcdeg Lon[4] = -122.191900 arcdeg 2020-10-14T05:22:15.645Z,1602652935.645 [canon_esp_trianguloid:Lap:F](IMPORTANT): Lat[5] = 36.697800 arcdeg Lon[5] = -122.056200 arcdeg 2020-10-14T05:22:16.063Z,1602652936.063 [canon_esp_trianguloid:Lap:G](IMPORTANT): Lat[6] = 36.754000 arcdeg Lon[6] = -122.015500 arcdeg 2020-10-14T05:22:16.447Z,1602652936.447 [canon_esp_trianguloid:Lap:H](IMPORTANT): Lat[7] = 36.797000 arcdeg Lon[7] = -121.847000 arcdeg 2020-10-14T05:22:16.858Z,1602652936.858 [canon_esp_trianguloid:Lap:I](IMPORTANT): Lat[8] = nan arcdeg Lon[8] = nan arcdeg 2020-10-14T05:22:17.659Z,1602652937.659 [canon_esp_trianguloid:Lap:Wpt1:A](IMPORTANT): Navigating to box start WP. YoYoMaxDepth: 50.000000 m 2020-10-14T05:22:18.078Z,1602652938.078 [canon_esp_trianguloid:SampleTimer:AcquireSample:B](IMPORTANT): Pre-sample comms. Elapsed time since last ESP sample: 0.362830 h 2020-10-14T05:22:21.334Z,1602652941.334 [canon_esp_trianguloid:Lap:Wpt2:A](IMPORTANT): Navigating to WP2. YoYoMaxDepth: 50.000000 m 2020-10-14T05:24:07.224Z,1602653047.224 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:SelectESPCartridge:A](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 2020-10-14T05:24:18.993Z,1602653058.993 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-10-14T05:24:19.309Z,1602653059.309 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-10-14T05:24:57.834Z,1602653097.834 [ESPComponent](IMPORTANT): ESP has connected as client 2020-10-14T05:24:58.645Z,1602653098.645 [ESPComponent](IMPORTANT): [sample #12] Setting cartridge argument to -6 2020-10-14T05:24:58.646Z,1602653098.646 [ESPComponent](IMPORTANT): [sample #12] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-10-14T05:24:59.125Z,1602653099.125 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:C](IMPORTANT): ESP sampling at 14.143001 m in 13.405207 degC water with 3.299600 ug/l chlorophyll fluorescence. 2020-10-14T05:24:59.450Z,1602653099.450 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PREPARING_SHOW_LOG 2020-10-14T05:24:59.853Z,1602653099.853 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-10-14T05:25:01.873Z,1602653101.873 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_LOADING_CARTRIDGE 2020-10-14T05:25:35.002Z,1602653135.002 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PRIMING (@18,archive_bac) 2020-10-14T05:25:36.618Z,1602653136.618 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PRIMING (@100.0) 2020-10-14T05:25:37.425Z,1602653137.425 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-10-14T05:28:03.709Z,1602653283.709 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2020-10-14T05:28:05.698Z,1602653285.698 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_FILTERING (@0.0) 2020-10-14T05:28:06.102Z,1602653286.102 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-10-14T05:53:11.109Z,1602654791.109 [canon_esp_trianguloid:Lap:Wpt2:C.Waypoint](IMPORTANT): Reached Waypoint: 36.754000,-122.015500 2020-10-14T05:53:11.513Z,1602654791.513 [canon_esp_trianguloid:Lap:Wpt3:A](IMPORTANT): Navigating to WP3. YoYoMaxDepth: 50.000000 m 2020-10-14T06:23:30.766Z,1602656610.766 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PAUSED (@1000.0) 2020-10-14T06:23:31.170Z,1602656611.170 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PROCESSING (@1000.0) 2020-10-14T06:23:33.595Z,1602656613.595 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PROCESSED (@18,archive_bac) 2020-10-14T06:35:37.194Z,1602657337.194 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_STOPPING (@18,archive_bac) 2020-10-14T06:36:02.646Z,1602657362.646 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-10-14T06:36:03.050Z,1602657363.050 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_STOPPED 2020-10-14T06:41:02.838Z,1602657662.838 [ESPComponent](IMPORTANT): [sample #12] ESP sampling sequence completed normally. 2020-10-14T06:41:03.247Z,1602657663.247 [ESPComponent](IMPORTANT): [sample #12] ESP log summary report (2 messages): @22:25:11.85 Selecting Cartridge 18 @23:23:28.94 Sampled 1000.0ml 2020-10-14T06:44:36.657Z,1602657876.657 [NAL9602](FAULT): received: +CSQ:0 OK416, 2, 0, 0, 0 OK 2020-10-14T06:49:14.550Z,1602658154.550 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2020-10-14T07:23:03.133Z,1602660183.133 [canon_esp_trianguloid:SampleTimer:AcquireSample:B](IMPORTANT): Pre-sample comms. Elapsed time since last ESP sample: 2.000055 h 2020-10-14T07:28:40.474Z,1602660520.474 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2020-10-14T07:34:54.024Z,1602660894.024 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:SelectESPCartridge:A](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 2020-10-14T07:35:05.801Z,1602660905.801 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-10-14T07:35:06.106Z,1602660906.106 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-10-14T07:35:44.600Z,1602660944.600 [ESPComponent](IMPORTANT): ESP has connected as client 2020-10-14T07:35:45.409Z,1602660945.409 [ESPComponent](IMPORTANT): [sample #13] Setting cartridge argument to -6 2020-10-14T07:35:45.410Z,1602660945.410 [ESPComponent](IMPORTANT): [sample #13] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-10-14T07:35:45.858Z,1602660945.858 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:C](IMPORTANT): ESP sampling at 9.958920 m in 12.682093 degC water with 1.457700 ug/l chlorophyll fluorescence. 2020-10-14T07:35:46.213Z,1602660946.213 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PREPARING_SHOW_LOG 2020-10-14T07:35:46.622Z,1602660946.622 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-10-14T07:35:48.637Z,1602660948.637 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_LOADING_CARTRIDGE 2020-10-14T07:36:21.770Z,1602660981.770 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_PRIMING (@17,archive_bac) 2020-10-14T07:36:23.382Z,1602660983.382 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PRIMING (@100.0) 2020-10-14T07:36:24.189Z,1602660984.189 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-10-14T07:38:52.063Z,1602661132.063 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_FILTERING (@0.0) 2020-10-14T07:38:52.466Z,1602661132.466 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-10-14T07:47:12.275Z,1602661632.275 [canon_esp_trianguloid:Lap:Wpt3:C.Waypoint](IMPORTANT): Reached Waypoint: 36.782500,-122.018000 2020-10-14T07:47:12.679Z,1602661632.679 [canon_esp_trianguloid:Lap:Wpt4:A](IMPORTANT): Navigating to WP4. YoYoMaxDepth: 50.000000 m 2020-10-14T08:31:46.637Z,1602664306.637 [CBIT](IMPORTANT): Beginning ground fault scan 2020-10-14T08:31:57.858Z,1602664317.858 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.005651 CHAN A1 (24V): 0.003231 CHAN A2 (12V): -0.004136 CHAN A3 (5V): -0.002410 CHAN B0 (3.3V): -0.001054 CHAN B1 (3.15aV): -0.000931 CHAN B2 (3.15bV): -0.000852 CHAN B3 (GND): -0.000045 OPEN: 0.007616 Full Scale Calc: 4.765 mA, -1.589 mA 2020-10-14T08:32:42.610Z,1602664362.610 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PAUSED (@1000.001) 2020-10-14T08:32:43.014Z,1602664363.014 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PROCESSING (@1000.001) 2020-10-14T08:32:45.438Z,1602664365.438 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_PROCESSED (@17,archive_bac) 2020-10-14T08:44:49.057Z,1602665089.057 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_STOPPING (@17,archive_bac) 2020-10-14T08:45:14.511Z,1602665114.511 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-10-14T08:45:14.916Z,1602665114.916 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_STOPPED 2020-10-14T08:50:14.696Z,1602665414.696 [ESPComponent](IMPORTANT): [sample #13] ESP sampling sequence completed normally. 2020-10-14T08:50:15.098Z,1602665415.098 [ESPComponent](IMPORTANT): [sample #13] ESP log summary report (2 messages): @00:35:58.45 Selecting Cartridge 17 @01:32:40.88 Sampled 1000.0ml 2020-10-14T09:34:05.463Z,1602668045.463 [canon_esp_trianguloid:SampleTimer:AcquireSample:B](IMPORTANT): Pre-sample comms. Elapsed time since last ESP sample: 2.000078 h 2020-10-14T09:45:12.205Z,1602668712.205 [BuoyancyServo](FAULT): Buoyancy getPosition uart error.serial timeout 2020-10-14T09:45:14.543Z,1602668714.543 [BuoyancyServo](FAULT): LCB fault: LCB Watchdog Reset. Invalid Command. Software Overcurrent. Current Limiter Activated. 2020-10-14T09:46:39.368Z,1602668799.368 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:SelectESPCartridge:A](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 2020-10-14T09:46:51.157Z,1602668811.157 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-10-14T09:46:51.278Z,1602668811.278 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-10-14T09:49:21.337Z,1602668961.337 [ESPComponent](FAULT): Timeout while waiting for ESP to connect (elapsed=150.0599) 2020-10-14T09:49:33.162Z,1602668973.162 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-10-14T09:49:33.298Z,1602668973.298 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-10-14T09:50:11.437Z,1602669011.437 [ESPComponent](IMPORTANT): ESP has connected as client 2020-10-14T09:50:12.249Z,1602669012.249 [ESPComponent](IMPORTANT): [sample #14] Setting cartridge argument to -6 2020-10-14T09:50:12.249Z,1602669012.249 [ESPComponent](IMPORTANT): [sample #14] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-10-14T09:50:12.696Z,1602669012.696 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:C](IMPORTANT): ESP sampling at 45.608124 m in 11.175013 degC water with 0.305100 ug/l chlorophyll fluorescence. 2020-10-14T09:50:13.055Z,1602669013.055 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PREPARING_SHOW_LOG 2020-10-14T09:50:13.458Z,1602669013.458 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-10-14T09:50:15.477Z,1602669015.477 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_LOADING_CARTRIDGE 2020-10-14T09:50:48.609Z,1602669048.609 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_WAITING_FOR_PRIMING (@16,archive_bac) 2020-10-14T09:50:50.225Z,1602669050.225 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PRIMING (@100.0) 2020-10-14T09:50:51.842Z,1602669051.842 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-10-14T09:53:26.978Z,1602669206.978 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_FILTERING (@0.0) 2020-10-14T09:53:27.382Z,1602669207.382 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-10-14T10:56:13.269Z,1602672973.269 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PAUSED (@1000.0) 2020-10-14T10:56:13.670Z,1602672973.670 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PROCESSING (@1000.0) 2020-10-14T10:56:16.093Z,1602672976.093 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_WAITING_FOR_PROCESSED (@16,archive_bac) 2020-10-14T11:08:19.693Z,1602673699.693 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_STOPPING (@16,archive_bac) 2020-10-14T11:08:45.146Z,1602673725.146 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-10-14T11:08:45.558Z,1602673725.558 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_STOPPED 2020-10-14T11:13:45.330Z,1602674025.330 [ESPComponent](IMPORTANT): [sample #14] ESP sampling sequence completed normally. 2020-10-14T11:13:45.734Z,1602674025.734 [ESPComponent](IMPORTANT): [sample #14] ESP log summary report (2 messages): @02:50:25.04 Selecting Cartridge 16 @03:56:11.44 Sampled 1000.0ml 2020-10-14T11:44:22.043Z,1602675862.043 [canon_esp_trianguloid:SampleTimer:AcquireSample:B](IMPORTANT): Pre-sample comms. Elapsed time since last ESP sample: 2.000112 h 2020-10-14T11:50:29.591Z,1602676229.591 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:SelectESPCartridge:A](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 2020-10-14T11:50:41.386Z,1602676241.386 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-10-14T11:50:41.521Z,1602676241.521 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-10-14T11:51:20.869Z,1602676280.869 [ESPComponent](IMPORTANT): ESP has connected as client 2020-10-14T11:51:21.682Z,1602676281.682 [ESPComponent](IMPORTANT): [sample #15] Setting cartridge argument to -6 2020-10-14T11:51:21.683Z,1602676281.683 [ESPComponent](IMPORTANT): [sample #15] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-10-14T11:51:22.126Z,1602676282.126 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:C](IMPORTANT): ESP sampling at 10.505962 m in 13.628412 degC water with 3.751600 ug/l chlorophyll fluorescence. 2020-10-14T11:51:22.485Z,1602676282.485 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_PREPARING_SHOW_LOG 2020-10-14T11:51:22.889Z,1602676282.889 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-10-14T11:51:24.911Z,1602676284.911 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_LOADING_CARTRIDGE 2020-10-14T11:51:58.040Z,1602676318.040 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_WAITING_FOR_PRIMING (@15,archive_bac) 2020-10-14T11:51:59.654Z,1602676319.654 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_PRIMING (@100.0) 2020-10-14T11:52:01.269Z,1602676321.269 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-10-14T11:54:29.542Z,1602676469.542 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_FILTERING (@0.0) 2020-10-14T11:54:29.945Z,1602676469.945 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-10-14T12:51:48.930Z,1602679908.930 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_PAUSED (@951.485) 2020-10-14T12:51:49.334Z,1602679909.334 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_PROCESSING (@951.485) 2020-10-14T12:51:51.761Z,1602679911.761 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_WAITING_FOR_PROCESSED (@15,archive_bac) 2020-10-14T13:03:54.970Z,1602680634.970 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_STOPPING (@15,archive_bac) 2020-10-14T13:04:20.430Z,1602680660.430 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-10-14T13:04:20.835Z,1602680660.835 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_STOPPED 2020-10-14T13:09:20.617Z,1602680960.617 [ESPComponent](IMPORTANT): [sample #15] ESP sampling sequence completed normally. 2020-10-14T13:09:21.022Z,1602680961.022 [ESPComponent](IMPORTANT): [sample #15] ESP log summary report (3 messages): @04:51:35.15 Selecting Cartridge 15 @05:51:46.36 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @05:51:46.57 Sampled 951.5ml 2020-10-14T13:16:16.362Z,1602681376.362 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2020-10-14T13:49:45.677Z,1602683385.677 [canon_esp_trianguloid:SampleTimer:AcquireSample:B](IMPORTANT): Pre-sample comms. Elapsed time since last ESP sample: 2.000015 h 2020-10-14T13:52:36.523Z,1602683556.523 [BPC1](FAULT): Failed to receive data from 2 sticks prior to timeout. Missing stick IDs are: 38, 39. 2020-10-14T13:52:56.381Z,1602683576.381 [NAL9602](FAULT): received: +CSQ:0 OK434, 2, 0, 0, 0 OK 2020-10-14T13:52:57.114Z,1602683577.114 [NAL9602](FAULT): LCB fault: Invalid Command. Hardware Overcurrent Shutdown. Current Limiter Activated. 2020-10-14T13:57:54.092Z,1602683874.092 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:SelectESPCartridge:A](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 2020-10-14T13:58:05.881Z,1602683885.881 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-10-14T13:58:05.994Z,1602683885.994 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-10-14T13:58:44.601Z,1602683924.601 [ESPComponent](IMPORTANT): ESP has connected as client 2020-10-14T13:58:45.412Z,1602683925.412 [ESPComponent](IMPORTANT): [sample #16] Setting cartridge argument to -6 2020-10-14T13:58:45.413Z,1602683925.413 [ESPComponent](IMPORTANT): [sample #16] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-10-14T13:58:45.868Z,1602683925.868 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:C](IMPORTANT): ESP sampling at 10.268141 m in 13.014612 degC water with 4.870300 ug/l chlorophyll fluorescence. 2020-10-14T13:58:46.217Z,1602683926.217 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_PREPARING_SHOW_LOG 2020-10-14T13:58:46.622Z,1602683926.622 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-10-14T13:58:48.645Z,1602683928.645 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_LOADING_CARTRIDGE 2020-10-14T13:59:21.773Z,1602683961.773 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_WAITING_FOR_PRIMING (@14,archive_bac) 2020-10-14T13:59:23.390Z,1602683963.390 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_PRIMING (@100.0) 2020-10-14T13:59:24.198Z,1602683964.198 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-10-14T14:01:53.273Z,1602684113.273 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_FILTERING (@0.0) 2020-10-14T14:01:53.678Z,1602684113.678 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-10-14T14:31:58.121Z,1602685918.121 [CBIT](IMPORTANT): Beginning ground fault scan 2020-10-14T14:32:09.040Z,1602685929.040 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.005542 CHAN A1 (24V): 0.002637 CHAN A2 (12V): -0.004164 CHAN A3 (5V): -0.002116 CHAN B0 (3.3V): -0.000780 CHAN B1 (3.15aV): -0.001005 CHAN B2 (3.15bV): -0.001025 CHAN B3 (GND): -0.000271 OPEN: 0.007575 Full Scale Calc: 4.765 mA, -1.589 mA 2020-10-14T14:58:21.762Z,1602687501.762 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_PAUSED (@1000.0) 2020-10-14T14:58:22.166Z,1602687502.166 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_PROCESSING (@1000.0) 2020-10-14T14:58:24.590Z,1602687504.590 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_WAITING_FOR_PROCESSED (@14,archive_bac) 2020-10-14T15:10:28.181Z,1602688228.181 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_STOPPING (@14,archive_bac) 2020-10-14T15:10:53.634Z,1602688253.634 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-10-14T15:10:54.038Z,1602688254.038 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_STOPPED 2020-10-14T15:15:53.821Z,1602688553.821 [ESPComponent](IMPORTANT): [sample #16] ESP sampling sequence completed normally. 2020-10-14T15:15:54.225Z,1602688554.225 [ESPComponent](IMPORTANT): [sample #16] ESP log summary report (2 messages): @06:58:58.47 Selecting Cartridge 14 @07:58:20.01 Sampled 1000.0ml 2020-10-14T15:19:22.719Z,1602688762.719 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=40442, MT Status=1, MTMSN=2815 2020-10-14T15:19:23.313Z,1602688763.313 [CommandLine](IMPORTANT): got command stop 2020-10-14T15:19:23.973Z,1602688763.973 [MissionManager](IMPORTANT): Started mission Default 2020-10-14T15:19:24.349Z,1602688764.349 [WetLabsBB2FL](FAULT): LCB fault: Software Overcurrent. 2020-10-14T15:35:46.223Z,1602689746.223 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 16.364028 min 2020-10-14T15:42:57.771Z,1602690177.771 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=40458, MT Status=1, MTMSN=2816 2020-10-14T15:42:58.558Z,1602690178.558 [CommandLine](IMPORTANT): got command schedule asap "load Science/sci2.xml;set sci2.MissionTimeout 3 hour;set sci2.NeedCommsTime 30 minute;set sci2.Lat1 36.7128 degree;set sci2.Lon1 -122.186 degree;set sci2.Lat2 nan degree;set sci2.Lon2 nan degree;set sci2.Speed 0.75 meter_per_second" 2jy58 1 2.000000 2020-10-14T15:42:58.558Z,1602690178.558 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=2jy58 2020-10-14T15:42:58.559Z,1602690178.559 [CommandLine](IMPORTANT): Scheduled #27 (#1 of 2 with id='2jy58'): "load Science/sci2.xml;set sci2.MissionTimeout 3 hour;set sci2.NeedCommsTime 30 minute;set sci2.Lat1 36.7128 degree;set sci2.Lon1 -122.186 degree;set sci2.Lat2 nan degree;set sci2.Lon2 nan degree;set sci2.Speed 0.75 meter_per_second" ASAP 2020-10-14T15:44:47.588Z,1602690287.588 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=40459, MT Status=1, MTMSN=2817 2020-10-14T15:44:48.286Z,1602690288.286 [CommandLine](IMPORTANT): got command schedule asap "set sci2.YoYoMinDepth 3 meter;set sci2.YoYoMaxDepth 50 meter;set sci2.MaxDepth 55 meter;run" 2jy58 2 2.000000 2020-10-14T15:44:48.286Z,1602690288.286 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=2jy58 2020-10-14T15:44:48.287Z,1602690288.287 [CommandLine](IMPORTANT): Scheduled #28 (#2 of 2 with id='2jy58'): "set sci2.YoYoMinDepth 3 meter;set sci2.YoYoMaxDepth 50 meter;set sci2.MaxDepth 55 meter;run" ASAP 2020-10-14T15:44:48.482Z,1602690288.482 [CommandLine](IMPORTANT): got command load ./Missions/Science/sci2.xml 2020-10-14T15:44:49.826Z,1602690289.826 [CommandLine](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2020-10-14T15:45:01.897Z,1602690301.897 [CommandLine](IMPORTANT): got command set sci2.MissionTimeout 3.000000 hour 2020-10-14T15:45:01.898Z,1602690301.898 [CommandLine](IMPORTANT): got command set sci2.NeedCommsTime 30.000000 minute 2020-10-14T15:45:01.899Z,1602690301.899 [CommandLine](IMPORTANT): got command set sci2.Lat1 36.712799 degree 2020-10-14T15:45:01.900Z,1602690301.900 [CommandLine](IMPORTANT): got command set sci2.Lon1 -122.185997 degree 2020-10-14T15:45:01.900Z,1602690301.900 [CommandLine](IMPORTANT): got command set sci2.Lat2 nan degree 2020-10-14T15:45:01.901Z,1602690301.901 [CommandLine](IMPORTANT): got command set sci2.Lon2 nan degree 2020-10-14T15:45:01.902Z,1602690301.902 [CommandLine](IMPORTANT): got command set sci2.Speed 0.750000 meter_per_second 2020-10-14T15:45:07.030Z,1602690307.030 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=40460, MT Status=1, MTMSN=2818 2020-10-14T15:45:08.397Z,1602690308.397 [CommandLine](IMPORTANT): got command set sci2.YoYoMinDepth 3.000000 meter 2020-10-14T15:45:08.398Z,1602690308.398 [CommandLine](IMPORTANT): got command set sci2.YoYoMaxDepth 50.000000 meter 2020-10-14T15:45:08.399Z,1602690308.399 [CommandLine](IMPORTANT): got command set sci2.MaxDepth 55.000000 meter 2020-10-14T15:45:08.399Z,1602690308.399 [CommandLine](IMPORTANT): got command run 2020-10-14T15:45:08.402Z,1602690308.402 [CommandLine](IMPORTANT): Running 2020-10-14T15:45:08.417Z,1602690308.417 [CommandLine](IMPORTANT): got command stop 2020-10-14T15:45:08.445Z,1602690308.445 [MissionManager](IMPORTANT): Started mission sci2 2020-10-14T15:45:08.674Z,1602690308.674 [MissionManager](IMPORTANT): Started mission Default 2020-10-14T15:45:50.676Z,1602690350.676 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=40461, MT Status=1, MTMSN=2819 2020-10-14T15:45:51.273Z,1602690351.273 [CommandLine](IMPORTANT): got command schedule clear 2020-10-14T15:45:51.273Z,1602690351.273 [CommandLine](IMPORTANT): #Cleared scheduled commands:0 2020-10-14T15:45:51.273Z,1602690351.273 [CommandLine](IMPORTANT): got command schedule resume 2020-10-14T15:45:51.273Z,1602690351.273 [CommandLine](IMPORTANT): Scheduling is resumed 2020-10-14T15:48:21.498Z,1602690501.498 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=40465, MT Status=1, MTMSN=2820 2020-10-14T15:48:22.310Z,1602690502.310 [CommandLine](IMPORTANT): got command schedule asap "load Science/sci2.xml;set sci2.MissionTimeout 3 hour;set sci2.NeedCommsTime 30 minute;set sci2.Lat1 36.7128 degree;set sci2.Lon1 -122.186 degree;set sci2.Lat2 nan degree;set sci2.Lon2 nan degree;set sci2.Speed 0.75 meter_per_second" 2jyh5 1 2.000000 2020-10-14T15:48:22.310Z,1602690502.310 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=2jyh5 2020-10-14T15:48:22.311Z,1602690502.311 [CommandLine](IMPORTANT): Scheduled #29 (#1 of 2 with id='2jyh5'): "load Science/sci2.xml;set sci2.MissionTimeout 3 hour;set sci2.NeedCommsTime 30 minute;set sci2.Lat1 36.7128 degree;set sci2.Lon1 -122.186 degree;set sci2.Lat2 nan degree;set sci2.Lon2 nan degree;set sci2.Speed 0.75 meter_per_second" ASAP 2020-10-14T15:48:43.122Z,1602690523.122 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=40466, MT Status=1, MTMSN=2821 2020-10-14T15:48:43.738Z,1602690523.738 [CommandLine](IMPORTANT): got command schedule asap "set sci2.YoYoMinDepth 3 meter;set sci2.YoYoMaxDepth 50 meter;set sci2.MaxDepth 55 meter;run" 2jyh5 2 2.000000 2020-10-14T15:48:43.738Z,1602690523.738 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=2jyh5 2020-10-14T15:48:43.739Z,1602690523.739 [CommandLine](IMPORTANT): Scheduled #30 (#2 of 2 with id='2jyh5'): "set sci2.YoYoMinDepth 3 meter;set sci2.YoYoMaxDepth 50 meter;set sci2.MaxDepth 55 meter;run" ASAP 2020-10-14T15:48:43.943Z,1602690523.943 [CommandLine](IMPORTANT): got command load ./Missions/Science/sci2.xml 2020-10-14T15:48:45.316Z,1602690525.316 [CommandLine](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2020-10-14T15:48:57.612Z,1602690537.612 [CommandLine](IMPORTANT): got command set sci2.MissionTimeout 3.000000 hour 2020-10-14T15:48:57.613Z,1602690537.613 [CommandLine](IMPORTANT): got command set sci2.NeedCommsTime 30.000000 minute 2020-10-14T15:48:57.614Z,1602690537.614 [CommandLine](IMPORTANT): got command set sci2.Lat1 36.712799 degree 2020-10-14T15:48:57.615Z,1602690537.615 [CommandLine](IMPORTANT): got command set sci2.Lon1 -122.185997 degree 2020-10-14T15:48:57.615Z,1602690537.615 [CommandLine](IMPORTANT): got command set sci2.Lat2 nan degree 2020-10-14T15:48:57.616Z,1602690537.616 [CommandLine](IMPORTANT): got command set sci2.Lon2 nan degree 2020-10-14T15:48:57.616Z,1602690537.616 [CommandLine](IMPORTANT): got command set sci2.Speed 0.750000 meter_per_second 2020-10-14T15:49:04.451Z,1602690544.451 [CommandLine](IMPORTANT): got command set sci2.YoYoMinDepth 3.000000 meter 2020-10-14T15:49:04.452Z,1602690544.452 [CommandLine](IMPORTANT): got command set sci2.YoYoMaxDepth 50.000000 meter 2020-10-14T15:49:04.453Z,1602690544.453 [CommandLine](IMPORTANT): got command set sci2.MaxDepth 55.000000 meter 2020-10-14T15:49:04.453Z,1602690544.453 [CommandLine](IMPORTANT): got command run 2020-10-14T15:49:04.455Z,1602690544.455 [CommandLine](IMPORTANT): Running 2020-10-14T15:49:05.436Z,1602690545.436 [MissionManager](IMPORTANT): Started mission sci2 2020-10-14T17:01:20.916Z,1602694880.916 [sci2:Lap:Wpt1:A.Waypoint](IMPORTANT): Reached Waypoint: 36.712800,-122.185992 2020-10-14T17:13:08.433Z,1602695588.433 [MissionManager](IMPORTANT): Started mission Default 2020-10-14T17:21:08.348Z,1602696068.348 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 7.991796 min 2020-10-14T17:22:56.543Z,1602696176.543 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=40495, MT Status=1, MTMSN=2822 2020-10-14T17:22:57.291Z,1602696177.291 [CommandLine](IMPORTANT): got command schedule asap "load Science/profile_station.xml;set profile_station.MissionTimeout 1 hour;set profile_station.NeedCommsTime 30 minute;set profile_station.Lat 36.7117 degree;set profile_station.Lon -122.1919 degree" 2k2xq 1 2.000000 2020-10-14T17:22:57.292Z,1602696177.292 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=2k2xq 2020-10-14T17:22:57.293Z,1602696177.293 [CommandLine](IMPORTANT): Scheduled #31 (#1 of 2 with id='2k2xq'): "load Science/profile_station.xml;set profile_station.MissionTimeout 1 hour;set profile_station.NeedCommsTime 30 minute;set profile_station.Lat 36.7117 degree;set profile_station.Lon -122.1919 degree" ASAP 2020-10-14T17:25:22.414Z,1602696322.414 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=40496, MT Status=1, MTMSN=2823 2020-10-14T17:25:23.166Z,1602696323.166 [CommandLine](IMPORTANT): got command schedule asap "set profile_station.Radius 200 meter;set profile_station.YoYoMinDepth 3 meter;set profile_station.YoYoMaxDepth 50 meter;set profile_station.Speed 0.75 meter_per_second;run" 2k2xq 2 2.000000 2020-10-14T17:25:23.166Z,1602696323.166 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=2k2xq 2020-10-14T17:25:23.167Z,1602696323.167 [CommandLine](IMPORTANT): Scheduled #32 (#2 of 2 with id='2k2xq'): "set profile_station.Radius 200 meter;set profile_station.YoYoMinDepth 3 meter;set profile_station.YoYoMaxDepth 50 meter;set profile_station.Speed 0.75 meter_per_second;run" ASAP 2020-10-14T17:25:23.393Z,1602696323.393 [CommandLine](IMPORTANT): got command load ./Missions/Science/profile_station.xml 2020-10-14T17:25:25.088Z,1602696325.088 [CommandLine](IMPORTANT): Loaded ./Missions/Science/profile_station.xml 2020-10-14T17:25:38.476Z,1602696338.476 [CommandLine](IMPORTANT): got command set profile_station.MissionTimeout 1.000000 hour 2020-10-14T17:25:38.477Z,1602696338.477 [CommandLine](IMPORTANT): got command set profile_station.NeedCommsTime 30.000000 minute 2020-10-14T17:25:38.478Z,1602696338.478 [CommandLine](IMPORTANT): got command set profile_station.Lat 36.711700 degree 2020-10-14T17:25:38.479Z,1602696338.479 [CommandLine](IMPORTANT): got command set profile_station.Lon -122.191902 degree 2020-10-14T17:25:52.167Z,1602696352.167 [CommandLine](IMPORTANT): got command set profile_station.Radius 200.000000 meter 2020-10-14T17:25:52.168Z,1602696352.168 [CommandLine](IMPORTANT): got command set profile_station.YoYoMinDepth 3.000000 meter 2020-10-14T17:25:52.181Z,1602696352.181 [CommandLine](IMPORTANT): got command set profile_station.YoYoMaxDepth 50.000000 meter 2020-10-14T17:25:52.182Z,1602696352.182 [CommandLine](IMPORTANT): got command set profile_station.Speed 0.750000 meter_per_second 2020-10-14T17:25:52.182Z,1602696352.182 [CommandLine](IMPORTANT): got command run 2020-10-14T17:25:52.185Z,1602696352.185 [CommandLine](IMPORTANT): Running 2020-10-14T17:25:52.459Z,1602696352.459 [MissionManager](IMPORTANT): Started mission profile_station 2020-10-14T17:27:25.521Z,1602696445.521 [BuoyancyServo](FAULT): Buoyancy getPosition uart error.serial timeout 2020-10-14T18:25:52.861Z,1602699952.861 [MissionManager](IMPORTANT): Started mission Default 2020-10-14T18:32:42.062Z,1602700362.062 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 6.813100 min 2020-10-14T18:39:11.090Z,1602700751.090 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 13.297405 min 2020-10-14T18:44:49.934Z,1602701089.934 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 18.944499 min 2020-10-14T18:51:49.475Z,1602701509.475 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 25.936749 min 2020-10-14T18:53:29.178Z,1602701609.178 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=40526, MT Status=1, MTMSN=2824 2020-10-14T18:53:29.934Z,1602701609.934 [CommandLine](IMPORTANT): got command schedule asap "load Science/isotherm_depth_canon.xml;set IsothermDepthCANON.NumSamplers 2 count;set IsothermDepthCANON.MissionTimeout 4 hour;set IsothermDepthCANON.InitialDiveDuration 2 minute" 2k70m 1 4.000000 2020-10-14T18:53:29.934Z,1602701609.934 [CommandLine](IMPORTANT): Scheduling command #1 of 4 with id=2k70m 2020-10-14T18:53:29.935Z,1602701609.935 [CommandLine](IMPORTANT): Scheduled #33 (#1 of 4 with id='2k70m'): "load Science/isotherm_depth_canon.xml;set IsothermDepthCANON.NumSamplers 2 count;set IsothermDepthCANON.MissionTimeout 4 hour;set IsothermDepthCANON.InitialDiveDuration 2 minute" ASAP 2020-10-14T18:53:46.882Z,1602701626.882 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=40527, MT Status=1, MTMSN=2825 2020-10-14T18:53:47.635Z,1602701627.635 [CommandLine](IMPORTANT): got command schedule asap "set IsothermDepthCANON.SpeedSampling 0 meter_per_second;set IsothermDepthCANON.MaxDepth 60 meter;set IsothermDepthCANON.DeepBoundESP 58 meter;set IsothermDepthCANON.ShallowBoundChl 3 meter" 2k70m 2 4.000000 2020-10-14T18:53:47.635Z,1602701627.635 [CommandLine](IMPORTANT): Scheduling command #2 of 4 with id=2k70m 2020-10-14T18:53:47.636Z,1602701627.636 [CommandLine](IMPORTANT): Scheduled #34 (#2 of 4 with id='2k70m'): "set IsothermDepthCANON.SpeedSampling 0 meter_per_second;set IsothermDepthCANON.MaxDepth 60 meter;set IsothermDepthCANON.DeepBoundESP 58 meter;set IsothermDepthCANON.ShallowBoundChl 3 meter" ASAP 2020-10-14T18:54:45.767Z,1602701685.767 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=40528, MT Status=1, MTMSN=2826 2020-10-14T18:54:46.558Z,1602701686.558 [CommandLine](IMPORTANT): got command schedule asap "set IsothermDepthCANON.TransitYoYoMinDepth 3 meter;set IsothermDepthCANON.TransitYoYoMaxDepth 50 meter;set IsothermDepthCANON.Lat1 36.7117 degree;set IsothermDepthCANON.Lon1 -122.1919 degree" 2k70m 3 4.000000 2020-10-14T18:54:46.558Z,1602701686.558 [CommandLine](IMPORTANT): Scheduling command #3 of 4 with id=2k70m 2020-10-14T18:54:46.559Z,1602701686.559 [CommandLine](IMPORTANT): Scheduled #35 (#3 of 4 with id='2k70m'): "set IsothermDepthCANON.TransitYoYoMinDepth 3 meter;set IsothermDepthCANON.TransitYoYoMaxDepth 50 meter;set IsothermDepthCANON.Lat1 36.7117 degree;set IsothermDepthCANON.Lon1 -122.1919 degree" ASAP 2020-10-14T18:55:11.024Z,1602701711.024 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=40529, MT Status=1, MTMSN=2827 2020-10-14T18:55:11.791Z,1602701711.791 [CommandLine](IMPORTANT): got command schedule asap "set IsothermDepthCANON.SampleType1 2 count;set IsothermDepthCANON.SampleType2 2 count;set IsothermDepthCANON.TempDiffFromPeakChl1 0 kelvin;set IsothermDepthCANON.Dep2 50 meter;set IsothermDepthCANON.WaitDepUndulation1 20 minute;run" 2k70m 4 4.000000 2020-10-14T18:55:11.791Z,1602701711.791 [CommandLine](IMPORTANT): Scheduling command #4 of 4 with id=2k70m 2020-10-14T18:55:11.792Z,1602701711.792 [CommandLine](IMPORTANT): Scheduled #36 (#4 of 4 with id='2k70m'): "set IsothermDepthCANON.SampleType1 2 count;set IsothermDepthCANON.SampleType2 2 count;set IsothermDepthCANON.TempDiffFromPeakChl1 0 kelvin;set IsothermDepthCANON.Dep2 50 meter;set IsothermDepthCANON.WaitDepUndulation1 20 minute;run" ASAP 2020-10-14T18:55:11.910Z,1602701711.910 [CommandLine](IMPORTANT): got command load ./Missions/Science/isotherm_depth_canon.xml 2020-10-14T18:55:23.770Z,1602701723.770 [CommandLine](IMPORTANT): Loaded ./Missions/Science/isotherm_depth_canon.xml 2020-10-14T18:55:37.497Z,1602701737.497 [CommandLine](IMPORTANT): got command set IsothermDepthCANON.NumSamplers 2.000000 count 2020-10-14T18:55:37.498Z,1602701737.498 [CommandLine](IMPORTANT): got command set IsothermDepthCANON.MissionTimeout 4.000000 hour 2020-10-14T18:55:37.499Z,1602701737.499 [CommandLine](IMPORTANT): got command set IsothermDepthCANON.InitialDiveDuration 2.000000 minute 2020-10-14T18:55:54.957Z,1602701754.957 [CommandLine](IMPORTANT): got command set IsothermDepthCANON.SpeedSampling 0.000000 meter_per_second 2020-10-14T18:55:54.958Z,1602701754.958 [CommandLine](IMPORTANT): got command set IsothermDepthCANON.MaxDepth 60.000000 meter 2020-10-14T18:55:54.958Z,1602701754.958 [CommandLine](IMPORTANT): got command set IsothermDepthCANON.DeepBoundESP 58.000000 meter 2020-10-14T18:55:54.959Z,1602701754.959 [CommandLine](IMPORTANT): got command set IsothermDepthCANON.ShallowBoundChl 3.000000 meter 2020-10-14T18:56:11.798Z,1602701771.798 [CommandLine](IMPORTANT): got command set IsothermDepthCANON.TransitYoYoMinDepth 3.000000 meter 2020-10-14T18:56:11.799Z,1602701771.799 [CommandLine](IMPORTANT): got command set IsothermDepthCANON.TransitYoYoMaxDepth 50.000000 meter 2020-10-14T18:56:11.800Z,1602701771.800 [CommandLine](IMPORTANT): got command set IsothermDepthCANON.Lat1 36.711700 degree 2020-10-14T18:56:11.800Z,1602701771.800 [CommandLine](IMPORTANT): got command set IsothermDepthCANON.Lon1 -122.191902 degree 2020-10-14T18:56:33.060Z,1602701793.060 [CommandLine](IMPORTANT): got command set IsothermDepthCANON.SampleType1 2.000000 count 2020-10-14T18:56:33.073Z,1602701793.073 [CommandLine](IMPORTANT): got command set IsothermDepthCANON.SampleType2 2.000000 count 2020-10-14T18:56:33.074Z,1602701793.074 [CommandLine](IMPORTANT): got command set IsothermDepthCANON.TempDiffFromPeakChl1 0.000000 kelvin 2020-10-14T18:56:33.075Z,1602701793.075 [CommandLine](IMPORTANT): got command set IsothermDepthCANON.Dep2 50.000000 meter 2020-10-14T18:56:33.075Z,1602701793.075 [CommandLine](IMPORTANT): got command set IsothermDepthCANON.WaitDepUndulation1 20.000000 minute 2020-10-14T18:56:33.076Z,1602701793.076 [CommandLine](IMPORTANT): got command run 2020-10-14T18:56:33.079Z,1602701793.079 [CommandLine](IMPORTANT): Running 2020-10-14T18:56:33.088Z,1602701793.088 [MissionManager](IMPORTANT): Started mission IsothermDepthCANON 2020-10-14T18:56:33.146Z,1602701793.146 [IsothermDepthCANON:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 21.00 hours. 2020-10-14T19:09:30.048Z,1602702570.048 [IsothermDepthCANON:TransitToSamplingLocationNoComms:Wpt1NoComms:C.Waypoint](IMPORTANT): Reached Waypoint: 36.711700,-122.191907 2020-10-14T19:12:21.369Z,1602702741.369 [IsothermDepthCANON:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.649967 m 2020-10-14T19:12:30.285Z,1602702750.285 [IsothermDepthCANON:SetSampleOptions:Q](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , 0.000000 K , nan m , nan degC , nan m , 20.000000 min . 2020-10-14T19:18:06.007Z,1602703086.007 [IsothermDepthCANON:FindPeakChlVertical:FindPeak:LogGoUp:B](IMPORTANT): Go up from 30.028639 m 2020-10-14T19:24:58.509Z,1602703498.509 [IsothermDepthCANON:FindPeakChlVertical:FindPeak:SetChlPeakTempDepth:L](IMPORTANT): Set peak-chl depth and temp. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlTemperatureSet, PeakChlSet = 28.463558 m , 1.017000 ug/l , 9.641784 m , 12.884912 degC , 2.723300 ug/l 2020-10-14T19:25:01.366Z,1602703501.366 [IsothermDepthCANON:TakeSamples:FiringOnTemp:C](IMPORTANT): Taking sample No. 1.000000 count . Target temp = 12.884912 degC . 2020-10-14T19:25:02.159Z,1602703502.159 [IsothermDepthCANON:DampDown:A](IMPORTANT): Wait 20.000000 min for the depth undulation to damp down. 2020-10-14T19:45:05.757Z,1602704705.757 [IsothermDepthCANON:Sample:SampleWrapper:ESP:AcquireESP:SelectESPCartridge:A](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 2020-10-14T19:45:17.506Z,1602704717.506 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-10-14T19:45:17.612Z,1602704717.612 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-10-14T19:45:57.001Z,1602704757.001 [ESPComponent](IMPORTANT): ESP has connected as client 2020-10-14T19:45:57.814Z,1602704757.814 [ESPComponent](IMPORTANT): [sample #17] Setting cartridge argument to -6 2020-10-14T19:45:57.814Z,1602704757.814 [ESPComponent](IMPORTANT): [sample #17] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-10-14T19:45:58.288Z,1602704758.288 [IsothermDepthCANON:Sample:SampleWrapper:ESP:AcquireESP:C](IMPORTANT): ESP sampling at 10.956091 m in 12.867090 degC water with 2.305200 ug/l chlorophyll fluorescence. 2020-10-14T19:45:58.617Z,1602704758.617 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_PREPARING_SHOW_LOG 2020-10-14T19:45:59.022Z,1602704759.022 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-10-14T19:46:01.042Z,1602704761.042 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_LOADING_CARTRIDGE 2020-10-14T19:46:34.185Z,1602704794.185 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_WAITING_FOR_PRIMING (@13,archive_bac) 2020-10-14T19:46:35.802Z,1602704795.802 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_PRIMING (@100.0) 2020-10-14T19:46:37.418Z,1602704797.418 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-10-14T19:49:10.141Z,1602704950.141 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_FILTERING (@0.0) 2020-10-14T19:49:10.546Z,1602704950.546 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-10-14T19:55:38.895Z,1602705338.895 [IsothermDepthCANON:Sample:SampleWrapper:CANONSampler:AcquireCANONSampler:E](IMPORTANT): CANONSampler sampling at 7.899221 m in 12.906214 degC water with 2.644200 ug/l chlorophyll fluorescence. 2020-10-14T19:59:30.328Z,1602705570.328 [CANONSampler](IMPORTANT): Sample 4, err_code=0 2020-10-14T20:32:09.137Z,1602707529.137 [CBIT](IMPORTANT): Beginning ground fault scan 2020-10-14T20:32:20.038Z,1602707540.038 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.005186 CHAN A1 (24V): 0.002899 CHAN A2 (12V): -0.003993 CHAN A3 (5V): -0.001745 CHAN B0 (3.3V): -0.000937 CHAN B1 (3.15aV): -0.003862 CHAN B2 (3.15bV): -0.000973 CHAN B3 (GND): 0.000027 OPEN: 0.007522 Full Scale Calc: 4.765 mA, -1.589 mA 2020-10-14T20:46:36.490Z,1602708396.490 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_PAUSED (@926.503) 2020-10-14T20:46:36.887Z,1602708396.887 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_PROCESSING (@926.503) 2020-10-14T20:46:39.310Z,1602708399.310 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_WAITING_FOR_PROCESSED (@13,archive_bac) 2020-10-14T20:58:42.909Z,1602709122.909 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_STOPPING (@13,archive_bac) 2020-10-14T20:59:08.362Z,1602709148.362 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-10-14T20:59:08.770Z,1602709148.770 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_STOPPED 2020-10-14T21:04:08.561Z,1602709448.561 [ESPComponent](IMPORTANT): [sample #17] ESP sampling sequence completed normally. 2020-10-14T21:04:08.969Z,1602709448.969 [ESPComponent](IMPORTANT): [sample #17] ESP log summary report (3 messages): @12:46:11.23 Selecting Cartridge 13 @13:46:34.21 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @13:46:34.41 Sampled 926.5ml 2020-10-14T21:04:11.437Z,1602709451.437 [IsothermDepthCANON:TakeSamples:FiringOnTemp:TriggerOnTemp:C](IMPORTANT): Sample No. 1.000000 count completed. 2020-10-14T21:04:28.017Z,1602709468.017 [IsothermDepthCANON:SetSampleOptions:Q](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , nan K , nan m , nan degC , 50.000000 m , 10.000000 min . 2020-10-14T21:04:30.843Z,1602709470.843 [IsothermDepthCANON:TakeSamples:FiringOnDepth:C](IMPORTANT): Taking sample No. 2.000000 count . Target depth = 50.000000 m . 2020-10-14T21:18:02.092Z,1602710282.092 [IsothermDepthCANON:TriggerSampleAtDepth:SampleWrapper:B](IMPORTANT): At 50.041145 m , settling for 10.000000 min 2020-10-14T21:28:05.323Z,1602710885.323 [IsothermDepthCANON:Sample:SampleWrapper:ESP:AcquireESP:SelectESPCartridge:A](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 2020-10-14T21:28:17.081Z,1602710897.081 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-10-14T21:28:17.200Z,1602710897.200 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-10-14T21:28:55.758Z,1602710935.758 [ESPComponent](IMPORTANT): ESP has connected as client 2020-10-14T21:28:56.568Z,1602710936.568 [ESPComponent](IMPORTANT): [sample #18] Setting cartridge argument to -6 2020-10-14T21:28:56.569Z,1602710936.569 [ESPComponent](IMPORTANT): [sample #18] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-10-14T21:28:57.066Z,1602710937.066 [IsothermDepthCANON:Sample:SampleWrapper:ESP:AcquireESP:C](IMPORTANT): ESP sampling at 50.089600 m in 10.353510 degC water with 0.124300 ug/l chlorophyll fluorescence. 2020-10-14T21:28:57.374Z,1602710937.374 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_PREPARING_SHOW_LOG 2020-10-14T21:28:57.777Z,1602710937.777 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-10-14T21:28:59.798Z,1602710939.798 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_LOADING_CARTRIDGE 2020-10-14T21:29:32.936Z,1602710972.936 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_WAITING_FOR_PRIMING (@12,archive_bac) 2020-10-14T21:29:34.550Z,1602710974.550 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_PRIMING (@100.0) 2020-10-14T21:29:35.357Z,1602710975.357 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-10-14T21:32:03.229Z,1602711123.229 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_FILTERING (@0.0) 2020-10-14T21:32:03.634Z,1602711123.634 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-10-14T21:38:38.544Z,1602711518.544 [IsothermDepthCANON:Sample:SampleWrapper:CANONSampler:AcquireCANONSampler:E](IMPORTANT): CANONSampler sampling at 50.437759 m in 10.338404 degC water with 0.169500 ug/l chlorophyll fluorescence. 2020-10-14T21:42:31.890Z,1602711751.890 [CANONSampler](IMPORTANT): Sample 5, err_code=0 2020-10-14T22:13:58.675Z,1602713638.675 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_PAUSED (@1000.0) 2020-10-14T22:13:59.079Z,1602713639.079 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_PROCESSING (@1000.0) 2020-10-14T22:14:01.502Z,1602713641.502 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_WAITING_FOR_PROCESSED (@12,archive_bac) 2020-10-14T22:26:05.097Z,1602714365.097 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_STOPPING (@12,archive_bac) 2020-10-14T22:26:30.550Z,1602714390.550 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-10-14T22:26:30.956Z,1602714390.956 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_STOPPED 2020-10-14T22:31:30.738Z,1602714690.738 [ESPComponent](IMPORTANT): [sample #18] ESP sampling sequence completed normally. 2020-10-14T22:31:31.141Z,1602714691.141 [ESPComponent](IMPORTANT): [sample #18] ESP log summary report (2 messages): @14:29:09.70 Selecting Cartridge 12 @15:13:56.74 Sampled 1000.0ml 2020-10-14T22:31:34.014Z,1602714694.014 [IsothermDepthCANON:TakeSamples:FiringOnDepth:TriggerOnDepth:B](IMPORTANT): Sample No. 2.000000 count completed. 2020-10-14T22:31:36.808Z,1602714696.808 [MissionManager](IMPORTANT): Started mission Default 2020-10-14T23:00:50.801Z,1602716450.801 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 29.226569 min 2020-10-14T23:07:11.817Z,1602716831.817 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 35.576599 min 2020-10-14T23:08:32.401Z,1602716912.401 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=40567, MT Status=1, MTMSN=2828 2020-10-14T23:08:33.155Z,1602716913.155 [CommandLine](IMPORTANT): got command schedule asap "load Science/canon_esp_trianguloid.xml;set canon_esp_trianguloid.MissionTimeout 12 hour;set canon_esp_trianguloid.leg 5 count;set canon_esp_trianguloid.StartWithASample 0 bool;set canon_esp_trianguloid.Lat1 NaN degree" 2kitc 1 3.000000 2020-10-14T23:08:33.155Z,1602716913.155 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2kitc 2020-10-14T23:08:33.156Z,1602716913.156 [CommandLine](IMPORTANT): Scheduled #37 (#1 of 3 with id='2kitc'): "load Science/canon_esp_trianguloid.xml;set canon_esp_trianguloid.MissionTimeout 12 hour;set canon_esp_trianguloid.leg 5 count;set canon_esp_trianguloid.StartWithASample 0 bool;set canon_esp_trianguloid.Lat1 NaN degree" ASAP 2020-10-14T23:09:52.543Z,1602716992.543 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=40568, MT Status=1, MTMSN=2829 2020-10-14T23:09:53.346Z,1602716993.346 [CommandLine](IMPORTANT): got command schedule asap "set canon_esp_trianguloid.Lon1 NaN degree;set canon_esp_trianguloid.Speed 0.75 meter_per_second;set canon_esp_trianguloid.YoYoMinDepth 3 meter;set canon_esp_trianguloid.YoYoMaxDepth1 50 meter" 2kitc 2 3.000000 2020-10-14T23:09:53.346Z,1602716993.346 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2kitc 2020-10-14T23:09:53.347Z,1602716993.347 [CommandLine](IMPORTANT): Scheduled #38 (#2 of 3 with id='2kitc'): "set canon_esp_trianguloid.Lon1 NaN degree;set canon_esp_trianguloid.Speed 0.75 meter_per_second;set canon_esp_trianguloid.YoYoMinDepth 3 meter;set canon_esp_trianguloid.YoYoMaxDepth1 50 meter" ASAP 2020-10-14T23:10:20.523Z,1602717020.523 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=40569, MT Status=1, MTMSN=2830 2020-10-14T23:10:21.166Z,1602717021.166 [CommandLine](IMPORTANT): got command schedule asap "set canon_esp_trianguloid.MaxDepth 62 meter;run" 2kitc 3 3.000000 2020-10-14T23:10:21.166Z,1602717021.166 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2kitc 2020-10-14T23:10:21.167Z,1602717021.167 [CommandLine](IMPORTANT): Scheduled #39 (#3 of 3 with id='2kitc'): "set canon_esp_trianguloid.MaxDepth 62 meter;run" ASAP 2020-10-14T23:10:21.376Z,1602717021.376 [CommandLine](IMPORTANT): got command load ./Missions/Science/canon_esp_trianguloid.xml 2020-10-14T23:10:23.500Z,1602717023.500 [CommandLine](IMPORTANT): Loaded ./Missions/Science/canon_esp_trianguloid.xml 2020-10-14T23:10:41.446Z,1602717041.446 [CommandLine](IMPORTANT): got command set canon_esp_trianguloid.MissionTimeout 12.000000 hour 2020-10-14T23:10:41.447Z,1602717041.447 [CommandLine](IMPORTANT): got command set canon_esp_trianguloid.leg 5.000000 count 2020-10-14T23:10:41.449Z,1602717041.449 [CommandLine](IMPORTANT): got command set canon_esp_trianguloid.StartWithASample 0.000000 bool 2020-10-14T23:10:41.451Z,1602717041.451 [CommandLine](IMPORTANT): got command set canon_esp_trianguloid.Lat1 nan degree 2020-10-14T23:10:59.833Z,1602717059.833 [CommandLine](IMPORTANT): got command set canon_esp_trianguloid.Lon1 nan degree 2020-10-14T23:10:59.834Z,1602717059.834 [CommandLine](IMPORTANT): got command set canon_esp_trianguloid.Speed 0.750000 meter_per_second 2020-10-14T23:10:59.834Z,1602717059.834 [CommandLine](IMPORTANT): got command set canon_esp_trianguloid.YoYoMinDepth 3.000000 meter 2020-10-14T23:10:59.835Z,1602717059.835 [CommandLine](IMPORTANT): got command set canon_esp_trianguloid.YoYoMaxDepth1 50.000000 meter 2020-10-14T23:11:04.547Z,1602717064.547 [CommandLine](IMPORTANT): got command set canon_esp_trianguloid.MaxDepth 62.000000 meter 2020-10-14T23:11:04.548Z,1602717064.548 [CommandLine](IMPORTANT): got command run 2020-10-14T23:11:04.550Z,1602717064.550 [CommandLine](IMPORTANT): Running 2020-10-14T23:11:04.787Z,1602717064.787 [MissionManager](IMPORTANT): Started mission canon_esp_trianguloid 2020-10-14T23:13:50.673Z,1602717230.673 [canon_esp_trianguloid:Lap:A](IMPORTANT): Starting Lap 2020-10-14T23:13:51.085Z,1602717231.085 [canon_esp_trianguloid:Lap:B](IMPORTANT): Lat[1] = nan arcdeg Lon[1] = nan arcdeg 2020-10-14T23:13:51.483Z,1602717231.483 [canon_esp_trianguloid:Lap:C](IMPORTANT): Lat[2] = nan arcdeg Lon[2] = nan arcdeg 2020-10-14T23:13:51.887Z,1602717231.887 [canon_esp_trianguloid:Lap:D](IMPORTANT): Lat[3] = nan arcdeg Lon[3] = nan arcdeg 2020-10-14T23:13:52.290Z,1602717232.290 [canon_esp_trianguloid:Lap:E](IMPORTANT): Lat[4] = nan arcdeg Lon[4] = nan arcdeg 2020-10-14T23:13:52.697Z,1602717232.697 [canon_esp_trianguloid:Lap:F](IMPORTANT): Lat[5] = 36.697800 arcdeg Lon[5] = -122.056200 arcdeg 2020-10-14T23:13:53.114Z,1602717233.114 [canon_esp_trianguloid:Lap:G](IMPORTANT): Lat[6] = 36.754000 arcdeg Lon[6] = -122.015500 arcdeg 2020-10-14T23:13:53.504Z,1602717233.504 [canon_esp_trianguloid:Lap:H](IMPORTANT): Lat[7] = 36.797000 arcdeg Lon[7] = -121.847000 arcdeg 2020-10-14T23:13:53.907Z,1602717233.907 [canon_esp_trianguloid:Lap:I](IMPORTANT): Lat[8] = nan arcdeg Lon[8] = nan arcdeg 2020-10-14T23:13:54.731Z,1602717234.731 [canon_esp_trianguloid:Lap:Wpt1:A](IMPORTANT): Navigating to box start WP. YoYoMaxDepth: 50.000000 m 2020-10-14T23:15:32.528Z,1602717332.528 [canon_esp_trianguloid:Lap:Wpt2:A](IMPORTANT): Navigating to WP2. YoYoMaxDepth: 50.000000 m 2020-10-14T23:15:33.330Z,1602717333.330 [canon_esp_trianguloid:Lap:Wpt3:A](IMPORTANT): Navigating to WP3. YoYoMaxDepth: 50.000000 m 2020-10-14T23:15:34.148Z,1602717334.148 [canon_esp_trianguloid:Lap:Wpt4:A](IMPORTANT): Navigating to WP4. YoYoMaxDepth: 50.000000 m 2020-10-14T23:15:34.940Z,1602717334.940 [canon_esp_trianguloid:Lap:Wpt5:A](IMPORTANT): Navigating to WP5. YoYoMaxDepth: 50.000000 m 2020-10-15T00:46:40.154Z,1602722800.154 [ThrusterServo](FAULT): Invalid EZ Servo response:"" 2020-10-15T01:10:22.699Z,1602724222.699 [canon_esp_trianguloid:SampleTimer:AcquireSample:B](IMPORTANT): Pre-sample comms. Elapsed time since last ESP sample: 2.000111 h 2020-10-15T01:20:36.179Z,1602724836.179 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:SelectESPCartridge:A](IMPORTANT): Requesting ESP cartridge type: -6.000000 count 2020-10-15T01:20:47.973Z,1602724847.973 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-10-15T01:20:48.102Z,1602724848.102 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-10-15T01:21:26.749Z,1602724886.749 [ESPComponent](IMPORTANT): ESP has connected as client 2020-10-15T01:21:27.560Z,1602724887.560 [ESPComponent](IMPORTANT): [sample #19] Setting cartridge argument to -6 2020-10-15T01:21:27.560Z,1602724887.560 [ESPComponent](IMPORTANT): [sample #19] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-10-15T01:21:28.029Z,1602724888.029 [canon_esp_trianguloid:Sample:SampleWrapper:ESP:AcquireESP:C](IMPORTANT): ESP sampling at 15.530534 m in 13.427912 degC water with 5.288400 ug/l chlorophyll fluorescence. 2020-10-15T01:21:28.366Z,1602724888.366 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_PREPARING_SHOW_LOG 2020-10-15T01:21:28.769Z,1602724888.769 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-10-15T01:21:30.791Z,1602724890.791 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_LOADING_CARTRIDGE 2020-10-15T01:22:03.920Z,1602724923.920 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_WAITING_FOR_PRIMING (@11,archive_bac) 2020-10-15T01:22:05.534Z,1602724925.534 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_PRIMING (@100.0) 2020-10-15T01:22:06.344Z,1602724926.344 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-10-15T01:24:34.221Z,1602725074.221 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_FILTERING (@0.0) 2020-10-15T01:24:34.626Z,1602725074.626 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-10-15T02:24:36.098Z,1602728676.098 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_PAUSED (@1000.0) 2020-10-15T02:24:36.502Z,1602728676.502 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_PROCESSING (@1000.0) 2020-10-15T02:24:38.926Z,1602728678.926 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_WAITING_FOR_PROCESSED (@11,archive_bac) 2020-10-15T02:32:20.425Z,1602729140.425 [CBIT](IMPORTANT): Beginning ground fault scan 2020-10-15T02:32:31.422Z,1602729151.422 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.005776 CHAN A1 (24V): 0.004347 CHAN A2 (12V): -0.004620 CHAN A3 (5V): -0.001578 CHAN B0 (3.3V): 0.000341 CHAN B1 (3.15aV): 0.000336 CHAN B2 (3.15bV): -0.001170 CHAN B3 (GND): 0.001400 OPEN: 0.006516 Full Scale Calc: 4.765 mA, -1.589 mA 2020-10-15T02:36:42.526Z,1602729402.526 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_STOPPING (@11,archive_bac) 2020-10-15T02:37:07.978Z,1602729427.978 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-10-15T02:37:08.382Z,1602729428.382 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_STOPPED 2020-10-15T02:42:08.170Z,1602729728.170 [ESPComponent](IMPORTANT): [sample #19] ESP sampling sequence completed normally. 2020-10-15T02:42:08.573Z,1602729728.573 [ESPComponent](IMPORTANT): [sample #19] ESP log summary report (2 messages): @18:21:40.75 Selecting Cartridge 11 @19:24:34.43 Sampled 1000.0ml 2020-10-15T02:45:00.731Z,1602729900.731 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=40594, MT Status=1, MTMSN=2831 2020-10-15T02:45:01.317Z,1602729901.317 [CommandLine](IMPORTANT): got command stop 2020-10-15T02:45:01.317Z,1602729901.317 [CommandLine](IMPORTANT): Scheduling is paused 2020-10-15T02:45:01.318Z,1602729901.318 [CommandLine](IMPORTANT): got command schedule resume 2020-10-15T02:45:01.318Z,1602729901.318 [CommandLine](IMPORTANT): Scheduling is resumed 2020-10-15T02:45:01.983Z,1602729901.983 [MissionManager](IMPORTANT): Started mission Default