2020-07-27T06:35:15.644Z,1595831715.644 [CommandLine](IMPORTANT): got command restart logs 2020-07-27T06:35:26.993Z,1595831726.993 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=38450, MT Status=1, MTMSN=2736 2020-07-27T06:35:28.024Z,1595831728.024 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.NumESPSamplers 4 count;set Smear.MissionTimeout 12 hour;set Smear.WaitDuration 35 minute;set Smear.MaxWaitNoFiring 50000 day;set Smear.SpeedSampling 0.65 meter_per_second" 3m3cq 1 2.000000 2020-07-27T06:35:28.025Z,1595831728.025 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=3m3cq 2020-07-27T06:35:28.026Z,1595831728.026 [CommandLine](IMPORTANT): Scheduled #19 (#1 of 2 with id='3m3cq'): "load Science/smear_waypoint_sampling.xml;set Smear.NumESPSamplers 4 count;set Smear.MissionTimeout 12 hour;set Smear.WaitDuration 35 minute;set Smear.MaxWaitNoFiring 50000 day;set Smear.SpeedSampling 0.65 meter_per_second" ASAP 2020-07-27T06:35:42.029Z,1595831742.029 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=38451, MT Status=1, MTMSN=2737 2020-07-27T06:35:42.848Z,1595831742.848 [CommandLine](IMPORTANT): got command schedule asap "set Smear.MaxDepth 60 meter;set Smear.SamplingYoYoMinDepth 5 meter;set Smear.SamplingYoYoMaxDepth 50 meter;set Smear.SamplingEndLatitude 36.797 degree;set Smear.SamplingEndLongitude -121.847 degree;run " 3m3cq 2 2.000000 2020-07-27T06:35:42.848Z,1595831742.848 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=3m3cq 2020-07-27T06:35:42.849Z,1595831742.849 [CommandLine](IMPORTANT): Scheduled #20 (#2 of 2 with id='3m3cq'): "set Smear.MaxDepth 60 meter;set Smear.SamplingYoYoMinDepth 5 meter;set Smear.SamplingYoYoMaxDepth 50 meter;set Smear.SamplingEndLatitude 36.797 degree;set Smear.SamplingEndLongitude -121.847 degree;run " ASAP 2020-07-27T06:35:42.987Z,1595831742.987 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2020-07-27T06:35:45.476Z,1595831745.476 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2020-07-27T06:35:54.915Z,1595831754.915 [CommandLine](IMPORTANT): got command set Smear.NumESPSamplers 4.000000 count 2020-07-27T06:35:54.916Z,1595831754.916 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 12.000000 hour 2020-07-27T06:35:54.918Z,1595831754.918 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 35.000000 minute 2020-07-27T06:35:54.918Z,1595831754.918 [CommandLine](IMPORTANT): got command set Smear.MaxWaitNoFiring 50000.000000 day 2020-07-27T06:35:54.919Z,1595831754.919 [CommandLine](IMPORTANT): got command set Smear.SpeedSampling 0.650000 meter_per_second 2020-07-27T06:36:05.268Z,1595831765.268 [CommandLine](IMPORTANT): got command set Smear.MaxDepth 60.000000 meter 2020-07-27T06:36:05.269Z,1595831765.269 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 5.000000 meter 2020-07-27T06:36:05.270Z,1595831765.270 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 50.000000 meter 2020-07-27T06:36:05.271Z,1595831765.271 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 36.797001 degree 2020-07-27T06:36:05.272Z,1595831765.272 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -121.847000 degree 2020-07-27T06:36:05.272Z,1595831765.272 [CommandLine](IMPORTANT): got command run 2020-07-27T06:36:05.275Z,1595831765.275 [CommandLine](IMPORTANT): Running 2020-07-27T06:36:05.489Z,1595831765.489 [MissionManager](IMPORTANT): Started mission Smear 2020-07-27T06:36:06.700Z,1595831766.700 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=38452, MT Status=1, MTMSN=2738 2020-07-27T06:36:07.275Z,1595831767.275 [CommandLine](IMPORTANT): got command schedule clear 2020-07-27T06:36:07.275Z,1595831767.275 [CommandLine](IMPORTANT): #Cleared scheduled commands:0 2020-07-27T06:36:07.275Z,1595831767.275 [CommandLine](IMPORTANT): got command schedule resume 2020-07-27T06:36:07.276Z,1595831767.276 [CommandLine](IMPORTANT): Scheduling is resumed 2020-07-27T06:58:39.962Z,1595833119.962 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking ESP sample No. 1.000000 count . 2020-07-27T06:58:41.168Z,1595833121.168 [Smear:InsertWait:A](IMPORTANT): Wait 35.000000 min before firing sample. 2020-07-27T07:33:43.702Z,1595835223.702 [Smear:ESPSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 22.001143 m , 11.331598 degC , 0.644100 ug/l . 2020-07-27T07:33:45.792Z,1595835225.792 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-27T07:33:45.897Z,1595835225.897 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-27T07:34:24.068Z,1595835264.068 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-27T07:34:24.876Z,1595835264.876 [ESPComponent](IMPORTANT): [sample #11] Setting cartridge argument to -6 2020-07-27T07:34:24.876Z,1595835264.876 [ESPComponent](IMPORTANT): [sample #11] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-27T07:34:25.312Z,1595835265.312 [Smear:ESPSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2020-07-27T07:34:25.680Z,1595835265.680 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-27T07:34:26.085Z,1595835266.085 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-27T07:34:28.105Z,1595835268.105 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-27T07:35:00.830Z,1595835300.830 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PRIMING (@11,archive_bac) 2020-07-27T07:35:02.446Z,1595835302.446 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PRIMING (@100.0) 2020-07-27T07:35:04.062Z,1595835304.062 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-27T07:37:52.951Z,1595835472.951 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_FILTERING (@0.0) 2020-07-27T07:37:53.351Z,1595835473.351 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-27T08:07:07.630Z,1595837227.630 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PAUSED (@509.382) 2020-07-27T08:07:08.029Z,1595837228.029 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PROCESSING (@509.382) 2020-07-27T08:07:10.452Z,1595837230.452 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PROCESSED (@11,archive_bac) 2020-07-27T08:19:13.676Z,1595837953.676 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_STOPPING (@11,archive_bac) 2020-07-27T08:19:39.127Z,1595837979.127 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-27T08:19:39.528Z,1595837979.528 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_STOPPED 2020-07-27T08:24:39.306Z,1595838279.306 [ESPComponent](IMPORTANT): [sample #11] ESP sampling sequence completed normally. 2020-07-27T08:24:39.708Z,1595838279.708 [ESPComponent](IMPORTANT): [sample #11] ESP log summary report (3 messages): @00:34:37.00 Selecting Cartridge 11 @01:07:04.39 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @01:07:04.59 Sampled 509.4ml 2020-07-27T08:24:40.191Z,1595838280.191 [Smear:SamplingToWaypoint:TakeSamples:Firing:G](IMPORTANT): ESP sample No. 1.000000 count completed. 2020-07-27T08:35:56.988Z,1595838956.988 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking ESP sample No. 2.000000 count . 2020-07-27T08:35:58.206Z,1595838958.206 [Smear:InsertWait:A](IMPORTANT): Wait 35.000000 min before firing sample. 2020-07-27T09:11:00.780Z,1595841060.780 [Smear:ESPSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 17.117657 m , 12.038110 degC , 1.853200 ug/l . 2020-07-27T09:11:02.876Z,1595841062.876 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-27T09:11:03.000Z,1595841063.000 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-27T09:11:41.150Z,1595841101.150 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-27T09:11:41.962Z,1595841101.962 [ESPComponent](IMPORTANT): [sample #12] Setting cartridge argument to -6 2020-07-27T09:11:41.962Z,1595841101.962 [ESPComponent](IMPORTANT): [sample #12] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-27T09:11:42.413Z,1595841102.413 [Smear:ESPSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2020-07-27T09:11:42.764Z,1595841102.764 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-27T09:11:43.170Z,1595841103.170 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-27T09:11:45.190Z,1595841105.190 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-27T09:12:17.916Z,1595841137.916 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PRIMING (@10,archive_bac) 2020-07-27T09:12:19.538Z,1595841139.538 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PRIMING (@100.0) 2020-07-27T09:12:20.340Z,1595841140.340 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-27T09:15:09.631Z,1595841309.631 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_FILTERING (@0.0) 2020-07-27T09:15:10.032Z,1595841310.032 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-27T09:45:51.635Z,1595843151.635 [CBIT](IMPORTANT): Beginning ground fault scan 2020-07-27T09:46:02.562Z,1595843162.562 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.087583 CHAN A1 (24V): -0.005129 CHAN A2 (12V): 0.058047 CHAN A3 (5V): 0.013816 CHAN B0 (3.3V): 0.007980 CHAN B1 (3.15aV): 0.007540 CHAN B2 (3.15bV): 0.008152 CHAN B3 (GND): -0.005644 OPEN: 0.014225 Full Scale Calc: 4.765 mA, -1.589 mA 2020-07-27T10:05:40.170Z,1595844340.170 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PAUSED (@1000.0) 2020-07-27T10:05:40.573Z,1595844340.573 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PROCESSING (@1000.0) 2020-07-27T10:05:43.001Z,1595844343.001 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PROCESSED (@10,archive_bac) 2020-07-27T10:17:46.232Z,1595845066.232 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_STOPPING (@10,archive_bac) 2020-07-27T10:18:11.685Z,1595845091.685 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-27T10:18:12.090Z,1595845092.090 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_STOPPED 2020-07-27T10:23:11.871Z,1595845391.871 [ESPComponent](IMPORTANT): [sample #12] ESP sampling sequence completed normally. 2020-07-27T10:23:12.275Z,1595845392.275 [ESPComponent](IMPORTANT): [sample #12] ESP log summary report (2 messages): @02:11:54.35 Selecting Cartridge 10 @03:05:38.08 Sampled 1000.0ml 2020-07-27T10:23:12.730Z,1595845392.730 [Smear:SamplingToWaypoint:TakeSamples:Firing:G](IMPORTANT): ESP sample No. 2.000000 count completed. 2020-07-27T10:34:23.997Z,1595846063.997 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking ESP sample No. 3.000000 count . 2020-07-27T10:34:25.216Z,1595846065.216 [Smear:InsertWait:A](IMPORTANT): Wait 35.000000 min before firing sample. 2020-07-27T11:09:27.753Z,1595848167.753 [Smear:ESPSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 11.537167 m , 14.566003 degC , 8.734901 ug/l . 2020-07-27T11:09:29.831Z,1595848169.831 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-27T11:09:29.957Z,1595848169.957 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-27T11:10:07.699Z,1595848207.699 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-27T11:10:08.515Z,1595848208.515 [ESPComponent](IMPORTANT): [sample #13] Setting cartridge argument to -6 2020-07-27T11:10:08.516Z,1595848208.516 [ESPComponent](IMPORTANT): [sample #13] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-27T11:10:08.995Z,1595848208.995 [Smear:ESPSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2020-07-27T11:10:09.318Z,1595848209.318 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-27T11:10:09.720Z,1595848209.720 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-27T11:10:11.739Z,1595848211.739 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-27T11:10:44.468Z,1595848244.468 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_PRIMING (@9,archive_bac) 2020-07-27T11:10:46.084Z,1595848246.084 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PRIMING (@100.0) 2020-07-27T11:10:46.894Z,1595848246.894 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-27T11:13:36.581Z,1595848416.581 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_FILTERING (@0.0) 2020-07-27T11:13:36.980Z,1595848416.980 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-27T12:06:42.749Z,1595851602.749 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PAUSED (@1000.0) 2020-07-27T12:06:43.139Z,1595851603.139 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_PROCESSING (@1000.0) 2020-07-27T12:06:45.563Z,1595851605.563 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_WAITING_FOR_PROCESSED (@9,archive_bac) 2020-07-27T12:18:48.768Z,1595852328.768 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_STOPPING (@9,archive_bac) 2020-07-27T12:19:14.215Z,1595852354.215 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-27T12:19:14.616Z,1595852354.616 [ESPComponent](IMPORTANT): [sample #13] ESP sampling state: S_STOPPED 2020-07-27T12:24:14.398Z,1595852654.398 [ESPComponent](IMPORTANT): [sample #13] ESP sampling sequence completed normally. 2020-07-27T12:24:14.800Z,1595852654.800 [ESPComponent](IMPORTANT): [sample #13] ESP log summary report (2 messages): @04:10:20.86 Selecting Cartridge 9 @05:06:40.29 Sampled 1000.0ml 2020-07-27T12:24:15.251Z,1595852655.251 [Smear:SamplingToWaypoint:TakeSamples:Firing:G](IMPORTANT): ESP sample No. 3.000000 count completed. 2020-07-27T12:32:41.703Z,1595853161.703 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking ESP sample No. 4.000000 count . 2020-07-27T12:32:42.937Z,1595853162.937 [Smear:InsertWait:A](IMPORTANT): Wait 35.000000 min before firing sample. 2020-07-27T13:07:45.440Z,1595855265.440 [Smear:ESPSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 23.456263 m , 11.741693 degC , 2.282600 ug/l . 2020-07-27T13:07:47.527Z,1595855267.527 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-27T13:07:47.675Z,1595855267.675 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-27T13:08:25.019Z,1595855305.019 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-27T13:08:25.826Z,1595855305.826 [ESPComponent](IMPORTANT): [sample #14] Setting cartridge argument to -6 2020-07-27T13:08:25.827Z,1595855305.827 [ESPComponent](IMPORTANT): [sample #14] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-27T13:08:26.264Z,1595855306.264 [Smear:ESPSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2020-07-27T13:08:26.632Z,1595855306.632 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-27T13:08:27.038Z,1595855307.038 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-27T13:08:29.058Z,1595855309.058 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-27T13:09:01.782Z,1595855341.782 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_WAITING_FOR_PRIMING (@8,archive_bac) 2020-07-27T13:09:03.395Z,1595855343.395 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PRIMING (@100.0) 2020-07-27T13:09:04.204Z,1595855344.204 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-27T13:11:53.898Z,1595855513.898 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_FILTERING (@0.0) 2020-07-27T13:11:54.300Z,1595855514.300 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-27T14:06:03.820Z,1595858763.820 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PAUSED (@1000.0) 2020-07-27T14:06:04.226Z,1595858764.226 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_PROCESSING (@1000.0) 2020-07-27T14:06:06.647Z,1595858766.647 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_WAITING_FOR_PROCESSED (@8,archive_bac) 2020-07-27T14:18:09.863Z,1595859489.863 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_STOPPING (@8,archive_bac) 2020-07-27T14:18:35.315Z,1595859515.315 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-27T14:18:35.716Z,1595859515.716 [ESPComponent](IMPORTANT): [sample #14] ESP sampling state: S_STOPPED 2020-07-27T14:23:35.510Z,1595859815.510 [ESPComponent](IMPORTANT): [sample #14] ESP sampling sequence completed normally. 2020-07-27T14:23:35.912Z,1595859815.912 [ESPComponent](IMPORTANT): [sample #14] ESP log summary report (2 messages): @06:08:38.49 Selecting Cartridge 8 @07:06:01.87 Sampled 1000.0ml 2020-07-27T14:23:36.365Z,1595859816.365 [Smear:SamplingToWaypoint:TakeSamples:Firing:G](IMPORTANT): ESP sample No. 4.000000 count completed. 2020-07-27T14:23:38.370Z,1595859818.370 [MissionManager](IMPORTANT): Started mission Default 2020-07-27T14:32:12.878Z,1595860332.878 [DataOverHttps](IMPORTANT): SBD MTMSN=20200727T143124 2020-07-27T14:32:20.384Z,1595860340.384 [CommandLine](IMPORTANT): got command schedule asap "load Science/esp_sample_station.xml;set esp_sample_station.MissionTimeout 30 hour;set esp_sample_station.NeedCommsTime 60 minute;set esp_sample_station.LapRepeat 2 count;set esp_sample_station.Lat4 NaN degree" 3mr0b 1 2.000000 2020-07-27T14:32:20.384Z,1595860340.384 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=3mr0b 2020-07-27T14:32:20.385Z,1595860340.385 [CommandLine](IMPORTANT): Scheduled #21 (#1 of 2 with id='3mr0b'): "load Science/esp_sample_station.xml;set esp_sample_station.MissionTimeout 30 hour;set esp_sample_station.NeedCommsTime 60 minute;set esp_sample_station.LapRepeat 2 count;set esp_sample_station.Lat4 NaN degree" ASAP 2020-07-27T14:32:21.321Z,1595860341.321 [DataOverHttps](IMPORTANT): SBD MTMSN=20200727T143133 2020-07-27T14:32:28.784Z,1595860348.784 [CommandLine](IMPORTANT): got command schedule asap "set esp_sample_station.Lon4 NaN degree;set esp_sample_station.Speed 0.65 meter_per_second;set esp_sample_station.MaxDepth 60 meter;run " 3mr0b 2 2.000000 2020-07-27T14:32:28.784Z,1595860348.784 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=3mr0b 2020-07-27T14:32:28.785Z,1595860348.785 [CommandLine](IMPORTANT): Scheduled #22 (#2 of 2 with id='3mr0b'): "set esp_sample_station.Lon4 NaN degree;set esp_sample_station.Speed 0.65 meter_per_second;set esp_sample_station.MaxDepth 60 meter;run " ASAP 2020-07-27T14:32:28.884Z,1595860348.884 [CommandLine](IMPORTANT): got command load ./Missions/Science/esp_sample_station.xml 2020-07-27T14:32:31.197Z,1595860351.197 [CommandLine](IMPORTANT): Loaded ./Missions/Science/esp_sample_station.xml 2020-07-27T14:32:42.754Z,1595860362.754 [CommandLine](IMPORTANT): got command set esp_sample_station.MissionTimeout 30.000000 hour 2020-07-27T14:32:42.755Z,1595860362.755 [CommandLine](IMPORTANT): got command set esp_sample_station.NeedCommsTime 60.000000 minute 2020-07-27T14:32:42.756Z,1595860362.756 [CommandLine](IMPORTANT): got command set esp_sample_station.LapRepeat 2.000000 count 2020-07-27T14:32:42.757Z,1595860362.757 [CommandLine](IMPORTANT): got command set esp_sample_station.Lat4 nan degree 2020-07-27T14:32:50.060Z,1595860370.060 [CommandLine](IMPORTANT): got command set esp_sample_station.Lon4 nan degree 2020-07-27T14:32:50.061Z,1595860370.061 [CommandLine](IMPORTANT): got command set esp_sample_station.Speed 0.650000 meter_per_second 2020-07-27T14:32:50.061Z,1595860370.061 [CommandLine](IMPORTANT): got command set esp_sample_station.MaxDepth 60.000000 meter 2020-07-27T14:32:50.062Z,1595860370.062 [CommandLine](IMPORTANT): got command run 2020-07-27T14:32:50.066Z,1595860370.066 [CommandLine](IMPORTANT): Running 2020-07-27T14:32:50.354Z,1595860370.354 [MissionManager](IMPORTANT): Started mission esp_sample_station 2020-07-27T14:33:58.933Z,1595860438.933 [esp_sample_station:Lap:A](IMPORTANT): Starting Lap 2020-07-27T14:33:59.342Z,1595860439.342 [esp_sample_station:Lap:B](IMPORTANT): Lat[1] = 36.797000 arcdeg Lon[1] = -121.847000 arcdeg 2020-07-27T14:33:59.777Z,1595860439.777 [esp_sample_station:Lap:C](IMPORTANT): Lat[2] = 36.821900 arcdeg Lon[2] = -121.885600 arcdeg 2020-07-27T14:34:00.199Z,1595860440.199 [esp_sample_station:Lap:D](IMPORTANT): Lat[3] = 36.766000 arcdeg Lon[3] = -121.864900 arcdeg 2020-07-27T14:34:00.571Z,1595860440.571 [esp_sample_station:Lap:E](IMPORTANT): Lat[4] = nan arcdeg Lon[4] = nan arcdeg 2020-07-27T14:34:04.568Z,1595860444.568 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.797000 arcdeg , -121.847000 arcdeg 2020-07-27T14:39:00.691Z,1595860740.691 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2020-07-27T15:39:58.387Z,1595864398.387 [NAL9602](FAULT): received: +CSQ:0 OK563, 2, 0, 0, 0 OK 2020-07-27T15:39:59.109Z,1595864399.109 [NAL9602](FAULT): LCB fault: LCB Watchdog Reset. Invalid Command. Hardware Overcurrent Shutdown. Software Overcurrent. Current Limiter Activated. 2020-07-27T15:46:02.967Z,1595864762.967 [CBIT](IMPORTANT): Beginning ground fault scan 2020-07-27T15:46:13.790Z,1595864773.790 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.081884 CHAN A1 (24V): -0.002436 CHAN A2 (12V): 0.001625 CHAN A3 (5V): 0.031152 CHAN B0 (3.3V): -0.010257 CHAN B1 (3.15aV): 0.009341 CHAN B2 (3.15bV): 0.013947 CHAN B3 (GND): -0.001187 OPEN: 0.014676 Full Scale Calc: 4.765 mA, -1.589 mA 2020-07-27T17:47:31.328Z,1595872051.328 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:D.Waypoint](IMPORTANT): Reached Waypoint: 36.797000,-121.847000 2020-07-27T17:53:47.973Z,1595872427.973 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:A](IMPORTANT): Requesting ESP sample with cartridge type -6.000000 count 2020-07-27T17:53:50.072Z,1595872430.072 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-27T17:53:50.409Z,1595872430.409 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-27T17:54:28.090Z,1595872468.090 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-27T17:54:28.902Z,1595872468.902 [ESPComponent](IMPORTANT): [sample #15] Setting cartridge argument to -6 2020-07-27T17:54:28.902Z,1595872468.902 [ESPComponent](IMPORTANT): [sample #15] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-27T17:54:29.335Z,1595872469.335 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:D](IMPORTANT): ESP sampling at 15.303818 m in 12.198053 degC water with 1.478040 ug/l chlorophyll fluorescence. 2020-07-27T17:54:29.708Z,1595872469.708 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-27T17:54:30.111Z,1595872470.111 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-27T17:54:32.130Z,1595872472.130 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-27T17:55:04.866Z,1595872504.866 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_WAITING_FOR_PRIMING (@7,archive_bac) 2020-07-27T17:55:06.480Z,1595872506.480 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_PRIMING (@100.0) 2020-07-27T17:55:07.288Z,1595872507.288 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-27T17:57:48.088Z,1595872668.088 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_FILTERING (@0.0) 2020-07-27T17:57:48.498Z,1595872668.498 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-27T18:49:22.492Z,1595875762.492 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_PAUSED (@1000.0) 2020-07-27T18:49:22.899Z,1595875762.899 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_PROCESSING (@1000.0) 2020-07-27T18:49:25.321Z,1595875765.321 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_WAITING_FOR_PROCESSED (@7,archive_bac) 2020-07-27T19:01:28.541Z,1595876488.541 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_STOPPING (@7,archive_bac) 2020-07-27T19:01:54.003Z,1595876514.003 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-27T19:01:54.400Z,1595876514.400 [ESPComponent](IMPORTANT): [sample #15] ESP sampling state: S_STOPPED 2020-07-27T19:06:54.183Z,1595876814.183 [ESPComponent](IMPORTANT): [sample #15] ESP sampling sequence completed normally. 2020-07-27T19:06:54.591Z,1595876814.591 [ESPComponent](IMPORTANT): [sample #15] ESP log summary report (2 messages): @10:54:41.50 Selecting Cartridge 7 @11:49:20.73 Sampled 1000.0ml 2020-07-27T19:12:41.722Z,1595877161.722 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.821900 arcdeg , -121.885600 arcdeg 2020-07-27T21:46:13.878Z,1595886373.878 [CBIT](IMPORTANT): Beginning ground fault scan 2020-07-27T21:46:24.792Z,1595886384.792 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.084628 CHAN A1 (24V): -0.005152 CHAN A2 (12V): 0.107367 CHAN A3 (5V): 0.014116 CHAN B0 (3.3V): 0.008683 CHAN B1 (3.15aV): 0.008373 CHAN B2 (3.15bV): 0.008242 CHAN B3 (GND): -0.004271 OPEN: 0.014528 Full Scale Calc: 4.765 mA, -1.589 mA 2020-07-27T22:00:53.377Z,1595887253.377 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:D.Waypoint](IMPORTANT): Reached Waypoint: 36.821900,-121.885600 2020-07-27T22:08:03.132Z,1595887683.132 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:A](IMPORTANT): Requesting ESP sample with cartridge type -6.000000 count 2020-07-27T22:08:05.228Z,1595887685.228 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-27T22:08:05.365Z,1595887685.365 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-27T22:08:40.811Z,1595887720.811 [Radio_Surface](FAULT): LCB fault: Hardware Overcurrent Shutdown. 2020-07-27T22:08:43.094Z,1595887723.094 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-27T22:08:43.909Z,1595887723.909 [ESPComponent](IMPORTANT): [sample #16] Setting cartridge argument to -6 2020-07-27T22:08:43.910Z,1595887723.910 [ESPComponent](IMPORTANT): [sample #16] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-27T22:08:44.356Z,1595887724.356 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:D](IMPORTANT): ESP sampling at 12.267648 m in 13.749872 degC water with 3.645380 ug/l chlorophyll fluorescence. 2020-07-27T22:08:44.708Z,1595887724.708 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-27T22:08:45.115Z,1595887725.115 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-27T22:08:47.135Z,1595887727.135 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-27T22:09:19.867Z,1595887759.867 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_WAITING_FOR_PRIMING (@6,archive_bac) 2020-07-27T22:09:21.472Z,1595887761.472 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_PRIMING (@100.0) 2020-07-27T22:09:23.087Z,1595887763.087 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-27T22:12:02.679Z,1595887922.679 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_FILTERING (@0.0) 2020-07-27T22:12:03.080Z,1595887923.080 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-27T23:10:34.847Z,1595891434.847 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_PAUSED (@1000.004) 2020-07-27T23:10:35.248Z,1595891435.248 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_PROCESSING (@1000.004) 2020-07-27T23:10:37.668Z,1595891437.668 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_WAITING_FOR_PROCESSED (@6,archive_bac) 2020-07-27T23:22:40.902Z,1595892160.902 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_STOPPING (@6,archive_bac) 2020-07-27T23:23:06.353Z,1595892186.353 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-27T23:23:06.760Z,1595892186.760 [ESPComponent](IMPORTANT): [sample #16] ESP sampling state: S_STOPPED 2020-07-27T23:28:06.536Z,1595892486.536 [ESPComponent](IMPORTANT): [sample #16] ESP sampling sequence completed normally. 2020-07-27T23:28:06.946Z,1595892486.946 [ESPComponent](IMPORTANT): [sample #16] ESP log summary report (2 messages): @15:08:56.62 Selecting Cartridge 6 @16:10:33.21 Sampled 1000.0ml 2020-07-27T23:32:43.647Z,1595892763.647 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.766000 arcdeg , -121.864900 arcdeg 2020-07-28T02:50:55.180Z,1595904655.180 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:D.Waypoint](IMPORTANT): Reached Waypoint: 36.766000,-121.864900 2020-07-28T03:00:17.278Z,1595905217.278 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:A](IMPORTANT): Requesting ESP sample with cartridge type -6.000000 count 2020-07-28T03:00:19.371Z,1595905219.371 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-28T03:00:19.495Z,1595905219.495 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-28T03:00:56.884Z,1595905256.884 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-28T03:00:57.697Z,1595905257.697 [ESPComponent](IMPORTANT): [sample #17] Setting cartridge argument to -6 2020-07-28T03:00:57.697Z,1595905257.697 [ESPComponent](IMPORTANT): [sample #17] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-28T03:00:58.135Z,1595905258.135 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:D](IMPORTANT): ESP sampling at 16.530237 m in 14.206598 degC water with 1.965070 ug/l chlorophyll fluorescence. 2020-07-28T03:00:58.505Z,1595905258.505 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-28T03:00:58.903Z,1595905258.903 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-28T03:01:00.927Z,1595905260.927 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-28T03:01:33.653Z,1595905293.653 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_WAITING_FOR_PRIMING (@5,archive_bac) 2020-07-28T03:01:35.270Z,1595905295.270 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_PRIMING (@100.0) 2020-07-28T03:01:36.076Z,1595905296.076 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-28T03:04:24.579Z,1595905464.579 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_FILTERING (@0.0) 2020-07-28T03:04:24.980Z,1595905464.980 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-28T03:23:55.844Z,1595906635.844 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_PAUSED (@401.733) 2020-07-28T03:23:56.251Z,1595906636.251 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_PROCESSING (@401.733) 2020-07-28T03:23:58.674Z,1595906638.674 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_WAITING_FOR_PROCESSED (@5,archive_bac) 2020-07-28T03:36:01.872Z,1595907361.872 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_STOPPING (@5,archive_bac) 2020-07-28T03:36:27.325Z,1595907387.325 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-28T03:36:27.732Z,1595907387.732 [ESPComponent](IMPORTANT): [sample #17] ESP sampling state: S_STOPPED 2020-07-28T03:41:27.524Z,1595907687.524 [ESPComponent](IMPORTANT): [sample #17] ESP sampling sequence completed normally. 2020-07-28T03:41:27.931Z,1595907687.931 [ESPComponent](IMPORTANT): [sample #17] ESP log summary report (3 messages): @20:01:10.23 Selecting Cartridge 5 @20:23:53.04 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @20:23:53.24 Sampled 401.7ml 2020-07-28T03:46:24.809Z,1595907984.809 [CBIT](IMPORTANT): Beginning ground fault scan 2020-07-28T03:46:37.474Z,1595907997.474 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): 0.000186 CHAN A1 (24V): -0.002915 CHAN A2 (12V): 0.000643 CHAN A3 (5V): -0.001151 CHAN B0 (3.3V): -0.001060 CHAN B1 (3.15aV): -0.000888 CHAN B2 (3.15bV): -0.000949 CHAN B3 (GND): -0.001201 OPEN: 0.014045 Full Scale Calc: 4.765 mA, -1.589 mA 2020-07-28T03:48:56.437Z,1595908136.437 [esp_sample_station:Lap:A](IMPORTANT): Starting Lap 2020-07-28T03:48:56.853Z,1595908136.853 [esp_sample_station:Lap:B](IMPORTANT): Lat[1] = 36.797000 arcdeg Lon[1] = -121.847000 arcdeg 2020-07-28T03:48:57.245Z,1595908137.245 [esp_sample_station:Lap:C](IMPORTANT): Lat[2] = 36.821900 arcdeg Lon[2] = -121.885600 arcdeg 2020-07-28T03:48:57.657Z,1595908137.657 [esp_sample_station:Lap:D](IMPORTANT): Lat[3] = 36.766000 arcdeg Lon[3] = -121.864900 arcdeg 2020-07-28T03:48:58.055Z,1595908138.055 [esp_sample_station:Lap:E](IMPORTANT): Lat[4] = nan arcdeg Lon[4] = nan arcdeg 2020-07-28T03:49:02.106Z,1595908142.106 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.797000 arcdeg , -121.847000 arcdeg 2020-07-28T05:38:39.657Z,1595914719.657 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:D.Waypoint](IMPORTANT): Reached Waypoint: 36.797000,-121.847000 2020-07-28T05:46:13.425Z,1595915173.425 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:A](IMPORTANT): Requesting ESP sample with cartridge type -6.000000 count 2020-07-28T05:46:15.531Z,1595915175.531 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-28T05:46:15.622Z,1595915175.622 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-28T05:46:52.991Z,1595915212.991 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-28T05:46:53.799Z,1595915213.799 [ESPComponent](IMPORTANT): [sample #18] Setting cartridge argument to -6 2020-07-28T05:46:53.799Z,1595915213.799 [ESPComponent](IMPORTANT): [sample #18] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-28T05:46:54.272Z,1595915214.272 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:D](IMPORTANT): ESP sampling at 12.342613 m in 14.389521 degC water with 20.414581 ug/l chlorophyll fluorescence. 2020-07-28T05:46:54.604Z,1595915214.604 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-28T05:46:55.012Z,1595915215.012 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-28T05:46:57.033Z,1595915217.033 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-28T05:47:29.755Z,1595915249.755 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_WAITING_FOR_PRIMING (@4,archive_bac) 2020-07-28T05:47:31.368Z,1595915251.368 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_PRIMING (@100.0) 2020-07-28T05:47:32.987Z,1595915252.987 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-28T05:50:12.581Z,1595915412.581 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_FILTERING (@0.0) 2020-07-28T05:50:12.984Z,1595915412.984 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-28T06:10:36.389Z,1595916636.389 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_PAUSED (@368.454) 2020-07-28T06:10:36.787Z,1595916636.787 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_PROCESSING (@368.454) 2020-07-28T06:10:39.212Z,1595916639.212 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_WAITING_FOR_PROCESSED (@4,archive_bac) 2020-07-28T06:22:42.402Z,1595917362.402 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_STOPPING (@4,archive_bac) 2020-07-28T06:23:07.859Z,1595917387.859 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-28T06:23:08.257Z,1595917388.257 [ESPComponent](IMPORTANT): [sample #18] ESP sampling state: S_STOPPED 2020-07-28T06:28:08.057Z,1595917688.057 [ESPComponent](IMPORTANT): [sample #18] ESP sampling sequence completed normally. 2020-07-28T06:28:08.468Z,1595917688.468 [ESPComponent](IMPORTANT): [sample #18] ESP log summary report (3 messages): @22:47:06.15 Selecting Cartridge 4 @23:10:33.80 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @23:10:34.00 Sampled 368.5ml 2020-07-28T06:28:10.071Z,1595917690.071 [RudderServo](FAULT): Rudder uart error - getPosition..serial timeout 2020-07-28T06:33:54.897Z,1595918034.897 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.821900 arcdeg , -121.885600 arcdeg 2020-07-28T07:59:04.672Z,1595923144.672 [ThrusterServo](FAULT): Invalid EZ Servo response:"" 2020-07-28T09:22:38.088Z,1595928158.088 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:D.Waypoint](IMPORTANT): Reached Waypoint: 36.821900,-121.885600 2020-07-28T09:30:56.506Z,1595928656.506 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:A](IMPORTANT): Requesting ESP sample with cartridge type -6.000000 count 2020-07-28T09:30:58.580Z,1595928658.580 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-28T09:30:58.707Z,1595928658.707 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-28T09:31:36.091Z,1595928696.091 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-28T09:31:36.903Z,1595928696.903 [ESPComponent](IMPORTANT): [sample #19] Setting cartridge argument to -6 2020-07-28T09:31:36.903Z,1595928696.903 [ESPComponent](IMPORTANT): [sample #19] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-28T09:31:37.351Z,1595928697.351 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:D](IMPORTANT): ESP sampling at 17.445562 m in 12.110682 degC water with 1.352610 ug/l chlorophyll fluorescence. 2020-07-28T09:31:37.711Z,1595928697.711 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-28T09:31:38.112Z,1595928698.112 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-28T09:31:40.132Z,1595928700.132 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-28T09:32:12.856Z,1595928732.856 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_WAITING_FOR_PRIMING (@3,archive_bac) 2020-07-28T09:32:14.475Z,1595928734.475 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_PRIMING (@100.0) 2020-07-28T09:32:16.093Z,1595928736.093 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-28T09:34:55.275Z,1595928895.275 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_FILTERING (@0.0) 2020-07-28T09:34:55.674Z,1595928895.674 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-28T09:46:37.563Z,1595929597.563 [CBIT](IMPORTANT): Beginning ground fault scan 2020-07-28T09:46:48.462Z,1595929608.462 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): 0.003351 CHAN A1 (24V): -0.002421 CHAN A2 (12V): 0.017810 CHAN A3 (5V): -0.001793 CHAN B0 (3.3V): 0.015549 CHAN B1 (3.15aV): 0.011687 CHAN B2 (3.15bV): 0.015509 CHAN B3 (GND): -0.001412 OPEN: 0.008981 Full Scale Calc: 4.765 mA, -1.589 mA 2020-07-28T10:30:54.344Z,1595932254.344 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_PAUSED (@977.059) 2020-07-28T10:30:54.749Z,1595932254.749 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_PROCESSING (@977.059) 2020-07-28T10:30:57.176Z,1595932257.176 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_WAITING_FOR_PROCESSED (@3,archive_bac) 2020-07-28T10:43:00.392Z,1595932980.392 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_STOPPING (@3,archive_bac) 2020-07-28T10:43:26.252Z,1595933006.252 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-28T10:43:26.652Z,1595933006.652 [ESPComponent](IMPORTANT): [sample #19] ESP sampling state: S_STOPPED 2020-07-28T10:48:26.432Z,1595933306.432 [ESPComponent](IMPORTANT): [sample #19] ESP sampling sequence completed normally. 2020-07-28T10:48:26.840Z,1595933306.840 [ESPComponent](IMPORTANT): [sample #19] ESP log summary report (3 messages): @02:31:49.51 Selecting Cartridge 3 @03:30:51.45 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @03:30:51.64 Sampled 977.1ml 2020-07-28T10:53:27.210Z,1595933607.210 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:C](IMPORTANT): Navigating to WP 36.766000 arcdeg , -121.864900 arcdeg 2020-07-28T13:11:59.179Z,1595941919.179 [NAL9602](FAULT): Verify xmit timeout failure. 2020-07-28T13:11:59.983Z,1595941919.983 [NAL9602](FAULT): LCB fault: Software Overcurrent. 2020-07-28T14:41:31.103Z,1595947291.103 [esp_sample_station:Lap:WaypointTrajectory:Station:GoToStation:D.Waypoint](IMPORTANT): Reached Waypoint: 36.766000,-121.864900 2020-07-28T14:47:57.206Z,1595947677.206 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:A](IMPORTANT): Requesting ESP sample with cartridge type -6.000000 count 2020-07-28T14:47:59.303Z,1595947679.303 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2020-07-28T14:47:59.602Z,1595947679.602 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2020-07-28T14:48:37.304Z,1595947717.304 [ESPComponent](IMPORTANT): ESP has connected as client 2020-07-28T14:48:38.116Z,1595947718.116 [ESPComponent](IMPORTANT): [sample #20] Setting cartridge argument to -6 2020-07-28T14:48:38.116Z,1595947718.116 [ESPComponent](IMPORTANT): [sample #20] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2020-07-28T14:48:38.621Z,1595947718.621 [esp_sample_station:Lap:WaypointTrajectory:Station:SampleOnStation:ProfileSample:CircleSample:SampleESP:D](IMPORTANT): ESP sampling at 9.965213 m in 14.787745 degC water with 17.508221 ug/l chlorophyll fluorescence. 2020-07-28T14:48:38.920Z,1595947718.920 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_PREPARING_SHOW_LOG 2020-07-28T14:48:39.324Z,1595947719.324 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_PREPARING_SHOW_STATUS 2020-07-28T14:48:41.345Z,1595947721.345 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_LOADING_CARTRIDGE 2020-07-28T14:49:14.071Z,1595947754.071 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_WAITING_FOR_PRIMING (@2,archive_bac) 2020-07-28T14:49:15.684Z,1595947755.684 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_PRIMING (@100.0) 2020-07-28T14:49:16.495Z,1595947756.495 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2020-07-28T14:51:58.505Z,1595947918.505 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_FILTERING (@0.0) 2020-07-28T14:51:58.908Z,1595947918.908 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2020-07-28T15:02:24.748Z,1595948544.748 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_PAUSED (@250.941) 2020-07-28T15:02:25.152Z,1595948545.152 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_PROCESSING (@250.941) 2020-07-28T15:02:27.580Z,1595948547.580 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_WAITING_FOR_PROCESSED (@2,archive_bac) 2020-07-28T15:14:30.779Z,1595949270.779 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_STOPPING (@2,archive_bac) 2020-07-28T15:14:56.241Z,1595949296.241 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs & 2020-07-28T15:14:56.648Z,1595949296.648 [ESPComponent](IMPORTANT): [sample #20] ESP sampling state: S_STOPPED 2020-07-28T15:19:56.540Z,1595949596.540 [ESPComponent](IMPORTANT): [sample #20] ESP sampling sequence completed normally. 2020-07-28T15:19:56.950Z,1595949596.950 [ESPComponent](IMPORTANT): [sample #20] ESP log summary report (3 messages): @07:48:50.96 Selecting Cartridge 2 @08:02:21.84 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @08:02:22.03 Sampled 250.9ml 2020-07-28T15:29:20.934Z,1595950160.934 [MissionManager](IMPORTANT): Started mission Default 2020-07-28T15:29:21.143Z,1595950161.143 [WetLabsBB2FL](FAULT): LCB fault: Software Overcurrent. 2020-07-28T15:29:21.712Z,1595950161.712 [Aanderaa_O2](FAULT): LCB fault: Software Overcurrent. 2020-07-28T15:35:43.034Z,1595950543.034 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 6.361091 min 2020-07-28T15:41:30.890Z,1595950890.890 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 12.158773 min 2020-07-28T15:42:55.421Z,1595950975.421 [DataOverHttps](IMPORTANT): SBD MTMSN=20200728T154206 2020-07-28T15:43:02.800Z,1595950982.800 [CommandLine](IMPORTANT): got command schedule asap "load Science/profile_station.xml;set profile_station.MissionTimeout 12 hour;set profile_station.Lat 36.7970 degree;set profile_station.Lon -121.8470 degree;set profile_station.YoYoMinDepth 5 meter" 3ooxx 1 2.000000 2020-07-28T15:43:02.801Z,1595950982.801 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=3ooxx 2020-07-28T15:43:02.801Z,1595950982.801 [CommandLine](IMPORTANT): Scheduled #23 (#1 of 2 with id='3ooxx'): "load Science/profile_station.xml;set profile_station.MissionTimeout 12 hour;set profile_station.Lat 36.7970 degree;set profile_station.Lon -121.8470 degree;set profile_station.YoYoMinDepth 5 meter" ASAP 2020-07-28T15:43:03.709Z,1595950983.709 [DataOverHttps](IMPORTANT): SBD MTMSN=20200728T154215 2020-07-28T15:43:11.004Z,1595950991.004 [CommandLine](IMPORTANT): got command schedule asap "set profile_station.YoYoMaxDepth 50 meter;set profile_station.Speed 0.65 meter_per_second;run " 3ooxx 2 2.000000 2020-07-28T15:43:11.004Z,1595950991.004 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=3ooxx 2020-07-28T15:43:11.005Z,1595950991.005 [CommandLine](IMPORTANT): Scheduled #24 (#2 of 2 with id='3ooxx'): "set profile_station.YoYoMaxDepth 50 meter;set profile_station.Speed 0.65 meter_per_second;run " ASAP 2020-07-28T15:43:11.119Z,1595950991.119 [CommandLine](IMPORTANT): got command load ./Missions/Science/profile_station.xml 2020-07-28T15:43:12.839Z,1595950992.839 [CommandLine](IMPORTANT): Loaded ./Missions/Science/profile_station.xml 2020-07-28T15:43:23.248Z,1595951003.248 [CommandLine](IMPORTANT): got command set profile_station.MissionTimeout 12.000000 hour 2020-07-28T15:43:23.249Z,1595951003.249 [CommandLine](IMPORTANT): got command set profile_station.Lat 36.797001 degree 2020-07-28T15:43:23.249Z,1595951003.249 [CommandLine](IMPORTANT): got command set profile_station.Lon -121.847000 degree 2020-07-28T15:43:23.250Z,1595951003.250 [CommandLine](IMPORTANT): got command set profile_station.YoYoMinDepth 5.000000 meter 2020-07-28T15:43:28.264Z,1595951008.264 [CommandLine](IMPORTANT): got command set profile_station.YoYoMaxDepth 50.000000 meter 2020-07-28T15:43:28.264Z,1595951008.264 [CommandLine](IMPORTANT): got command set profile_station.Speed 0.650000 meter_per_second 2020-07-28T15:43:28.265Z,1595951008.265 [CommandLine](IMPORTANT): got command run 2020-07-28T15:43:28.268Z,1595951008.268 [CommandLine](IMPORTANT): Running 2020-07-28T15:43:28.417Z,1595951008.417 [MissionManager](IMPORTANT): Started mission profile_station 2020-07-28T15:46:48.618Z,1595951208.618 [CBIT](IMPORTANT): Beginning ground fault scan 2020-07-28T15:46:59.418Z,1595951219.418 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.074632 CHAN A1 (24V): -0.002633 CHAN A2 (12V): 0.055711 CHAN A3 (5V): -0.000716 CHAN B0 (3.3V): 0.011968 CHAN B1 (3.15aV): -0.001309 CHAN B2 (3.15bV): 0.012744 CHAN B3 (GND): -0.000474 OPEN: 0.015267 Full Scale Calc: 4.765 mA, -1.589 mA 2020-07-28T17:58:06.856Z,1595959086.856 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=38853, MT Status=1, MTMSN=2739 2020-07-28T17:58:07.656Z,1595959087.656 [CommandLine](IMPORTANT): got command schedule asap "load Science/sci2.xml;set sci2.MissionTimeout 14 hour;set sci2.Lat1 36.8219 degree;set sci2.Lon1 -121.8856 degree;set sci2.Lat2 36.7660 degree;set sci2.Lon2 -121.8649 degree;set sci2.Lat3 36.7970 degree" 3ouy5 1 2.000000 2020-07-28T17:58:07.656Z,1595959087.656 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=3ouy5 2020-07-28T17:58:07.657Z,1595959087.657 [CommandLine](IMPORTANT): Scheduled #25 (#1 of 2 with id='3ouy5'): "load Science/sci2.xml;set sci2.MissionTimeout 14 hour;set sci2.Lat1 36.8219 degree;set sci2.Lon1 -121.8856 degree;set sci2.Lat2 36.7660 degree;set sci2.Lon2 -121.8649 degree;set sci2.Lat3 36.7970 degree" ASAP 2020-07-28T17:58:27.139Z,1595959107.139 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=38854, MT Status=1, MTMSN=2740 2020-07-28T17:58:27.881Z,1595959107.881 [CommandLine](IMPORTANT): got command schedule asap "set sci2.Lon3 -121.8470 degree;set sci2.Speed 0.65 meter_per_second;set sci2.YoYoMinDepth 5 meter;set sci2.YoYoMaxDepth 50 meter;set sci2.MaxDepth 60 meter;run " 3ouy5 2 2.000000 2020-07-28T17:58:27.881Z,1595959107.881 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=3ouy5 2020-07-28T17:58:27.882Z,1595959107.882 [CommandLine](IMPORTANT): Scheduled #26 (#2 of 2 with id='3ouy5'): "set sci2.Lon3 -121.8470 degree;set sci2.Speed 0.65 meter_per_second;set sci2.YoYoMinDepth 5 meter;set sci2.YoYoMaxDepth 50 meter;set sci2.MaxDepth 60 meter;run " ASAP 2020-07-28T17:58:28.007Z,1595959108.007 [CommandLine](IMPORTANT): got command load ./Missions/Science/sci2.xml 2020-07-28T17:58:30.474Z,1595959110.474 [CommandLine](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2020-07-28T17:58:30.840Z,1595959110.840 [MissionManager](IMPORTANT): Started mission Default 2020-07-28T17:58:38.679Z,1595959118.679 [CommandLine](IMPORTANT): got command set sci2.MissionTimeout 14.000000 hour 2020-07-28T17:58:38.680Z,1595959118.680 [CommandLine](IMPORTANT): got command set sci2.Lat1 36.821899 degree 2020-07-28T17:58:38.680Z,1595959118.680 [CommandLine](IMPORTANT): got command set sci2.Lon1 -121.885597 degree 2020-07-28T17:58:38.681Z,1595959118.681 [CommandLine](IMPORTANT): got command set sci2.Lat2 36.765999 degree 2020-07-28T17:58:38.682Z,1595959118.682 [CommandLine](IMPORTANT): got command set sci2.Lon2 -121.864899 degree 2020-07-28T17:58:38.682Z,1595959118.682 [CommandLine](IMPORTANT): got command set sci2.Lat3 36.797001 degree 2020-07-28T17:58:46.707Z,1595959126.707 [CommandLine](IMPORTANT): got command set sci2.Lon3 -121.847000 degree 2020-07-28T17:58:46.707Z,1595959126.707 [CommandLine](IMPORTANT): got command set sci2.Speed 0.650000 meter_per_second 2020-07-28T17:58:46.708Z,1595959126.708 [CommandLine](IMPORTANT): got command set sci2.YoYoMinDepth 5.000000 meter 2020-07-28T17:58:46.709Z,1595959126.709 [CommandLine](IMPORTANT): got command set sci2.YoYoMaxDepth 50.000000 meter 2020-07-28T17:58:46.710Z,1595959126.710 [CommandLine](IMPORTANT): got command set sci2.MaxDepth 60.000000 meter 2020-07-28T17:58:46.710Z,1595959126.710 [CommandLine](IMPORTANT): got command run 2020-07-28T17:58:46.713Z,1595959126.713 [CommandLine](IMPORTANT): Running 2020-07-28T17:58:46.974Z,1595959126.974 [MissionManager](IMPORTANT): Started mission sci2 2020-07-28T18:07:14.852Z,1595959634.852 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2020-07-28T19:08:02.062Z,1595963282.062 [NAL9602](FAULT): received: +CSQ:0 OK861, 2, 0, 0, 0 OK 2020-07-28T20:37:51.399Z,1595968671.399 [sci2:Lap:Wpt1:A.Waypoint](IMPORTANT): Reached Waypoint: 36.821898,-121.885600 2020-07-28T21:46:59.446Z,1595972819.446 [CBIT](IMPORTANT): Beginning ground fault scan 2020-07-28T21:47:10.357Z,1595972830.357 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.089274 CHAN A1 (24V): -0.001489 CHAN A2 (12V): -0.000170 CHAN A3 (5V): -0.001959 CHAN B0 (3.3V): -0.000101 CHAN B1 (3.15aV): -0.001182 CHAN B2 (3.15bV): -0.000510 CHAN B3 (GND): -0.001387 OPEN: 0.014035 Full Scale Calc: 4.765 mA, -1.589 mA 2020-07-28T22:37:59.069Z,1595975879.069 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=38889, MT Status=1, MTMSN=2741 2020-07-28T22:37:59.624Z,1595975879.624 [CommandLine](IMPORTANT): got command schedule clear 2020-07-28T22:37:59.624Z,1595975879.624 [CommandLine](IMPORTANT): #Cleared scheduled commands:0 2020-07-28T22:37:59.625Z,1595975879.625 [CommandLine](IMPORTANT): got command schedule resume 2020-07-28T22:38:19.084Z,1595975899.084 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=38890, MT Status=1, MTMSN=2742 2020-07-28T22:38:19.915Z,1595975899.915 [CommandLine](IMPORTANT): got command schedule "load Science/profile_station.xml;set profile_station.MissionTimeout 14 hour;set profile_station.Lat 36.7970 degree;set profile_station.Lon -121.8470 degree;set profile_station.YoYoMaxDepth 50 meter;set profile_station.MaxDepth 60 meter" 3p78c 1 2.000000 2020-07-28T22:38:19.915Z,1595975899.915 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=3p78c 2020-07-28T22:38:19.916Z,1595975899.916 [CommandLine](IMPORTANT): Scheduled #27 (#1 of 2 with id='3p78c'): "load Science/profile_station.xml;set profile_station.MissionTimeout 14 hour;set profile_station.Lat 36.7970 degree;set profile_station.Lon -121.8470 degree;set profile_station.YoYoMaxDepth 50 meter;set profile_station.MaxDepth 60 meter" 2020-07-28T23:46:56.616Z,1595980016.616 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=38891, MT Status=1, MTMSN=2743 2020-07-28T23:46:57.208Z,1595980017.208 [CommandLine](IMPORTANT): got command schedule "run " 3p78c 2 2.000000 2020-07-28T23:46:57.209Z,1595980017.209 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=3p78c 2020-07-28T23:46:57.210Z,1595980017.210 [CommandLine](IMPORTANT): Scheduled #28 (#2 of 2 with id='3p78c'): "run " 2020-07-29T00:16:55.301Z,1595981815.301 [sci2:Lap:Wpt2:A.Waypoint](IMPORTANT): Reached Waypoint: 36.766000,-121.864905 2020-07-29T00:18:04.479Z,1595981884.479 [RudderServo](FAULT): Rudder uart error - getPosition..serial timeout 2020-07-29T02:04:39.729Z,1595988279.729 [sci2:Lap:Wpt3:A.Waypoint](IMPORTANT): Reached Waypoint: 36.797002,-121.846996 2020-07-29T02:04:41.467Z,1595988281.467 [CommandLine](IMPORTANT): got command load ./Missions/Science/profile_station.xml 2020-07-29T02:04:42.527Z,1595988282.527 [Aanderaa_O2](FAULT): LCB fault: Software Overcurrent. 2020-07-29T02:04:42.913Z,1595988282.913 [CommandLine](IMPORTANT): Loaded ./Missions/Science/profile_station.xml 2020-07-29T02:04:43.018Z,1595988283.018 [MissionManager](IMPORTANT): Started mission Default 2020-07-29T02:04:57.851Z,1595988297.851 [CommandLine](IMPORTANT): got command set profile_station.MissionTimeout 14.000000 hour 2020-07-29T02:04:57.852Z,1595988297.852 [CommandLine](IMPORTANT): got command set profile_station.Lat 36.797001 degree 2020-07-29T02:04:57.853Z,1595988297.853 [CommandLine](IMPORTANT): got command set profile_station.Lon -121.847000 degree 2020-07-29T02:04:57.854Z,1595988297.854 [CommandLine](IMPORTANT): got command set profile_station.YoYoMaxDepth 50.000000 meter 2020-07-29T02:04:57.854Z,1595988297.854 [CommandLine](IMPORTANT): got command set profile_station.MaxDepth 60.000000 meter 2020-07-29T02:04:58.059Z,1595988298.059 [CommandLine](IMPORTANT): got command run 2020-07-29T02:04:58.061Z,1595988298.061 [CommandLine](IMPORTANT): Running 2020-07-29T02:04:58.309Z,1595988298.309 [MissionManager](IMPORTANT): Started mission profile_station 2020-07-29T03:47:10.569Z,1595994430.569 [CBIT](IMPORTANT): Beginning ground fault scan 2020-07-29T03:47:21.481Z,1595994441.481 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.079976 CHAN A1 (24V): -0.009942 CHAN A2 (12V): 0.111228 CHAN A3 (5V): 0.013496 CHAN B0 (3.3V): 0.005373 CHAN B1 (3.15aV): 0.004871 CHAN B2 (3.15bV): 0.004995 CHAN B3 (GND): -0.006448 OPEN: 0.013211 Full Scale Calc: 4.765 mA, -1.589 mA 2020-07-29T09:47:21.735Z,1596016041.735 [CBIT](IMPORTANT): Beginning ground fault scan 2020-07-29T09:47:32.641Z,1596016052.641 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.070882 CHAN A1 (24V): -0.002463 CHAN A2 (12V): 0.062628 CHAN A3 (5V): 0.003705 CHAN B0 (3.3V): -0.000566 CHAN B1 (3.15aV): 0.013876 CHAN B2 (3.15bV): 0.011117 CHAN B3 (GND): -0.000637 OPEN: 0.015293 Full Scale Calc: 4.765 mA, -1.589 mA