2017-12-16T14:47:21.486Z,1513435641.486 [CommandLine](IMPORTANT): got command restart logs 2017-12-16T14:47:41.494Z,1513435661.494 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=20316, MT Status=1, MTMSN=973 2017-12-16T14:47:42.263Z,1513435662.263 [CommandLine](IMPORTANT): got command schedule asap "load Science/chlpeak_sampling_InAboveBelow.xml;set DriftOrDonutAtChlPeak.MissionTimeout 20 hour;set DriftOrDonutAtChlPeak.AcousticTimeout 21 hour;set DriftOrDonutAtChlPeak.SpeedChlPeakHoldingSampling 0 meter_per_second" urli 1 5.000000 2017-12-16T14:47:42.264Z,1513435662.264 [CommandLine](IMPORTANT): Scheduling command #1 of 5 with id=urli 2017-12-16T14:47:42.265Z,1513435662.265 [CommandLine](IMPORTANT): Scheduled #31 (#1 of 5 with id='urli'): "load Science/chlpeak_sampling_InAboveBelow.xml;set DriftOrDonutAtChlPeak.MissionTimeout 20 hour;set DriftOrDonutAtChlPeak.AcousticTimeout 21 hour;set DriftOrDonutAtChlPeak.SpeedChlPeakHoldingSampling 0 meter_per_second" ASAP 2017-12-16T14:47:55.645Z,1513435675.645 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=20317, MT Status=1, MTMSN=974 2017-12-16T14:47:56.472Z,1513435676.472 [CommandLine](IMPORTANT): got command schedule asap "set DriftOrDonutAtChlPeak.Lat1 36.793 degree;set DriftOrDonutAtChlPeak.Lon1 -121.877 degree;set DriftOrDonutAtChlPeak.VertDist4 0 meter;set DriftOrDonutAtChlPeak.VertDist5 0 meter;set DriftOrDonutAtChlPeak.VertDist6 0 meter" urli 2 5.000000 2017-12-16T14:47:56.472Z,1513435676.472 [CommandLine](IMPORTANT): Scheduling command #2 of 5 with id=urli 2017-12-16T14:47:56.473Z,1513435676.473 [CommandLine](IMPORTANT): Scheduled #32 (#2 of 5 with id='urli'): "set DriftOrDonutAtChlPeak.Lat1 36.793 degree;set DriftOrDonutAtChlPeak.Lon1 -121.877 degree;set DriftOrDonutAtChlPeak.VertDist4 0 meter;set DriftOrDonutAtChlPeak.VertDist5 0 meter;set DriftOrDonutAtChlPeak.VertDist6 0 meter" ASAP 2017-12-16T14:48:13.006Z,1513435693.006 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=20318, MT Status=1, MTMSN=975 2017-12-16T14:48:13.787Z,1513435693.787 [CommandLine](IMPORTANT): got command schedule asap "set DriftOrDonutAtChlPeak.VertDist7 0 meter;set DriftOrDonutAtChlPeak.VertDist8 0 meter;set DriftOrDonutAtChlPeak.VertDist9 0 meter;set DriftOrDonutAtChlPeak.Reacq4 1 bool;set DriftOrDonutAtChlPeak.Reacq7 1 bool" urli 3 5.000000 2017-12-16T14:48:13.787Z,1513435693.787 [CommandLine](IMPORTANT): Scheduling command #3 of 5 with id=urli 2017-12-16T14:48:13.788Z,1513435693.788 [CommandLine](IMPORTANT): Scheduled #33 (#3 of 5 with id='urli'): "set DriftOrDonutAtChlPeak.VertDist7 0 meter;set DriftOrDonutAtChlPeak.VertDist8 0 meter;set DriftOrDonutAtChlPeak.VertDist9 0 meter;set DriftOrDonutAtChlPeak.Reacq4 1 bool;set DriftOrDonutAtChlPeak.Reacq7 1 bool" ASAP 2017-12-16T14:48:26.757Z,1513435706.757 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=20319, MT Status=1, MTMSN=976 2017-12-16T14:48:27.497Z,1513435707.497 [CommandLine](IMPORTANT): got command schedule asap "set DriftOrDonutAtChlPeak.DeepBoundChl 50 meter;set DriftOrDonutAtChlPeak.CylinderTimeout 120 minute;set DriftOrDonutAtChlPeak.CylinderYoYoMaxDep 50 meter;set DriftOrDonutAtChlPeak.CylinderRadius 500 meter" urli 4 5.000000 2017-12-16T14:48:27.497Z,1513435707.497 [CommandLine](IMPORTANT): Scheduling command #4 of 5 with id=urli 2017-12-16T14:48:27.498Z,1513435707.498 [CommandLine](IMPORTANT): Scheduled #34 (#4 of 5 with id='urli'): "set DriftOrDonutAtChlPeak.DeepBoundChl 50 meter;set DriftOrDonutAtChlPeak.CylinderTimeout 120 minute;set DriftOrDonutAtChlPeak.CylinderYoYoMaxDep 50 meter;set DriftOrDonutAtChlPeak.CylinderRadius 500 meter" ASAP 2017-12-16T14:48:48.769Z,1513435728.769 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=20320, MT Status=1, MTMSN=977 2017-12-16T14:48:49.507Z,1513435729.507 [CommandLine](IMPORTANT): got command schedule asap "set DriftOrDonutAtChlPeak.YoYoMaxDepth 50 meter;set DriftOrDonutAtChlPeak.MaxDepth 80 meter;set DriftOrDonutAtChlPeak.MaxWaitNoFiring 4 hour;run " urli 5 5.000000 2017-12-16T14:48:49.508Z,1513435729.508 [CommandLine](IMPORTANT): Scheduling command #5 of 5 with id=urli 2017-12-16T14:48:49.509Z,1513435729.509 [CommandLine](IMPORTANT): Scheduled #35 (#5 of 5 with id='urli'): "set DriftOrDonutAtChlPeak.YoYoMaxDepth 50 meter;set DriftOrDonutAtChlPeak.MaxDepth 80 meter;set DriftOrDonutAtChlPeak.MaxWaitNoFiring 4 hour;run " ASAP 2017-12-16T14:48:49.721Z,1513435729.721 [CommandLine](IMPORTANT): got command load ./Missions/Science/chlpeak_sampling_InAboveBelow.xml 2017-12-16T14:48:56.158Z,1513435736.158 [CommandLine](IMPORTANT): Loaded ./Missions/Science/chlpeak_sampling_InAboveBelow.xml 2017-12-16T14:49:15.464Z,1513435755.464 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.MissionTimeout 20.000000 hour 2017-12-16T14:49:15.465Z,1513435755.465 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.AcousticTimeout 21.000000 hour 2017-12-16T14:49:15.466Z,1513435755.466 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.SpeedChlPeakHoldingSampling 0.000000 meter_per_second 2017-12-16T14:49:35.842Z,1513435775.842 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.Lat1 36.792999 degree 2017-12-16T14:49:35.843Z,1513435775.843 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.Lon1 -121.876999 degree 2017-12-16T14:49:35.844Z,1513435775.844 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.VertDist4 0.000000 meter 2017-12-16T14:49:35.844Z,1513435775.844 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.VertDist5 0.000000 meter 2017-12-16T14:49:35.845Z,1513435775.845 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.VertDist6 0.000000 meter 2017-12-16T14:49:57.194Z,1513435797.194 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.VertDist7 0.000000 meter 2017-12-16T14:49:57.204Z,1513435797.204 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.VertDist8 0.000000 meter 2017-12-16T14:49:57.204Z,1513435797.204 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.VertDist9 0.000000 meter 2017-12-16T14:49:57.205Z,1513435797.205 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.Reacq4 1.000000 bool 2017-12-16T14:49:57.206Z,1513435797.206 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.Reacq7 1.000000 bool 2017-12-16T14:50:17.552Z,1513435817.552 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.DeepBoundChl 50.000000 meter 2017-12-16T14:50:17.553Z,1513435817.553 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.CylinderTimeout 120.000000 minute 2017-12-16T14:50:17.554Z,1513435817.554 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.CylinderYoYoMaxDep 50.000000 meter 2017-12-16T14:50:17.555Z,1513435817.555 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.CylinderRadius 500.000000 meter 2017-12-16T14:50:32.027Z,1513435832.027 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.YoYoMaxDepth 50.000000 meter 2017-12-16T14:50:32.028Z,1513435832.028 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.MaxDepth 80.000000 meter 2017-12-16T14:50:32.028Z,1513435832.028 [CommandLine](IMPORTANT): got command set DriftOrDonutAtChlPeak.MaxWaitNoFiring 4.000000 hour 2017-12-16T14:50:32.029Z,1513435832.029 [CommandLine](IMPORTANT): got command run 2017-12-16T14:50:32.034Z,1513435832.034 [CommandLine](IMPORTANT): Running 2017-12-16T14:50:32.161Z,1513435832.161 [MissionManager](IMPORTANT): Started mission DriftOrDonutAtChlPeak 2017-12-16T15:01:44.355Z,1513436504.355 [CBIT](IMPORTANT): EFC elev offset (n=7200): elevOffset = 0.910750 degree 2017-12-16T15:37:38.935Z,1513438658.935 [DriftOrDonutAtChlPeak:FindHighChlLocation:Lap:Wpt1:A.Waypoint](IMPORTANT): Reached Waypoint: 36.793000,-121.876994 2017-12-16T15:37:41.760Z,1513438661.760 [DriftOrDonutAtChlPeak:FindHighChlLocation:SetSamplingLocationtoHiChlLocation:C](IMPORTANT): Set cylinder center to hi-chl location 36.808149 arcdeg , -121.891624 arcdeg , 2.490037 ug/l . 2017-12-16T15:37:42.124Z,1513438662.124 [DriftOrDonutAtChlPeak:FindHighChlLocation:CylinderYoYoAroundSamplingLocation:A](IMPORTANT): Yoyo profile on a cylinder around sampling location 36.808149 arcdeg , -121.891624 arcdeg , at radius = 500.000000 m 2017-12-16T15:49:45.911Z,1513439385.911 [CBIT](IMPORTANT): EFC elev offset (n=7200): elevOffset = 0.768856 degree 2017-12-16T16:14:24.199Z,1513440864.199 [RudderServo](FAULT): Rudder uart error - getPosition..serial timeout 2017-12-16T16:45:14.732Z,1513442714.732 [CBIT](IMPORTANT): EFC elev offset (n=7200): elevOffset = 0.635866 degree 2017-12-16T17:37:42.205Z,1513445862.205 [DriftOrDonutAtChlPeak:FindHighChlLocation:GoToCylinderCenter:A](IMPORTANT): Go to cylinder center (i.e., sampling location): 36.808149 arcdeg , -121.891624 arcdeg 2017-12-16T17:39:40.258Z,1513445980.258 [CBIT](IMPORTANT): Beginning ground fault scan 2017-12-16T17:39:51.121Z,1513445991.121 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.054633 CHAN A1 (24V): 0.032678 CHAN A2 (12V): 0.035244 CHAN A3 (5V): 0.005177 CHAN B0 (3.3V): 0.002838 CHAN B1 (3.15aV): 0.000348 CHAN B2 (3.15bV): 0.000708 CHAN B3 (GND): -0.007477 OPEN: 0.012403 Full Scale Calc: 4.765 mA, -1.589 mA 2017-12-16T17:42:15.606Z,1513446135.606 [CBIT](IMPORTANT): EFC elev offset (n=7200): elevOffset = 0.766098 degree 2017-12-16T17:47:37.483Z,1513446457.483 [DriftOrDonutAtChlPeak:FindHighChlLocation:GoToCylinderCenter:ToCylinderCenter.Waypoint](IMPORTANT): Reached Waypoint: 36.808149,-121.891624 2017-12-16T17:58:11.734Z,1513447091.734 [DriftOrDonutAtChlPeak:ChlPeakHolding:LogGoDown:B](IMPORTANT): Go down from 0.193932 m 2017-12-16T18:18:01.420Z,1513448281.420 [DriftOrDonutAtChlPeak:ChlPeakHolding:LogGoUp:B](IMPORTANT): Go up from 53.016979 m 2017-12-16T18:21:15.428Z,1513448475.428 [DriftOrDonutAtChlPeak:ChlPeakHolding:SetPeakDepth:G](IMPORTANT): Set PeakChlDepthSet. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlSet = 51.466896 m , 0.535800 ug/l , 16.213566 m , 0.772981 ug/l 2017-12-16T18:37:16.582Z,1513449436.582 [DriftOrDonutAtChlPeak:TakeSamples:Firing:C](IMPORTANT): Taking ESP sample No. 1.000000 count at target depth 16.213566 m . 2017-12-16T18:37:17.824Z,1513449437.824 [DriftOrDonutAtChlPeak:ChlPeakHolding:ResetFlagGoUpFlagGoDown:G](IMPORTANT): Hold depth. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlSet = 16.228546 m , 0.980400 ug/l , 16.213566 m , 0.772981 ug/l . 2017-12-16T18:50:18.643Z,1513450218.643 [ESPComponent](IMPORTANT): Powered ESP with command: ! echo 1 > /dev/loadA6 2017-12-16T18:50:18.643Z,1513450218.643 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 134.89.95.2:134.89.95.12 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 134.89.10.32 ms-dns 134.89.10.10 2017-12-16T18:50:18.708Z,1513450218.708 [CommandLine](IMPORTANT): got command ! echo 1 > /dev/loadA6 2017-12-16T18:50:18.968Z,1513450218.968 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2017-12-16T18:50:56.855Z,1513450256.855 [ESPComponent](IMPORTANT): ESP has connected as client 2017-12-16T18:50:57.673Z,1513450257.673 [ESPComponent](IMPORTANT): ESP sampling sequence starting (sample #16) sampling state: S_WAITING_INITIAL_PROMPT 2017-12-16T18:50:58.188Z,1513450258.188 [DriftOrDonutAtChlPeak:SampleAtDepth:SampleWrapper:SampleESP:B](IMPORTANT): ESP sampling at 16.430023 m inwater with 0.868657 ug/l chlorophyll fluorescence. 2017-12-16T18:50:58.453Z,1513450258.453 [ESPComponent](IMPORTANT): ESP sampling state: S_PREPARING_SHOW_LOG 2017-12-16T18:50:58.849Z,1513450258.849 [ESPComponent](IMPORTANT): ESP sampling state: S_PREPARING_SHOW_STATUS 2017-12-16T18:51:00.845Z,1513450260.845 [ESPComponent](IMPORTANT): ESP sampling state: S_LOADING_CARTRIDGE 2017-12-16T18:51:22.856Z,1513450282.856 [ESPComponent](IMPORTANT): ESP sampling state: S_FILTERING 2017-12-16T18:51:25.242Z,1513450285.242 [ESPComponent](IMPORTANT): ESP sampling state: S_WAITING_FOR_PAUSED 2017-12-16T19:19:48.458Z,1513451988.458 [ESPComponent](IMPORTANT): ESP sampling state: S_PROCESSING 2017-12-16T19:19:50.857Z,1513451990.857 [ESPComponent](IMPORTANT): ESP sampling state: S_WAITING_FOR_PROCESSED 2017-12-16T19:31:33.257Z,1513452693.257 [ESPComponent](IMPORTANT): ESP sampling state: S_STOPPING 2017-12-16T19:31:37.238Z,1513452697.238 [ESPComponent](CRITICAL): ESP sampling sequence terminated with error: Unexpected ESP state ES_PROCESS_FAILED. Expecting one of: ES_PROCESSED, ES_PROCESSING 2017-12-16T19:31:37.406Z,1513452697.406 [CommandLine](FAULT): Scheduling is paused 2017-12-16T19:31:38.412Z,1513452698.412 [MissionManager](IMPORTANT): Started mission Default 2017-12-16T19:31:39.067Z,1513452699.067 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T19:31:40.527Z,1513452700.527 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T19:31:41.991Z,1513452701.991 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T19:31:42.011Z,1513452702.011 [CBIT](FAULT): Hardware Fault in component: CTD_Seabird 2017-12-16T19:41:43.181Z,1513453303.181 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T19:41:44.495Z,1513453304.495 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T19:41:45.807Z,1513453305.807 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T19:41:47.255Z,1513453307.255 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T19:41:48.603Z,1513453308.603 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T19:41:48.727Z,1513453308.727 [CBIT](FAULT): Hardware Fault in component: CTD_Seabird 2017-12-16T19:44:45.496Z,1513453485.496 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 13.111229 min 2017-12-16T19:51:49.391Z,1513453909.391 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T19:51:50.827Z,1513453910.827 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T19:51:52.135Z,1513453912.135 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T19:51:53.503Z,1513453913.503 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T19:51:54.871Z,1513453914.871 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T19:51:55.139Z,1513453915.139 [CBIT](FAULT): Hardware Fault in component: CTD_Seabird 2017-12-16T19:52:57.901Z,1513453977.901 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 21.318166 min 2017-12-16T19:54:58.065Z,1513454098.065 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=20376, MT Status=1, MTMSN=978 2017-12-16T19:54:58.643Z,1513454098.643 [CommandLine](IMPORTANT): got command ! /mnt/mmc/LRAUV/Tools/esp-ppp-mivegas.sh 2017-12-16T19:54:59.169Z,1513454099.169 [CommandLine](IMPORTANT): /dev/mem opened. Memory mapped at address 0x40020000. Value at address 0x40028124 (0x40020124): 0x0 Written 0x8; readback 0x8 /dev/mem opened. Memory mapped at address 0x40020000. Value at address 0x40028050 (0x40020050): 0x0 Written 0x8; readback 0x8 /dev/mem opened. Memory mapped at address 0x40020000. Value at address 0x40028044 (0x40020044): 0x0 Written 0x8; readback 0x8 2017-12-16T20:01:46.392Z,1513454506.392 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 30.126007 min 2017-12-16T20:01:56.175Z,1513454516.175 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:01:57.487Z,1513454517.487 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:01:58.939Z,1513454518.939 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:02:00.251Z,1513454520.251 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:02:01.695Z,1513454521.695 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:02:01.989Z,1513454521.989 [CBIT](FAULT): Hardware Fault in component: CTD_Seabird 2017-12-16T20:02:19.105Z,1513454539.105 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=20381, MT Status=1, MTMSN=979 2017-12-16T20:02:19.647Z,1513454539.647 [CommandLine](IMPORTANT): got command ! ifconfig 2017-12-16T20:02:19.825Z,1513454539.825 [CommandLine](IMPORTANT): eth0 Link encap:Ethernet HWaddr 50:2D:F4:07:45:52 inet addr:134.89.95.2 Bcast:134.89.95.15 Mask:255.255.255.240 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:9809 errors:14 dropped:0 overruns:0 frame:14 TX packets:20276 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:1607112 (1.5 Mb) TX bytes:10675131 (10.1 Mb) Interrupt:29 lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 UP LOOPBACK RUNNING MULTICAST MTU:16436 Metric:1 RX packets:115471 errors:0 dropped:0 overruns:0 frame:0 TX packets:115471 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:12872755 (12.2 Mb) TX bytes:12872755 (12.2 Mb) ppp0 Link encap:Point-to-Point Protocol inet addr:134.89.95.2 P-t-P:134.89.95.12 Mask:255.255.255.255 UP POINTOPOINT RUNNING NOARP MULTICAST MTU:1500 Metric:1 RX packets:9 errors:0 dropped:0 overruns:0 frame:0 TX packets:9 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:3 RX bytes:173 (173.0 b) TX bytes:137 (137.0 b) 2017-12-16T20:04:34.989Z,1513454674.989 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=20382, MT Status=1, MTMSN=980 2017-12-16T20:04:35.620Z,1513454675.620 [CommandLine](IMPORTANT): got command ! rsync -vv upload@134.89.95.12:/var/log/esp/real.out /mnt/mmc/LRAUV/Logs/ 2017-12-16T20:05:00.030Z,1513454700.030 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=20383, MT Status=1, MTMSN=981 2017-12-16T20:05:00.881Z,1513454700.881 [CommandLine](FAULT): Command P½Y timed out 2017-12-16T20:05:14.545Z,1513454714.545 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=20384, MT Status=1, MTMSN=982 2017-12-16T20:05:15.083Z,1513454715.083 [CommandLine](IMPORTANT): got command ! ps -eaf | grep -i rsync 2017-12-16T20:05:15.613Z,1513454715.613 [CommandLine](IMPORTANT): root 5153 795 0 20:05 pts/0 00:00:00 sh -c ps -eaf | grep -i rsync root 5155 5153 0 20:05 pts/0 00:00:00 grep -i rsync 2017-12-16T20:11:19.559Z,1513455079.559 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 39.679089 min 2017-12-16T20:11:49.885Z,1513455109.885 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=20390, MT Status=1, MTMSN=983 2017-12-16T20:11:50.441Z,1513455110.441 [CommandLine](IMPORTANT): got command ! grep "::Error" /mnt/mmc/LRAUV/Logs/real.out | tail 2017-12-16T20:11:52.609Z,1513455112.609 [CommandLine](IMPORTANT): @13:37:34.56 Cartridge::Error in LRAUV -- no dry cartridges remain @18:00:45.15 Cartridge::Sampler::Error in FILTERING -- Cartridge (or plumbing) leaks @21:11:34.61 Cartridge::Sampler::Error in preston -- Cartridge (or plumbing) leaks @21:14:31.15 Cartridge::Error in preston -- No cartridge is loaded @21:17:16.51 Cartridge::Sampler::Error in preston -- Cartridge (or plumbing) leaks @14:28:18.96 Slide::Error in preston -- Storage Carousel Not yet Homed! @14:28:29.44 Slide::Error in preston -- Plunge Valve Not yet Homed! @19:47:40.23 Slide::Error in PROCESSING -- Archive Syringe positionErr @11:31:23.49 Slide::Error in PROCESSING -- Archive Syringe positionErr 2017-12-16T20:12:02.903Z,1513455122.903 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:12:04.231Z,1513455124.231 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:12:05.662Z,1513455125.662 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:12:06.975Z,1513455126.975 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:12:08.323Z,1513455128.323 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:12:08.411Z,1513455128.411 [CBIT](FAULT): Hardware Fault in component: CTD_Seabird 2017-12-16T20:19:55.454Z,1513455595.454 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 48.276799 min 2017-12-16T20:21:36.925Z,1513455696.925 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=20398, MT Status=1, MTMSN=984 2017-12-16T20:21:37.468Z,1513455697.468 [CommandLine](IMPORTANT): got command ! /mnt/mmc/LRAUV/Tools/esp-mivegas-off.sh 2017-12-16T20:22:08.998Z,1513455728.998 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:22:10.379Z,1513455730.379 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:22:11.739Z,1513455731.739 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:22:13.051Z,1513455733.051 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:22:14.555Z,1513455734.555 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:22:14.782Z,1513455734.782 [CBIT](FAULT): Hardware Fault in component: CTD_Seabird 2017-12-16T20:27:03.167Z,1513456023.167 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 55.406071 min 2017-12-16T20:32:15.323Z,1513456335.323 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:32:16.759Z,1513456336.759 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:32:18.063Z,1513456338.063 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:32:19.375Z,1513456339.375 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:32:20.803Z,1513456340.803 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:32:21.057Z,1513456341.057 [CBIT](FAULT): Hardware Fault in component: CTD_Seabird 2017-12-16T20:33:55.437Z,1513456435.437 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 62.277230 min 2017-12-16T20:40:55.705Z,1513456855.705 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 69.281779 min 2017-12-16T20:41:24.850Z,1513456884.850 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=20407, MT Status=1, MTMSN=985 2017-12-16T20:41:25.604Z,1513456885.604 [CommandLine](IMPORTANT): got command schedule asap "load Science/chlpeak_sampling_InAboveBelow.xml;set DriftOrDonutAtChlPeak.MissionTimeout 20 hour;set DriftOrDonutAtChlPeak.AcousticTimeout 21 hour;set DriftOrDonutAtChlPeak.SpeedChlPeakHoldingSampling 0 meter_per_second" v7x1 1 6.000000 2017-12-16T20:41:25.604Z,1513456885.604 [CommandLine](IMPORTANT): Scheduling command #1 of 6 with id=v7x1 2017-12-16T20:41:25.605Z,1513456885.605 [CommandLine](IMPORTANT): Scheduled #36 (#1 of 6 with id='v7x1'): "load Science/chlpeak_sampling_InAboveBelow.xml;set DriftOrDonutAtChlPeak.MissionTimeout 20 hour;set DriftOrDonutAtChlPeak.AcousticTimeout 21 hour;set DriftOrDonutAtChlPeak.SpeedChlPeakHoldingSampling 0 meter_per_second" ASAP 2017-12-16T20:42:21.591Z,1513456941.591 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:42:22.907Z,1513456942.907 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:42:24.362Z,1513456944.362 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:42:25.675Z,1513456945.675 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:42:27.099Z,1513456947.099 [CTD_Seabird](FAULT): LCB fault: Software Overcurrent. 2017-12-16T20:42:27.453Z,1513456947.453 [CBIT](FAULT): Hardware Fault in component: CTD_Seabird 2017-12-16T20:42:53.101Z,1513456973.101 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=20408, MT Status=1, MTMSN=986 2017-12-16T20:42:53.871Z,1513456973.871 [CommandLine](IMPORTANT): got command schedule asap "set DriftOrDonutAtChlPeak.NumESPSamplers 8 count;set DriftOrDonutAtChlPeak.Lat1 36.793 degree;set DriftOrDonutAtChlPeak.Lon1 -121.877 degree;set DriftOrDonutAtChlPeak.VertDist4 0 meter;set DriftOrDonutAtChlPeak.VertDist5 0 meter" v7x1 2 6.000000 2017-12-16T20:42:53.872Z,1513456973.872 [CommandLine](IMPORTANT): Scheduling command #2 of 6 with id=v7x1 2017-12-16T20:42:53.873Z,1513456973.873 [CommandLine](IMPORTANT): Scheduled #37 (#2 of 6 with id='v7x1'): "set DriftOrDonutAtChlPeak.NumESPSamplers 8 count;set DriftOrDonutAtChlPeak.Lat1 36.793 degree;set DriftOrDonutAtChlPeak.Lon1 -121.877 degree;set DriftOrDonutAtChlPeak.VertDist4 0 meter;set DriftOrDonutAtChlPeak.VertDist5 0 meter" ASAP 2017-12-16T20:43:18.493Z,1513456998.493 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=20409, MT Status=1, MTMSN=987 2017-12-16T20:43:19.299Z,1513456999.299 [CommandLine](IMPORTANT): got command schedule asap "set DriftOrDonutAtChlPeak.VertDist6 0 meter;set DriftOrDonutAtChlPeak.VertDist7 0 meter;set DriftOrDonutAtChlPeak.VertDist8 0 meter;set DriftOrDonutAtChlPeak.Reacq3 1 bool;set DriftOrDonutAtChlPeak.Reacq4 0 bool" v7x1 3 6.000000 2017-12-16T20:43:19.300Z,1513456999.300 [CommandLine](IMPORTANT): Scheduling command #3 of 6 with id=v7x1 2017-12-16T20:43:19.301Z,1513456999.301 [CommandLine](IMPORTANT): Scheduled #38 (#3 of 6 with id='v7x1'): "set DriftOrDonutAtChlPeak.VertDist6 0 meter;set DriftOrDonutAtChlPeak.VertDist7 0 meter;set DriftOrDonutAtChlPeak.VertDist8 0 meter;set DriftOrDonutAtChlPeak.Reacq3 1 bool;set DriftOrDonutAtChlPeak.Reacq4 0 bool" ASAP 2017-12-16T20:43:39.617Z,1513457019.617 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=20410, MT Status=1, MTMSN=988 2017-12-16T20:43:40.302Z,1513457020.302 [CommandLine](IMPORTANT): got command schedule asap "set DriftOrDonutAtChlPeak.Reacq6 1 bool;set DriftOrDonutAtChlPeak.Reacq7 0 bool;set DriftOrDonutAtChlPeak.DeepBoundChl 50 meter;set DriftOrDonutAtChlPeak.CylinderTimeout 120 minute" v7x1 4 6.000000 2017-12-16T20:43:40.303Z,1513457020.303 [CommandLine](IMPORTANT): Scheduling command #4 of 6 with id=v7x1 2017-12-16T20:43:40.304Z,1513457020.304 [CommandLine](IMPORTANT): Scheduled #39 (#4 of 6 with id='v7x1'): "set DriftOrDonutAtChlPeak.Reacq6 1 bool;set DriftOrDonutAtChlPeak.Reacq7 0 bool;set DriftOrDonutAtChlPeak.DeepBoundChl 50 meter;set DriftOrDonutAtChlPeak.CylinderTimeout 120 minute" ASAP 2017-12-16T20:43:51.633Z,1513457031.633 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=20411, MT Status=1, MTMSN=989 2017-12-16T20:43:52.403Z,1513457032.403 [CommandLine](IMPORTANT): got command schedule asap "set DriftOrDonutAtChlPeak.CylinderYoYoMaxDep 50 meter;set DriftOrDonutAtChlPeak.CylinderRadius 500 meter;set DriftOrDonutAtChlPeak.YoYoMaxDepth 50 meter;set DriftOrDonutAtChlPeak.MaxDepth 80 meter" v7x1 5 6.000000 2017-12-16T20:43:52.404Z,1513457032.404 [CommandLine](IMPORTANT): Scheduling command #5 of 6 with id=v7x1 2017-12-16T20:43:52.406Z,1513457032.406 [CommandLine](IMPORTANT): Scheduled #40 (#5 of 6 with id='v7x1'): "set DriftOrDonutAtChlPeak.CylinderYoYoMaxDep 50 meter;set DriftOrDonutAtChlPeak.CylinderRadius 500 meter;set DriftOrDonutAtChlPeak.YoYoMaxDepth 50 meter;set DriftOrDonutAtChlPeak.MaxDepth 80 meter" ASAP 2017-12-16T20:44:02.041Z,1513457042.041 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=20412, MT Status=1, MTMSN=990 2017-12-16T20:44:02.604Z,1513457042.604 [CommandLine](IMPORTANT): got command schedule asap "set DriftOrDonutAtChlPeak.MaxWaitNoFiring 4 hour;run " v7x1 6 6.000000 2017-12-16T20:44:02.604Z,1513457042.604 [CommandLine](IMPORTANT): Scheduling command #6 of 6 with id=v7x1 2017-12-16T20:44:02.605Z,1513457042.605 [CommandLine](IMPORTANT): Scheduled #41 (#6 of 6 with id='v7x1'): "set DriftOrDonutAtChlPeak.MaxWaitNoFiring 4 hour;run " ASAP 2017-12-16T20:44:02.885Z,1513457042.885 [CommandLine](IMPORTANT): got command load ./Missions/Science/chlpeak_sampling_InAboveBelow.xml 2017-12-16T20:44:07.736Z,1513457047.736 [CommandLine](IMPORTANT): Loaded ./Missions/Science/chlpeak_sampling_InAboveBelow.xml