2016-12-19T02:00:46.449Z,1482112846.449 [SBIT](CRITICAL): SBIT FAILED 2016-12-19T01:58:08.667Z,1482112688.667 [Supervisor](IMPORTANT): Reading configuration overrides from Data/persisted.cfg 2016-12-19T01:58:12.726Z,1482112692.726 [SBIT](IMPORTANT): git: 2016-09-21 2016-12-19T01:58:12.727Z,1482112692.727 [SBIT](IMPORTANT): Kernel Release: 2.6.27.8 2016-12-19T01:58:12.727Z,1482112692.727 [SBIT](IMPORTANT): Kernel Version:#639 PREEMPT Wed Mar 12 12:53:33 PDT 2014 2016-12-19T01:59:09.213Z,1482112749.213 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=18318, MT Status=1, MTMSN=788 2016-12-19T01:59:09.891Z,1482112749.891 [CommandLine](IMPORTANT): got command configSet CBIT.abortDepth 325.000000 meter 2016-12-19T01:59:09.892Z,1482112749.892 [CommandLine](IMPORTANT): got command configSet CBIT.stopDepth 310.000000 meter 2016-12-19T01:59:52.482Z,1482112792.482 [SBIT](IMPORTANT): Beginning Startup BIT 2016-12-19T01:59:52.486Z,1482112792.486 [CBIT](IMPORTANT): Beginning GF scan 2016-12-19T02:00:19.321Z,1482112819.321 [CBIT](FAULT): Chan 0 High side GF detected mA: CHAN 5 (24V): 0.305226 CHAN 4 (Batt): 0.161843 CHAN 2 (12V): 0.127696 CHAN 1 (5V): 0.038739 CHAN 0 (3.3V): 0.018843 OPEN: 0.000574 Full Scale Calc: 0.392 2016-12-19T02:00:46.050Z,1482112846.050 [SBIT](FAULT): Mass: EXPECTED:-0.020000 ACTUAL:-0.012980 2016-12-19T02:00:46.050Z,1482112846.050 [SBIT](FAULT): Control surface position failure. 2016-12-19T02:00:46.451Z,1482112846.451 [CommandLine](FAULT): Scheduling is paused 2016-12-19T02:00:46.849Z,1482112846.849 [MissionManager](IMPORTANT): Started mission Startup 2016-12-19T02:01:16.415Z,1482112876.415 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=18319, MT Status=1, MTMSN=789 2016-12-19T02:01:16.961Z,1482112876.961 [CommandLine](IMPORTANT): got command ! killall roweadcp 2016-12-19T02:02:38.253Z,1482112958.253 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=18320, MT Status=1, MTMSN=790 2016-12-19T02:02:39.990Z,1482112959.990 [CommandLine](IMPORTANT): got command get ESPComponent.loadAtStartup 2016-12-19T02:02:39.991Z,1482112959.991 [CommandLine](IMPORTANT): ESPComponent.loadAtStartup 1 bool 2016-12-19T02:02:39.991Z,1482112959.991 [CommandLine](IMPORTANT): got command get ESPComponent.simulateHardware 2016-12-19T02:02:39.992Z,1482112959.992 [CommandLine](IMPORTANT): ESPComponent.simulateHardware 0 bool 2016-12-19T02:02:47.816Z,1482112967.816 [MissionManager](IMPORTANT): Started mission Default 2016-12-19T02:03:02.979Z,1482112982.979 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=18321, MT Status=1, MTMSN=791 2016-12-19T02:03:03.634Z,1482112983.634 [CommandLine](IMPORTANT): got command ! find /mnt/mmc/LRAUV/Logs -name syslog | xargs grep -ni "ESP sampling at" 2016-12-19T02:03:17.169Z,1482112997.169 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=18322, MT Status=1, MTMSN=792 2016-12-19T02:03:23.667Z,1482113003.667 [CommandLine](FAULT): Command timed out 2016-12-19T02:11:24.037Z,1482113484.037 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 8.597023 min 2016-12-19T02:11:48.410Z,1482113508.410 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=18332, MT Status=1, MTMSN=793 2016-12-19T02:11:49.060Z,1482113509.060 [CommandLine](IMPORTANT): got command ! find /mnt/mmc/LRAUV/Logs -name syslog | xargs grep -ni "ESP sampling at" > /mnt/mmc/LRAUV/junk.out & 2016-12-19T02:15:40.408Z,1482113740.408 [NAL9602](FAULT): Verify xmit timeout failure. 2016-12-19T02:21:24.159Z,1482114084.159 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 18.598891 min 2016-12-19T02:26:47.707Z,1482114407.707 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2016-12-19T02:27:56.987Z,1482114476.987 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=18339, MT Status=1, MTMSN=794 2016-12-19T02:27:57.642Z,1482114477.642 [CommandLine](IMPORTANT): got command ! grep -ni "ESP sampling sequence starting" /mnt/mmc/LRAUV/Logs/20161218T210505/syslog 2016-12-19T02:28:17.079Z,1482114497.079 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=18340, MT Status=1, MTMSN=795 2016-12-19T02:28:17.678Z,1482114497.678 [CommandLine](IMPORTANT): got command ! cat /mnt/mmc/LRAUV/junk.out 2016-12-19T02:28:17.814Z,1482114497.814 [CommandLine](IMPORTANT): /mnt/mmc/LRAUV/Logs/20161215T210644/syslog:1593:2016-12-15T21:47:27.130Z,1481838447.130 [spiralSample:SampleAtDepth:SampleWrapper:SampleESP:B](IMPORTANT): ESP sampling at 50.223400 m in nan degC water with nan ug/l chlorophyll fluorescence. /mnt/mmc/LRAUV/Logs/20161215T232642/syslog:20351:2016-12-16T01:25:31.270Z,1481851531.270 [spiralSample:SampleAtDepth:SampleWrapper:SampleESP:B](IMPORTANT): ESP sampling at 100.598015 m in nan degC water with nan ug/l chlorophyll fluorescence. /mnt/mmc/LRAUV/Logs/20161217T012603/syslog:48357:2016-12-17T04:37:30.294Z,1481949450.294 [spiralSample:SampleAtDepth:SampleWrapper:SampleESP:B](IMPORTANT): ESP sampling at 200.644653 m in nan degC water with nan ug/l chlorophyll fluorescence. /mnt/mmc/LRAUV/Logs/20161219T005158/syslog:1948:2016-12-19T01:35:26.918Z,1482111326.918 [NAL9602](INFO): Received command:! grep -ni "ESP sampling at" /mnt/mmc/LRAUV/Logs/20161218T210505/syslog /mnt/mmc/LRAUV/Logs/20161219T005158/syslog:1949:2016-12-19T01:35:27.002Z,1482111327.002 [CommandLine](IMPORTANT): got command ! grep -ni "ESP sampling at" /mnt/mmc/LRAUV/Logs/20161218T210505/syslog /mnt/mmc/LRAUV/Logs/20161219T005158/syslog:2192:2016-12-19T01:42:57.672Z,1482111777.672 [NAL9602](INFO): Received command:find /mnt/mmc/LRAUV/Logs -name syslog | xargs grep -ni "ESP sampling at" /mnt/mmc/LRAUV/Logs/20161219T015803/syslog:513:2016-12-19T02:03:03.542Z,1482112983.542 [NAL9602](INFO): Received command:! find /mnt/mmc/LRAUV/Logs -name syslog | xargs grep -ni "ESP sampling at" /mnt/mmc/LRAUV/Logs/20161219T015803/syslog:514:2016-12-19T02:03:03.634Z,1482112983.634 [CommandLine](IMPORTANT): got command ! find /mnt/mmc/LRAUV/Logs -name syslog | xargs grep -ni "ESP sampling at" 2016-12-19T02:28:56.275Z,1482114536.275 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=18341, MT Status=1, MTMSN=796 2016-12-19T02:28:56.898Z,1482114536.898 [CommandLine](IMPORTANT): got command ! ps -eaf | grep -i find;! ps -eaf | grep -i grep 2016-12-19T02:28:57.647Z,1482114537.647 [CommandLine](IMPORTANT): root 1791 767 4 02:28 pts/0 00:00:00 sh -c ps -eaf | grep -i find;! ps -eaf | grep -i grep root 1793 1791 2 02:28 pts/0 00:00:00 grep -i find root 1791 767 4 02:28 pts/0 00:00:00 sh -c ps -eaf | grep -i find;! ps -eaf | grep -i grep root 1795 1791 0 02:28 pts/0 00:00:00 grep -i grep 2016-12-19T02:30:06.275Z,1482114606.275 [NAL9602](FAULT): Verify xmit timeout failure. 2016-12-19T02:30:47.083Z,1482114647.083 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=18342, MT Status=1, MTMSN=797 2016-12-19T02:30:48.236Z,1482114648.236 [CommandLine](IMPORTANT): got command get ESPComponent.simulateHardware 2016-12-19T02:30:48.236Z,1482114648.236 [CommandLine](IMPORTANT): ESPComponent.simulateHardware 0 bool 2016-12-19T02:31:27.554Z,1482114687.554 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=18343, MT Status=1, MTMSN=798 2016-12-19T02:31:28.628Z,1482114688.628 [CommandLine](IMPORTANT): got command get ESPComponent.loadAtStartup 2016-12-19T02:31:28.628Z,1482114688.628 [CommandLine](IMPORTANT): ESPComponent.loadAtStartup 1 bool 2016-12-19T02:39:09.739Z,1482115149.739 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 36.359505 min 2016-12-19T02:39:22.505Z,1482115162.505 [NAL9602](FAULT): GPS failed to acquire within timeout. 2016-12-19T02:40:07.705Z,1482115207.705 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=18350, MT Status=1, MTMSN=799 2016-12-19T02:40:08.275Z,1482115208.275 [CommandLine](IMPORTANT): got command configSet list 2016-12-19T02:40:08.275Z,1482115208.275 [CommandLine](IMPORTANT): Listing configuration overrides from Data/persisted.cfg 2016-12-19T02:40:08.282Z,1482115208.282 [CommandLine](IMPORTANT): DropWeight.loadAtStartup=0 bool; 2016-12-19T02:40:08.282Z,1482115208.282 [CommandLine](IMPORTANT): ESPComponent.filterCompleteTimeout=90 minute; 2016-12-19T02:40:08.282Z,1482115208.282 [CommandLine](IMPORTANT): ESPComponent.sampleTimeout=75 minute; 2016-12-19T02:40:08.282Z,1482115208.282 [CommandLine](IMPORTANT): Rowe_600LCM.loadAtStartup=0 bool; 2016-12-19T02:40:08.282Z,1482115208.282 [CommandLine](IMPORTANT): VerticalControl.massDefault=-2 centimeter; 2016-12-19T02:49:08.301Z,1482115748.301 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 46.333549 min 2016-12-19T02:50:47.012Z,1482115847.012 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=18358, MT Status=1, MTMSN=800 2016-12-19T02:50:47.669Z,1482115847.669 [CommandLine](IMPORTANT): got command configSet CBIT.abortDepth 325.000000 meter persist 2016-12-19T02:50:47.672Z,1482115847.672 [CommandLine](IMPORTANT): got command configSet CBIT.stopDepth 310.000000 meter persist 2016-12-19T02:51:37.900Z,1482115897.900 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=18359, MT Status=1, MTMSN=801 2016-12-19T02:51:39.050Z,1482115899.050 [CommandLine](IMPORTANT): got command get CBIT.abortDepth 2016-12-19T02:51:39.050Z,1482115899.050 [CommandLine](IMPORTANT): CBIT.abortDepth 325.000000 m 2016-12-19T02:51:39.050Z,1482115899.050 [CommandLine](IMPORTANT): got command get CBIT.stopDepth 2016-12-19T02:51:39.051Z,1482115899.051 [CommandLine](IMPORTANT): CBIT.stopDepth 310.000000 m 2016-12-19T03:01:17.412Z,1482116477.412 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 58.486593 min 2016-12-19T04:19:47.510Z,1482121187.510 [Default:B.GoToSurface](CRITICAL): Surfacing timeout. Returning calc satisfied. 2016-12-19T03:06:32.584Z,1482116792.584 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2016-12-19T03:19:40.628Z,1482117580.628 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=18365, MT Status=1, MTMSN=802 2016-12-19T03:19:41.288Z,1482117581.288 [CommandLine](IMPORTANT): got command load ./Missions/Science/spiralSample.xml 2016-12-19T03:19:41.633Z,1482117581.633 [CommandLine](IMPORTANT): Loaded ./Missions/Science/spiralSample.xml 2016-12-19T03:19:44.973Z,1482117584.973 [CommandLine](IMPORTANT): got command set spiralSample.MissionTimeout 1.500000 hour 2016-12-19T03:19:44.974Z,1482117584.974 [CommandLine](IMPORTANT): got command set spiralSample.Depth 297.000000 meter 2016-12-19T03:19:44.974Z,1482117584.974 [CommandLine](IMPORTANT): got command set spiralSample.RudderAngle 14.000000 degree 2016-12-19T03:19:44.975Z,1482117584.975 [CommandLine](IMPORTANT): got command run 2016-12-19T03:19:44.978Z,1482117584.978 [CommandLine](IMPORTANT): Running 2016-12-19T03:19:45.042Z,1482117585.042 [MissionManager](IMPORTANT): Started mission spiralSample 2016-12-19T03:19:45.905Z,1482117585.905 [ThrusterServo](FAULT): getVelocity uart error serial timeout 2016-12-19T03:19:45.905Z,1482117585.905 [ThrusterServo](FAULT): Thruster uart error: serial timeout 2016-12-19T03:45:07.122Z,1482119107.122 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyS1 linkname esp noauth local lock 115200 134.89.95.2:134.89.95.12 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 134.89.10.32 ms-dns 134.89.10.10 2016-12-19T03:45:07.196Z,1482119107.196 [CommandLine](IMPORTANT): got command ! echo 1 > /dev/loadB7 2016-12-19T03:45:07.630Z,1482119107.630 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2016-12-19T03:46:13.053Z,1482119173.053 [ESPComponent](IMPORTANT): ESP has connected as client 2016-12-19T03:46:13.989Z,1482119173.989 [ESPComponent](IMPORTANT): ESP sampling sequence starting (sample #1) sampling state: S_WAITING_INITIAL_PROMPT 2016-12-19T03:46:14.354Z,1482119174.354 [spiralSample:SampleAtDepth:SampleWrapper:SampleESP:B](IMPORTANT): ESP sampling at 295.815002 m in nan degC water with nan ug/l chlorophyll fluorescence. 2016-12-19T03:46:15.053Z,1482119175.053 [ESPComponent](IMPORTANT): ESP sampling state: S_PREPARING_SHOW_LOG 2016-12-19T03:46:15.454Z,1482119175.454 [ESPComponent](IMPORTANT): ESP sampling state: S_PREPARING_SHOW_STATUS 2016-12-19T03:46:17.051Z,1482119177.051 [ESPComponent](IMPORTANT): ESP sampling state: S_LOADING_CARTRIDGE 2016-12-19T03:46:55.050Z,1482119215.050 [ESPComponent](IMPORTANT): ESP sampling state: S_FILTERING 2016-12-19T03:46:57.451Z,1482119217.451 [ESPComponent](IMPORTANT): ESP sampling state: S_WAITING_FOR_PAUSED 2016-12-19T04:02:01.051Z,1482120121.051 [ESPComponent](IMPORTANT): ESP sampling state: S_PROCESSING 2016-12-19T04:02:03.451Z,1482120123.451 [ESPComponent](IMPORTANT): ESP sampling state: S_WAITING_FOR_PROCESSED 2016-12-19T04:03:01.052Z,1482120181.052 [ESPComponent](IMPORTANT): ESP sampling state: S_STOPPING 2016-12-19T04:03:06.654Z,1482120186.654 [ESPComponent](IMPORTANT): ESP sampling sequence completed normally (sample #1) 2016-12-19T04:03:07.507Z,1482120187.507 [MissionManager](IMPORTANT): Started mission Default 2016-12-19T04:19:59.861Z,1482121199.861 [NAL9602](FAULT): GPS failed to acquire within timeout. 2016-12-19T04:25:19.866Z,1482121519.866 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2016-12-19T04:40:36.423Z,1482122436.423 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 37.475114 min 2016-12-19T04:40:49.186Z,1482122449.186 [NAL9602](FAULT): GPS failed to acquire within timeout. 2016-12-19T04:53:37.634Z,1482123217.634 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 50.495329 min 2016-12-19T04:54:18.808Z,1482123258.808 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=18379, MT Status=1, MTMSN=803