2019-07-26T02:31:10.677Z,1564108270.677 [Supervisor](IMPORTANT): Reading configuration overrides from Data/persisted.cfg 2019-07-26T02:31:15.361Z,1564108275.361 [SBIT](IMPORTANT): git: 2019-07-25 2019-07-26T02:31:15.361Z,1564108275.361 [SBIT](IMPORTANT): Kernel Release: 2.6.27.8 2019-07-26T02:31:15.956Z,1564108275.956 [CommandLine](IMPORTANT): got command ! echo 1 > /dev/loadB2 2019-07-26T02:31:16.920Z,1564108276.920 [RudderServo](FAULT): Rudder failed to initialize 2019-07-26T02:32:29.867Z,1564108349.867 [SBIT](IMPORTANT): Beginning Startup BIT 2019-07-26T02:32:29.871Z,1564108349.871 [CBIT](IMPORTANT): Beginning ground fault scan 2019-07-26T02:32:40.896Z,1564108360.896 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.003617 CHAN A1 (24V): -0.010468 CHAN A2 (12V): -0.003316 CHAN A3 (5V): -0.006821 CHAN B0 (3.3V): -0.002864 CHAN B1 (3.15aV): -0.002255 CHAN B2 (3.15bV): -0.001638 CHAN B3 (GND): -0.002940 OPEN: 0.012398 Full Scale Calc: 4.765 mA, -1.589 mA 2019-07-26T02:33:23.506Z,1564108403.506 [SBIT](IMPORTANT): SBIT PASSED 2019-07-26T02:33:23.600Z,1564108403.600 [CommandLine](IMPORTANT): got command configSet list 2019-07-26T02:33:23.601Z,1564108403.601 [CommandLine](IMPORTANT): Listing configuration overrides from Data/persisted.cfg 2019-07-26T02:33:23.601Z,1564108403.601 [CommandLine](IMPORTANT): BPC1.batteryMissingStickThreshold=2 count; 2019-07-26T02:33:23.602Z,1564108403.602 [CommandLine](IMPORTANT): BuoyancyServo.fastPumpDepth=5 meter; 2019-07-26T02:33:23.602Z,1564108403.602 [CommandLine](IMPORTANT): DVL_micro.loadAtStartup=0 bool; 2019-07-26T02:33:23.602Z,1564108403.602 [CommandLine](IMPORTANT): DropWeight.loadAtStartup=0 bool; 2019-07-26T02:33:23.602Z,1564108403.602 [CommandLine](IMPORTANT): VerticalControl.buoyancyNeutral=400 cubic_centimeter; 2019-07-26T02:33:23.602Z,1564108403.602 [CommandLine](IMPORTANT): VerticalControl.kiDepthBuoy=0.3 reciprocal_second; 2019-07-26T02:33:23.602Z,1564108403.602 [CommandLine](IMPORTANT): VerticalControl.massDefault=13.5 millimeter; 2019-07-26T02:33:23.914Z,1564108403.914 [MissionManager](IMPORTANT): Started mission Startup 2019-07-26T02:35:07.470Z,1564108507.470 [MissionManager](IMPORTANT): Started mission Default 2019-07-26T02:42:23.795Z,1564108943.795 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 7.265602 min 2019-07-26T02:43:50.393Z,1564109030.393 [DataOverHttps](IMPORTANT): SBD MTMSN=20190726T024339 2019-07-26T02:43:55.681Z,1564109035.681 [CommandLine](IMPORTANT): got command schedule asap "load Science/profile_station.xml;set profile_station.MissionTimeout 2 hour;set profile_station.NeedCommsTime 30 minute;set profile_station.Lat 36.797 degree;set profile_station.Lon -121.847 degree" 5rkh 1 2.000000 2019-07-26T02:43:55.682Z,1564109035.682 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=5rkh 2019-07-26T02:43:55.683Z,1564109035.683 [CommandLine](IMPORTANT): Scheduled #1 (#1 of 2 with id='5rkh'): "load Science/profile_station.xml;set profile_station.MissionTimeout 2 hour;set profile_station.NeedCommsTime 30 minute;set profile_station.Lat 36.797 degree;set profile_station.Lon -121.847 degree" ASAP 2019-07-26T02:43:56.425Z,1564109036.425 [DataOverHttps](IMPORTANT): SBD MTMSN=20190726T024345 2019-07-26T02:44:01.489Z,1564109041.489 [CommandLine](IMPORTANT): got command schedule asap "set profile_station.YoYoMaxDepth 30 meter;set profile_station.MaxDepth 35 meter;set profile_station.MinOffshore 0.5 kilometer;run " 5rkh 2 2.000000 2019-07-26T02:44:01.489Z,1564109041.489 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=5rkh 2019-07-26T02:44:01.490Z,1564109041.490 [CommandLine](IMPORTANT): Scheduled #2 (#2 of 2 with id='5rkh'): "set profile_station.YoYoMaxDepth 30 meter;set profile_station.MaxDepth 35 meter;set profile_station.MinOffshore 0.5 kilometer;run " ASAP 2019-07-26T02:44:01.618Z,1564109041.618 [CommandLine](IMPORTANT): got command load ./Missions/Science/profile_station.xml 2019-07-26T02:44:03.379Z,1564109043.379 [CommandLine](IMPORTANT): Loaded ./Missions/Science/profile_station.xml 2019-07-26T02:44:12.387Z,1564109052.387 [CommandLine](IMPORTANT): got command set profile_station.MissionTimeout 2.000000 hour 2019-07-26T02:44:12.388Z,1564109052.388 [CommandLine](IMPORTANT): got command set profile_station.NeedCommsTime 30.000000 minute 2019-07-26T02:44:12.388Z,1564109052.388 [CommandLine](IMPORTANT): got command set profile_station.Lat 36.797001 degree 2019-07-26T02:44:12.389Z,1564109052.389 [CommandLine](IMPORTANT): got command set profile_station.Lon -121.847000 degree 2019-07-26T02:44:19.069Z,1564109059.069 [CommandLine](IMPORTANT): got command set profile_station.YoYoMaxDepth 30.000000 meter 2019-07-26T02:44:19.070Z,1564109059.070 [CommandLine](IMPORTANT): got command set profile_station.MaxDepth 35.000000 meter 2019-07-26T02:44:19.071Z,1564109059.071 [CommandLine](IMPORTANT): got command set profile_station.MinOffshore 0.500000 kilometer 2019-07-26T02:44:19.071Z,1564109059.071 [CommandLine](IMPORTANT): got command run 2019-07-26T02:44:19.074Z,1564109059.074 [CommandLine](IMPORTANT): Running 2019-07-26T02:44:19.335Z,1564109059.335 [MissionManager](IMPORTANT): Started mission profile_station 2019-07-26T03:19:15.436Z,1564111155.436 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=30085, MT Status=1, MTMSN=1985 2019-07-26T03:19:15.921Z,1564111155.921 [CommandLine](IMPORTANT): got command stop 2019-07-26T03:19:15.922Z,1564111155.922 [CommandLine](IMPORTANT): Scheduling is paused 2019-07-26T03:19:16.275Z,1564111156.275 [MissionManager](IMPORTANT): Started mission Default 2019-07-26T03:27:32.137Z,1564111652.137 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 8.257727 min 2019-07-26T03:28:56.835Z,1564111736.835 [DataOverHttps](IMPORTANT): SBD MTMSN=20190726T032841 2019-07-26T03:29:02.207Z,1564111742.207 [CommandLine](IMPORTANT): got command schedule asap "load Maintenance/ballast_and_trim.xml;set ballast_and_trim.MissionTimeout 60 minute;set ballast_and_trim.Depth1 20 meter;set ballast_and_trim.TargetDepthTimeout 30 minute;set ballast_and_trim.MaxWaitOnSurface 20 minute" 5tn9 1 2.000000 2019-07-26T03:29:02.208Z,1564111742.208 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=5tn9 2019-07-26T03:29:02.209Z,1564111742.209 [CommandLine](IMPORTANT): Scheduled #3 (#1 of 2 with id='5tn9'): "load Maintenance/ballast_and_trim.xml;set ballast_and_trim.MissionTimeout 60 minute;set ballast_and_trim.Depth1 20 meter;set ballast_and_trim.TargetDepthTimeout 30 minute;set ballast_and_trim.MaxWaitOnSurface 20 minute" ASAP 2019-07-26T03:29:03.005Z,1564111743.005 [DataOverHttps](IMPORTANT): SBD MTMSN=20190726T032847 2019-07-26T03:29:08.109Z,1564111748.109 [CommandLine](IMPORTANT): got command schedule asap "set ballast_and_trim.SettleTime 15 minute;set ballast_and_trim.EstimationTimeout 30 minute;run " 5tn9 2 2.000000 2019-07-26T03:29:08.110Z,1564111748.110 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=5tn9 2019-07-26T03:29:08.111Z,1564111748.111 [CommandLine](IMPORTANT): Scheduled #4 (#2 of 2 with id='5tn9'): "set ballast_and_trim.SettleTime 15 minute;set ballast_and_trim.EstimationTimeout 30 minute;run " ASAP 2019-07-26T03:29:08.296Z,1564111748.296 [CommandLine](IMPORTANT): got command load ./Missions/Maintenance/ballast_and_trim.xml 2019-07-26T03:29:11.070Z,1564111751.070 [CommandLine](IMPORTANT): Loaded ./Missions/Maintenance/ballast_and_trim.xml 2019-07-26T03:29:23.720Z,1564111763.720 [CommandLine](IMPORTANT): got command set ballast_and_trim.MissionTimeout 60.000000 minute 2019-07-26T03:29:23.721Z,1564111763.721 [CommandLine](IMPORTANT): got command set ballast_and_trim.Depth1 20.000000 meter 2019-07-26T03:29:23.722Z,1564111763.722 [CommandLine](IMPORTANT): got command set ballast_and_trim.TargetDepthTimeout 30.000000 minute 2019-07-26T03:29:23.723Z,1564111763.723 [CommandLine](IMPORTANT): got command set ballast_and_trim.MaxWaitOnSurface 20.000000 minute 2019-07-26T03:29:29.851Z,1564111769.851 [CommandLine](IMPORTANT): got command set ballast_and_trim.SettleTime 15.000000 minute 2019-07-26T03:29:29.856Z,1564111769.856 [CommandLine](IMPORTANT): got command set ballast_and_trim.EstimationTimeout 30.000000 minute 2019-07-26T03:29:29.857Z,1564111769.857 [CommandLine](IMPORTANT): got command run 2019-07-26T03:29:29.865Z,1564111769.865 [CommandLine](IMPORTANT): Running 2019-07-26T03:29:30.181Z,1564111770.181 [MissionManager](IMPORTANT): Started mission ballast_and_trim 2019-07-26T04:20:05.958Z,1564114805.958 [ballast_and_trim:RunBallastAndTrim:RunDepth1:BallastAndTrim:BallastAndTrimAtTargetDepth:G.](IMPORTANT): BallastAndTrim completed. Estimation time: 30.01 minutes (time-out limit reached). 2019-07-26T04:20:05.959Z,1564114805.959 [ballast_and_trim:RunBallastAndTrim:RunDepth1:BallastAndTrim:BallastAndTrimAtTargetDepth:G.](IMPORTANT): Estimated buoyancyNeutral: 208.567181 +/- 6.826601 cc (conf. level 99.90%, sigma: 14.402254 cc). 2019-07-26T04:20:05.961Z,1564114805.961 [ballast_and_trim:RunBallastAndTrim:RunDepth1:BallastAndTrim:BallastAndTrimAtTargetDepth:G.](IMPORTANT): Estimated massDefault: 19.139338 +/- 0.360148 mm (conf. level 99.90%, sigma: 0.759813 mm). 2019-07-26T04:25:08.200Z,1564115108.200 [MissionManager](IMPORTANT): Started mission Default 2019-07-26T04:33:35.790Z,1564115615.790 [DataOverHttps](IMPORTANT): SBD MTMSN=20190726T043314 2019-07-26T04:33:41.237Z,1564115621.237 [CommandLine](IMPORTANT): got command configSet VerticalControl.massDefault 19.000000 millimeter persist 2019-07-26T04:34:05.347Z,1564115645.347 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 8.945486 min 2019-07-26T04:34:11.974Z,1564115651.974 [DataOverHttps](IMPORTANT): SBD MOMSN=11477438, MTMSN=20190726T043351 2019-07-26T04:34:17.367Z,1564115657.367 [CommandLine](IMPORTANT): got command configSet VerticalControl.buoyancyNeutral 210.000000 cubic_centimeter persist 2019-07-26T04:35:50.573Z,1564115750.573 [DataOverHttps](IMPORTANT): SBD MTMSN=20190726T043529 2019-07-26T04:35:55.684Z,1564115755.684 [CommandLine](IMPORTANT): got command load ./Missions/Maintenance/calibrate_sparton_compass.xml 2019-07-26T04:35:57.410Z,1564115757.410 [CommandLine](IMPORTANT): Loaded ./Missions/Maintenance/calibrate_sparton_compass.xml 2019-07-26T04:36:08.299Z,1564115768.299 [CommandLine](IMPORTANT): got command set SpartonCompassCal.YoYoMaxDepth 30.000000 meter 2019-07-26T04:36:08.301Z,1564115768.301 [CommandLine](IMPORTANT): got command set SpartonCompassCal.MaxDepth 37.000000 meter 2019-07-26T04:36:08.301Z,1564115768.301 [CommandLine](IMPORTANT): got command run 2019-07-26T04:36:08.304Z,1564115768.304 [CommandLine](IMPORTANT): Running 2019-07-26T04:36:08.629Z,1564115768.629 [MissionManager](IMPORTANT): Started mission SpartonCompassCal 2019-07-26T04:54:18.461Z,1564116858.461 [BPC1](FAULT): Battery stick #38 (s/n: 0139) reported TERMINATE_DISCHARGE_ALARM. Status code: 0x48C0. 2019-07-26T04:54:18.461Z,1564116858.461 [BPC1](FAULT): Battery stick #39 (s/n: 00F0) reported TERMINATE_DISCHARGE_ALARM. Status code: 0x48C0. 2019-07-26T05:36:09.441Z,1564119369.441 [AHRS_M2](IMPORTANT): Acquired 10 calibration points. 2019-07-26T05:36:09.476Z,1564119369.476 [MissionManager](IMPORTANT): Started mission Default 2019-07-26T05:36:10.217Z,1564119370.217 [AHRS_M2](IMPORTANT): Magnetic calibration quality (0[best] to 10000) is 0.000226. 2019-07-26T05:46:39.252Z,1564119999.252 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 10.489451 min 2019-07-26T05:52:02.842Z,1564120322.842 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 15.882684 min 2019-07-26T05:57:22.061Z,1564120642.061 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 21.203333 min 2019-07-26T06:02:42.100Z,1564120962.100 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 26.537083 min 2019-07-26T06:08:04.108Z,1564121284.108 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 31.903782 min 2019-07-26T06:10:48.269Z,1564121448.269 [DataOverHttps](IMPORTANT): SBD MTMSN=20190726T061018 2019-07-26T06:10:53.548Z,1564121453.548 [CommandLine](IMPORTANT): got command schedule clear 2019-07-26T06:10:53.549Z,1564121453.549 [CommandLine](IMPORTANT): #Cleared scheduled commands:0 2019-07-26T06:10:53.549Z,1564121453.549 [CommandLine](IMPORTANT): got command schedule resume 2019-07-26T06:10:53.549Z,1564121453.549 [CommandLine](IMPORTANT): Scheduling is resumed 2019-07-26T06:13:37.817Z,1564121617.817 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 37.465527 min 2019-07-26T06:19:28.087Z,1564121968.087 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 43.303739 min 2019-07-26T06:24:48.118Z,1564122288.118 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 48.637341 min 2019-07-26T06:30:07.402Z,1564122607.402 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 53.958980 min 2019-07-26T06:35:26.244Z,1564122926.244 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 59.272770 min 2019-07-26T06:36:58.285Z,1564123018.285 [DataOverHttps](IMPORTANT): SBD MTMSN=20190726T063625 2019-07-26T06:37:03.557Z,1564123023.557 [CommandLine](IMPORTANT): got command load ./Missions/Science/esp_kiss.xml 2019-07-26T06:37:05.455Z,1564123025.455 [CommandLine](IMPORTANT): Loaded ./Missions/Science/esp_kiss.xml 2019-07-26T06:37:10.324Z,1564123030.324 [CommandLine](IMPORTANT): got command set esp_kiss.TargetDepth 5.000000 meter 2019-07-26T06:37:10.325Z,1564123030.325 [CommandLine](IMPORTANT): got command set esp_kiss.MaxDepth 15.000000 meter 2019-07-26T06:37:10.326Z,1564123030.326 [CommandLine](IMPORTANT): got command run 2019-07-26T06:37:10.330Z,1564123030.330 [CommandLine](IMPORTANT): Running 2019-07-26T06:37:10.568Z,1564123030.568 [MissionManager](IMPORTANT): Started mission esp_kiss 2019-07-26T06:37:21.916Z,1564123041.916 [DataOverHttps](IMPORTANT): SBD MOMSN=11477595, MTMSN=20190726T063649 2019-07-26T06:37:27.375Z,1564123047.375 [CommandLine](IMPORTANT): got command schedule "load Science/sci2.xml;set sci2.MissionTimeout 8 hour;set sci2.NeedCommsTime 30 minute;set sci2.Lat1 36.8342 degree;set sci2.Lon1 -121.898 degree;set sci2.YoYoMaxDepth 20 meter;set sci2.MaxDepth 30 meter;run " 2019-07-26T06:37:27.376Z,1564123047.376 [CommandLine](IMPORTANT): Scheduled #5: "load Science/sci2.xml;set sci2.MissionTimeout 8 hour;set sci2.NeedCommsTime 30 minute;set sci2.Lat1 36.8342 degree;set sci2.Lon1 -121.898 degree;set sci2.YoYoMaxDepth 20 meter;set sci2.MaxDepth 30 meter;run " 2019-07-26T06:37:34.622Z,1564123054.622 [DataOverHttps](IMPORTANT): SBD MOMSN=11477600, MTMSN=20190726T063702 2019-07-26T06:37:41.197Z,1564123061.197 [CommandLine](IMPORTANT): got command schedule list 2019-07-26T06:37:41.197Z,1564123061.197 [CommandLine](IMPORTANT): Scheduled #5: "load Science/sci2.xml;set sci2.MissionTimeout 8 hour;set sci2.NeedCommsTime 30 minute;set sci2.Lat1 36.8342 degree;set sci2.Lon1 -121.898 degree;set sci2.YoYoMaxDepth 20 meter;set sci2.MaxDepth 30 meter;run " 2019-07-26T06:38:01.170Z,1564123081.170 [DataOverHttps](IMPORTANT): SBD MOMSN=11477606, MTMSN=20190726T063728 2019-07-26T06:38:06.545Z,1564123086.545 [CommandLine](IMPORTANT): got command schedule "load Science/esp_kiss.xml;set esp_kiss.TargetDepth 5 meter;set esp_kiss.MaxDepth 15 meter;run " 2019-07-26T06:38:06.546Z,1564123086.546 [CommandLine](IMPORTANT): Scheduled #6: "load Science/esp_kiss.xml;set esp_kiss.TargetDepth 5 meter;set esp_kiss.MaxDepth 15 meter;run " 2019-07-26T06:38:26.770Z,1564123106.770 [DataOverHttps](IMPORTANT): SBD MOMSN=11477620, MTMSN=20190726T063754 2019-07-26T06:38:32.305Z,1564123112.305 [CommandLine](IMPORTANT): got command schedule list 2019-07-26T06:38:32.305Z,1564123112.305 [CommandLine](IMPORTANT): Scheduled #5: "load Science/sci2.xml;set sci2.MissionTimeout 8 hour;set sci2.NeedCommsTime 30 minute;set sci2.Lat1 36.8342 degree;set sci2.Lon1 -121.898 degree;set sci2.YoYoMaxDepth 20 meter;set sci2.MaxDepth 30 meter;run " 2019-07-26T06:38:32.305Z,1564123112.305 [CommandLine](IMPORTANT): Scheduled #6: "load Science/esp_kiss.xml;set esp_kiss.TargetDepth 5 meter;set esp_kiss.MaxDepth 15 meter;run " 2019-07-26T06:45:05.311Z,1564123505.311 [esp_kiss:SampleESP:sample:A](IMPORTANT): At 5.109277 m , settling for 3.000000 min 2019-07-26T06:48:06.406Z,1564123686.406 [esp_kiss:SampleESP:sample:C](IMPORTANT): Requesting ESP cartridge type: -4.000000 count 2019-07-26T06:48:07.969Z,1564123687.969 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::' 2019-07-26T06:48:08.409Z,1564123688.409 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2019-07-26T06:48:08.544Z,1564123688.544 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2019-07-26T06:48:40.905Z,1564123720.905 [ESPComponent](IMPORTANT): ESP has connected as client 2019-07-26T06:48:41.813Z,1564123721.813 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -4 2019-07-26T06:48:41.814Z,1564123721.814 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2019-07-26T06:48:42.174Z,1564123722.174 [esp_kiss:SampleESP:sample:F](IMPORTANT): ESP sampling at 4.923492 m inwater with 1.884420 ug/l chlorophyll fluorescence. 2019-07-26T06:48:42.926Z,1564123722.926 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG 2019-07-26T06:48:43.333Z,1564123723.333 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS 2019-07-26T06:48:44.945Z,1564123724.945 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE 2019-07-26T06:49:23.366Z,1564123763.366 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PRIMING (@20,archiveHiBiomass_bac) 2019-07-26T06:49:24.984Z,1564123764.984 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PRIMING (@100.0) 2019-07-26T06:49:25.790Z,1564123765.790 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2019-07-26T06:52:05.297Z,1564123925.297 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_FILTERING (@0.0) 2019-07-26T06:52:05.701Z,1564123925.701 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2019-07-26T07:04:45.845Z,1564124685.845 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PAUSED (@201.676) 2019-07-26T07:04:46.253Z,1564124686.253 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PROCESSING (@201.676) 2019-07-26T07:04:48.673Z,1564124688.673 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PROCESSED (@20,archiveHiBiomass_bac) 2019-07-26T07:17:37.773Z,1564125457.773 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING (@20,archiveHiBiomass_bac) 2019-07-26T07:18:04.486Z,1564125484.486 [ESPComponent](IMPORTANT): Syncing ESP logs with command: ! rsync -ruzq esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs/. & 2019-07-26T07:18:04.489Z,1564125484.489 [CommandLine](IMPORTANT): got command ! rsync -ruzq esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs/. & 2019-07-26T07:18:04.890Z,1564125484.890 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED 2019-07-26T07:18:09.537Z,1564125489.537 [CommandLine](FAULT): Command rsync -ruzq esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs/. & timed out 2019-07-26T07:23:04.884Z,1564125784.884 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence completed normally. 2019-07-26T07:23:05.289Z,1564125785.289 [ESPComponent](IMPORTANT): [sample #1] ESP log summary report (5 messages): @23:48:55.34 Selecting Cartridge 20 @00:04:41.50 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @00:04:41.70 Sampled 201.7ml @00:06:18.54 Slide::Error in PROCESSING -- Archive Syringe (ArS) positionErr at 1672ul (sensed 1697ul) @00:06:18.55 Retry #1 of 2 2019-07-26T07:23:06.166Z,1564125786.166 [esp_kiss:SampleESP:sample:A](IMPORTANT): At 4.656484 m , settling for 3.000000 min 2019-07-26T07:26:07.290Z,1564125967.290 [esp_kiss:SampleESP:sample:C](IMPORTANT): Requesting ESP cartridge type: -9.000000 count 2019-07-26T07:26:09.356Z,1564125969.356 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2019-07-26T07:26:09.465Z,1564125969.465 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2019-07-26T07:26:41.585Z,1564126001.585 [ESPComponent](IMPORTANT): ESP has connected as client 2019-07-26T07:26:42.406Z,1564126002.406 [ESPComponent](IMPORTANT): [sample #2] Setting cartridge argument to -9 2019-07-26T07:26:42.407Z,1564126002.407 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2019-07-26T07:26:42.850Z,1564126002.850 [esp_kiss:SampleESP:sample:F](IMPORTANT): ESP sampling at 5.148767 m inwater with 1.829700 ug/l chlorophyll fluorescence. 2019-07-26T07:26:43.204Z,1564126003.204 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_LOG 2019-07-26T07:26:43.605Z,1564126003.605 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_STATUS 2019-07-26T07:26:45.626Z,1564126005.626 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_LOADING_CARTRIDGE 2019-07-26T07:27:24.410Z,1564126044.410 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PRIMING (@19,daSPR_phyto) 2019-07-26T07:27:26.028Z,1564126046.028 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PRIMING (@100.0) 2019-07-26T07:27:27.643Z,1564126047.643 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2019-07-26T07:30:06.630Z,1564126206.630 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_FILTERING (@0.0) 2019-07-26T07:30:07.032Z,1564126207.032 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2019-07-26T08:07:14.373Z,1564128434.373 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PAUSED (@648.985) 2019-07-26T08:07:14.773Z,1564128434.773 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PROCESSING (@648.985) 2019-07-26T08:07:17.200Z,1564128437.200 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PROCESSED (@19,daSPR_phyto) 2019-07-26T08:08:23.387Z,1564128503.387 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPING (@19,daSPR_phyto) 2019-07-26T08:08:25.421Z,1564128505.421 [CommandLine](IMPORTANT): got command ! rsync -ruzq esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs/. & 2019-07-26T08:08:25.437Z,1564128505.437 [ESPComponent](IMPORTANT): Syncing ESP logs with command: ! rsync -ruzq esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs/. & 2019-07-26T08:08:25.817Z,1564128505.817 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_ERROR (@19,daSPR_phyto) 2019-07-26T08:08:30.460Z,1564128510.460 [CommandLine](FAULT): Command rsync -ruzq esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr' /LRAUV/ESPlogs/. & timed out 2019-07-26T08:13:25.649Z,1564128805.649 [ESPComponent](CRITICAL): [sample #2] ESP sampling sequence terminated with error: Unexpected ESP state ESP_STATE_PROCESS_FAILED. Expecting one of: ESP_STATE_PROCESSED, ESP_STATE_PROCESSING 2019-07-26T08:13:25.806Z,1564128805.806 [CommandLine](FAULT): Scheduling is paused for 2 commands 2019-07-26T08:13:26.052Z,1564128806.052 [ESPComponent](IMPORTANT): [sample #2] ESP log summary report (5 messages): @00:26:55.98 Selecting Cartridge 19 @01:07:08.04 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @01:07:08.24 Sampled 649.0ml @01:08:14.29 Slide::Error in PROCESSING -- Air Syringe (AirS) pressureOutOfBounds at evac (sensed 168ul) (try 1 of 3) @01:08:17.96 Slide::Error in PROCESSING -- Archive Syringe (ArS) positionErr at empty (sensed 23ul) 2019-07-26T08:13:26.509Z,1564128806.509 [MissionManager](IMPORTANT): Started mission Default 2019-07-26T08:15:47.050Z,1564128947.050 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=30125, MT Status=1, MTMSN=1986