2021-08-14T03:38:12.536Z,1628912292.536 [Supervisor](IMPORTANT): Reading configuration overrides from Data/persisted.cfg 2021-08-14T03:38:17.522Z,1628912297.522 [SBIT](IMPORTANT): git: 2021-08-09 2021-08-14T03:38:17.523Z,1628912297.523 [SBIT](IMPORTANT): Kernel Release: 2.6.27.8 2021-08-14T03:38:19.121Z,1628912299.121 [RudderServo](FAULT): Rudder failed to initialize 2021-08-14T03:39:06.130Z,1628912346.130 [SBIT](IMPORTANT): Beginning Startup BIT 2021-08-14T03:39:06.134Z,1628912346.134 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-14T03:39:12.166Z,1628912352.166 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=44949, MT Status=1, MTMSN=3174 2021-08-14T03:39:13.138Z,1628912353.138 [CommandLine](IMPORTANT): got command schedule "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2qf8i 1 3.000000 2021-08-14T03:39:13.139Z,1628912353.139 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2qf8i 2021-08-14T03:39:13.140Z,1628912353.140 [CommandLine](IMPORTANT): Scheduled #1 (#1 of 3 with id='2qf8i'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2021-08-14T03:39:17.379Z,1628912357.379 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.006265 CHAN A1 (24V): 0.000363 CHAN A2 (12V): -0.006341 CHAN A3 (5V): -0.004738 CHAN B0 (3.3V): -0.002002 CHAN B1 (3.15aV): -0.001779 CHAN B2 (3.15bV): -0.001265 CHAN B3 (GND): -0.001234 OPEN: 0.012284 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-14T03:40:00.158Z,1628912400.158 [SBIT](IMPORTANT): SBIT PASSED 2021-08-14T03:40:00.158Z,1628912400.158 [SBIT](IMPORTANT): Listing configuration overrides from Data/persisted.cfg 2021-08-14T03:40:00.159Z,1628912400.159 [SBIT](IMPORTANT): BPC1.batteryMissingStickThreshold=2 count; 2021-08-14T03:40:00.159Z,1628912400.159 [SBIT](IMPORTANT): CBIT.abortDepth=210 meter; 2021-08-14T03:40:00.159Z,1628912400.159 [SBIT](IMPORTANT): CBIT.gf24Offset=148.5 microampere; 2021-08-14T03:40:00.159Z,1628912400.159 [SBIT](IMPORTANT): CBIT.stopDepth=200 meter; 2021-08-14T03:40:00.159Z,1628912400.159 [SBIT](IMPORTANT): CTD_Seabird.minSalinityBound=0.01 practical_salinity_unit; 2021-08-14T03:40:00.159Z,1628912400.159 [SBIT](IMPORTANT): DAT.loadAtStartup=0 bool; 2021-08-14T03:40:00.160Z,1628912400.160 [SBIT](IMPORTANT): DVL_micro.loadAtStartup=1 bool; 2021-08-14T03:40:00.160Z,1628912400.160 [SBIT](IMPORTANT): DataOverHttps.timeout=1 minute; 2021-08-14T03:40:00.160Z,1628912400.160 [SBIT](IMPORTANT): DeadReckonUsingMultipleVelocitySources.loadAtStartup=0 bool; 2021-08-14T03:40:00.160Z,1628912400.160 [SBIT](IMPORTANT): DeadReckonUsingSpeedCalculator.loadAtStartup=1 bool; 2021-08-14T03:40:00.160Z,1628912400.160 [SBIT](IMPORTANT): Depth_Keller.offset=-0.55 decibar; 2021-08-14T03:40:00.160Z,1628912400.160 [SBIT](IMPORTANT): Express none WetLabsBB2FL.bin_mean_mass_concentration_of_chlorophyll_in_sea_water; 2021-08-14T03:40:00.160Z,1628912400.160 [SBIT](IMPORTANT): Express linearApproximation WetLabsBB2FL.bin_median_mass_concentration_of_chlorophyll_in_sea_water 0.400000 microgram_per_liter; 2021-08-14T03:40:00.161Z,1628912400.161 [SBIT](IMPORTANT): Express linearApproximation height_above_sea_floor 5.000000 meter; 2021-08-14T03:40:00.161Z,1628912400.161 [SBIT](IMPORTANT): VerticalControl.buoyancyNeutral=305.870803 cubic_centimeter; 2021-08-14T03:40:00.161Z,1628912400.161 [SBIT](IMPORTANT): VerticalControl.massDefault=7.218472 millimeter; 2021-08-14T03:40:00.161Z,1628912400.161 [SBIT](IMPORTANT): VerticalControl.surfaceThreshold=1 meter; 2021-08-14T03:40:00.550Z,1628912400.550 [MissionManager](IMPORTANT): Started mission Startup 2021-08-14T03:42:01.031Z,1628912521.031 [MissionManager](IMPORTANT): Started mission Default 2021-08-14T03:42:18.726Z,1628912538.726 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44950, MT Status=1, MTMSN=3175 2021-08-14T03:42:19.617Z,1628912539.617 [CommandLine](IMPORTANT): got command schedule "set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 41.950754 degree;set Smear.SamplingEndLongitude -87.203876 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2qf8i 2 3.000000 2021-08-14T03:42:19.618Z,1628912539.618 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2qf8i 2021-08-14T03:42:19.620Z,1628912539.620 [CommandLine](IMPORTANT): Scheduled #2 (#2 of 3 with id='2qf8i'): "set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 41.950754 degree;set Smear.SamplingEndLongitude -87.203876 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2021-08-14T03:47:39.215Z,1628912859.215 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44951, MT Status=1, MTMSN=3176 2021-08-14T03:47:39.957Z,1628912859.957 [CommandLine](IMPORTANT): got command schedule "set Smear.NeedCommsTimeVeryLong 8 h;run" 2qf8i 3 3.000000 2021-08-14T03:47:39.958Z,1628912859.958 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2qf8i 2021-08-14T03:47:39.959Z,1628912859.959 [CommandLine](IMPORTANT): Scheduled #3 (#3 of 3 with id='2qf8i'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-14T03:47:40.137Z,1628912860.137 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-14T03:47:43.190Z,1628912863.190 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-14T03:47:52.313Z,1628912872.313 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-14T03:47:52.314Z,1628912872.314 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-14T03:47:52.315Z,1628912872.315 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-14T03:47:52.315Z,1628912872.315 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-14T03:47:52.316Z,1628912872.316 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-14T03:47:56.898Z,1628912876.898 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44952, MT Status=1, MTMSN=3177 2021-08-14T03:48:03.041Z,1628912883.041 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 15.000000 meter 2021-08-14T03:48:03.042Z,1628912883.042 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 30.000000 meter 2021-08-14T03:48:03.042Z,1628912883.042 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 41.950752 degree 2021-08-14T03:48:03.043Z,1628912883.043 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.203873 degree 2021-08-14T03:48:03.044Z,1628912883.044 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-14T03:48:03.045Z,1628912883.045 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-14T03:48:03.049Z,1628912883.049 [CommandLine](IMPORTANT): got command stop 2021-08-14T03:48:03.088Z,1628912883.088 [CommandLine](IMPORTANT): Scheduling is paused for 1 commands 2021-08-14T03:49:34.886Z,1628912974.886 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44957, MT Status=1, MTMSN=3178 2021-08-14T03:49:35.675Z,1628912975.675 [CommandLine](IMPORTANT): got command schedule "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 80 m" 2qfxs 1 3.000000 2021-08-14T03:49:35.675Z,1628912975.675 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2qfxs 2021-08-14T03:49:35.676Z,1628912975.676 [CommandLine](IMPORTANT): Scheduled #4 (#1 of 3 with id='2qfxs'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 80 m" 2021-08-14T03:49:35.677Z,1628912975.677 [CommandLine](FAULT): Scheduling was paused by a command at 2021-08-14T03:48:03Z 2021-08-14T03:49:36.128Z,1628912976.128 [NAL9602](FAULT): GPS failed to acquire within timeout. 2021-08-14T03:49:36.920Z,1628912976.920 [NAL9602](FAULT): LCB fault: Software Overcurrent. 2021-08-14T03:50:38.589Z,1628913038.589 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44958, MT Status=1, MTMSN=3179 2021-08-14T03:50:39.360Z,1628913039.360 [CommandLine](IMPORTANT): got command schedule "set Smear.SamplingYoYoMinDepth 30 m;set Smear.SamplingYoYoMaxDepth 38 m;set Smear.SamplingEndLatitude 41.950754 degree;set Smear.SamplingEndLongitude -87.203876 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2qfxs 2 3.000000 2021-08-14T03:50:39.360Z,1628913039.360 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2qfxs 2021-08-14T03:50:39.361Z,1628913039.361 [CommandLine](IMPORTANT): Scheduled #5 (#2 of 3 with id='2qfxs'): "set Smear.SamplingYoYoMinDepth 30 m;set Smear.SamplingYoYoMaxDepth 38 m;set Smear.SamplingEndLatitude 41.950754 degree;set Smear.SamplingEndLongitude -87.203876 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2021-08-14T03:50:39.362Z,1628913039.362 [CommandLine](FAULT): Scheduling was paused by a command at 2021-08-14T03:48:03Z 2021-08-14T03:51:51.945Z,1628913111.945 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44959, MT Status=1, MTMSN=3180 2021-08-14T03:51:52.550Z,1628913112.550 [CommandLine](IMPORTANT): got command schedule "set Smear.NeedCommsTimeVeryLong 8 h;run" 2qfxs 3 3.000000 2021-08-14T03:51:52.551Z,1628913112.551 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2qfxs 2021-08-14T03:51:52.552Z,1628913112.552 [CommandLine](IMPORTANT): Scheduled #6 (#3 of 3 with id='2qfxs'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-14T03:51:52.552Z,1628913112.552 [CommandLine](FAULT): Scheduling was paused by a command at 2021-08-14T03:48:03Z 2021-08-14T03:52:34.726Z,1628913154.726 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=44962, MT Status=1, MTMSN=3181 2021-08-14T03:52:35.313Z,1628913155.313 [CommandLine](IMPORTANT): got command stop 2021-08-14T03:58:54.541Z,1628913534.541 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 16.885213 min 2021-08-14T03:59:20.237Z,1628913560.237 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44969, MT Status=1, MTMSN=3182 2021-08-14T03:59:21.042Z,1628913561.042 [CommandLine](IMPORTANT): got command schedule "load Science/sci2.xml;set sci2.MissionTimeout 9 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 41.950754 degree;set sci2.Lon1 -87.203876 degree;set sci2.Lat2 41.753473 degree;set sci2.Lon2 -87.109951 degree;set sci2.YoYoMinDepth 5 m" 2qg69 1 2.000000 2021-08-14T03:59:21.043Z,1628913561.043 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=2qg69 2021-08-14T03:59:21.044Z,1628913561.044 [CommandLine](IMPORTANT): Scheduled #7 (#1 of 2 with id='2qg69'): "load Science/sci2.xml;set sci2.MissionTimeout 9 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 41.950754 degree;set sci2.Lon1 -87.203876 degree;set sci2.Lat2 41.753473 degree;set sci2.Lon2 -87.109951 degree;set sci2.YoYoMinDepth 5 m" 2021-08-14T03:59:21.044Z,1628913561.044 [CommandLine](FAULT): Scheduling was paused by a command at 2021-08-14T03:52:35Z 2021-08-14T03:59:45.247Z,1628913585.247 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44970, MT Status=1, MTMSN=3183 2021-08-14T03:59:45.861Z,1628913585.861 [CommandLine](IMPORTANT): got command schedule "set sci2.YoYoMaxDepth 60 m;set sci2.MaxDepth 130 m;run" 2qg69 2 2.000000 2021-08-14T03:59:45.862Z,1628913585.862 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=2qg69 2021-08-14T03:59:45.863Z,1628913585.863 [CommandLine](IMPORTANT): Scheduled #8 (#2 of 2 with id='2qg69'): "set sci2.YoYoMaxDepth 60 m;set sci2.MaxDepth 130 m;run" 2021-08-14T03:59:45.863Z,1628913585.863 [CommandLine](FAULT): Scheduling was paused by a command at 2021-08-14T03:52:35Z 2021-08-14T04:05:47.817Z,1628913947.817 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 23.772888 min 2021-08-14T04:06:04.673Z,1628913964.673 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44976, MT Status=1, MTMSN=3184 2021-08-14T04:06:05.629Z,1628913965.629 [CommandLine](IMPORTANT): got command schedule list 2021-08-14T04:06:05.630Z,1628913965.630 [CommandLine](IMPORTANT): Scheduled #3 (#3 of 3 with id='2qf8i'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-14T04:06:05.631Z,1628913965.631 [CommandLine](IMPORTANT): Scheduled #4 (#1 of 3 with id='2qfxs'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 80 m" 2021-08-14T04:06:05.632Z,1628913965.632 [CommandLine](IMPORTANT): Scheduled #5 (#2 of 3 with id='2qfxs'): "set Smear.SamplingYoYoMinDepth 30 m;set Smear.SamplingYoYoMaxDepth 38 m;set Smear.SamplingEndLatitude 41.950754 degree;set Smear.SamplingEndLongitude -87.203876 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2021-08-14T04:06:05.633Z,1628913965.633 [CommandLine](IMPORTANT): Scheduled #6 (#3 of 3 with id='2qfxs'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-14T04:06:05.634Z,1628913965.634 [CommandLine](IMPORTANT): Scheduled #7 (#1 of 2 with id='2qg69'): "load Science/sci2.xml;set sci2.MissionTimeout 9 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 41.950754 degree;set sci2.Lon1 -87.203876 degree;set sci2.Lat2 41.753473 degree;set sci2.Lon2 -87.109951 degree;set sci2.YoYoMinDepth 5 m" 2021-08-14T04:06:05.635Z,1628913965.635 [CommandLine](IMPORTANT): Scheduled #8 (#2 of 2 with id='2qg69'): "set sci2.YoYoMaxDepth 60 m;set sci2.MaxDepth 130 m;run" 2021-08-14T04:06:05.635Z,1628913965.635 [CommandLine](FAULT): Scheduling was paused by a command at 2021-08-14T03:52:35Z 2021-08-14T04:13:49.307Z,1628914429.307 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 31.797835 min 2021-08-14T04:14:20.635Z,1628914460.635 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44983, MT Status=1, MTMSN=3185 2021-08-14T04:14:21.217Z,1628914461.217 [CommandLine](IMPORTANT): got command schedule remove 3 2021-08-14T04:21:16.496Z,1628914876.496 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 39.251192 min 2021-08-14T04:22:00.074Z,1628914920.074 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44989, MT Status=1, MTMSN=3186 2021-08-14T04:22:00.830Z,1628914920.830 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2qhf2 1 3.000000 2021-08-14T04:22:00.830Z,1628914920.830 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2qhf2 2021-08-14T04:22:00.831Z,1628914920.831 [CommandLine](IMPORTANT): Scheduled #9 (#1 of 3 with id='2qhf2'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" ASAP 2021-08-14T04:22:18.970Z,1628914938.970 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44990, MT Status=1, MTMSN=3187 2021-08-14T04:22:19.745Z,1628914939.745 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 41.950754 degree;set Smear.SamplingEndLongitude -87.203876 degree;set Smear.YoYoUpPitch 12 degree" 2qhf2 2 3.000000 2021-08-14T04:22:19.746Z,1628914939.746 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2qhf2 2021-08-14T04:22:19.748Z,1628914939.748 [CommandLine](IMPORTANT): Scheduled #10 (#2 of 3 with id='2qhf2'): "set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 41.950754 degree;set Smear.SamplingEndLongitude -87.203876 degree;set Smear.YoYoUpPitch 12 degree" ASAP 2021-08-14T04:22:34.501Z,1628914954.501 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=44991, MT Status=1, MTMSN=3188 2021-08-14T04:22:35.170Z,1628914955.170 [CommandLine](IMPORTANT): got command schedule asap "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2qhf2 3 3.000000 2021-08-14T04:22:35.170Z,1628914955.170 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2qhf2 2021-08-14T04:22:35.171Z,1628914955.171 [CommandLine](IMPORTANT): Scheduled #11 (#3 of 3 with id='2qhf2'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-14T04:22:35.294Z,1628914955.294 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-14T04:22:37.624Z,1628914957.624 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-14T04:22:47.207Z,1628914967.207 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-14T04:22:47.208Z,1628914967.208 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-14T04:22:47.209Z,1628914967.209 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-14T04:22:47.210Z,1628914967.210 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-14T04:22:47.211Z,1628914967.211 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-14T04:22:56.955Z,1628914976.955 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 15.000000 meter 2021-08-14T04:22:56.955Z,1628914976.955 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 30.000000 meter 2021-08-14T04:22:56.961Z,1628914976.961 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 41.950752 degree 2021-08-14T04:22:56.962Z,1628914976.962 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.203873 degree 2021-08-14T04:22:56.963Z,1628914976.963 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-14T04:23:00.869Z,1628914980.869 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-14T04:23:00.870Z,1628914980.870 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-14T04:23:00.870Z,1628914980.870 [CommandLine](IMPORTANT): got command run 2021-08-14T04:23:00.892Z,1628914980.892 [CommandLine](IMPORTANT): Running 2021-08-14T04:23:00.997Z,1628914980.997 [MissionManager](IMPORTANT): Started mission Smear 2021-08-14T04:23:02.206Z,1628914982.206 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44993, MT Status=1, MTMSN=3189 2021-08-14T04:23:02.794Z,1628914982.794 [CommandLine](IMPORTANT): got command schedule list 2021-08-14T04:23:02.794Z,1628914982.794 [CommandLine](IMPORTANT): Scheduled #4 (#1 of 3 with id='2qfxs'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 80 m" 2021-08-14T04:23:02.795Z,1628914982.795 [CommandLine](IMPORTANT): Scheduled #5 (#2 of 3 with id='2qfxs'): "set Smear.SamplingYoYoMinDepth 30 m;set Smear.SamplingYoYoMaxDepth 38 m;set Smear.SamplingEndLatitude 41.950754 degree;set Smear.SamplingEndLongitude -87.203876 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2021-08-14T04:23:02.796Z,1628914982.796 [CommandLine](IMPORTANT): Scheduled #6 (#3 of 3 with id='2qfxs'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-14T04:23:02.797Z,1628914982.797 [CommandLine](IMPORTANT): Scheduled #7 (#1 of 2 with id='2qg69'): "load Science/sci2.xml;set sci2.MissionTimeout 9 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 41.950754 degree;set sci2.Lon1 -87.203876 degree;set sci2.Lat2 41.753473 degree;set sci2.Lon2 -87.109951 degree;set sci2.YoYoMinDepth 5 m" 2021-08-14T04:23:02.798Z,1628914982.798 [CommandLine](IMPORTANT): Scheduled #8 (#2 of 2 with id='2qg69'): "set sci2.YoYoMaxDepth 60 m;set sci2.MaxDepth 130 m;run" 2021-08-14T04:23:02.798Z,1628914982.798 [CommandLine](FAULT): Scheduling was paused by a command at 2021-08-14T03:52:35Z 2021-08-14T04:23:02.799Z,1628914982.799 [CommandLine](IMPORTANT): got command schedule resume 2021-08-14T04:23:02.799Z,1628914982.799 [CommandLine](IMPORTANT): Scheduling is resumed 2021-08-14T04:29:19.976Z,1628915359.976 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-14T04:29:20.801Z,1628915360.801 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-14T04:44:23.353Z,1628916263.353 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 15.648075 m , 17.501489 degC , 0.405600 ug/l . 2021-08-14T04:44:24.923Z,1628916264.923 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::' 2021-08-14T04:44:35.057Z,1628916275.057 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-14T04:44:35.366Z,1628916275.366 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-14T04:45:22.774Z,1628916322.774 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-14T04:45:23.588Z,1628916323.588 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -1 2021-08-14T04:45:23.589Z,1628916323.589 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-14T04:45:24.027Z,1628916324.027 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-14T04:45:24.795Z,1628916324.795 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-14T04:45:25.199Z,1628916325.199 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-14T04:45:26.815Z,1628916326.815 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-14T04:46:01.155Z,1628916361.155 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PRIMING (@36,aRNAl_bac) 2021-08-14T04:46:02.771Z,1628916362.771 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PRIMING (@100.0) 2021-08-14T04:46:03.176Z,1628916363.176 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-14T04:46:03.580Z,1628916363.580 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-14T04:48:32.658Z,1628916512.658 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_FILTERING (@0.0) 2021-08-14T04:48:33.062Z,1628916513.062 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-14T05:38:02.195Z,1628919482.195 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PAUSED (@869.5) 2021-08-14T05:38:02.613Z,1628919482.613 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PROCESSING (@869.5) 2021-08-14T05:38:04.620Z,1628919484.620 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-14T05:38:05.023Z,1628919485.023 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PROCESSED (@36,aRNAl_bac) 2021-08-14T05:39:39.968Z,1628919579.968 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING (@36,aRNAl_bac) 2021-08-14T05:39:47.237Z,1628919587.237 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-14T05:39:47.640Z,1628919587.640 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED 2021-08-14T05:44:47.415Z,1628919887.415 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence completed normally. 2021-08-14T05:44:47.820Z,1628919887.820 [ESPComponent](IMPORTANT): [sample #1] ESP log summary report (5 messages): @00:45:37.01 Selecting Cartridge 36 @00:46:11.52 Cartridge::Sampler::PossibleLeak in FILTERING -- Retained only 44.3psia @00:46:11.53 Retry #1 of 2 @01:37:59.44 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @01:37:59.64 Sampled 869.5ml 2021-08-14T05:44:48.694Z,1628919888.694 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-14T05:54:08.124Z,1628920448.124 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-14T05:54:10.684Z,1628920450.684 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-14T05:54:11.078Z,1628920451.078 [MissionManager](IMPORTANT): Started mission Default 2021-08-14T05:54:20.547Z,1628920460.547 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-14T05:54:20.548Z,1628920460.548 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-14T05:54:20.549Z,1628920460.549 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-14T05:54:20.550Z,1628920460.550 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-14T05:54:20.550Z,1628920460.550 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-14T05:54:20.551Z,1628920460.551 [CommandLine](IMPORTANT): got command set Smear.MaxDepth 80.000000 meter 2021-08-14T05:54:32.417Z,1628920472.417 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 30.000000 meter 2021-08-14T05:54:32.418Z,1628920472.418 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 38.000000 meter 2021-08-14T05:54:32.419Z,1628920472.419 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 41.950752 degree 2021-08-14T05:54:32.419Z,1628920472.419 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.203873 degree 2021-08-14T05:54:32.420Z,1628920472.420 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-14T05:54:32.421Z,1628920472.421 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-14T05:54:34.791Z,1628920474.791 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-14T05:54:34.791Z,1628920474.791 [CommandLine](IMPORTANT): got command run 2021-08-14T05:54:34.805Z,1628920474.805 [CommandLine](IMPORTANT): Running 2021-08-14T05:54:34.973Z,1628920474.973 [MissionManager](IMPORTANT): Started mission Smear 2021-08-14T06:01:25.347Z,1628920885.347 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-14T06:01:26.170Z,1628920886.170 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-14T06:01:46.343Z,1628920906.343 [BPC1](FAULT): Battery stick #38 (s/n: 0139) reported TERMINATE_DISCHARGE_ALARM. Status code: 0x4AD0. 2021-08-14T06:16:28.703Z,1628921788.703 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 29.292803 m , 7.962793 degC , 0.270400 ug/l . 2021-08-14T06:16:40.497Z,1628921800.497 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-14T06:16:40.666Z,1628921800.666 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-14T06:17:27.830Z,1628921847.830 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-14T06:17:28.651Z,1628921848.651 [ESPComponent](IMPORTANT): [sample #2] Setting cartridge argument to -1 2021-08-14T06:17:28.652Z,1628921848.652 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-14T06:17:29.079Z,1628921849.079 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-14T06:17:29.446Z,1628921849.446 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-14T06:17:29.850Z,1628921849.850 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-14T06:17:31.870Z,1628921851.870 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-14T06:18:06.216Z,1628921886.216 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PRIMING (@35,aRNAl_bac) 2021-08-14T06:18:07.828Z,1628921887.828 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PRIMING (@100.0) 2021-08-14T06:18:08.231Z,1628921888.231 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-14T06:18:08.635Z,1628921888.635 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-14T06:20:30.043Z,1628922030.043 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_FILTERING (@0.0) 2021-08-14T06:20:30.446Z,1628922030.446 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-14T07:54:43.735Z,1628927683.735 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PAUSED (@1530.2) 2021-08-14T07:54:44.139Z,1628927684.139 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PROCESSING (@1530.2) 2021-08-14T07:54:46.160Z,1628927686.160 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-14T07:54:46.565Z,1628927686.565 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PROCESSED (@35,aRNAl_bac) 2021-08-14T07:56:21.507Z,1628927781.507 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPING (@35,aRNAl_bac) 2021-08-14T07:56:28.791Z,1628927788.791 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-14T07:56:29.187Z,1628927789.187 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPED 2021-08-14T08:01:28.967Z,1628928088.967 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence completed normally. 2021-08-14T08:01:29.371Z,1628928089.371 [ESPComponent](IMPORTANT): [sample #2] ESP log summary report (3 messages): @02:17:42.46 Selecting Cartridge 35 @03:54:41.25 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @03:54:41.44 Sampled 1530.2ml 2021-08-14T08:01:30.219Z,1628928090.219 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-14T08:13:00.625Z,1628928780.625 [CommandLine](IMPORTANT): got command load ./Missions/Science/sci2.xml 2021-08-14T08:13:03.431Z,1628928783.431 [CommandLine](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2021-08-14T08:13:03.640Z,1628928783.640 [MissionManager](IMPORTANT): Started mission Default 2021-08-14T08:13:13.119Z,1628928793.119 [CommandLine](IMPORTANT): got command set sci2.MissionTimeout 9.000000 hour 2021-08-14T08:13:13.120Z,1628928793.120 [CommandLine](IMPORTANT): got command set sci2.NeedCommsTime 45.000000 minute 2021-08-14T08:13:13.121Z,1628928793.121 [CommandLine](IMPORTANT): got command set sci2.Lat1 41.950752 degree 2021-08-14T08:13:13.122Z,1628928793.122 [CommandLine](IMPORTANT): got command set sci2.Lon1 -87.203873 degree 2021-08-14T08:13:13.123Z,1628928793.123 [CommandLine](IMPORTANT): got command set sci2.Lat2 41.753471 degree 2021-08-14T08:13:13.123Z,1628928793.123 [CommandLine](IMPORTANT): got command set sci2.Lon2 -87.109947 degree 2021-08-14T08:13:13.124Z,1628928793.124 [CommandLine](IMPORTANT): got command set sci2.YoYoMinDepth 5.000000 meter 2021-08-14T08:13:16.368Z,1628928796.368 [CommandLine](IMPORTANT): got command set sci2.YoYoMaxDepth 60.000000 meter 2021-08-14T08:13:16.368Z,1628928796.368 [CommandLine](IMPORTANT): got command set sci2.MaxDepth 130.000000 meter 2021-08-14T08:13:16.369Z,1628928796.369 [CommandLine](IMPORTANT): got command run 2021-08-14T08:13:16.372Z,1628928796.372 [CommandLine](IMPORTANT): Running 2021-08-14T08:13:16.566Z,1628928796.566 [MissionManager](IMPORTANT): Started mission sci2 2021-08-14T09:39:17.717Z,1628933957.717 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-14T09:39:28.544Z,1628933968.544 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.002766 CHAN A1 (24V): 0.004052 CHAN A2 (12V): -0.019821 CHAN A3 (5V): -0.004346 CHAN B0 (3.3V): -0.003024 CHAN B1 (3.15aV): 0.009198 CHAN B2 (3.15bV): -0.000828 CHAN B3 (GND): -0.001687 OPEN: 0.011901 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-14T12:39:10.564Z,1628944750.564 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45091, MT Status=1, MTMSN=3190 2021-08-14T12:39:11.302Z,1628944751.302 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 55 m" 2r2sg 1 3.000000 2021-08-14T12:39:11.303Z,1628944751.303 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2r2sg 2021-08-14T12:39:11.304Z,1628944751.304 [CommandLine](IMPORTANT): Scheduled #12 (#1 of 3 with id='2r2sg'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 55 m" ASAP 2021-08-14T12:44:24.143Z,1628945064.143 [sci2:NeedComms:C:A_Timeout:A](IMPORTANT): first GPS update timeout 2021-08-14T12:45:04.203Z,1628945104.203 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45092, MT Status=1, MTMSN=3191 2021-08-14T12:45:05.038Z,1628945105.038 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SamplingYoYoMinDepth 30 m;set Smear.SamplingYoYoMaxDepth 44 m;set Smear.SamplingEndLatitude 41.950754 degree;set Smear.SamplingEndLongitude -87.203876 degree;set Smear.YoYoUpPitch 12 degree" 2r2sg 2 3.000000 2021-08-14T12:45:05.038Z,1628945105.038 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2r2sg 2021-08-14T12:45:05.039Z,1628945105.039 [CommandLine](IMPORTANT): Scheduled #13 (#2 of 3 with id='2r2sg'): "set Smear.SamplingYoYoMinDepth 30 m;set Smear.SamplingYoYoMaxDepth 44 m;set Smear.SamplingEndLatitude 41.950754 degree;set Smear.SamplingEndLongitude -87.203876 degree;set Smear.YoYoUpPitch 12 degree" ASAP 2021-08-14T12:47:26.435Z,1628945246.435 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45093, MT Status=1, MTMSN=3192 2021-08-14T12:47:27.174Z,1628945247.174 [CommandLine](IMPORTANT): got command schedule asap "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2r2sg 3 3.000000 2021-08-14T12:47:27.175Z,1628945247.175 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2r2sg 2021-08-14T12:47:27.176Z,1628945247.176 [CommandLine](IMPORTANT): Scheduled #14 (#3 of 3 with id='2r2sg'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-14T12:47:27.438Z,1628945247.438 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-14T12:47:30.030Z,1628945250.030 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-14T12:47:30.173Z,1628945250.173 [MissionManager](IMPORTANT): Started mission Default 2021-08-14T12:47:42.423Z,1628945262.423 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-14T12:47:42.424Z,1628945262.424 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-14T12:47:42.425Z,1628945262.425 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-14T12:47:42.426Z,1628945262.426 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-14T12:47:42.427Z,1628945262.427 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-14T12:47:42.427Z,1628945262.427 [CommandLine](IMPORTANT): got command set Smear.MaxDepth 55.000000 meter 2021-08-14T12:47:45.623Z,1628945265.623 [NAL9602](FAULT): GPS failed to acquire within timeout. 2021-08-14T12:47:46.333Z,1628945266.333 [NAL9602](FAULT): LCB fault: Software Overcurrent. 2021-08-14T12:47:53.763Z,1628945273.763 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 30.000000 meter 2021-08-14T12:47:53.763Z,1628945273.763 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 44.000000 meter 2021-08-14T12:47:53.764Z,1628945273.764 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 41.950752 degree 2021-08-14T12:47:53.765Z,1628945273.765 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.203873 degree 2021-08-14T12:47:53.766Z,1628945273.766 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-14T12:47:58.119Z,1628945278.119 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-14T12:47:58.120Z,1628945278.120 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-14T12:47:58.120Z,1628945278.120 [CommandLine](IMPORTANT): got command run 2021-08-14T12:47:58.122Z,1628945278.122 [CommandLine](IMPORTANT): Running 2021-08-14T12:47:58.416Z,1628945278.416 [MissionManager](IMPORTANT): Started mission Smear 2021-08-14T12:56:00.386Z,1628945760.386 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45094, MT Status=1, MTMSN=3193 2021-08-14T12:56:01.167Z,1628945761.167 [CommandLine](IMPORTANT): got command schedule "load Science/sci2.xml;set sci2.MissionTimeout 9 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 41.950754 degree;set sci2.Lon1 -87.203876 degree;set sci2.Lat2 41.753473 degree;set sci2.Lon2 -87.109951 degree;set sci2.YoYoMinDepth 5 m" 2r32a 1 2.000000 2021-08-14T12:56:01.167Z,1628945761.167 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=2r32a 2021-08-14T12:56:01.168Z,1628945761.168 [CommandLine](IMPORTANT): Scheduled #15 (#1 of 2 with id='2r32a'): "load Science/sci2.xml;set sci2.MissionTimeout 9 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 41.950754 degree;set sci2.Lon1 -87.203876 degree;set sci2.Lat2 41.753473 degree;set sci2.Lon2 -87.109951 degree;set sci2.YoYoMinDepth 5 m" 2021-08-14T12:56:22.412Z,1628945782.412 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45095, MT Status=1, MTMSN=3194 2021-08-14T12:56:23.002Z,1628945783.002 [CommandLine](IMPORTANT): got command schedule "set sci2.YoYoMaxDepth 60 m;set sci2.MaxDepth 130 m;run" 2r32a 2 2.000000 2021-08-14T12:56:23.003Z,1628945783.003 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=2r32a 2021-08-14T12:56:23.004Z,1628945783.004 [CommandLine](IMPORTANT): Scheduled #16 (#2 of 2 with id='2r32a'): "set sci2.YoYoMaxDepth 60 m;set sci2.MaxDepth 130 m;run" 2021-08-14T13:02:33.378Z,1628946153.378 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-14T13:02:34.209Z,1628946154.209 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-14T13:17:36.756Z,1628947056.756 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 40.832870 m , 5.737207 degC , 0.218400 ug/l . 2021-08-14T13:17:48.525Z,1628947068.525 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-14T13:17:48.637Z,1628947068.637 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-14T13:18:36.098Z,1628947116.098 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-14T13:18:36.914Z,1628947116.914 [ESPComponent](IMPORTANT): [sample #3] Setting cartridge argument to -1 2021-08-14T13:18:36.915Z,1628947116.915 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-14T13:18:37.373Z,1628947117.373 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-14T13:18:37.715Z,1628947117.715 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-14T13:18:38.119Z,1628947118.119 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-14T13:18:40.143Z,1628947120.143 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-14T13:19:14.479Z,1628947154.479 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PRIMING (@34,aRNAl_bac) 2021-08-14T13:19:16.100Z,1628947156.100 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PRIMING (@100.0) 2021-08-14T13:19:16.500Z,1628947156.500 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-14T13:19:16.903Z,1628947156.903 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-14T13:21:38.711Z,1628947298.711 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_FILTERING (@0.0) 2021-08-14T13:21:39.115Z,1628947299.115 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-14T15:02:15.027Z,1628953335.027 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PAUSED (@1639.4) 2021-08-14T15:02:15.431Z,1628953335.431 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PROCESSING (@1639.4) 2021-08-14T15:02:17.455Z,1628953337.455 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-14T15:02:17.855Z,1628953337.855 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PROCESSED (@34,aRNAl_bac) 2021-08-14T15:03:52.798Z,1628953432.798 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPING (@34,aRNAl_bac) 2021-08-14T15:04:00.068Z,1628953440.068 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-14T15:04:00.471Z,1628953440.471 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPED 2021-08-14T15:09:00.251Z,1628953740.251 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence completed normally. 2021-08-14T15:09:00.655Z,1628953740.655 [ESPComponent](IMPORTANT): [sample #3] ESP log summary report (3 messages): @09:18:51.39 Selecting Cartridge 34 @11:02:12.33 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @11:02:12.93 Sampled 1639.4ml 2021-08-14T15:09:01.494Z,1628953741.494 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-14T15:18:06.182Z,1628954286.182 [Smear:NeedComms:C:A_Timeout:A](IMPORTANT): first GPS update timeout 2021-08-14T15:21:07.643Z,1628954467.643 [NAL9602](FAULT): GPS failed to acquire within timeout. 2021-08-14T15:21:08.438Z,1628954468.438 [NAL9602](FAULT): LCB fault: Software Overcurrent. 2021-08-14T15:27:53.845Z,1628954873.845 [Smear:NeedComms:E:A_Timeout:A](IMPORTANT): second GPS update timeout 2021-08-14T15:27:55.536Z,1628954875.536 [CommandLine](IMPORTANT): got command load ./Missions/Science/sci2.xml 2021-08-14T15:27:58.045Z,1628954878.045 [CommandLine](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2021-08-14T15:27:58.288Z,1628954878.288 [MissionManager](IMPORTANT): Started mission Default 2021-08-14T15:28:06.601Z,1628954886.601 [CommandLine](IMPORTANT): got command set sci2.MissionTimeout 9.000000 hour 2021-08-14T15:28:06.602Z,1628954886.602 [CommandLine](IMPORTANT): got command set sci2.NeedCommsTime 45.000000 minute 2021-08-14T15:28:06.602Z,1628954886.602 [CommandLine](IMPORTANT): got command set sci2.Lat1 41.950752 degree 2021-08-14T15:28:06.603Z,1628954886.603 [CommandLine](IMPORTANT): got command set sci2.Lon1 -87.203873 degree 2021-08-14T15:28:06.604Z,1628954886.604 [CommandLine](IMPORTANT): got command set sci2.Lat2 41.753471 degree 2021-08-14T15:28:06.632Z,1628954886.632 [CommandLine](IMPORTANT): got command set sci2.Lon2 -87.109947 degree 2021-08-14T15:28:06.633Z,1628954886.633 [CommandLine](IMPORTANT): got command set sci2.YoYoMinDepth 5.000000 meter 2021-08-14T15:28:09.541Z,1628954889.541 [CommandLine](IMPORTANT): got command set sci2.YoYoMaxDepth 60.000000 meter 2021-08-14T15:28:09.541Z,1628954889.541 [CommandLine](IMPORTANT): got command set sci2.MaxDepth 130.000000 meter 2021-08-14T15:28:09.542Z,1628954889.542 [CommandLine](IMPORTANT): got command run 2021-08-14T15:28:09.544Z,1628954889.544 [CommandLine](IMPORTANT): Running 2021-08-14T15:28:09.626Z,1628954889.626 [MissionManager](IMPORTANT): Started mission sci2 2021-08-14T15:31:52.597Z,1628955112.597 [NAL9602](FAULT): GPS failed to acquire within timeout. 2021-08-14T15:31:53.429Z,1628955113.429 [NAL9602](FAULT): LCB fault: Software Overcurrent. 2021-08-14T15:35:10.606Z,1628955310.606 [sci2:NeedComms:C:A_Timeout:A](IMPORTANT): first GPS update timeout 2021-08-14T15:39:28.647Z,1628955568.647 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-14T15:39:39.603Z,1628955579.603 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.004137 CHAN A1 (24V): 0.004006 CHAN A2 (12V): -0.005463 CHAN A3 (5V): -0.004634 CHAN B0 (3.3V): -0.002182 CHAN B1 (3.15aV): -0.001150 CHAN B2 (3.15bV): -0.001338 CHAN B3 (GND): -0.000182 OPEN: 0.012041 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-14T15:42:36.449Z,1628955756.449 [NAL9602](FAULT): GPS failed to acquire within timeout. 2021-08-14T15:42:58.745Z,1628955778.745 [sci2:NeedComms:E:A_Timeout:A](IMPORTANT): second GPS update timeout 2021-08-14T15:49:59.671Z,1628956199.671 [sci2:NeedComms:C:A_Timeout:A](IMPORTANT): first GPS update timeout 2021-08-14T16:04:04.602Z,1628957044.602 [CBIT](CRITICAL): Data Fault in component: NAL9602 2021-08-14T15:53:19.374Z,1628956399.374 [NAL9602](FAULT): GPS failed to acquire within timeout. 2021-08-14T15:58:20.022Z,1628956700.022 [sci2:NeedComms:E:A_Timeout:A](IMPORTANT): second GPS update timeout 2021-08-14T16:04:04.565Z,1628957044.565 [NAL9602](FAULT): GPS failed to acquire within timeout. 2021-08-14T16:04:05.045Z,1628957045.045 [CommandLine](FAULT): Scheduling is paused 2021-08-14T16:04:05.786Z,1628957045.786 [MissionManager](IMPORTANT): Started mission Default 2021-08-14T16:15:53.283Z,1628957753.283 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.785243 min 2021-08-14T16:16:30.860Z,1628957790.860 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45137, MT Status=1, MTMSN=3195 2021-08-14T16:16:31.397Z,1628957791.397 [CommandLine](IMPORTANT): got command ibit 2021-08-14T16:16:31.706Z,1628957791.706 [IBIT](IMPORTANT): Beginning Initiated BIT 2021-08-14T16:16:31.706Z,1628957791.706 [IBIT](IMPORTANT): Beginning control surface checks. 2021-08-14T16:16:31.710Z,1628957791.710 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-14T16:16:32.058Z,1628957792.058 [NAL9602](FAULT): GPS failed to acquire within timeout. 2021-08-14T16:16:32.870Z,1628957792.870 [NAL9602](FAULT): LCB fault: Software Overcurrent. 2021-08-14T16:16:42.631Z,1628957802.631 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): 0.000145 CHAN A1 (24V): 0.002958 CHAN A2 (12V): -0.005566 CHAN A3 (5V): -0.021770 CHAN B0 (3.3V): -0.002135 CHAN B1 (3.15aV): -0.001659 CHAN B2 (3.15bV): -0.002238 CHAN B3 (GND): 0.028839 OPEN: 0.012068 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-14T16:18:22.796Z,1628957902.796 [IBIT](FAULT): Error acquiring IBIT communications status. Timeout expired. 2021-08-14T16:18:23.215Z,1628957903.215 [IBIT](IMPORTANT): Battery Status: Battery Charge (AH): 0.000000 Voltage: 14.827000 2021-08-14T16:18:23.216Z,1628957903.216 [IBIT](IMPORTANT): batteryCapacityThreshold: 50.000000 Ah 2021-08-14T16:18:23.216Z,1628957903.216 [IBIT](IMPORTANT): batteryVoltageThreshold: 13.700000 V 2021-08-14T16:18:23.579Z,1628957903.579 [IBIT](IMPORTANT): bitHumidityThreshold: 55.000000 % 2021-08-14T16:18:23.579Z,1628957903.579 [IBIT](IMPORTANT): bitPressureThreshold: 0.750000 psi 2021-08-14T16:18:23.579Z,1628957903.579 [IBIT](IMPORTANT): Pressure:7.779022 PSI 2021-08-14T16:18:23.580Z,1628957903.580 [IBIT](IMPORTANT): Humidity:14.503723 % 2021-08-14T16:18:24.008Z,1628957904.008 [IBIT](IMPORTANT): Vehicle Pitch:-1.804250 degrees 2021-08-14T16:18:24.008Z,1628957904.008 [IBIT](IMPORTANT): Vehicle Roll:-1.112066 degrees 2021-08-14T16:18:24.009Z,1628957904.009 [IBIT](IMPORTANT): Vehicle Heading:124.508614 degrees 2021-08-14T16:18:24.411Z,1628957904.411 [IBIT](IMPORTANT): surfaceThreshold: 1.000000 m 2021-08-14T16:18:24.411Z,1628957904.411 [IBIT](IMPORTANT): buoyancyNeutral: 305.870789 cc 2021-08-14T16:18:24.412Z,1628957904.412 [IBIT](IMPORTANT): massDefault: 0.721847 cm 2021-08-14T16:18:24.412Z,1628957904.412 [IBIT](IMPORTANT): stopDepth: 200.000000 m 2021-08-14T16:18:24.412Z,1628957904.412 [IBIT](IMPORTANT): abortDepth: 210.000000 m 2021-08-14T16:18:24.412Z,1628957904.412 [IBIT](IMPORTANT): IBIT FAILED 2021-08-14T16:37:09.969Z,1628959029.969 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 33.063206 min 2021-08-14T16:37:11.587Z,1628959031.587 [NAL9602](FAULT): GPS failed to acquire within timeout. 2021-08-14T16:39:01.894Z,1628959141.894 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45143, MT Status=1, MTMSN=3196 2021-08-14T16:39:02.678Z,1628959142.678 [CommandLine](IMPORTANT): got command schedule asap "load Maintenance/ballast_and_trim.xml;set ballast_and_trim.MissionTimeout 15 min;set ballast_and_trim.Depth1 2 m;set ballast_and_trim.ApproachSpeed 0 m/s;set ballast_and_trim.MassEstimationErrorBound 1 mm" 2rfep 1 2.000000 2021-08-14T16:39:02.678Z,1628959142.678 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=2rfep 2021-08-14T16:39:02.679Z,1628959142.679 [CommandLine](IMPORTANT): Scheduled #17 (#1 of 2 with id='2rfep'): "load Maintenance/ballast_and_trim.xml;set ballast_and_trim.MissionTimeout 15 min;set ballast_and_trim.Depth1 2 m;set ballast_and_trim.ApproachSpeed 0 m/s;set ballast_and_trim.MassEstimationErrorBound 1 mm" ASAP 2021-08-14T16:42:48.991Z,1628959368.991 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45144, MT Status=1, MTMSN=3197 2021-08-14T16:42:49.667Z,1628959369.667 [CommandLine](IMPORTANT): got command schedule asap "set ballast_and_trim.BuoyEstimationErrorBound 25 cc;set ballast_and_trim.MinAltitude 1 m;set ballast_and_trim.MaxDepth 4.5 m;run" 2rfep 2 2.000000 2021-08-14T16:42:49.667Z,1628959369.667 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=2rfep 2021-08-14T16:42:49.668Z,1628959369.668 [CommandLine](IMPORTANT): Scheduled #18 (#2 of 2 with id='2rfep'): "set ballast_and_trim.BuoyEstimationErrorBound 25 cc;set ballast_and_trim.MinAltitude 1 m;set ballast_and_trim.MaxDepth 4.5 m;run" ASAP 2021-08-14T16:42:49.949Z,1628959369.949 [CommandLine](IMPORTANT): got command load ./Missions/Maintenance/ballast_and_trim.xml 2021-08-14T16:42:52.849Z,1628959372.849 [CommandLine](IMPORTANT): Loaded ./Missions/Maintenance/ballast_and_trim.xml 2021-08-14T16:43:07.392Z,1628959387.392 [CommandLine](IMPORTANT): got command set ballast_and_trim.MissionTimeout 15.000000 minute 2021-08-14T16:43:07.400Z,1628959387.400 [CommandLine](IMPORTANT): got command set ballast_and_trim.Depth1 2.000000 meter 2021-08-14T16:43:07.403Z,1628959387.403 [CommandLine](IMPORTANT): got command set ballast_and_trim.ApproachSpeed 0.000000 meter_per_second 2021-08-14T16:43:07.433Z,1628959387.433 [CommandLine](IMPORTANT): got command set ballast_and_trim.MassEstimationErrorBound 1.000000 millimeter 2021-08-14T16:43:16.831Z,1628959396.831 [CommandLine](IMPORTANT): got command set ballast_and_trim.BuoyEstimationErrorBound 25.000000 cubic_centimeter 2021-08-14T16:43:16.833Z,1628959396.833 [CommandLine](IMPORTANT): got command set ballast_and_trim.MinAltitude 1.000000 meter 2021-08-14T16:43:16.834Z,1628959396.834 [CommandLine](IMPORTANT): got command set ballast_and_trim.MaxDepth 4.500000 meter 2021-08-14T16:43:16.835Z,1628959396.835 [CommandLine](IMPORTANT): got command run 2021-08-14T16:43:16.915Z,1628959396.915 [CommandLine](IMPORTANT): Running 2021-08-14T16:43:17.146Z,1628959397.146 [MissionManager](IMPORTANT): Started mission ballast_and_trim 2021-08-14T16:43:28.036Z,1628959408.036 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45145, MT Status=1, MTMSN=3198 2021-08-14T16:43:31.206Z,1628959411.206 [CommandLine](IMPORTANT): got command set ballast_and_trim.SkipComms 1.000000 bool 2021-08-14T16:47:55.131Z,1628959675.131 [NAL9602](FAULT): GPS failed to acquire within timeout. 2021-08-14T16:50:17.740Z,1628959817.740 [ballast_and_trim:NeedComms:C:A_Timeout:A](IMPORTANT): first GPS update timeout 2021-08-14T16:53:57.025Z,1628960037.025 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45146, MT Status=1, MTMSN=3199 2021-08-14T16:53:57.783Z,1628960037.783 [CommandLine](IMPORTANT): got command load ./Missions/Maintenance/ballast_and_trim.xml 2021-08-14T16:53:59.641Z,1628960039.641 [CommandLine](IMPORTANT): Loaded ./Missions/Maintenance/ballast_and_trim.xml 2021-08-14T16:54:12.075Z,1628960052.075 [CommandLine](IMPORTANT): got command set ballast_and_trim.MissionTimeout 15.000000 minute 2021-08-14T16:54:12.076Z,1628960052.076 [CommandLine](IMPORTANT): got command set ballast_and_trim.SkipComms 1.000000 bool 2021-08-14T16:54:12.077Z,1628960052.077 [CommandLine](IMPORTANT): got command set ballast_and_trim.Depth1 8.000000 meter 2021-08-14T16:54:12.078Z,1628960052.078 [CommandLine](IMPORTANT): got command set ballast_and_trim.SettleTime 25.000000 minute 2021-08-14T16:54:12.079Z,1628960052.079 [CommandLine](IMPORTANT): got command set ballast_and_trim.MaxDepth 15.000000 meter 2021-08-14T16:54:12.079Z,1628960052.079 [CommandLine](IMPORTANT): got command run 2021-08-14T16:54:12.114Z,1628960052.114 [CommandLine](IMPORTANT): Running 2021-08-14T16:54:12.122Z,1628960052.122 [MissionManager](IMPORTANT): Started mission ballast_and_trim 2021-08-14T16:58:37.674Z,1628960317.674 [NAL9602](FAULT): GPS failed to acquire within timeout. 2021-08-14T17:01:12.451Z,1628960472.451 [ballast_and_trim:NeedComms:C:A_Timeout:A](IMPORTANT): first GPS update timeout 2021-08-14T17:09:12.639Z,1628960952.639 [MissionManager](IMPORTANT): Started mission Default 2021-08-14T17:15:22.303Z,1628961322.303 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 6.154508 min 2021-08-14T17:15:45.785Z,1628961345.785 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45158, MT Status=1, MTMSN=3200 2021-08-14T17:15:46.369Z,1628961346.369 [CommandLine](IMPORTANT): got command ibit 2021-08-14T17:15:46.621Z,1628961346.621 [IBIT](IMPORTANT): Beginning Initiated BIT 2021-08-14T17:15:46.621Z,1628961346.621 [IBIT](IMPORTANT): Beginning control surface checks. 2021-08-14T17:15:46.625Z,1628961346.625 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-14T17:15:59.688Z,1628961359.688 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.004501 CHAN A1 (24V): 0.003367 CHAN A2 (12V): -0.004498 CHAN A3 (5V): -0.002358 CHAN B0 (3.3V): -0.001375 CHAN B1 (3.15aV): -0.001017 CHAN B2 (3.15bV): 0.002735 CHAN B3 (GND): -0.001407 OPEN: 0.012145 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-14T17:16:32.658Z,1628961392.658 [IBIT](IMPORTANT): Communications Status: Fix Status: 1 Iridium Signal Strength: 5 Latitude: 41.985573 Longitude: -87.250954 2021-08-14T17:16:33.061Z,1628961393.061 [IBIT](IMPORTANT): Battery Status: Battery Charge (AH): 203.046844 Voltage: 14.946000 2021-08-14T17:16:33.061Z,1628961393.061 [IBIT](IMPORTANT): batteryCapacityThreshold: 50.000000 Ah 2021-08-14T17:16:33.062Z,1628961393.062 [IBIT](IMPORTANT): batteryVoltageThreshold: 13.700000 V 2021-08-14T17:16:33.479Z,1628961393.479 [IBIT](IMPORTANT): bitHumidityThreshold: 55.000000 % 2021-08-14T17:16:33.479Z,1628961393.479 [IBIT](IMPORTANT): bitPressureThreshold: 0.750000 psi 2021-08-14T17:16:33.480Z,1628961393.480 [IBIT](IMPORTANT): Pressure:7.833161 PSI 2021-08-14T17:16:33.480Z,1628961393.480 [IBIT](IMPORTANT): Humidity:14.808936 % 2021-08-14T17:16:33.882Z,1628961393.882 [IBIT](IMPORTANT): Vehicle Pitch:-0.218298 degrees 2021-08-14T17:16:33.882Z,1628961393.882 [IBIT](IMPORTANT): Vehicle Roll:3.608624 degrees 2021-08-14T17:16:33.882Z,1628961393.882 [IBIT](IMPORTANT): Vehicle Heading:101.038643 degrees 2021-08-14T17:16:34.300Z,1628961394.300 [IBIT](IMPORTANT): surfaceThreshold: 1.000000 m 2021-08-14T17:16:34.300Z,1628961394.300 [IBIT](IMPORTANT): buoyancyNeutral: 305.870789 cc 2021-08-14T17:16:34.301Z,1628961394.301 [IBIT](IMPORTANT): massDefault: 0.721847 cm 2021-08-14T17:16:34.301Z,1628961394.301 [IBIT](IMPORTANT): stopDepth: 200.000000 m 2021-08-14T17:16:34.301Z,1628961394.301 [IBIT](IMPORTANT): abortDepth: 210.000000 m 2021-08-14T17:16:34.302Z,1628961394.302 [IBIT](IMPORTANT): IBIT PASSED 2021-08-14T17:22:13.471Z,1628961733.471 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 13.006976 min 2021-08-14T17:29:34.646Z,1628962174.646 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 20.360079 min 2021-08-14T17:36:51.037Z,1628962611.037 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 27.633403 min 2021-08-14T17:40:42.943Z,1628962842.943 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45172, MT Status=1, MTMSN=3201 2021-08-14T17:40:43.675Z,1628962843.675 [CommandLine](IMPORTANT): got command schedule asap "load Science/sci2.xml;set sci2.MissionTimeout 9 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 41.950754 degree;set sci2.Lon1 -87.203876 degree;set sci2.Lat2 41.753473 degree;set sci2.Lon2 -87.109951 degree;set sci2.YoYoMinDepth 5 m" 2ri1m 1 2.000000 2021-08-14T17:40:43.675Z,1628962843.675 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=2ri1m 2021-08-14T17:40:43.676Z,1628962843.676 [CommandLine](IMPORTANT): Scheduled #19 (#1 of 2 with id='2ri1m'): "load Science/sci2.xml;set sci2.MissionTimeout 9 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 41.950754 degree;set sci2.Lon1 -87.203876 degree;set sci2.Lat2 41.753473 degree;set sci2.Lon2 -87.109951 degree;set sci2.YoYoMinDepth 5 m" ASAP 2021-08-14T17:41:03.878Z,1628962863.878 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45173, MT Status=1, MTMSN=3202 2021-08-14T17:41:04.514Z,1628962864.514 [CommandLine](IMPORTANT): got command schedule asap "set sci2.YoYoMaxDepth 60 m;set sci2.MaxDepth 130 m;run" 2ri1m 2 2.000000 2021-08-14T17:41:04.514Z,1628962864.514 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=2ri1m 2021-08-14T17:41:04.515Z,1628962864.515 [CommandLine](IMPORTANT): Scheduled #20 (#2 of 2 with id='2ri1m'): "set sci2.YoYoMaxDepth 60 m;set sci2.MaxDepth 130 m;run" ASAP 2021-08-14T17:41:04.643Z,1628962864.643 [CommandLine](IMPORTANT): got command load ./Missions/Science/sci2.xml 2021-08-14T17:41:06.483Z,1628962866.483 [CommandLine](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2021-08-14T17:41:16.634Z,1628962876.634 [CommandLine](IMPORTANT): got command set sci2.MissionTimeout 9.000000 hour 2021-08-14T17:41:16.635Z,1628962876.635 [CommandLine](IMPORTANT): got command set sci2.NeedCommsTime 45.000000 minute 2021-08-14T17:41:16.635Z,1628962876.635 [CommandLine](IMPORTANT): got command set sci2.Lat1 41.950752 degree 2021-08-14T17:41:16.636Z,1628962876.636 [CommandLine](IMPORTANT): got command set sci2.Lon1 -87.203873 degree 2021-08-14T17:41:16.637Z,1628962876.637 [CommandLine](IMPORTANT): got command set sci2.Lat2 41.753471 degree 2021-08-14T17:41:16.638Z,1628962876.638 [CommandLine](IMPORTANT): got command set sci2.Lon2 -87.109947 degree 2021-08-14T17:41:16.638Z,1628962876.638 [CommandLine](IMPORTANT): got command set sci2.YoYoMinDepth 5.000000 meter 2021-08-14T17:41:19.892Z,1628962879.892 [CommandLine](IMPORTANT): got command set sci2.YoYoMaxDepth 60.000000 meter 2021-08-14T17:41:19.893Z,1628962879.893 [CommandLine](IMPORTANT): got command set sci2.MaxDepth 130.000000 meter 2021-08-14T17:41:19.894Z,1628962879.894 [CommandLine](IMPORTANT): got command run 2021-08-14T17:41:19.898Z,1628962879.898 [CommandLine](IMPORTANT): Running 2021-08-14T17:41:19.987Z,1628962879.987 [MissionManager](IMPORTANT): Started mission sci2 2021-08-14T19:39:26.456Z,1628969966.456 [sci2:Lap:Wpt1:A.Waypoint](IMPORTANT): Reached Waypoint: 41.950752,-87.203873 2021-08-14T21:02:21.426Z,1628974941.426 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45209, MT Status=1, MTMSN=3203 2021-08-14T21:02:22.180Z,1628974942.180 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2rqf4 1 3.000000 2021-08-14T21:02:22.181Z,1628974942.181 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2rqf4 2021-08-14T21:02:22.182Z,1628974942.182 [CommandLine](IMPORTANT): Scheduled #21 (#1 of 3 with id='2rqf4'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" ASAP 2021-08-14T21:02:44.032Z,1628974964.032 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45210, MT Status=1, MTMSN=3204 2021-08-14T21:02:44.825Z,1628974964.825 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 41.753473 degree;set Smear.SamplingEndLongitude -87.109951 degree;set Smear.YoYoUpPitch 12 degree" 2rqf4 2 3.000000 2021-08-14T21:02:44.826Z,1628974964.826 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2rqf4 2021-08-14T21:02:44.827Z,1628974964.827 [CommandLine](IMPORTANT): Scheduled #22 (#2 of 3 with id='2rqf4'): "set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 41.753473 degree;set Smear.SamplingEndLongitude -87.109951 degree;set Smear.YoYoUpPitch 12 degree" ASAP 2021-08-14T21:02:57.292Z,1628974977.292 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45211, MT Status=1, MTMSN=3205 2021-08-14T21:02:57.962Z,1628974977.962 [CommandLine](IMPORTANT): got command schedule asap "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2rqf4 3 3.000000 2021-08-14T21:02:57.963Z,1628974977.963 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2rqf4 2021-08-14T21:02:57.964Z,1628974977.964 [CommandLine](IMPORTANT): Scheduled #23 (#3 of 3 with id='2rqf4'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-14T21:02:58.054Z,1628974978.054 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-14T21:03:00.634Z,1628974980.634 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-14T21:03:00.944Z,1628974980.944 [MissionManager](IMPORTANT): Started mission Default 2021-08-14T21:03:12.397Z,1628974992.397 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-14T21:03:12.398Z,1628974992.398 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-14T21:03:12.399Z,1628974992.399 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-14T21:03:12.400Z,1628974992.400 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-14T21:03:12.401Z,1628974992.401 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-14T21:03:25.323Z,1628975005.323 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 15.000000 meter 2021-08-14T21:03:25.324Z,1628975005.324 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 30.000000 meter 2021-08-14T21:03:25.338Z,1628975005.338 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 41.753471 degree 2021-08-14T21:03:25.338Z,1628975005.338 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.109947 degree 2021-08-14T21:03:25.339Z,1628975005.339 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-14T21:03:29.861Z,1628975009.861 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-14T21:03:29.861Z,1628975009.861 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-14T21:03:29.862Z,1628975009.862 [CommandLine](IMPORTANT): got command run 2021-08-14T21:03:29.869Z,1628975009.869 [CommandLine](IMPORTANT): Running 2021-08-14T21:03:30.205Z,1628975010.205 [MissionManager](IMPORTANT): Started mission Smear 2021-08-14T21:04:09.385Z,1628975049.385 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45212, MT Status=1, MTMSN=3206 2021-08-14T21:04:10.169Z,1628975050.169 [CommandLine](IMPORTANT): got command schedule "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2rqrw 1 3.000000 2021-08-14T21:04:10.170Z,1628975050.170 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2rqrw 2021-08-14T21:04:10.171Z,1628975050.171 [CommandLine](IMPORTANT): Scheduled #24 (#1 of 3 with id='2rqrw'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2021-08-14T21:04:10.171Z,1628975050.171 [CommandLine](FAULT): Scheduling was paused by an error at 2021-08-14T16:04:04Z 2021-08-14T21:04:31.137Z,1628975071.137 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45213, MT Status=1, MTMSN=3207 2021-08-14T21:04:31.913Z,1628975071.913 [CommandLine](IMPORTANT): got command schedule "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 41.753473 degree;set Smear.SamplingEndLongitude -87.109951 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2rqrw 2 3.000000 2021-08-14T21:04:31.913Z,1628975071.913 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2rqrw 2021-08-14T21:04:31.914Z,1628975071.914 [CommandLine](IMPORTANT): Scheduled #25 (#2 of 3 with id='2rqrw'): "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 41.753473 degree;set Smear.SamplingEndLongitude -87.109951 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2021-08-14T21:04:31.915Z,1628975071.915 [CommandLine](FAULT): Scheduling was paused by an error at 2021-08-14T16:04:04Z 2021-08-14T21:06:18.134Z,1628975178.134 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45214, MT Status=1, MTMSN=3208 2021-08-14T21:06:18.726Z,1628975178.726 [CommandLine](IMPORTANT): got command schedule "set Smear.NeedCommsTimeVeryLong 8 h;run" 2rqrw 3 3.000000 2021-08-14T21:06:18.727Z,1628975178.727 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2rqrw 2021-08-14T21:06:18.728Z,1628975178.728 [CommandLine](IMPORTANT): Scheduled #26 (#3 of 3 with id='2rqrw'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-14T21:06:18.728Z,1628975178.728 [CommandLine](FAULT): Scheduling was paused by an error at 2021-08-14T16:04:04Z 2021-08-14T21:12:21.870Z,1628975541.870 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-14T21:12:22.675Z,1628975542.675 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-14T21:27:25.246Z,1628976445.246 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 17.198088 m , 16.373407 degC , 0.436800 ug/l . 2021-08-14T21:27:37.025Z,1628976457.025 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-14T21:27:37.141Z,1628976457.141 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-14T21:28:24.998Z,1628976504.998 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-14T21:28:25.810Z,1628976505.810 [ESPComponent](IMPORTANT): [sample #4] Setting cartridge argument to -1 2021-08-14T21:28:25.811Z,1628976505.811 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-14T21:28:26.258Z,1628976506.258 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-14T21:28:26.615Z,1628976506.615 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-14T21:28:27.018Z,1628976507.018 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-14T21:28:29.039Z,1628976509.039 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-14T21:29:03.383Z,1628976543.383 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PRIMING (@33,aRNAl_bac) 2021-08-14T21:29:04.999Z,1628976544.999 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PRIMING (@100.0) 2021-08-14T21:29:05.406Z,1628976545.406 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-14T21:29:05.811Z,1628976545.811 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-14T21:31:27.211Z,1628976687.211 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_FILTERING (@0.0) 2021-08-14T21:31:27.615Z,1628976687.615 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-14T22:12:33.295Z,1628979153.295 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PAUSED (@714.7) 2021-08-14T22:12:33.699Z,1628979153.699 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PROCESSING (@714.7) 2021-08-14T22:12:35.720Z,1628979155.720 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-14T22:12:36.123Z,1628979156.123 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PROCESSED (@33,aRNAl_bac) 2021-08-14T22:14:11.063Z,1628979251.063 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPING (@33,aRNAl_bac) 2021-08-14T22:14:18.336Z,1628979258.336 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-14T22:14:18.744Z,1628979258.744 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPED 2021-08-14T22:19:18.511Z,1628979558.511 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence completed normally. 2021-08-14T22:19:18.915Z,1628979558.915 [ESPComponent](IMPORTANT): [sample #4] ESP log summary report (3 messages): @17:28:39.48 Selecting Cartridge 33 @18:12:30.82 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @18:12:31.02 Sampled 714.7ml 2021-08-14T22:19:19.769Z,1628979559.769 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-14T22:29:06.658Z,1628980146.658 [MissionManager](IMPORTANT): Started mission Default 2021-08-14T22:29:07.249Z,1628980147.249 [WetLabsBB2FL](FAULT): LCB fault: Hardware Overcurrent Shutdown. 2021-08-14T22:35:13.070Z,1628980513.070 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 6.100271 min 2021-08-14T22:41:06.116Z,1628980866.116 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.984002 min 2021-08-14T22:50:01.607Z,1628981401.607 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 20.909052 min 2021-08-14T22:58:41.015Z,1628981921.015 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 29.565599 min 2021-08-14T23:08:12.604Z,1628982492.604 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 39.092102 min 2021-08-14T23:08:29.432Z,1628982509.432 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45260, MT Status=1, MTMSN=3209 2021-08-14T23:08:30.005Z,1628982510.005 [CommandLine](IMPORTANT): got command schedule resume 2021-08-14T23:08:30.005Z,1628982510.005 [CommandLine](IMPORTANT): Scheduling is resumed 2021-08-14T23:08:30.086Z,1628982510.086 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-14T23:08:32.279Z,1628982512.279 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-14T23:08:43.617Z,1628982523.617 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-14T23:08:43.618Z,1628982523.618 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-14T23:08:43.618Z,1628982523.618 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-14T23:08:43.620Z,1628982523.620 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-14T23:08:43.621Z,1628982523.621 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-14T23:08:58.664Z,1628982538.664 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 5.000000 meter 2021-08-14T23:08:58.671Z,1628982538.671 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 15.000000 meter 2021-08-14T23:08:58.672Z,1628982538.672 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 41.753471 degree 2021-08-14T23:08:58.673Z,1628982538.673 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.109947 degree 2021-08-14T23:08:58.674Z,1628982538.674 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-14T23:08:58.675Z,1628982538.675 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-14T23:09:01.534Z,1628982541.534 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-14T23:09:01.534Z,1628982541.534 [CommandLine](IMPORTANT): got command run 2021-08-14T23:09:01.536Z,1628982541.536 [CommandLine](IMPORTANT): Running 2021-08-14T23:09:01.654Z,1628982541.654 [MissionManager](IMPORTANT): Started mission Smear 2021-08-14T23:13:52.603Z,1628982832.603 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-14T23:13:53.416Z,1628982833.416 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-14T23:15:59.897Z,1628982959.897 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-14T23:16:10.901Z,1628982970.901 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.004252 CHAN A1 (24V): 0.003131 CHAN A2 (12V): -0.006271 CHAN A3 (5V): -0.003850 CHAN B0 (3.3V): -0.002017 CHAN B1 (3.15aV): -0.000329 CHAN B2 (3.15bV): -0.001087 CHAN B3 (GND): -0.001421 OPEN: 0.012009 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-14T23:28:55.997Z,1628983735.997 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 6.322998 m , 23.074396 degC , 0.353600 ug/l . 2021-08-14T23:29:07.761Z,1628983747.761 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-14T23:29:07.893Z,1628983747.893 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-14T23:29:54.920Z,1628983794.920 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-14T23:29:55.730Z,1628983795.730 [ESPComponent](IMPORTANT): [sample #5] Setting cartridge argument to -1 2021-08-14T23:29:55.730Z,1628983795.730 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-14T23:29:56.188Z,1628983796.188 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-14T23:29:56.535Z,1628983796.535 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-14T23:29:56.939Z,1628983796.939 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-14T23:29:58.958Z,1628983798.958 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-14T23:30:33.303Z,1628983833.303 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PRIMING (@32,aRNAl_bac) 2021-08-14T23:30:34.919Z,1628983834.919 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PRIMING (@100.0) 2021-08-14T23:30:35.324Z,1628983835.324 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-14T23:30:35.727Z,1628983835.727 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-14T23:32:59.557Z,1628983979.557 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_FILTERING (@0.0) 2021-08-14T23:32:59.955Z,1628983979.955 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-15T00:24:54.898Z,1628987094.898 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PAUSED (@971.6) 2021-08-15T00:24:55.303Z,1628987095.303 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PROCESSING (@971.6) 2021-08-15T00:24:57.321Z,1628987097.321 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-15T00:24:57.723Z,1628987097.723 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PROCESSED (@32,aRNAl_bac) 2021-08-15T00:26:33.068Z,1628987193.068 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPING (@32,aRNAl_bac) 2021-08-15T00:26:40.340Z,1628987200.340 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-15T00:26:40.746Z,1628987200.746 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPED 2021-08-15T00:31:40.522Z,1628987500.522 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence completed normally. 2021-08-15T00:31:40.927Z,1628987500.927 [ESPComponent](IMPORTANT): [sample #5] ESP log summary report (3 messages): @19:30:09.51 Selecting Cartridge 32 @20:24:52.15 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @20:24:52.35 Sampled 971.6ml 2021-08-15T00:31:41.798Z,1628987501.798 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-15T00:39:25.995Z,1628987965.995 [MissionManager](IMPORTANT): Started mission Default 2021-08-15T00:45:48.380Z,1628988348.380 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 6.366389 min 2021-08-15T00:52:22.147Z,1628988742.147 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 12.928972 min 2021-08-15T00:59:01.742Z,1628989141.742 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 19.589099 min 2021-08-15T01:04:40.132Z,1628989480.132 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 25.228994 min 2021-08-15T01:10:28.415Z,1628989828.415 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 31.033645 min 2021-08-15T01:18:04.851Z,1628990284.851 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 38.640658 min 2021-08-15T01:24:26.254Z,1628990666.254 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 44.997913 min 2021-08-15T01:29:58.738Z,1628990998.738 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 50.539103 min 2021-08-15T01:30:25.284Z,1628991025.284 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45311, MT Status=1, MTMSN=3210 2021-08-15T01:30:26.075Z,1628991026.075 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2s3yx 1 3.000000 2021-08-15T01:30:26.075Z,1628991026.075 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2s3yx 2021-08-15T01:30:26.076Z,1628991026.076 [CommandLine](IMPORTANT): Scheduled #27 (#1 of 3 with id='2s3yx'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" ASAP 2021-08-15T01:31:57.245Z,1628991117.245 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45312, MT Status=1, MTMSN=3211 2021-08-15T01:31:57.942Z,1628991117.942 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 41.753473 degree;set Smear.SamplingEndLongitude -87.109951 degree;set Smear.YoYoUpPitch 12 degree" 2s3yx 2 3.000000 2021-08-15T01:31:57.942Z,1628991117.942 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2s3yx 2021-08-15T01:31:57.943Z,1628991117.943 [CommandLine](IMPORTANT): Scheduled #28 (#2 of 3 with id='2s3yx'): "set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 41.753473 degree;set Smear.SamplingEndLongitude -87.109951 degree;set Smear.YoYoUpPitch 12 degree" ASAP 2021-08-15T01:32:13.638Z,1628991133.638 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45313, MT Status=1, MTMSN=3212 2021-08-15T01:32:14.264Z,1628991134.264 [CommandLine](IMPORTANT): got command schedule asap "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2s3yx 3 3.000000 2021-08-15T01:32:14.265Z,1628991134.265 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2s3yx 2021-08-15T01:32:14.266Z,1628991134.266 [CommandLine](IMPORTANT): Scheduled #29 (#3 of 3 with id='2s3yx'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-15T01:32:14.361Z,1628991134.361 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-15T01:32:16.620Z,1628991136.620 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-15T01:32:28.333Z,1628991148.333 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-15T01:32:28.334Z,1628991148.334 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-15T01:32:28.335Z,1628991148.335 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-15T01:32:28.336Z,1628991148.336 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-15T01:32:28.336Z,1628991148.336 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-15T01:32:30.254Z,1628991150.254 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45314, MT Status=1, MTMSN=3213 2021-08-15T01:32:38.526Z,1628991158.526 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 15.000000 meter 2021-08-15T01:32:38.527Z,1628991158.527 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 30.000000 meter 2021-08-15T01:32:38.528Z,1628991158.528 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 41.753471 degree 2021-08-15T01:32:38.545Z,1628991158.545 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.109947 degree 2021-08-15T01:32:38.546Z,1628991158.546 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-15T01:32:38.553Z,1628991158.553 [CommandLine](IMPORTANT): got command schedule 2021-08-15T01:32:38.553Z,1628991158.553 [CommandLine](FAULT): Incomplete syntax. Try: help schedule 2021-08-15T01:32:43.398Z,1628991163.398 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-15T01:32:43.398Z,1628991163.398 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-15T01:32:43.399Z,1628991163.399 [CommandLine](IMPORTANT): got command run 2021-08-15T01:32:43.401Z,1628991163.401 [CommandLine](IMPORTANT): Running 2021-08-15T01:32:43.479Z,1628991163.479 [MissionManager](IMPORTANT): Started mission Smear 2021-08-15T01:33:04.061Z,1628991184.061 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45315, MT Status=1, MTMSN=3214 2021-08-15T01:33:04.826Z,1628991184.826 [CommandLine](IMPORTANT): got command schedule "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 41.753473 degree;set Smear.SamplingEndLongitude -87.109951 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2s43y 2 3.000000 2021-08-15T01:33:04.826Z,1628991184.826 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2s43y 2021-08-15T01:33:04.827Z,1628991184.827 [CommandLine](IMPORTANT): Scheduled #30 (#2 of 3 with id='2s43y'): "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 41.753473 degree;set Smear.SamplingEndLongitude -87.109951 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2021-08-15T01:33:22.637Z,1628991202.637 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45316, MT Status=1, MTMSN=3215 2021-08-15T01:33:23.173Z,1628991203.173 [CommandLine](IMPORTANT): got command schedule "set Smear.NeedCommsTimeVeryLong 8 h;run" 2s43y 3 3.000000 2021-08-15T01:33:23.174Z,1628991203.174 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2s43y 2021-08-15T01:33:23.175Z,1628991203.175 [CommandLine](IMPORTANT): Scheduled #31 (#3 of 3 with id='2s43y'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-15T01:33:42.849Z,1628991222.849 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45317, MT Status=1, MTMSN=3216 2021-08-15T01:33:43.309Z,1628991223.309 [CommandLine](IMPORTANT): got command schedule resume 2021-08-15T01:36:49.335Z,1628991409.335 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-15T01:36:50.140Z,1628991410.140 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-15T01:51:52.729Z,1628992312.729 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 15.463757 m , 17.923395 degC , 0.582400 ug/l . 2021-08-15T01:52:04.501Z,1628992324.501 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-15T01:52:04.603Z,1628992324.603 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-15T01:52:52.067Z,1628992372.067 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-15T01:52:52.879Z,1628992372.879 [ESPComponent](IMPORTANT): [sample #6] Setting cartridge argument to -1 2021-08-15T01:52:52.879Z,1628992372.879 [ESPComponent](IMPORTANT): [sample #6] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-15T01:52:53.331Z,1628992373.331 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-15T01:52:53.682Z,1628992373.682 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-15T01:52:54.087Z,1628992374.087 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-15T01:52:56.106Z,1628992376.106 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-15T01:53:30.447Z,1628992410.447 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PRIMING (@31,aRNAl_bac) 2021-08-15T01:53:32.062Z,1628992412.062 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PRIMING (@100.0) 2021-08-15T01:53:32.467Z,1628992412.467 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-15T01:53:32.871Z,1628992412.871 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-15T01:55:54.270Z,1628992554.270 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_FILTERING (@0.0) 2021-08-15T01:55:54.675Z,1628992554.675 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-15T02:31:23.411Z,1628994683.411 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PAUSED (@651.0) 2021-08-15T02:31:23.803Z,1628994683.803 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PROCESSING (@651.0) 2021-08-15T02:31:25.823Z,1628994685.823 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-15T02:31:26.226Z,1628994686.226 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PROCESSED (@31,aRNAl_bac) 2021-08-15T02:33:01.171Z,1628994781.171 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_STOPPING (@31,aRNAl_bac) 2021-08-15T02:33:08.440Z,1628994788.440 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-15T02:33:08.843Z,1628994788.843 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_STOPPED 2021-08-15T02:38:08.618Z,1628995088.618 [ESPComponent](IMPORTANT): [sample #6] ESP sampling sequence completed normally. 2021-08-15T02:38:09.028Z,1628995089.028 [ESPComponent](IMPORTANT): [sample #6] ESP log summary report (3 messages): @21:53:06.88 Selecting Cartridge 31 @22:31:20.93 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @22:31:21.13 Sampled 651.0ml 2021-08-15T02:38:09.883Z,1628995089.883 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-15T02:43:07.482Z,1628995387.482 [MissionManager](IMPORTANT): Started mission Default 2021-08-15T02:48:54.498Z,1628995734.498 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 5.776940 min 2021-08-15T02:49:26.677Z,1628995766.677 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45342, MT Status=1, MTMSN=3217 2021-08-15T02:49:27.229Z,1628995767.229 [CommandLine](IMPORTANT): got command stop 2021-08-15T02:49:27.229Z,1628995767.229 [CommandLine](IMPORTANT): Scheduling is paused for 2 commands 2021-08-15T02:49:27.230Z,1628995767.230 [CommandLine](IMPORTANT): got command schedule clear 2021-08-15T02:49:27.230Z,1628995767.230 [CommandLine](IMPORTANT): #Cleared scheduled commands:2 2021-08-15T02:49:27.230Z,1628995767.230 [CommandLine](IMPORTANT): got command schedule resume 2021-08-15T02:49:27.230Z,1628995767.230 [CommandLine](IMPORTANT): Scheduling is resumed 2021-08-15T02:55:41.517Z,1628996141.517 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 12.560574 min 2021-08-15T03:01:17.224Z,1628996477.224 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 18.155587 min 2021-08-15T03:01:33.272Z,1628996493.272 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45351, MT Status=1, MTMSN=3218 2021-08-15T03:01:34.006Z,1628996494.006 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2s895 1 3.000000 2021-08-15T03:01:34.007Z,1628996494.007 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2s895 2021-08-15T03:01:34.008Z,1628996494.008 [CommandLine](IMPORTANT): Scheduled #32 (#1 of 3 with id='2s895'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" ASAP 2021-08-15T03:02:06.600Z,1628996526.600 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45352, MT Status=1, MTMSN=3219 2021-08-15T03:02:07.344Z,1628996527.344 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 41.753473 degree;set Smear.SamplingEndLongitude -87.109951 degree;set Smear.YoYoUpPitch 12 degree" 2s895 2 3.000000 2021-08-15T03:02:07.344Z,1628996527.344 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2s895 2021-08-15T03:02:07.345Z,1628996527.345 [CommandLine](IMPORTANT): Scheduled #33 (#2 of 3 with id='2s895'): "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 41.753473 degree;set Smear.SamplingEndLongitude -87.109951 degree;set Smear.YoYoUpPitch 12 degree" ASAP 2021-08-15T03:02:23.370Z,1628996543.370 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45353, MT Status=1, MTMSN=3220 2021-08-15T03:02:23.978Z,1628996543.978 [CommandLine](IMPORTANT): got command schedule asap "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2s895 3 3.000000 2021-08-15T03:02:23.979Z,1628996543.979 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2s895 2021-08-15T03:02:23.980Z,1628996543.980 [CommandLine](IMPORTANT): Scheduled #34 (#3 of 3 with id='2s895'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-15T03:02:24.224Z,1628996544.224 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-15T03:02:26.459Z,1628996546.459 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-15T03:02:38.371Z,1628996558.371 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-15T03:02:38.372Z,1628996558.372 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-15T03:02:38.385Z,1628996558.385 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-15T03:02:38.386Z,1628996558.386 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-15T03:02:38.387Z,1628996558.387 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-15T03:02:51.527Z,1628996571.527 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 5.000000 meter 2021-08-15T03:02:51.527Z,1628996571.527 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 15.000000 meter 2021-08-15T03:02:51.557Z,1628996571.557 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 41.753471 degree 2021-08-15T03:02:51.558Z,1628996571.558 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.109947 degree 2021-08-15T03:02:51.559Z,1628996571.559 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-15T03:02:56.640Z,1628996576.640 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-15T03:02:56.659Z,1628996576.659 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-15T03:02:56.663Z,1628996576.663 [CommandLine](IMPORTANT): got command run 2021-08-15T03:02:56.690Z,1628996576.690 [CommandLine](IMPORTANT): Running 2021-08-15T03:02:57.342Z,1628996577.342 [MissionManager](IMPORTANT): Started mission Smear 2021-08-15T03:05:30.942Z,1628996730.942 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-15T03:05:31.772Z,1628996731.772 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-15T03:20:34.328Z,1628997634.328 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 7.366804 m , 23.188501 degC , 0.416000 ug/l . 2021-08-15T03:20:46.118Z,1628997646.118 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-15T03:20:46.233Z,1628997646.233 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-15T03:23:16.375Z,1628997796.375 [ESPComponent](FAULT): Timeout while waiting for ESP to connect (elapsed=150.1420) 2021-08-15T03:23:28.213Z,1628997808.213 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-15T03:23:28.302Z,1628997808.302 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-15T03:24:16.167Z,1628997856.167 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-15T03:24:16.982Z,1628997856.982 [ESPComponent](IMPORTANT): [sample #7] Setting cartridge argument to -1 2021-08-15T03:24:16.982Z,1628997856.982 [ESPComponent](IMPORTANT): [sample #7] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-15T03:24:17.416Z,1628997857.416 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-15T03:24:17.782Z,1628997857.782 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-15T03:24:18.186Z,1628997858.186 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-15T03:24:20.207Z,1628997860.207 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-15T03:24:54.555Z,1628997894.555 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PRIMING (@30,aRNAl_bac) 2021-08-15T03:24:56.171Z,1628997896.171 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PRIMING (@100.0) 2021-08-15T03:24:56.580Z,1628997896.580 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-15T03:24:56.979Z,1628997896.979 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-15T03:27:22.018Z,1628998042.018 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_FILTERING (@0.0) 2021-08-15T03:27:22.423Z,1628998042.423 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-15T04:26:43.346Z,1629001603.346 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PAUSED (@1124.8) 2021-08-15T04:26:43.751Z,1629001603.751 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PROCESSING (@1124.8) 2021-08-15T04:26:45.771Z,1629001605.771 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-15T04:26:46.178Z,1629001606.178 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PROCESSED (@30,aRNAl_bac) 2021-08-15T04:28:21.119Z,1629001701.119 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_STOPPING (@30,aRNAl_bac) 2021-08-15T04:28:28.392Z,1629001708.392 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-15T04:28:28.798Z,1629001708.798 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_STOPPED 2021-08-15T04:33:28.597Z,1629002008.597 [ESPComponent](IMPORTANT): [sample #7] ESP sampling sequence completed normally. 2021-08-15T04:33:29.001Z,1629002009.001 [ESPComponent](IMPORTANT): [sample #7] ESP log summary report (3 messages): @23:24:30.41 Selecting Cartridge 30 @00:26:40.45 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @00:26:40.65 Sampled 1124.8ml 2021-08-15T04:33:29.857Z,1629002009.857 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-15T04:35:07.188Z,1629002107.188 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=45362, MT Status=1, MTMSN=3221 2021-08-15T04:35:07.989Z,1629002107.989 [CommandLine](IMPORTANT): got command schedule "load Science/sci2.xml;set sci2.MissionTimeout 4 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 41.753473 degree;set sci2.Lon1 -87.109951 degree;set sci2.YoYoMinDepth 5 m;set sci2.YoYoMaxDepth 60 m;set sci2.MaxDepth 130 m;run" 2021-08-15T04:35:07.990Z,1629002107.990 [CommandLine](IMPORTANT): Scheduled #35: "load Science/sci2.xml;set sci2.MissionTimeout 4 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 41.753473 degree;set sci2.Lon1 -87.109951 degree;set sci2.YoYoMinDepth 5 m;set sci2.YoYoMaxDepth 60 m;set sci2.MaxDepth 130 m;run" 2021-08-15T04:35:20.033Z,1629002120.033 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45363, MT Status=1, MTMSN=3222 2021-08-15T04:35:20.822Z,1629002120.822 [CommandLine](IMPORTANT): got command schedule "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2sbbk 1 3.000000 2021-08-15T04:35:20.822Z,1629002120.822 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2sbbk 2021-08-15T04:35:20.823Z,1629002120.823 [CommandLine](IMPORTANT): Scheduled #36 (#1 of 3 with id='2sbbk'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2021-08-15T04:35:35.171Z,1629002135.171 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45364, MT Status=1, MTMSN=3223 2021-08-15T04:35:35.967Z,1629002135.967 [CommandLine](IMPORTANT): got command schedule "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 41.839371 degree;set Smear.SamplingEndLongitude -86.862526 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2sbbk 2 3.000000 2021-08-15T04:35:35.967Z,1629002135.967 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2sbbk 2021-08-15T04:35:35.968Z,1629002135.968 [CommandLine](IMPORTANT): Scheduled #37 (#2 of 3 with id='2sbbk'): "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 41.839371 degree;set Smear.SamplingEndLongitude -86.862526 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2021-08-15T04:35:51.047Z,1629002151.047 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45365, MT Status=1, MTMSN=3224 2021-08-15T04:35:51.678Z,1629002151.678 [CommandLine](IMPORTANT): got command schedule "set Smear.NeedCommsTimeVeryLong 8 h;run" 2sbbk 3 3.000000 2021-08-15T04:35:51.678Z,1629002151.678 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2sbbk 2021-08-15T04:35:51.679Z,1629002151.679 [CommandLine](IMPORTANT): Scheduled #38 (#3 of 3 with id='2sbbk'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-15T04:36:38.271Z,1629002198.271 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45366, MT Status=1, MTMSN=3225 2021-08-15T04:36:38.964Z,1629002198.964 [CommandLine](IMPORTANT): got command schedule "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2sbh1 1 3.000000 2021-08-15T04:36:38.965Z,1629002198.965 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2sbh1 2021-08-15T04:36:38.966Z,1629002198.966 [CommandLine](IMPORTANT): Scheduled #39 (#1 of 3 with id='2sbh1'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2021-08-15T04:36:53.690Z,1629002213.690 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45367, MT Status=1, MTMSN=3226 2021-08-15T04:36:54.485Z,1629002214.485 [CommandLine](IMPORTANT): got command schedule "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 41.839371 degree;set Smear.SamplingEndLongitude -86.862526 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2sbh1 2 3.000000 2021-08-15T04:36:54.486Z,1629002214.486 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2sbh1 2021-08-15T04:36:54.487Z,1629002214.487 [CommandLine](IMPORTANT): Scheduled #40 (#2 of 3 with id='2sbh1'): "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 41.839371 degree;set Smear.SamplingEndLongitude -86.862526 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2021-08-15T04:37:08.440Z,1629002228.440 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45368, MT Status=1, MTMSN=3227 2021-08-15T04:37:09.018Z,1629002229.018 [CommandLine](IMPORTANT): got command schedule "set Smear.NeedCommsTimeVeryLong 8 h;run" 2sbh1 3 3.000000 2021-08-15T04:37:09.019Z,1629002229.019 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2sbh1 2021-08-15T04:37:09.020Z,1629002229.020 [CommandLine](IMPORTANT): Scheduled #41 (#3 of 3 with id='2sbh1'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-15T04:37:25.546Z,1629002245.546 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45369, MT Status=1, MTMSN=3228 2021-08-15T04:37:26.361Z,1629002246.361 [CommandLine](IMPORTANT): got command schedule "load Science/sci2.xml;set sci2.MissionTimeout 4 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 41.839371 degree;set sci2.Lon1 -86.862526 degree;set sci2.YoYoMinDepth 5 m;set sci2.YoYoMaxDepth 60 m;set sci2.MaxDepth 130 m;run" 2021-08-15T04:37:26.362Z,1629002246.362 [CommandLine](IMPORTANT): Scheduled #42: "load Science/sci2.xml;set sci2.MissionTimeout 4 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 41.839371 degree;set sci2.Lon1 -86.862526 degree;set sci2.YoYoMinDepth 5 m;set sci2.YoYoMaxDepth 60 m;set sci2.MaxDepth 130 m;run" 2021-08-15T04:41:17.201Z,1629002477.201 [CommandLine](IMPORTANT): got command load ./Missions/Science/sci2.xml 2021-08-15T04:41:17.553Z,1629002477.553 [WetLabsBB2FL](FAULT): LCB fault: Software Overcurrent. 2021-08-15T04:41:19.474Z,1629002479.474 [CommandLine](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2021-08-15T04:41:19.772Z,1629002479.772 [MissionManager](IMPORTANT): Started mission Default 2021-08-15T04:41:31.239Z,1629002491.239 [CommandLine](IMPORTANT): got command set sci2.MissionTimeout 4.000000 hour 2021-08-15T04:41:31.240Z,1629002491.240 [CommandLine](IMPORTANT): got command set sci2.NeedCommsTime 45.000000 minute 2021-08-15T04:41:31.240Z,1629002491.240 [CommandLine](IMPORTANT): got command set sci2.Lat1 41.753471 degree 2021-08-15T04:41:31.241Z,1629002491.241 [CommandLine](IMPORTANT): got command set sci2.Lon1 -87.109947 degree 2021-08-15T04:41:31.242Z,1629002491.242 [CommandLine](IMPORTANT): got command set sci2.YoYoMinDepth 5.000000 meter 2021-08-15T04:41:31.243Z,1629002491.243 [CommandLine](IMPORTANT): got command set sci2.YoYoMaxDepth 60.000000 meter 2021-08-15T04:41:31.244Z,1629002491.244 [CommandLine](IMPORTANT): got command set sci2.MaxDepth 130.000000 meter 2021-08-15T04:41:31.244Z,1629002491.244 [CommandLine](IMPORTANT): got command run 2021-08-15T04:41:31.246Z,1629002491.246 [CommandLine](IMPORTANT): Running 2021-08-15T04:41:31.462Z,1629002491.462 [MissionManager](IMPORTANT): Started mission sci2 2021-08-15T05:16:11.181Z,1629004571.181 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-15T05:16:22.548Z,1629004582.548 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.004657 CHAN A1 (24V): 0.003499 CHAN A2 (12V): -0.029224 CHAN A3 (5V): -0.004728 CHAN B0 (3.3V): -0.002346 CHAN B1 (3.15aV): 0.000658 CHAN B2 (3.15bV): -0.001390 CHAN B3 (GND): -0.002405 OPEN: 0.011962 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-15T05:19:29.404Z,1629004769.404 [ElevatorServo](FAULT): Elevator uart error - getPosition.serial timeout 2021-08-15T06:06:24.330Z,1629007584.330 [sci2:Lap:Wpt1:A.Waypoint](IMPORTANT): Reached Waypoint: 41.753472,-87.109945 2021-08-15T06:06:26.976Z,1629007586.976 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-15T06:06:29.411Z,1629007589.411 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-15T06:06:29.583Z,1629007589.583 [MissionManager](IMPORTANT): Started mission Default 2021-08-15T06:06:42.060Z,1629007602.060 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-15T06:06:42.061Z,1629007602.061 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-15T06:06:42.061Z,1629007602.061 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-15T06:06:42.062Z,1629007602.062 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-15T06:06:42.063Z,1629007602.063 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-15T06:06:58.443Z,1629007618.443 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 5.000000 meter 2021-08-15T06:06:58.444Z,1629007618.444 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 15.000000 meter 2021-08-15T06:06:58.445Z,1629007618.445 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 41.839371 degree 2021-08-15T06:06:58.446Z,1629007618.446 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -86.862526 degree 2021-08-15T06:06:58.447Z,1629007618.447 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-15T06:06:58.447Z,1629007618.447 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-15T06:07:01.575Z,1629007621.575 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-15T06:07:01.575Z,1629007621.575 [CommandLine](IMPORTANT): got command run 2021-08-15T06:07:01.579Z,1629007621.579 [CommandLine](IMPORTANT): Running 2021-08-15T06:07:01.906Z,1629007621.906 [MissionManager](IMPORTANT): Started mission Smear 2021-08-15T06:11:31.529Z,1629007891.529 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-15T06:11:32.324Z,1629007892.324 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-15T06:26:34.901Z,1629008794.901 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 6.513252 m , 23.362695 degC , 0.447200 ug/l . 2021-08-15T06:26:46.673Z,1629008806.673 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-15T06:26:46.809Z,1629008806.809 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-15T06:27:32.222Z,1629008852.222 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-15T06:27:33.039Z,1629008853.039 [ESPComponent](IMPORTANT): [sample #8] Setting cartridge argument to -1 2021-08-15T06:27:33.039Z,1629008853.039 [ESPComponent](IMPORTANT): [sample #8] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-15T06:27:33.483Z,1629008853.483 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-15T06:27:33.839Z,1629008853.839 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-15T06:27:34.244Z,1629008854.244 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-15T06:27:36.262Z,1629008856.262 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-15T06:28:10.627Z,1629008890.627 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PRIMING (@29,aRNAl_bac) 2021-08-15T06:28:12.244Z,1629008892.244 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PRIMING (@100.0) 2021-08-15T06:28:12.671Z,1629008892.671 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-15T06:28:13.050Z,1629008893.050 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-15T06:30:37.684Z,1629009037.684 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_FILTERING (@0.0) 2021-08-15T06:30:38.087Z,1629009038.087 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-15T07:18:57.723Z,1629011937.723 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PAUSED (@939.4) 2021-08-15T07:18:58.127Z,1629011938.127 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PROCESSING (@939.4) 2021-08-15T07:19:00.147Z,1629011940.147 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-15T07:19:00.553Z,1629011940.553 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PROCESSED (@29,aRNAl_bac) 2021-08-15T07:20:35.495Z,1629012035.495 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_STOPPING (@29,aRNAl_bac) 2021-08-15T07:20:42.768Z,1629012042.768 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-15T07:20:43.171Z,1629012043.171 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_STOPPED 2021-08-15T07:25:42.950Z,1629012342.950 [ESPComponent](IMPORTANT): [sample #8] ESP sampling sequence completed normally. 2021-08-15T07:25:43.355Z,1629012343.355 [ESPComponent](IMPORTANT): [sample #8] ESP log summary report (3 messages): @02:27:46.85 Selecting Cartridge 29 @03:18:55.02 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @03:18:55.22 Sampled 939.4ml 2021-08-15T07:25:44.198Z,1629012344.198 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-15T07:32:45.581Z,1629012765.581 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-15T07:32:48.275Z,1629012768.275 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-15T07:32:48.620Z,1629012768.620 [MissionManager](IMPORTANT): Started mission Default 2021-08-15T07:32:59.176Z,1629012779.176 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-15T07:32:59.177Z,1629012779.177 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-15T07:32:59.178Z,1629012779.178 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-15T07:32:59.178Z,1629012779.178 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-15T07:32:59.179Z,1629012779.179 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-15T07:33:14.547Z,1629012794.547 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 5.000000 meter 2021-08-15T07:33:14.548Z,1629012794.548 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 15.000000 meter 2021-08-15T07:33:14.549Z,1629012794.549 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 41.839371 degree 2021-08-15T07:33:14.550Z,1629012794.550 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -86.862526 degree 2021-08-15T07:33:14.550Z,1629012794.550 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-15T07:33:14.551Z,1629012794.551 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-15T07:33:17.394Z,1629012797.394 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-15T07:33:17.395Z,1629012797.395 [CommandLine](IMPORTANT): got command run 2021-08-15T07:33:17.452Z,1629012797.452 [CommandLine](IMPORTANT): Running 2021-08-15T07:33:17.547Z,1629012797.547 [MissionManager](IMPORTANT): Started mission Smear 2021-08-15T07:36:42.482Z,1629013002.482 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-15T07:36:43.285Z,1629013003.285 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-15T07:51:45.938Z,1629013905.938 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 6.260711 m , 23.481805 degC , 0.520000 ug/l . 2021-08-15T07:51:57.713Z,1629013917.713 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-15T07:51:57.811Z,1629013917.811 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-15T07:52:44.910Z,1629013964.910 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-15T07:52:45.729Z,1629013965.729 [ESPComponent](IMPORTANT): [sample #9] Setting cartridge argument to -1 2021-08-15T07:52:45.730Z,1629013965.730 [ESPComponent](IMPORTANT): [sample #9] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-15T07:52:46.156Z,1629013966.156 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-15T07:52:46.526Z,1629013966.526 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-15T07:52:46.931Z,1629013966.931 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-15T07:52:48.950Z,1629013968.950 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-15T07:53:23.291Z,1629014003.291 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_PRIMING (@28,aRNAl_bac) 2021-08-15T07:53:24.906Z,1629014004.906 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PRIMING (@100.0) 2021-08-15T07:53:25.313Z,1629014005.313 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-15T07:53:25.716Z,1629014005.716 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-15T07:55:50.351Z,1629014150.351 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_FILTERING (@0.0) 2021-08-15T07:55:50.755Z,1629014150.755 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-15T08:43:33.603Z,1629017013.603 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PAUSED (@915.9) 2021-08-15T08:43:34.007Z,1629017014.007 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PROCESSING (@915.9) 2021-08-15T08:43:36.028Z,1629017016.028 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-15T08:43:36.431Z,1629017016.431 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_PROCESSED (@28,aRNAl_bac) 2021-08-15T08:45:11.371Z,1629017111.371 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_STOPPING (@28,aRNAl_bac) 2021-08-15T08:45:18.644Z,1629017118.644 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-15T08:45:19.049Z,1629017119.049 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_STOPPED 2021-08-15T08:49:07.037Z,1629017347.037 [ElevatorServo](FAULT): Reading outside of valid range:0.000000 2021-08-15T08:49:07.677Z,1629017347.677 [ElevatorServo](FAULT): Elevator uart error - getPosition.serial timeout 2021-08-15T08:50:18.830Z,1629017418.830 [ESPComponent](IMPORTANT): [sample #9] ESP sampling sequence completed normally. 2021-08-15T08:50:19.236Z,1629017419.236 [ESPComponent](IMPORTANT): [sample #9] ESP log summary report (3 messages): @03:52:59.55 Selecting Cartridge 28 @04:43:31.20 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @04:43:31.39 Sampled 915.9ml 2021-08-15T08:50:20.104Z,1629017420.104 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-15T08:54:42.110Z,1629017682.110 [CommandLine](IMPORTANT): got command load ./Missions/Science/sci2.xml 2021-08-15T08:54:47.524Z,1629017687.524 [CommandLine](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2021-08-15T08:54:47.583Z,1629017687.583 [MissionManager](IMPORTANT): Started mission Default 2021-08-15T08:55:06.520Z,1629017706.520 [CommandLine](IMPORTANT): got command set sci2.MissionTimeout 4.000000 hour 2021-08-15T08:55:06.521Z,1629017706.521 [CommandLine](IMPORTANT): got command set sci2.NeedCommsTime 45.000000 minute 2021-08-15T08:55:06.522Z,1629017706.522 [CommandLine](IMPORTANT): got command set sci2.Lat1 41.839371 degree 2021-08-15T08:55:06.522Z,1629017706.522 [CommandLine](IMPORTANT): got command set sci2.Lon1 -86.862526 degree 2021-08-15T08:55:06.523Z,1629017706.523 [CommandLine](IMPORTANT): got command set sci2.YoYoMinDepth 5.000000 meter 2021-08-15T08:55:06.524Z,1629017706.524 [CommandLine](IMPORTANT): got command set sci2.YoYoMaxDepth 60.000000 meter 2021-08-15T08:55:06.525Z,1629017706.525 [CommandLine](IMPORTANT): got command set sci2.MaxDepth 130.000000 meter 2021-08-15T08:55:06.525Z,1629017706.525 [CommandLine](IMPORTANT): got command run 2021-08-15T08:55:06.527Z,1629017706.527 [CommandLine](IMPORTANT): Running 2021-08-15T08:55:06.742Z,1629017706.742 [MissionManager](IMPORTANT): Started mission sci2 2021-08-15T11:16:22.821Z,1629026182.821 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-15T11:16:34.203Z,1629026194.203 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.005864 CHAN A1 (24V): 0.002608 CHAN A2 (12V): -0.005579 CHAN A3 (5V): -0.003770 CHAN B0 (3.3V): -0.002122 CHAN B1 (3.15aV): -0.001550 CHAN B2 (3.15bV): 0.009927 CHAN B3 (GND): -0.000644 OPEN: 0.012003 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-15T12:55:07.485Z,1629032107.485 [MissionManager](IMPORTANT): Started mission Default 2021-08-15T12:55:07.977Z,1629032107.977 [WetLabsBB2FL](FAULT): LCB fault: Hardware Overcurrent Shutdown. Software Overcurrent. Current Limiter Activated. 2021-08-15T12:55:46.252Z,1629032146.252 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45474, MT Status=1, MTMSN=3229 2021-08-15T12:55:46.986Z,1629032146.986 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2szi8 1 3.000000 2021-08-15T12:55:46.987Z,1629032146.987 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2szi8 2021-08-15T12:55:46.988Z,1629032146.988 [CommandLine](IMPORTANT): Scheduled #43 (#1 of 3 with id='2szi8'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" ASAP 2021-08-15T12:56:01.983Z,1629032161.983 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45475, MT Status=1, MTMSN=3230 2021-08-15T12:56:02.726Z,1629032162.726 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 41.839371 degree;set Smear.SamplingEndLongitude -86.862526 degree;set Smear.YoYoUpPitch 12 degree" 2szi8 2 3.000000 2021-08-15T12:56:02.726Z,1629032162.726 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2szi8 2021-08-15T12:56:02.727Z,1629032162.727 [CommandLine](IMPORTANT): Scheduled #44 (#2 of 3 with id='2szi8'): "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 41.839371 degree;set Smear.SamplingEndLongitude -86.862526 degree;set Smear.YoYoUpPitch 12 degree" ASAP 2021-08-15T12:56:26.162Z,1629032186.162 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45476, MT Status=1, MTMSN=3231 2021-08-15T12:56:26.761Z,1629032186.761 [CommandLine](IMPORTANT): got command schedule asap "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2szi8 3 3.000000 2021-08-15T12:56:26.761Z,1629032186.761 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2szi8 2021-08-15T12:56:26.762Z,1629032186.762 [CommandLine](IMPORTANT): Scheduled #45 (#3 of 3 with id='2szi8'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-15T12:56:26.904Z,1629032186.904 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-15T12:56:29.203Z,1629032189.203 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-15T12:56:40.543Z,1629032200.543 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-15T12:56:40.544Z,1629032200.544 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-15T12:56:40.546Z,1629032200.546 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-15T12:56:40.547Z,1629032200.547 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-15T12:56:40.547Z,1629032200.547 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-15T12:56:53.326Z,1629032213.326 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 5.000000 meter 2021-08-15T12:56:53.327Z,1629032213.327 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 15.000000 meter 2021-08-15T12:56:53.328Z,1629032213.328 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 41.839371 degree 2021-08-15T12:56:53.329Z,1629032213.329 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -86.862526 degree 2021-08-15T12:56:53.329Z,1629032213.329 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-15T12:56:58.164Z,1629032218.164 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-15T12:56:58.165Z,1629032218.165 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-15T12:56:58.166Z,1629032218.166 [CommandLine](IMPORTANT): got command run 2021-08-15T12:56:58.167Z,1629032218.167 [CommandLine](IMPORTANT): Running 2021-08-15T12:56:58.276Z,1629032218.276 [MissionManager](IMPORTANT): Started mission Smear 2021-08-15T13:01:16.059Z,1629032476.059 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-15T13:01:16.899Z,1629032476.899 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-15T13:16:19.431Z,1629033379.431 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 6.569736 m , 23.433801 degC , 0.395200 ug/l . 2021-08-15T13:16:31.213Z,1629033391.213 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-15T13:16:31.338Z,1629033391.338 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-15T13:17:19.186Z,1629033439.186 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-15T13:17:19.997Z,1629033439.997 [ESPComponent](IMPORTANT): [sample #10] Setting cartridge argument to -1 2021-08-15T13:17:19.998Z,1629033439.998 [ESPComponent](IMPORTANT): [sample #10] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-15T13:17:20.480Z,1629033440.480 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-15T13:17:20.803Z,1629033440.803 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-15T13:17:21.207Z,1629033441.207 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-15T13:17:23.229Z,1629033443.229 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-15T13:17:57.567Z,1629033477.567 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PRIMING (@27,aRNAl_bac) 2021-08-15T13:17:59.183Z,1629033479.183 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PRIMING (@100.0) 2021-08-15T13:17:59.588Z,1629033479.588 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-15T13:17:59.991Z,1629033479.991 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-15T13:20:25.027Z,1629033625.027 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_FILTERING (@0.0) 2021-08-15T13:20:25.431Z,1629033625.431 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-15T14:00:56.842Z,1629036056.842 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PAUSED (@776.6) 2021-08-15T14:00:57.244Z,1629036057.244 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PROCESSING (@776.6) 2021-08-15T14:00:59.274Z,1629036059.274 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-15T14:00:59.668Z,1629036059.668 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PROCESSED (@27,aRNAl_bac) 2021-08-15T14:02:34.607Z,1629036154.607 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_STOPPING (@27,aRNAl_bac) 2021-08-15T14:02:41.880Z,1629036161.880 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-15T14:02:42.287Z,1629036162.287 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_STOPPED 2021-08-15T14:07:42.054Z,1629036462.054 [ESPComponent](IMPORTANT): [sample #10] ESP sampling sequence completed normally. 2021-08-15T14:07:42.455Z,1629036462.455 [ESPComponent](IMPORTANT): [sample #10] ESP log summary report (3 messages): @09:17:33.15 Selecting Cartridge 27 @10:00:53.98 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @10:00:54.18 Sampled 776.6ml 2021-08-15T14:07:43.309Z,1629036463.309 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-15T14:30:41.922Z,1629037841.922 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=45504, MT Status=1, MTMSN=3232