2021-08-12T17:29:11.134Z,1628789351.134 [Supervisor](IMPORTANT): Reading configuration overrides from Data/persisted.cfg 2021-08-12T17:29:15.502Z,1628789355.502 [SBIT](IMPORTANT): git: 2021-08-09 2021-08-12T17:29:15.503Z,1628789355.503 [SBIT](IMPORTANT): Kernel Release: 2.6.27.8 2021-08-12T17:29:17.070Z,1628789357.070 [RudderServo](FAULT): Rudder failed to initialize 2021-08-12T17:30:04.063Z,1628789404.063 [SBIT](IMPORTANT): Beginning Startup BIT 2021-08-12T17:30:04.069Z,1628789404.069 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-12T17:30:15.430Z,1628789415.430 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.006328 CHAN A1 (24V): 0.002455 CHAN A2 (12V): -0.005993 CHAN A3 (5V): -0.004521 CHAN B0 (3.3V): -0.002420 CHAN B1 (3.15aV): -0.001729 CHAN B2 (3.15bV): -0.001297 CHAN B3 (GND): -0.001861 OPEN: 0.011950 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-12T17:30:57.816Z,1628789457.816 [SBIT](IMPORTANT): SBIT PASSED 2021-08-12T17:30:57.816Z,1628789457.816 [SBIT](IMPORTANT): Listing configuration overrides from Data/persisted.cfg 2021-08-12T17:30:57.818Z,1628789457.818 [SBIT](IMPORTANT): BPC1.batteryMissingStickThreshold=2 count; 2021-08-12T17:30:57.818Z,1628789457.818 [SBIT](IMPORTANT): CBIT.abortDepth=210 meter; 2021-08-12T17:30:57.818Z,1628789457.818 [SBIT](IMPORTANT): CBIT.gf24Offset=148.5 microampere; 2021-08-12T17:30:57.818Z,1628789457.818 [SBIT](IMPORTANT): CBIT.stopDepth=200 meter; 2021-08-12T17:30:57.818Z,1628789457.818 [SBIT](IMPORTANT): CTD_Seabird.minSalinityBound=0.01 practical_salinity_unit; 2021-08-12T17:30:57.818Z,1628789457.818 [SBIT](IMPORTANT): DAT.loadAtStartup=0 bool; 2021-08-12T17:30:57.818Z,1628789457.818 [SBIT](IMPORTANT): DVL_micro.loadAtStartup=1 bool; 2021-08-12T17:30:57.818Z,1628789457.818 [SBIT](IMPORTANT): DataOverHttps.timeout=1 minute; 2021-08-12T17:30:57.819Z,1628789457.819 [SBIT](IMPORTANT): DeadReckonUsingMultipleVelocitySources.loadAtStartup=0 bool; 2021-08-12T17:30:57.819Z,1628789457.819 [SBIT](IMPORTANT): DeadReckonUsingSpeedCalculator.loadAtStartup=1 bool; 2021-08-12T17:30:57.819Z,1628789457.819 [SBIT](IMPORTANT): Depth_Keller.offset=-0.55 decibar; 2021-08-12T17:30:57.819Z,1628789457.819 [SBIT](IMPORTANT): Express none WetLabsBB2FL.bin_mean_mass_concentration_of_chlorophyll_in_sea_water; 2021-08-12T17:30:57.819Z,1628789457.819 [SBIT](IMPORTANT): Express linearApproximation WetLabsBB2FL.bin_median_mass_concentration_of_chlorophyll_in_sea_water 0.400000 microgram_per_liter; 2021-08-12T17:30:57.819Z,1628789457.819 [SBIT](IMPORTANT): Express linearApproximation height_above_sea_floor 5.000000 meter; 2021-08-12T17:30:57.819Z,1628789457.819 [SBIT](IMPORTANT): VerticalControl.buoyancyNeutral=305.870803 cubic_centimeter; 2021-08-12T17:30:57.820Z,1628789457.820 [SBIT](IMPORTANT): VerticalControl.massDefault=7.218472 millimeter; 2021-08-12T17:30:57.820Z,1628789457.820 [SBIT](IMPORTANT): VerticalControl.surfaceThreshold=1 meter; 2021-08-12T17:30:58.206Z,1628789458.206 [MissionManager](IMPORTANT): Started mission Startup 2021-08-12T17:32:58.947Z,1628789578.947 [MissionManager](IMPORTANT): Started mission Default 2021-08-12T17:41:30.382Z,1628790090.382 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 8.517399 min 2021-08-12T17:42:37.254Z,1628790157.254 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44529, MT Status=1, MTMSN=3136 2021-08-12T17:42:38.001Z,1628790158.001 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 195 m" 2nt4t 1 3.000000 2021-08-12T17:42:38.002Z,1628790158.002 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2nt4t 2021-08-12T17:42:38.003Z,1628790158.003 [CommandLine](IMPORTANT): Scheduled #1 (#1 of 3 with id='2nt4t'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 195 m" ASAP 2021-08-12T17:44:17.667Z,1628790257.667 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44530, MT Status=1, MTMSN=3137 2021-08-12T17:44:18.394Z,1628790258.394 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SamplingYoYoMinDepth 80 m;set Smear.SamplingYoYoMaxDepth 190 m;set Smear.SamplingEndLatitude 42.752012 degree;set Smear.SamplingEndLongitude -87.563339 degree;set Smear.YoYoUpPitch 12 degree" 2nt4t 2 3.000000 2021-08-12T17:44:18.394Z,1628790258.394 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2nt4t 2021-08-12T17:44:18.395Z,1628790258.395 [CommandLine](IMPORTANT): Scheduled #2 (#2 of 3 with id='2nt4t'): "set Smear.SamplingYoYoMinDepth 80 m;set Smear.SamplingYoYoMaxDepth 190 m;set Smear.SamplingEndLatitude 42.752012 degree;set Smear.SamplingEndLongitude -87.563339 degree;set Smear.YoYoUpPitch 12 degree" ASAP 2021-08-12T17:44:31.221Z,1628790271.221 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=44531, MT Status=1, MTMSN=3138 2021-08-12T17:44:31.815Z,1628790271.815 [CommandLine](IMPORTANT): got command schedule asap "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2nt4t 3 3.000000 2021-08-12T17:44:31.816Z,1628790271.816 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2nt4t 2021-08-12T17:44:31.817Z,1628790271.817 [CommandLine](IMPORTANT): Scheduled #3 (#3 of 3 with id='2nt4t'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-12T17:44:57.105Z,1628790297.105 [CommandLine](IMPORTANT): got command set 2021-08-12T17:44:57.105Z,1628790297.105 [CommandLine](FAULT): Incomplete syntax. Try: help set 2021-08-12T17:45:24.198Z,1628790324.198 [CommandLine](IMPORTANT): got command set 2021-08-12T17:45:24.198Z,1628790324.198 [CommandLine](FAULT): Incomplete syntax. Try: help set 2021-08-12T17:45:33.023Z,1628790333.023 [CommandLine](IMPORTANT): got command set 2021-08-12T17:45:33.024Z,1628790333.024 [CommandLine](FAULT): Incomplete syntax. Try: help set 2021-08-12T17:50:24.986Z,1628790624.986 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 17.427260 min 2021-08-12T17:58:14.527Z,1628791094.527 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 25.252926 min 2021-08-12T17:59:15.645Z,1628791155.645 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44541, MT Status=1, MTMSN=3139 2021-08-12T17:59:16.225Z,1628791156.225 [CommandLine](IMPORTANT): got command stop 2021-08-12T17:59:16.225Z,1628791156.225 [CommandLine](IMPORTANT): Scheduling is paused 2021-08-12T17:59:16.226Z,1628791156.226 [CommandLine](IMPORTANT): got command schedule clear 2021-08-12T17:59:16.226Z,1628791156.226 [CommandLine](IMPORTANT): #Cleared scheduled commands:0 2021-08-12T17:59:16.226Z,1628791156.226 [CommandLine](IMPORTANT): got command schedule resume 2021-08-12T17:59:16.226Z,1628791156.226 [CommandLine](IMPORTANT): Scheduling is resumed 2021-08-12T17:59:38.050Z,1628791178.050 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44542, MT Status=1, MTMSN=3140 2021-08-12T17:59:39.419Z,1628791179.419 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 195 m;set Smear.SamplingYoYoMinDepth 80 m" 2ntu6 1 3.000000 2021-08-12T17:59:39.419Z,1628791179.419 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2ntu6 2021-08-12T17:59:39.420Z,1628791179.420 [CommandLine](IMPORTANT): Scheduled #4 (#1 of 3 with id='2ntu6'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 195 m;set Smear.SamplingYoYoMinDepth 80 m" ASAP 2021-08-12T17:59:49.263Z,1628791189.263 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=44543, MT Status=1, MTMSN=3141 2021-08-12T17:59:50.047Z,1628791190.047 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SamplingYoYoMaxDepth 190 m;set Smear.SamplingEndLatitude 42.752012 degree;set Smear.SamplingEndLongitude -87.563339 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2ntu6 2 3.000000 2021-08-12T17:59:50.047Z,1628791190.047 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2ntu6 2021-08-12T17:59:50.048Z,1628791190.048 [CommandLine](IMPORTANT): Scheduled #5 (#2 of 3 with id='2ntu6'): "set Smear.SamplingYoYoMaxDepth 190 m;set Smear.SamplingEndLatitude 42.752012 degree;set Smear.SamplingEndLongitude -87.563339 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" ASAP 2021-08-12T18:00:01.884Z,1628791201.884 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=44544, MT Status=1, MTMSN=3142 2021-08-12T18:00:02.463Z,1628791202.463 [CommandLine](IMPORTANT): got command schedule asap "set Smear.NeedCommsTimeVeryLong 8 h;run" 2ntu6 3 3.000000 2021-08-12T18:00:02.463Z,1628791202.463 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2ntu6 2021-08-12T18:00:02.464Z,1628791202.464 [CommandLine](IMPORTANT): Scheduled #6 (#3 of 3 with id='2ntu6'): "set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-12T18:00:02.656Z,1628791202.656 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-12T18:00:05.607Z,1628791205.607 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-12T18:00:16.795Z,1628791216.795 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-12T18:00:16.796Z,1628791216.796 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-12T18:00:16.797Z,1628791216.797 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-12T18:00:16.798Z,1628791216.798 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-12T18:00:16.799Z,1628791216.799 [CommandLine](IMPORTANT): got command set Smear.MaxDepth 195.000000 meter 2021-08-12T18:00:16.799Z,1628791216.799 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 80.000000 meter 2021-08-12T18:00:26.837Z,1628791226.837 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 190.000000 meter 2021-08-12T18:00:26.838Z,1628791226.838 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.752010 degree 2021-08-12T18:00:26.838Z,1628791226.838 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.563339 degree 2021-08-12T18:00:26.839Z,1628791226.839 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-12T18:00:26.840Z,1628791226.840 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-12T18:00:29.250Z,1628791229.250 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-12T18:00:29.251Z,1628791229.251 [CommandLine](IMPORTANT): got command run 2021-08-12T18:00:29.254Z,1628791229.254 [CommandLine](IMPORTANT): Running 2021-08-12T18:00:29.449Z,1628791229.449 [MissionManager](IMPORTANT): Started mission Smear 2021-08-12T18:13:08.749Z,1628791988.749 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-12T18:13:09.543Z,1628791989.543 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-12T18:28:12.105Z,1628792892.105 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 97.187424 m , 4.397485 degC , 0.072800 ug/l . 2021-08-12T18:28:13.675Z,1628792893.675 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::' 2021-08-12T18:28:23.815Z,1628792903.815 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-12T18:28:23.950Z,1628792903.950 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-12T18:29:11.446Z,1628792951.446 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-12T18:29:12.264Z,1628792952.264 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -1 2021-08-12T18:29:12.265Z,1628792952.265 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-12T18:29:12.717Z,1628792952.717 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-12T18:29:13.467Z,1628792953.467 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-12T18:29:13.870Z,1628792953.870 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-12T18:29:15.487Z,1628792955.487 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-12T18:29:49.827Z,1628792989.827 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PRIMING (@45,aRNAl_bac) 2021-08-12T18:29:51.443Z,1628792991.443 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PRIMING (@100.0) 2021-08-12T18:29:51.849Z,1628792991.849 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-12T18:29:52.253Z,1628792992.253 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-12T18:32:14.055Z,1628793134.055 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_FILTERING (@0.0) 2021-08-12T18:32:14.459Z,1628793134.459 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-12T20:20:20.034Z,1628799620.034 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PAUSED (@2000.0) 2021-08-12T20:20:20.435Z,1628799620.435 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PROCESSING (@2000.0) 2021-08-12T20:20:22.456Z,1628799622.456 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-12T20:20:22.859Z,1628799622.859 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PROCESSED (@45,aRNAl_bac) 2021-08-12T20:21:57.812Z,1628799717.812 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING (@45,aRNAl_bac) 2021-08-12T20:22:05.084Z,1628799725.084 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-12T20:22:05.487Z,1628799725.487 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED 2021-08-12T20:27:05.276Z,1628800025.276 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence completed normally. 2021-08-12T20:27:05.676Z,1628800025.676 [ESPComponent](IMPORTANT): [sample #1] ESP log summary report (2 messages): @14:29:25.96 Selecting Cartridge 45 @16:20:18.68 Sampled 2000.0ml 2021-08-12T20:27:06.513Z,1628800026.513 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-12T20:42:14.419Z,1628800934.419 [MissionManager](IMPORTANT): Started mission Default 2021-08-12T20:49:06.744Z,1628801346.744 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 6.865655 min 2021-08-12T20:54:47.968Z,1628801687.968 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 12.552721 min 2021-08-12T21:00:23.880Z,1628802023.880 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 18.150639 min 2021-08-12T21:07:26.176Z,1628802446.176 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 25.189091 min 2021-08-12T21:16:07.668Z,1628802967.668 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 33.880503 min 2021-08-12T21:16:28.864Z,1628802988.864 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44582, MT Status=1, MTMSN=3143 2021-08-12T21:16:29.698Z,1628802989.698 [CommandLine](IMPORTANT): got command schedule asap "load Science/sci2.xml;set sci2.MissionTimeout 9 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 42.752012 degree;set sci2.Lon1 -87.563339 degree;set sci2.Lat2 42.225433 degree;set sci2.Lon2 -87.677662 degree;set sci2.YoYoMinDepth 5 m" 2o2vh 1 2.000000 2021-08-12T21:16:29.699Z,1628802989.699 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=2o2vh 2021-08-12T21:16:29.700Z,1628802989.700 [CommandLine](IMPORTANT): Scheduled #7 (#1 of 2 with id='2o2vh'): "load Science/sci2.xml;set sci2.MissionTimeout 9 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 42.752012 degree;set sci2.Lon1 -87.563339 degree;set sci2.Lat2 42.225433 degree;set sci2.Lon2 -87.677662 degree;set sci2.YoYoMinDepth 5 m" ASAP 2021-08-12T21:16:49.648Z,1628803009.648 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44583, MT Status=1, MTMSN=3144 2021-08-12T21:16:50.239Z,1628803010.239 [CommandLine](IMPORTANT): got command schedule asap "set sci2.YoYoMaxDepth 60 m;set sci2.MaxDepth 130 m;run" 2o2vh 2 2.000000 2021-08-12T21:16:50.240Z,1628803010.240 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=2o2vh 2021-08-12T21:16:50.240Z,1628803010.240 [CommandLine](IMPORTANT): Scheduled #8 (#2 of 2 with id='2o2vh'): "set sci2.YoYoMaxDepth 60 m;set sci2.MaxDepth 130 m;run" ASAP 2021-08-12T21:16:50.403Z,1628803010.403 [CommandLine](IMPORTANT): got command load ./Missions/Science/sci2.xml 2021-08-12T21:16:52.976Z,1628803012.976 [CommandLine](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2021-08-12T21:17:03.286Z,1628803023.286 [CommandLine](IMPORTANT): got command set sci2.MissionTimeout 9.000000 hour 2021-08-12T21:17:03.286Z,1628803023.286 [CommandLine](IMPORTANT): got command set sci2.NeedCommsTime 45.000000 minute 2021-08-12T21:17:03.287Z,1628803023.287 [CommandLine](IMPORTANT): got command set sci2.Lat1 42.752010 degree 2021-08-12T21:17:03.288Z,1628803023.288 [CommandLine](IMPORTANT): got command set sci2.Lon1 -87.563339 degree 2021-08-12T21:17:03.289Z,1628803023.289 [CommandLine](IMPORTANT): got command set sci2.Lat2 42.225433 degree 2021-08-12T21:17:03.309Z,1628803023.309 [CommandLine](IMPORTANT): got command set sci2.Lon2 -87.677666 degree 2021-08-12T21:17:03.310Z,1628803023.310 [CommandLine](IMPORTANT): got command set sci2.YoYoMinDepth 5.000000 meter 2021-08-12T21:17:06.557Z,1628803026.557 [CommandLine](IMPORTANT): got command set sci2.YoYoMaxDepth 60.000000 meter 2021-08-12T21:17:06.558Z,1628803026.558 [CommandLine](IMPORTANT): got command set sci2.MaxDepth 130.000000 meter 2021-08-12T21:17:06.559Z,1628803026.559 [CommandLine](IMPORTANT): got command run 2021-08-12T21:17:06.562Z,1628803026.562 [CommandLine](IMPORTANT): Running 2021-08-12T21:17:07.849Z,1628803027.849 [MissionManager](IMPORTANT): Started mission sci2 2021-08-12T23:30:15.437Z,1628811015.437 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-12T23:30:27.228Z,1628811027.228 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.000737 CHAN A1 (24V): 0.003047 CHAN A2 (12V): -0.006161 CHAN A3 (5V): -0.004070 CHAN B0 (3.3V): -0.003364 CHAN B1 (3.15aV): -0.000967 CHAN B2 (3.15bV): -0.001447 CHAN B3 (GND): -0.002599 OPEN: 0.012333 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-13T01:10:26.278Z,1628817026.278 [sci2:Lap:Wpt1:A.Waypoint](IMPORTANT): Reached Waypoint: 42.752012,-87.563339 2021-08-13T02:39:15.712Z,1628822355.712 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=44643, MT Status=1, MTMSN=3145 2021-08-13T02:39:16.214Z,1628822356.214 [CommandLine](IMPORTANT): got command stop 2021-08-13T02:39:16.214Z,1628822356.214 [CommandLine](IMPORTANT): Scheduling is paused 2021-08-13T02:39:16.601Z,1628822356.601 [MissionManager](IMPORTANT): Started mission Default 2021-08-13T02:40:39.443Z,1628822439.443 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44644, MT Status=1, MTMSN=3146 2021-08-13T02:40:40.026Z,1628822440.026 [CommandLine](IMPORTANT): got command schedule clear 2021-08-13T02:40:40.026Z,1628822440.026 [CommandLine](IMPORTANT): #Cleared scheduled commands:0 2021-08-13T02:40:40.027Z,1628822440.027 [CommandLine](IMPORTANT): got command schedule resume 2021-08-13T02:40:40.027Z,1628822440.027 [CommandLine](IMPORTANT): Scheduling is resumed 2021-08-13T02:41:02.041Z,1628822462.041 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44645, MT Status=1, MTMSN=3147 2021-08-13T02:41:02.870Z,1628822462.870 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 195 m;set Smear.SamplingYoYoMinDepth 58 m" 2ohjl 1 3.000000 2021-08-13T02:41:02.872Z,1628822462.872 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2ohjl 2021-08-13T02:41:02.877Z,1628822462.877 [CommandLine](IMPORTANT): Scheduled #9 (#1 of 3 with id='2ohjl'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 195 m;set Smear.SamplingYoYoMinDepth 58 m" ASAP 2021-08-13T02:41:27.142Z,1628822487.142 [NAL9602](IMPORTANT): SBD MO Status=2, MOMSN=44646, MT Status=1, MTMSN=3148 2021-08-13T02:41:46.763Z,1628822506.763 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44646, MT Status=1, MTMSN=3148 2021-08-13T02:41:47.490Z,1628822507.490 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SamplingYoYoMaxDepth 190 m;set Smear.SamplingEndLatitude 42.225433 degree;set Smear.SamplingEndLongitude -87.677662 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2ohjl 2 3.000000 2021-08-13T02:41:47.492Z,1628822507.492 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2ohjl 2021-08-13T02:41:47.493Z,1628822507.493 [CommandLine](IMPORTANT): Scheduled #10 (#2 of 3 with id='2ohjl'): "set Smear.SamplingYoYoMaxDepth 190 m;set Smear.SamplingEndLatitude 42.225433 degree;set Smear.SamplingEndLongitude -87.677662 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" ASAP 2021-08-13T02:42:08.143Z,1628822528.143 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44647, MT Status=1, MTMSN=3149 2021-08-13T02:42:08.714Z,1628822528.714 [CommandLine](IMPORTANT): got command schedule asap "set Smear.NeedCommsTimeVeryLong 8 h;run" 2ohjl 3 3.000000 2021-08-13T02:42:08.715Z,1628822528.715 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2ohjl 2021-08-13T02:42:08.716Z,1628822528.716 [CommandLine](IMPORTANT): Scheduled #11 (#3 of 3 with id='2ohjl'): "set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-13T02:42:08.987Z,1628822528.987 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-13T02:42:11.162Z,1628822531.162 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-13T02:42:22.499Z,1628822542.499 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-13T02:42:22.500Z,1628822542.500 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-13T02:42:22.500Z,1628822542.500 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-13T02:42:22.501Z,1628822542.501 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-13T02:42:22.502Z,1628822542.502 [CommandLine](IMPORTANT): got command set Smear.MaxDepth 195.000000 meter 2021-08-13T02:42:22.503Z,1628822542.503 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 58.000000 meter 2021-08-13T02:42:32.993Z,1628822552.993 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 190.000000 meter 2021-08-13T02:42:32.994Z,1628822552.994 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.225433 degree 2021-08-13T02:42:32.994Z,1628822552.994 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.677666 degree 2021-08-13T02:42:32.995Z,1628822552.995 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-13T02:42:32.996Z,1628822552.996 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-13T02:42:35.654Z,1628822555.654 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-13T02:42:35.654Z,1628822555.654 [CommandLine](IMPORTANT): got command run 2021-08-13T02:42:35.656Z,1628822555.656 [CommandLine](IMPORTANT): Running 2021-08-13T02:42:36.056Z,1628822556.056 [MissionManager](IMPORTANT): Started mission Smear 2021-08-13T02:55:26.713Z,1628823326.713 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-13T02:55:27.518Z,1628823327.518 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-13T03:10:30.063Z,1628824230.063 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 56.364857 m , 4.801904 degC , 0.156000 ug/l . 2021-08-13T03:10:41.846Z,1628824241.846 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-13T03:10:41.959Z,1628824241.959 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-13T03:11:29.815Z,1628824289.815 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-13T03:11:30.627Z,1628824290.627 [ESPComponent](IMPORTANT): [sample #2] Setting cartridge argument to -1 2021-08-13T03:11:30.628Z,1628824290.628 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-13T03:11:31.083Z,1628824291.083 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-13T03:11:31.431Z,1628824291.431 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-13T03:11:31.835Z,1628824291.835 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-13T03:11:33.859Z,1628824293.859 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-13T03:12:08.203Z,1628824328.203 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PRIMING (@44,aRNAl_bac) 2021-08-13T03:12:09.819Z,1628824329.819 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PRIMING (@100.0) 2021-08-13T03:12:10.224Z,1628824330.224 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-13T03:12:10.627Z,1628824330.627 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-13T03:14:32.443Z,1628824472.443 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_FILTERING (@0.0) 2021-08-13T03:14:32.848Z,1628824472.848 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-13T05:08:23.815Z,1628831303.815 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PAUSED (@2000.0) 2021-08-13T05:08:24.219Z,1628831304.219 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PROCESSING (@2000.0) 2021-08-13T05:08:26.241Z,1628831306.241 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-13T05:08:26.643Z,1628831306.643 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PROCESSED (@44,aRNAl_bac) 2021-08-13T05:10:01.583Z,1628831401.583 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPING (@44,aRNAl_bac) 2021-08-13T05:10:08.856Z,1628831408.856 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-13T05:10:09.261Z,1628831409.261 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPED 2021-08-13T05:15:09.031Z,1628831709.031 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence completed normally. 2021-08-13T05:15:09.435Z,1628831709.435 [ESPComponent](IMPORTANT): [sample #2] ESP log summary report (2 messages): @23:11:44.22 Selecting Cartridge 44 @01:08:22.30 Sampled 2000.0ml 2021-08-13T05:15:10.281Z,1628831710.281 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-13T05:20:29.546Z,1628832029.546 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=44660, MT Status=1, MTMSN=3150 2021-08-13T05:20:30.329Z,1628832030.329 [CommandLine](IMPORTANT): got command schedule "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 80 m" 2oj41 1 3.000000 2021-08-13T05:20:30.329Z,1628832030.329 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2oj41 2021-08-13T05:20:30.330Z,1628832030.330 [CommandLine](IMPORTANT): Scheduled #12 (#1 of 3 with id='2oj41'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 80 m" 2021-08-13T05:23:21.696Z,1628832201.696 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44661, MT Status=1, MTMSN=3151 2021-08-13T05:23:22.498Z,1628832202.498 [CommandLine](IMPORTANT): got command schedule "set Smear.SamplingYoYoMinDepth 40 m;set Smear.SamplingYoYoMaxDepth 70 m;set Smear.SamplingEndLatitude 42.225433 degree;set Smear.SamplingEndLongitude -87.677662 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2oj41 2 3.000000 2021-08-13T05:23:22.499Z,1628832202.499 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2oj41 2021-08-13T05:23:22.500Z,1628832202.500 [CommandLine](IMPORTANT): Scheduled #13 (#2 of 3 with id='2oj41'): "set Smear.SamplingYoYoMinDepth 40 m;set Smear.SamplingYoYoMaxDepth 70 m;set Smear.SamplingEndLatitude 42.225433 degree;set Smear.SamplingEndLongitude -87.677662 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2021-08-13T05:23:43.932Z,1628832223.932 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44662, MT Status=1, MTMSN=3152 2021-08-13T05:23:44.563Z,1628832224.563 [CommandLine](IMPORTANT): got command schedule "set Smear.NeedCommsTimeVeryLong 8 h;run" 2oj41 3 3.000000 2021-08-13T05:23:44.563Z,1628832224.563 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2oj41 2021-08-13T05:23:44.565Z,1628832224.565 [CommandLine](IMPORTANT): Scheduled #14 (#3 of 3 with id='2oj41'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-13T05:24:05.699Z,1628832245.699 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44663, MT Status=1, MTMSN=3153 2021-08-13T05:24:06.411Z,1628832246.411 [CommandLine](IMPORTANT): got command schedule "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2ojak 1 3.000000 2021-08-13T05:24:06.412Z,1628832246.412 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2ojak 2021-08-13T05:24:06.413Z,1628832246.413 [CommandLine](IMPORTANT): Scheduled #15 (#1 of 3 with id='2ojak'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2021-08-13T05:24:27.128Z,1628832267.128 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44664, MT Status=1, MTMSN=3154 2021-08-13T05:24:27.701Z,1628832267.701 [CommandLine](IMPORTANT): got command schedule "set Smear.NeedCommsTimeVeryLong 8 h;run" 2ojak 3 3.000000 2021-08-13T05:24:27.702Z,1628832267.702 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2ojak 2021-08-13T05:24:27.703Z,1628832267.703 [CommandLine](IMPORTANT): Scheduled #16 (#3 of 3 with id='2ojak'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-13T05:24:45.618Z,1628832285.618 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44665, MT Status=1, MTMSN=3155 2021-08-13T05:24:46.445Z,1628832286.445 [CommandLine](IMPORTANT): got command schedule "set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 42.225433 degree;set Smear.SamplingEndLongitude -87.677662 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2ojak 2 3.000000 2021-08-13T05:24:46.446Z,1628832286.446 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2ojak 2021-08-13T05:24:46.447Z,1628832286.447 [CommandLine](IMPORTANT): Scheduled #16 (#2 of 3 with id='2ojak'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-13T05:25:00.285Z,1628832300.285 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44666, MT Status=1, MTMSN=3156 2021-08-13T05:25:01.054Z,1628832301.054 [CommandLine](IMPORTANT): got command schedule "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2oje0 1 3.000000 2021-08-13T05:25:01.055Z,1628832301.055 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2oje0 2021-08-13T05:25:01.056Z,1628832301.056 [CommandLine](IMPORTANT): Scheduled #18 (#1 of 3 with id='2oje0'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2021-08-13T05:25:17.580Z,1628832317.580 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44667, MT Status=1, MTMSN=3157 2021-08-13T05:25:18.383Z,1628832318.383 [CommandLine](IMPORTANT): got command schedule "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 42.225433 degree;set Smear.SamplingEndLongitude -87.677662 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2oje0 2 3.000000 2021-08-13T05:25:18.383Z,1628832318.383 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2oje0 2021-08-13T05:25:18.387Z,1628832318.387 [CommandLine](IMPORTANT): Scheduled #19 (#2 of 3 with id='2oje0'): "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 42.225433 degree;set Smear.SamplingEndLongitude -87.677662 degree;set Smear.YoYoUpPitch 12 degree;set Smear.YoYoDownPitch -12 degree" 2021-08-13T05:25:33.425Z,1628832333.425 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44668, MT Status=1, MTMSN=3158 2021-08-13T05:25:34.023Z,1628832334.023 [CommandLine](IMPORTANT): got command schedule "set Smear.NeedCommsTimeVeryLong 8 h;run" 2oje0 3 3.000000 2021-08-13T05:25:34.023Z,1628832334.023 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2oje0 2021-08-13T05:25:34.024Z,1628832334.024 [CommandLine](IMPORTANT): Scheduled #20 (#3 of 3 with id='2oje0'): "set Smear.NeedCommsTimeVeryLong 8 h;run" 2021-08-13T05:25:56.735Z,1628832356.735 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44669, MT Status=1, MTMSN=3159 2021-08-13T05:25:57.523Z,1628832357.523 [CommandLine](IMPORTANT): got command schedule "load Science/sci2.xml;set sci2.MissionTimeout 9 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 42.225433 degree;set sci2.Lon1 -87.677662 degree;set sci2.Lat2 41.950754 degree;set sci2.Lon2 -87.203876 degree;set sci2.YoYoMinDepth 5 m" 2ojls 1 2.000000 2021-08-13T05:25:57.523Z,1628832357.523 [CommandLine](IMPORTANT): Scheduling command #1 of 2 with id=2ojls 2021-08-13T05:25:57.524Z,1628832357.524 [CommandLine](IMPORTANT): Scheduled #21 (#1 of 2 with id='2ojls'): "load Science/sci2.xml;set sci2.MissionTimeout 9 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 42.225433 degree;set sci2.Lon1 -87.677662 degree;set sci2.Lat2 41.950754 degree;set sci2.Lon2 -87.203876 degree;set sci2.YoYoMinDepth 5 m" 2021-08-13T05:26:19.351Z,1628832379.351 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44670, MT Status=1, MTMSN=3160 2021-08-13T05:26:19.978Z,1628832379.978 [CommandLine](IMPORTANT): got command schedule "set sci2.YoYoMaxDepth 60 m;set sci2.MaxDepth 130 m;run" 2ojls 2 2.000000 2021-08-13T05:26:19.979Z,1628832379.979 [CommandLine](IMPORTANT): Scheduling command #2 of 2 with id=2ojls 2021-08-13T05:26:19.980Z,1628832379.980 [CommandLine](IMPORTANT): Scheduled #22 (#2 of 2 with id='2ojls'): "set sci2.YoYoMaxDepth 60 m;set sci2.MaxDepth 130 m;run" 2021-08-13T05:28:41.931Z,1628832521.931 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-13T05:28:44.463Z,1628832524.463 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-13T05:28:44.597Z,1628832524.597 [MissionManager](IMPORTANT): Started mission Default 2021-08-13T05:28:56.548Z,1628832536.548 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-13T05:28:56.548Z,1628832536.548 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-13T05:28:56.562Z,1628832536.562 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-13T05:28:56.562Z,1628832536.562 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-13T05:28:56.563Z,1628832536.563 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-13T05:28:56.564Z,1628832536.564 [CommandLine](IMPORTANT): got command set Smear.MaxDepth 80.000000 meter 2021-08-13T05:29:09.587Z,1628832549.587 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 40.000000 meter 2021-08-13T05:29:09.588Z,1628832549.588 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 70.000000 meter 2021-08-13T05:29:09.589Z,1628832549.589 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.225433 degree 2021-08-13T05:29:09.589Z,1628832549.589 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.677666 degree 2021-08-13T05:29:09.590Z,1628832549.590 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-13T05:29:09.591Z,1628832549.591 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-13T05:29:12.538Z,1628832552.538 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-13T05:29:12.538Z,1628832552.538 [CommandLine](IMPORTANT): got command run 2021-08-13T05:29:12.540Z,1628832552.540 [CommandLine](IMPORTANT): Running 2021-08-13T05:29:14.425Z,1628832554.425 [MissionManager](IMPORTANT): Started mission Smear 2021-08-13T05:30:27.244Z,1628832627.244 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-13T05:30:39.984Z,1628832639.984 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.003149 CHAN A1 (24V): 0.005348 CHAN A2 (12V): -0.004387 CHAN A3 (5V): -0.004649 CHAN B0 (3.3V): -0.001610 CHAN B1 (3.15aV): -0.001547 CHAN B2 (3.15bV): -0.007003 CHAN B3 (GND): 0.001079 OPEN: 0.012227 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-13T05:37:27.423Z,1628833047.423 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-13T05:37:28.240Z,1628833048.240 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-13T05:52:30.780Z,1628833950.780 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 52.858196 m , 4.698602 degC , 0.197600 ug/l . 2021-08-13T05:52:42.573Z,1628833962.573 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-13T05:52:42.676Z,1628833962.676 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-13T05:53:29.331Z,1628834009.331 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-13T05:53:30.142Z,1628834010.142 [ESPComponent](IMPORTANT): [sample #3] Setting cartridge argument to -1 2021-08-13T05:53:30.143Z,1628834010.143 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-13T05:53:30.578Z,1628834010.578 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-13T05:53:30.947Z,1628834010.947 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-13T05:53:31.354Z,1628834011.354 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-13T05:53:33.372Z,1628834013.372 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-13T05:54:07.716Z,1628834047.716 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PRIMING (@43,aRNAl_bac) 2021-08-13T05:54:09.329Z,1628834049.329 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PRIMING (@100.0) 2021-08-13T05:54:09.735Z,1628834049.735 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-13T05:54:10.135Z,1628834050.135 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-13T05:56:32.343Z,1628834192.343 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_FILTERING (@0.0) 2021-08-13T05:56:32.748Z,1628834192.748 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-13T07:52:55.615Z,1628841175.615 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PAUSED (@2000.0) 2021-08-13T07:52:56.022Z,1628841176.022 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PROCESSING (@2000.0) 2021-08-13T07:52:58.042Z,1628841178.042 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-13T07:52:58.443Z,1628841178.443 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PROCESSED (@43,aRNAl_bac) 2021-08-13T07:54:33.787Z,1628841273.787 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPING (@43,aRNAl_bac) 2021-08-13T07:54:41.059Z,1628841281.059 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-13T07:54:41.464Z,1628841281.464 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPED 2021-08-13T07:59:41.246Z,1628841581.246 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence completed normally. 2021-08-13T07:59:41.648Z,1628841581.648 [ESPComponent](IMPORTANT): [sample #3] ESP log summary report (2 messages): @01:53:44.19 Selecting Cartridge 43 @03:52:54.05 Sampled 2000.0ml 2021-08-13T07:59:42.495Z,1628841582.495 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-13T08:11:34.231Z,1628842294.231 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-13T08:11:36.834Z,1628842296.834 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-13T08:11:36.948Z,1628842296.948 [MissionManager](IMPORTANT): Started mission Default 2021-08-13T08:11:46.835Z,1628842306.835 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-13T08:11:46.836Z,1628842306.836 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-13T08:11:46.837Z,1628842306.837 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-13T08:11:46.838Z,1628842306.838 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-13T08:11:46.839Z,1628842306.839 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-13T08:12:00.760Z,1628842320.760 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 15.000000 meter 2021-08-13T08:12:00.761Z,1628842320.761 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 30.000000 meter 2021-08-13T08:12:00.762Z,1628842320.762 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.225433 degree 2021-08-13T08:12:00.763Z,1628842320.763 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.677666 degree 2021-08-13T08:12:00.764Z,1628842320.764 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-13T08:12:00.764Z,1628842320.764 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-13T08:12:03.505Z,1628842323.505 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-13T08:12:03.506Z,1628842323.506 [CommandLine](IMPORTANT): got command run 2021-08-13T08:12:03.508Z,1628842323.508 [CommandLine](IMPORTANT): Running 2021-08-13T08:12:04.402Z,1628842324.402 [MissionManager](IMPORTANT): Started mission Smear 2021-08-13T08:15:11.174Z,1628842511.174 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-13T08:15:11.982Z,1628842511.982 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-13T08:30:14.587Z,1628843414.587 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 21.613750 m , 8.443994 degC , 0.343200 ug/l . 2021-08-13T08:30:26.357Z,1628843426.357 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-13T08:30:26.488Z,1628843426.488 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-13T08:31:13.936Z,1628843473.936 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-13T08:31:14.742Z,1628843474.742 [ESPComponent](IMPORTANT): [sample #4] Setting cartridge argument to -1 2021-08-13T08:31:14.742Z,1628843474.742 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-13T08:31:15.199Z,1628843475.199 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-13T08:31:15.548Z,1628843475.548 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-13T08:31:15.957Z,1628843475.957 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-13T08:31:17.971Z,1628843477.971 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-13T08:31:52.312Z,1628843512.312 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PRIMING (@42,aRNAl_bac) 2021-08-13T08:31:53.927Z,1628843513.927 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PRIMING (@100.0) 2021-08-13T08:31:54.334Z,1628843514.334 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-13T08:31:54.735Z,1628843514.735 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-13T08:34:16.139Z,1628843656.139 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_FILTERING (@0.0) 2021-08-13T08:34:16.543Z,1628843656.543 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-13T09:25:50.840Z,1628846750.840 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PAUSED (@884.7) 2021-08-13T09:25:51.243Z,1628846751.243 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_PROCESSING (@884.7) 2021-08-13T09:25:53.264Z,1628846753.264 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-13T09:25:53.671Z,1628846753.671 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_WAITING_FOR_PROCESSED (@42,aRNAl_bac) 2021-08-13T09:27:28.607Z,1628846848.607 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPING (@42,aRNAl_bac) 2021-08-13T09:27:35.881Z,1628846855.881 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-13T09:27:36.296Z,1628846856.296 [ESPComponent](IMPORTANT): [sample #4] ESP sampling state: S_STOPPED 2021-08-13T09:32:36.067Z,1628847156.067 [ESPComponent](IMPORTANT): [sample #4] ESP sampling sequence completed normally. 2021-08-13T09:32:36.471Z,1628847156.471 [ESPComponent](IMPORTANT): [sample #4] ESP log summary report (3 messages): @04:31:28.66 Selecting Cartridge 42 @05:25:48.47 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @05:25:48.66 Sampled 884.7ml 2021-08-13T09:32:37.332Z,1628847157.332 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-13T09:40:20.537Z,1628847620.537 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-13T09:40:22.996Z,1628847622.996 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-13T09:40:23.065Z,1628847623.065 [MissionManager](IMPORTANT): Started mission Default 2021-08-13T09:40:33.671Z,1628847633.671 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-13T09:40:33.671Z,1628847633.671 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-13T09:40:33.672Z,1628847633.672 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-13T09:40:33.673Z,1628847633.673 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-13T09:40:33.674Z,1628847633.674 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-13T09:40:46.736Z,1628847646.736 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 5.000000 meter 2021-08-13T09:40:46.737Z,1628847646.737 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 15.000000 meter 2021-08-13T09:40:46.738Z,1628847646.738 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.225433 degree 2021-08-13T09:40:46.738Z,1628847646.738 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.677666 degree 2021-08-13T09:40:46.739Z,1628847646.739 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-13T09:40:46.740Z,1628847646.740 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-13T09:40:49.502Z,1628847649.502 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-13T09:40:49.502Z,1628847649.502 [CommandLine](IMPORTANT): got command run 2021-08-13T09:40:49.504Z,1628847649.504 [CommandLine](IMPORTANT): Running 2021-08-13T09:40:50.011Z,1628847650.011 [MissionManager](IMPORTANT): Started mission Smear 2021-08-13T09:42:59.319Z,1628847779.319 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-13T09:43:00.102Z,1628847780.102 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-13T09:58:02.658Z,1628848682.658 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 8.588517 m , 21.825586 degC , 0.322400 ug/l . 2021-08-13T09:58:14.441Z,1628848694.441 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-13T09:58:14.546Z,1628848694.546 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-13T09:59:01.597Z,1628848741.597 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-13T09:59:02.406Z,1628848742.406 [ESPComponent](IMPORTANT): [sample #5] Setting cartridge argument to -1 2021-08-13T09:59:02.407Z,1628848742.407 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-13T09:59:02.856Z,1628848742.856 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-13T09:59:03.211Z,1628848743.211 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-13T09:59:03.616Z,1628848743.616 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-13T09:59:05.635Z,1628848745.635 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-13T09:59:39.975Z,1628848779.975 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PRIMING (@41,aRNAl_bac) 2021-08-13T09:59:41.592Z,1628848781.592 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PRIMING (@100.0) 2021-08-13T09:59:41.997Z,1628848781.997 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-13T09:59:42.399Z,1628848782.399 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-13T10:02:06.643Z,1628848926.643 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_FILTERING (@0.0) 2021-08-13T10:02:07.048Z,1628848927.048 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-13T10:39:56.798Z,1628851196.798 [DVL_micro](FAULT): Failed to initialize within timeout. 2021-08-13T10:47:52.818Z,1628851672.818 [ElevatorServo](FAULT): Reading outside of valid range:0.000000 2021-08-13T10:47:53.473Z,1628851673.473 [ElevatorServo](FAULT): Elevator uart error - getPosition.serial timeout 2021-08-13T10:56:48.087Z,1628852208.087 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PAUSED (@951.3) 2021-08-13T10:56:48.492Z,1628852208.492 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_PROCESSING (@951.3) 2021-08-13T10:56:50.512Z,1628852210.512 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-13T10:56:50.918Z,1628852210.918 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_WAITING_FOR_PROCESSED (@41,aRNAl_bac) 2021-08-13T10:58:25.859Z,1628852305.859 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPING (@41,aRNAl_bac) 2021-08-13T10:58:33.134Z,1628852313.134 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-13T10:58:33.537Z,1628852313.537 [ESPComponent](IMPORTANT): [sample #5] ESP sampling state: S_STOPPED 2021-08-13T11:03:33.332Z,1628852613.332 [ESPComponent](IMPORTANT): [sample #5] ESP sampling sequence completed normally. 2021-08-13T11:03:33.708Z,1628852613.708 [ESPComponent](IMPORTANT): [sample #5] ESP log summary report (3 messages): @05:59:16.39 Selecting Cartridge 41 @06:56:45.64 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @06:56:45.84 Sampled 951.3ml 2021-08-13T11:03:34.561Z,1628852614.561 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-13T11:12:46.031Z,1628853166.031 [CommandLine](IMPORTANT): got command load ./Missions/Science/sci2.xml 2021-08-13T11:12:46.666Z,1628853166.666 [WetLabsBB2FL](FAULT): LCB fault: Software Overcurrent. 2021-08-13T11:12:48.449Z,1628853168.449 [CommandLine](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2021-08-13T11:12:48.688Z,1628853168.688 [MissionManager](IMPORTANT): Started mission Default 2021-08-13T11:12:57.109Z,1628853177.109 [CommandLine](IMPORTANT): got command set sci2.MissionTimeout 9.000000 hour 2021-08-13T11:12:57.115Z,1628853177.115 [CommandLine](IMPORTANT): got command set sci2.NeedCommsTime 45.000000 minute 2021-08-13T11:12:57.116Z,1628853177.116 [CommandLine](IMPORTANT): got command set sci2.Lat1 42.225433 degree 2021-08-13T11:12:57.117Z,1628853177.117 [CommandLine](IMPORTANT): got command set sci2.Lon1 -87.677666 degree 2021-08-13T11:12:57.150Z,1628853177.150 [CommandLine](IMPORTANT): got command set sci2.Lat2 41.950752 degree 2021-08-13T11:12:57.151Z,1628853177.151 [CommandLine](IMPORTANT): got command set sci2.Lon2 -87.203873 degree 2021-08-13T11:12:57.152Z,1628853177.152 [CommandLine](IMPORTANT): got command set sci2.YoYoMinDepth 5.000000 meter 2021-08-13T11:13:00.150Z,1628853180.150 [CommandLine](IMPORTANT): got command set sci2.YoYoMaxDepth 60.000000 meter 2021-08-13T11:13:00.151Z,1628853180.151 [CommandLine](IMPORTANT): got command set sci2.MaxDepth 130.000000 meter 2021-08-13T11:13:00.151Z,1628853180.151 [CommandLine](IMPORTANT): got command run 2021-08-13T11:13:00.153Z,1628853180.153 [CommandLine](IMPORTANT): Running 2021-08-13T11:13:00.387Z,1628853180.387 [MissionManager](IMPORTANT): Started mission sci2 2021-08-13T11:30:40.133Z,1628854240.133 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-13T11:30:51.073Z,1628854251.073 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.010213 CHAN A1 (24V): 0.003499 CHAN A2 (12V): -0.006437 CHAN A3 (5V): -0.006259 CHAN B0 (3.3V): -0.002222 CHAN B1 (3.15aV): -0.001714 CHAN B2 (3.15bV): -0.001446 CHAN B3 (GND): -0.002498 OPEN: 0.011812 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-13T15:30:46.037Z,1628868646.037 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=44783, MT Status=1, MTMSN=3161 2021-08-13T15:30:46.835Z,1628868646.835 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2pg1y 1 3.000000 2021-08-13T15:30:46.835Z,1628868646.835 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2pg1y 2021-08-13T15:30:46.836Z,1628868646.836 [CommandLine](IMPORTANT): Scheduled #23 (#1 of 3 with id='2pg1y'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" ASAP 2021-08-13T15:31:32.187Z,1628868692.187 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44784, MT Status=1, MTMSN=3162 2021-08-13T15:31:32.919Z,1628868692.919 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 42.225433 degree;set Smear.SamplingEndLongitude -87.677662 degree;set Smear.YoYoUpPitch 12 degree" 2pg1y 2 3.000000 2021-08-13T15:31:32.919Z,1628868692.919 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2pg1y 2021-08-13T15:31:32.920Z,1628868692.920 [CommandLine](IMPORTANT): Scheduled #24 (#2 of 3 with id='2pg1y'): "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 42.225433 degree;set Smear.SamplingEndLongitude -87.677662 degree;set Smear.YoYoUpPitch 12 degree" ASAP 2021-08-13T15:31:53.577Z,1628868713.577 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44785, MT Status=1, MTMSN=3163 2021-08-13T15:31:54.266Z,1628868714.266 [CommandLine](IMPORTANT): got command schedule asap "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2pg1y 3 3.000000 2021-08-13T15:31:54.267Z,1628868714.267 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2pg1y 2021-08-13T15:31:54.268Z,1628868714.268 [CommandLine](IMPORTANT): Scheduled #25 (#3 of 3 with id='2pg1y'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-13T15:31:54.485Z,1628868714.485 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-13T15:31:56.915Z,1628868716.915 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-13T15:31:57.252Z,1628868717.252 [MissionManager](IMPORTANT): Started mission Default 2021-08-13T15:32:06.365Z,1628868726.365 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-13T15:32:06.366Z,1628868726.366 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-13T15:32:06.367Z,1628868726.367 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-13T15:32:06.368Z,1628868726.368 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-13T15:32:06.368Z,1628868726.368 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-13T15:32:17.607Z,1628868737.607 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 5.000000 meter 2021-08-13T15:32:17.608Z,1628868737.608 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 15.000000 meter 2021-08-13T15:32:17.613Z,1628868737.613 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.225433 degree 2021-08-13T15:32:17.613Z,1628868737.613 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.677666 degree 2021-08-13T15:32:17.614Z,1628868737.614 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-13T15:32:22.265Z,1628868742.265 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-13T15:32:22.266Z,1628868742.266 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-13T15:32:22.266Z,1628868742.266 [CommandLine](IMPORTANT): got command run 2021-08-13T15:32:22.268Z,1628868742.268 [CommandLine](IMPORTANT): Running 2021-08-13T15:32:22.495Z,1628868742.495 [MissionManager](IMPORTANT): Started mission Smear 2021-08-13T15:37:17.372Z,1628869037.372 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-13T15:37:18.172Z,1628869038.172 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-13T15:52:20.720Z,1628869940.720 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 7.330532 m , 22.790613 degC , 0.228800 ug/l . 2021-08-13T15:52:32.510Z,1628869952.510 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-13T15:52:32.659Z,1628869952.659 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-13T15:53:19.667Z,1628869999.667 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-13T15:53:20.482Z,1628870000.482 [ESPComponent](IMPORTANT): [sample #6] Setting cartridge argument to -1 2021-08-13T15:53:20.483Z,1628870000.483 [ESPComponent](IMPORTANT): [sample #6] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-13T15:53:20.919Z,1628870000.919 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-13T15:53:21.283Z,1628870001.283 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-13T15:53:21.687Z,1628870001.687 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-13T15:53:23.708Z,1628870003.708 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-13T15:53:58.051Z,1628870038.051 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PRIMING (@40,aRNAl_bac) 2021-08-13T15:53:59.668Z,1628870039.668 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PRIMING (@100.0) 2021-08-13T15:54:00.072Z,1628870040.072 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-13T15:54:00.475Z,1628870040.475 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-13T15:56:24.301Z,1628870184.301 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_FILTERING (@0.0) 2021-08-13T15:56:24.703Z,1628870184.703 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-13T16:43:21.209Z,1628873001.209 [RudderServo](FAULT): Reading outside of valid range:0.000000 2021-08-13T16:43:21.841Z,1628873001.841 [RudderServo](FAULT): Rudder uart error - getPosition..serial timeout 2021-08-13T16:53:07.291Z,1628873587.291 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PAUSED (@1035.6) 2021-08-13T16:53:07.695Z,1628873587.695 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_PROCESSING (@1035.6) 2021-08-13T16:53:09.716Z,1628873589.716 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-13T16:53:10.119Z,1628873590.119 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_WAITING_FOR_PROCESSED (@40,aRNAl_bac) 2021-08-13T16:54:36.922Z,1628873676.922 [RudderServo](FAULT): Rudder uart error - getPosition..serial timeout 2021-08-13T16:54:45.059Z,1628873685.059 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_STOPPING (@40,aRNAl_bac) 2021-08-13T16:54:52.334Z,1628873692.334 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-13T16:54:52.749Z,1628873692.749 [ESPComponent](IMPORTANT): [sample #6] ESP sampling state: S_STOPPED 2021-08-13T16:59:52.503Z,1628873992.503 [ESPComponent](IMPORTANT): [sample #6] ESP sampling sequence completed normally. 2021-08-13T16:59:52.907Z,1628873992.907 [ESPComponent](IMPORTANT): [sample #6] ESP log summary report (3 messages): @11:53:34.20 Selecting Cartridge 40 @12:53:04.90 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @12:53:05.09 Sampled 1035.6ml 2021-08-13T16:59:53.755Z,1628873993.755 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-13T17:01:16.560Z,1628874076.560 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=44801, MT Status=1, MTMSN=3164 2021-08-13T17:01:17.316Z,1628874077.316 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2pku7 1 3.000000 2021-08-13T17:01:17.317Z,1628874077.317 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2pku7 2021-08-13T17:01:17.318Z,1628874077.318 [CommandLine](IMPORTANT): Scheduled #26 (#1 of 3 with id='2pku7'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" ASAP 2021-08-13T17:03:08.156Z,1628874188.156 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44802, MT Status=1, MTMSN=3165 2021-08-13T17:03:08.927Z,1628874188.927 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 42.225433 degree;set Smear.SamplingEndLongitude -87.677662 degree;set Smear.YoYoUpPitch 12 degree" 2pku7 2 3.000000 2021-08-13T17:03:08.927Z,1628874188.927 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2pku7 2021-08-13T17:03:08.928Z,1628874188.928 [CommandLine](IMPORTANT): Scheduled #27 (#2 of 3 with id='2pku7'): "set Smear.SamplingYoYoMinDepth 15 m;set Smear.SamplingYoYoMaxDepth 30 m;set Smear.SamplingEndLatitude 42.225433 degree;set Smear.SamplingEndLongitude -87.677662 degree;set Smear.YoYoUpPitch 12 degree" ASAP 2021-08-13T17:03:32.364Z,1628874212.364 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44803, MT Status=1, MTMSN=3166 2021-08-13T17:03:33.018Z,1628874213.018 [CommandLine](IMPORTANT): got command schedule asap "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2pku7 3 3.000000 2021-08-13T17:03:33.018Z,1628874213.018 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2pku7 2021-08-13T17:03:33.019Z,1628874213.019 [CommandLine](IMPORTANT): Scheduled #28 (#3 of 3 with id='2pku7'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-13T17:03:33.182Z,1628874213.182 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-13T17:03:33.754Z,1628874213.754 [WetLabsBB2FL](FAULT): LCB fault: Software Overcurrent. 2021-08-13T17:03:35.791Z,1628874215.791 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-13T17:03:36.025Z,1628874216.025 [MissionManager](IMPORTANT): Started mission Default 2021-08-13T17:03:45.570Z,1628874225.570 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-13T17:03:45.571Z,1628874225.571 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-13T17:03:45.571Z,1628874225.571 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-13T17:03:45.572Z,1628874225.572 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-13T17:03:45.573Z,1628874225.573 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-13T17:03:56.829Z,1628874236.829 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 15.000000 meter 2021-08-13T17:03:56.830Z,1628874236.830 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 30.000000 meter 2021-08-13T17:03:56.831Z,1628874236.831 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 42.225433 degree 2021-08-13T17:03:56.831Z,1628874236.831 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.677666 degree 2021-08-13T17:03:56.833Z,1628874236.833 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-13T17:04:02.380Z,1628874242.380 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-13T17:04:02.381Z,1628874242.381 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-13T17:04:02.382Z,1628874242.382 [CommandLine](IMPORTANT): got command run 2021-08-13T17:04:02.383Z,1628874242.383 [CommandLine](IMPORTANT): Running 2021-08-13T17:04:02.561Z,1628874242.561 [MissionManager](IMPORTANT): Started mission Smear 2021-08-13T17:16:28.567Z,1628874988.567 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-13T17:16:29.414Z,1628874989.414 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-13T17:30:51.161Z,1628875851.161 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-13T17:31:02.104Z,1628875862.104 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.004074 CHAN A1 (24V): 0.002909 CHAN A2 (12V): -0.022967 CHAN A3 (5V): -0.004955 CHAN B0 (3.3V): -0.003333 CHAN B1 (3.15aV): 0.001747 CHAN B2 (3.15bV): -0.001296 CHAN B3 (GND): -0.001489 OPEN: 0.012192 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-13T17:31:31.932Z,1628875891.932 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 20.465147 m , 9.422693 degC , 0.343200 ug/l . 2021-08-13T17:31:43.710Z,1628875903.710 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-13T17:31:43.839Z,1628875903.839 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-13T17:32:30.466Z,1628875950.466 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-13T17:32:31.284Z,1628875951.284 [ESPComponent](IMPORTANT): [sample #7] Setting cartridge argument to -1 2021-08-13T17:32:31.284Z,1628875951.284 [ESPComponent](IMPORTANT): [sample #7] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-13T17:32:31.715Z,1628875951.715 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-13T17:32:32.086Z,1628875952.086 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-13T17:32:32.486Z,1628875952.486 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-13T17:32:34.507Z,1628875954.507 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-13T17:33:08.851Z,1628875988.851 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PRIMING (@39,aRNAl_bac) 2021-08-13T17:33:10.463Z,1628875990.463 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PRIMING (@100.0) 2021-08-13T17:33:10.868Z,1628875990.868 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-13T17:33:11.271Z,1628875991.271 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-13T17:35:32.681Z,1628876132.681 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_FILTERING (@0.0) 2021-08-13T17:35:33.083Z,1628876133.083 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-13T18:43:13.803Z,1628880193.803 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PAUSED (@1152.5) 2021-08-13T18:43:14.208Z,1628880194.208 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PROCESSING (@1152.5) 2021-08-13T18:43:16.227Z,1628880196.227 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-13T18:43:16.632Z,1628880196.632 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PROCESSED (@39,aRNAl_bac) 2021-08-13T18:44:51.575Z,1628880291.575 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_STOPPING (@39,aRNAl_bac) 2021-08-13T18:44:58.851Z,1628880298.851 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-13T18:44:59.251Z,1628880299.251 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_STOPPED 2021-08-13T18:49:59.024Z,1628880599.024 [ESPComponent](IMPORTANT): [sample #7] ESP sampling sequence completed normally. 2021-08-13T18:49:59.427Z,1628880599.427 [ESPComponent](IMPORTANT): [sample #7] ESP log summary report (3 messages): @13:32:44.97 Selecting Cartridge 39 @14:43:11.37 Cartridge::Sampler::Clogged in FILTERING -- Cartridge clogged @14:43:11.58 Sampled 1152.5ml 2021-08-13T18:50:00.314Z,1628880600.314 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-13T18:56:58.175Z,1628881018.175 [MissionManager](IMPORTANT): Started mission Default 2021-08-13T19:03:15.368Z,1628881395.368 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 6.279987 min 2021-08-13T19:08:56.367Z,1628881736.367 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.962874 min 2021-08-13T19:14:23.330Z,1628882063.330 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 17.412557 min 2021-08-13T19:20:00.299Z,1628882400.299 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 23.028892 min 2021-08-13T19:25:32.926Z,1628882732.926 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 28.572327 min 2021-08-13T19:28:55.240Z,1628882935.240 [DataOverHttps](IMPORTANT): SBD MTMSN=20210813T192854 2021-08-13T19:29:02.783Z,1628882942.783 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 80 m" 2psrp 1 3.000000 2021-08-13T19:29:02.783Z,1628882942.783 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2psrp 2021-08-13T19:29:02.784Z,1628882942.784 [CommandLine](IMPORTANT): Scheduled #29 (#1 of 3 with id='2psrp'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 80 m" ASAP 2021-08-13T19:29:03.771Z,1628882943.771 [DataOverHttps](IMPORTANT): SBD MTMSN=20210813T192903 2021-08-13T19:29:12.102Z,1628882952.102 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SamplingYoYoMinDepth 40 m;set Smear.SamplingYoYoMaxDepth 70 m;set Smear.SamplingEndLatitude 41.950754 degree;set Smear.SamplingEndLongitude -87.203876 degree;set Smear.YoYoUpPitch 12 degree" 2psrp 2 3.000000 2021-08-13T19:29:12.102Z,1628882952.102 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2psrp 2021-08-13T19:29:12.103Z,1628882952.103 [CommandLine](IMPORTANT): Scheduled #30 (#2 of 3 with id='2psrp'): "set Smear.SamplingYoYoMinDepth 40 m;set Smear.SamplingYoYoMaxDepth 70 m;set Smear.SamplingEndLatitude 41.950754 degree;set Smear.SamplingEndLongitude -87.203876 degree;set Smear.YoYoUpPitch 12 degree" ASAP 2021-08-13T19:29:13.039Z,1628882953.039 [DataOverHttps](IMPORTANT): SBD MTMSN=20210813T192912 2021-08-13T19:29:20.707Z,1628882960.707 [CommandLine](IMPORTANT): got command schedule asap "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2psrp 3 3.000000 2021-08-13T19:29:20.707Z,1628882960.707 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2psrp 2021-08-13T19:29:20.708Z,1628882960.708 [CommandLine](IMPORTANT): Scheduled #31 (#3 of 3 with id='2psrp'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-13T19:29:20.906Z,1628882960.906 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-13T19:29:23.076Z,1628882963.076 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-13T19:29:36.578Z,1628882976.578 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-13T19:29:36.579Z,1628882976.579 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-13T19:29:36.579Z,1628882976.579 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-13T19:29:36.580Z,1628882976.580 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-13T19:29:36.581Z,1628882976.581 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-13T19:29:36.590Z,1628882976.590 [CommandLine](IMPORTANT): got command set Smear.MaxDepth 80.000000 meter 2021-08-13T19:29:57.682Z,1628882997.682 [DataOverHttps](IMPORTANT): SBD MTMSN=20210813T192957 2021-08-13T19:29:58.049Z,1628882998.049 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 40.000000 meter 2021-08-13T19:29:58.050Z,1628882998.050 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 70.000000 meter 2021-08-13T19:29:58.051Z,1628882998.051 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 41.950752 degree 2021-08-13T19:29:58.052Z,1628882998.052 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.203873 degree 2021-08-13T19:29:58.052Z,1628882998.052 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-13T19:30:04.245Z,1628883004.245 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-13T19:30:04.250Z,1628883004.250 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-13T19:30:04.250Z,1628883004.250 [CommandLine](IMPORTANT): got command run 2021-08-13T19:30:04.252Z,1628883004.252 [CommandLine](IMPORTANT): Running 2021-08-13T19:30:04.398Z,1628883004.398 [MissionManager](IMPORTANT): Started mission Smear 2021-08-13T19:30:07.561Z,1628883007.561 [CommandLine](IMPORTANT): got command stop 2021-08-13T19:30:07.561Z,1628883007.561 [CommandLine](IMPORTANT): Scheduling is paused 2021-08-13T19:30:08.066Z,1628883008.066 [MissionManager](IMPORTANT): Started mission Default 2021-08-13T19:30:32.173Z,1628883032.173 [DataOverHttps](IMPORTANT): SBD MOMSN=15878265, MTMSN=20210813T193031 2021-08-13T19:30:44.554Z,1628883044.554 [CommandLine](IMPORTANT): got command schedule asap "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 80 m" 2psu9 1 3.000000 2021-08-13T19:30:44.555Z,1628883044.555 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2psu9 2021-08-13T19:30:44.556Z,1628883044.556 [CommandLine](IMPORTANT): Scheduled #32 (#1 of 3 with id='2psu9'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool;set Smear.MaxDepth 80 m" ASAP 2021-08-13T19:30:45.740Z,1628883045.740 [DataOverHttps](IMPORTANT): SBD MTMSN=20210813T193045 2021-08-13T19:30:53.262Z,1628883053.262 [CommandLine](IMPORTANT): got command schedule asap "set Smear.SamplingYoYoMinDepth 30 m;set Smear.SamplingYoYoMaxDepth 70 m;set Smear.SamplingEndLatitude 41.950754 degree;set Smear.SamplingEndLongitude -87.203876 degree;set Smear.YoYoUpPitch 12 degree" 2psu9 2 3.000000 2021-08-13T19:30:53.263Z,1628883053.263 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2psu9 2021-08-13T19:30:53.264Z,1628883053.264 [CommandLine](IMPORTANT): Scheduled #33 (#2 of 3 with id='2psu9'): "set Smear.SamplingYoYoMinDepth 30 m;set Smear.SamplingYoYoMaxDepth 70 m;set Smear.SamplingEndLatitude 41.950754 degree;set Smear.SamplingEndLongitude -87.203876 degree;set Smear.YoYoUpPitch 12 degree" ASAP 2021-08-13T19:30:54.378Z,1628883054.378 [DataOverHttps](IMPORTANT): SBD MOMSN=15878269, MTMSN=20210813T193053 2021-08-13T19:31:01.873Z,1628883061.873 [CommandLine](IMPORTANT): got command schedule asap "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2psu9 3 3.000000 2021-08-13T19:31:01.874Z,1628883061.874 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2psu9 2021-08-13T19:31:01.876Z,1628883061.876 [CommandLine](IMPORTANT): Scheduled #34 (#3 of 3 with id='2psu9'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" ASAP 2021-08-13T19:31:01.940Z,1628883061.940 [CommandLine](IMPORTANT): got command load ./Missions/Science/smear_waypoint_sampling.xml 2021-08-13T19:31:04.500Z,1628883064.500 [CommandLine](IMPORTANT): Loaded ./Missions/Science/smear_waypoint_sampling.xml 2021-08-13T19:31:20.804Z,1628883080.804 [CommandLine](IMPORTANT): got command set Smear.CartridgeType -1.000000 count 2021-08-13T19:31:20.824Z,1628883080.824 [CommandLine](IMPORTANT): got command set Smear.MissionTimeout 8.000000 hour 2021-08-13T19:31:20.834Z,1628883080.834 [CommandLine](IMPORTANT): got command set Smear.WaitDuration 15.000000 minute 2021-08-13T19:31:20.835Z,1628883080.835 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeInTransit 45.000000 minute 2021-08-13T19:31:20.835Z,1628883080.835 [CommandLine](IMPORTANT): got command set Smear.ReachEndWaypoint 0.000000 bool 2021-08-13T19:31:20.836Z,1628883080.836 [CommandLine](IMPORTANT): got command set Smear.MaxDepth 80.000000 meter 2021-08-13T19:31:43.452Z,1628883103.452 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMinDepth 30.000000 meter 2021-08-13T19:31:43.453Z,1628883103.453 [CommandLine](IMPORTANT): got command set Smear.SamplingYoYoMaxDepth 70.000000 meter 2021-08-13T19:31:43.454Z,1628883103.454 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLatitude 41.950752 degree 2021-08-13T19:31:43.454Z,1628883103.454 [CommandLine](IMPORTANT): got command set Smear.SamplingEndLongitude -87.203873 degree 2021-08-13T19:31:43.455Z,1628883103.455 [CommandLine](IMPORTANT): got command set Smear.YoYoUpPitch 12.000000 degree 2021-08-13T19:31:53.445Z,1628883113.445 [CommandLine](IMPORTANT): got command set Smear.YoYoDownPitch -12.000000 degree 2021-08-13T19:31:53.446Z,1628883113.446 [CommandLine](IMPORTANT): got command set Smear.NeedCommsTimeVeryLong 8.000000 hour 2021-08-13T19:31:53.446Z,1628883113.446 [CommandLine](IMPORTANT): got command run 2021-08-13T19:31:53.449Z,1628883113.449 [CommandLine](IMPORTANT): Running 2021-08-13T19:31:53.798Z,1628883113.798 [MissionManager](IMPORTANT): Started mission Smear 2021-08-13T20:01:11.400Z,1628884871.400 [Smear:SamplingToWaypoint:TakeSamples:Firing:B](IMPORTANT): Taking sample No. 1.000000 count . 2021-08-13T20:01:12.220Z,1628884872.220 [Smear:InsertWait:A](IMPORTANT): Wait 15.000000 min before firing sample. 2021-08-13T20:16:14.763Z,1628885774.763 [Smear:TriggerSampling:TriggerESP:D](IMPORTANT): Trigger ESP sampling. DepthLogged, TempLogged, ChlLogged = 28.199438 m , 5.691614 degC , 0.249600 ug/l . 2021-08-13T20:16:26.553Z,1628885786.553 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2021-08-13T20:16:26.678Z,1628885786.678 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2021-08-13T20:17:13.782Z,1628885833.782 [ESPComponent](IMPORTANT): ESP has connected as client 2021-08-13T20:17:14.594Z,1628885834.594 [ESPComponent](IMPORTANT): [sample #8] Setting cartridge argument to -1 2021-08-13T20:17:14.595Z,1628885834.595 [ESPComponent](IMPORTANT): [sample #8] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2021-08-13T20:17:15.038Z,1628885835.038 [Smear:TriggerSampling:TriggerESP:G](IMPORTANT): Wait for ESP sampling to complete. 2021-08-13T20:17:15.399Z,1628885835.399 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PREPARING_SHOW_LOG 2021-08-13T20:17:15.803Z,1628885835.803 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PREPARING_SHOW_STATUS 2021-08-13T20:17:17.823Z,1628885837.823 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_LOADING_CARTRIDGE 2021-08-13T20:17:52.164Z,1628885872.164 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PRIMING (@38,aRNAl_bac) 2021-08-13T20:17:53.779Z,1628885873.779 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PRIMING (@100.0) 2021-08-13T20:17:54.183Z,1628885874.183 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=176.399994 issuedCmd_=Cmd.startFiltering 2021-08-13T20:17:54.588Z,1628885874.588 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2021-08-13T20:20:15.583Z,1628886015.583 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_FILTERING (@0.0) 2021-08-13T20:20:15.987Z,1628886015.987 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2021-08-13T22:24:27.099Z,1628893467.099 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PAUSED (@2000.0) 2021-08-13T22:24:27.503Z,1628893467.503 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PROCESSING (@2000.0) 2021-08-13T22:24:29.523Z,1628893469.523 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2021-08-13T22:24:29.927Z,1628893469.927 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PROCESSED (@38,aRNAl_bac) 2021-08-13T22:26:04.868Z,1628893564.868 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_STOPPING (@38,aRNAl_bac) 2021-08-13T22:26:12.144Z,1628893572.144 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2021-08-13T22:26:12.545Z,1628893572.545 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_STOPPED 2021-08-13T22:31:12.327Z,1628893872.327 [ESPComponent](IMPORTANT): [sample #8] ESP sampling sequence completed normally. 2021-08-13T22:31:12.731Z,1628893872.731 [ESPComponent](IMPORTANT): [sample #8] ESP log summary report (2 messages): @16:17:28.53 Selecting Cartridge 38 @18:24:25.58 Sampled 2000.0ml 2021-08-13T22:31:13.572Z,1628893873.572 [Smear:SamplingToWaypoint:TakeSamples:Firing:F](IMPORTANT): Sample No. 1.000000 count completed. 2021-08-13T22:33:19.645Z,1628893999.645 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=44857, MT Status=1, MTMSN=3167 2021-08-13T22:33:20.382Z,1628894000.382 [CommandLine](IMPORTANT): got command schedule "load Science/sci2.xml;set sci2.MissionTimeout 9 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 41.950754 degree;set sci2.Lon1 -87.203876 degree;set sci2.YoYoMinDepth 5 m;set sci2.YoYoMaxDepth 60 m;set sci2.MaxDepth 130 m;run" 2021-08-13T22:33:20.383Z,1628894000.383 [CommandLine](IMPORTANT): Scheduled #35: "load Science/sci2.xml;set sci2.MissionTimeout 9 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 41.950754 degree;set sci2.Lon1 -87.203876 degree;set sci2.YoYoMinDepth 5 m;set sci2.YoYoMaxDepth 60 m;set sci2.MaxDepth 130 m;run" 2021-08-13T22:33:20.383Z,1628894000.383 [CommandLine](FAULT): Scheduling was paused by a command at 2021-08-13T19:30:07Z 2021-08-13T22:36:44.499Z,1628894204.499 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44858, MT Status=1, MTMSN=3168 2021-08-13T22:36:45.179Z,1628894205.179 [CommandLine](IMPORTANT): got command schedule 20210814T020000 "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" 2pyra 1 3.000000 2021-08-13T22:36:45.180Z,1628894205.180 [CommandLine](IMPORTANT): Scheduling command #1 of 3 with id=2pyra 2021-08-13T22:36:45.181Z,1628894205.181 [CommandLine](IMPORTANT): Scheduled #36 (#1 of 3 with id='2pyra'): "load Science/smear_waypoint_sampling.xml;set Smear.CartridgeType -1 count;set Smear.MissionTimeout 8 h;set Smear.WaitDuration 15 min;set Smear.NeedCommsTimeInTransit 45 min;set Smear.ReachEndWaypoint 0 bool" at 2021-08-14T02:00:00Z 2021-08-13T22:36:45.181Z,1628894205.181 [CommandLine](FAULT): Scheduling was paused by a command at 2021-08-13T19:30:07Z 2021-08-13T22:36:58.444Z,1628894218.444 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44859, MT Status=1, MTMSN=3169 2021-08-13T22:36:59.214Z,1628894219.214 [CommandLine](IMPORTANT): got command schedule 20210814T020000 "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 41.950754 degree;set Smear.SamplingEndLongitude -87.203876 degree;set Smear.YoYoUpPitch 12 degree" 2pyra 2 3.000000 2021-08-13T22:36:59.215Z,1628894219.215 [CommandLine](IMPORTANT): Scheduling command #2 of 3 with id=2pyra 2021-08-13T22:36:59.216Z,1628894219.216 [CommandLine](IMPORTANT): Scheduled #37 (#2 of 3 with id='2pyra'): "set Smear.SamplingYoYoMinDepth 5 m;set Smear.SamplingYoYoMaxDepth 15 m;set Smear.SamplingEndLatitude 41.950754 degree;set Smear.SamplingEndLongitude -87.203876 degree;set Smear.YoYoUpPitch 12 degree" at 2021-08-14T02:00:00Z 2021-08-13T22:36:59.216Z,1628894219.216 [CommandLine](FAULT): Scheduling was paused by a command at 2021-08-13T19:30:07Z 2021-08-13T22:37:19.437Z,1628894239.437 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44860, MT Status=1, MTMSN=3170 2021-08-13T22:37:20.079Z,1628894240.079 [CommandLine](IMPORTANT): got command schedule 20210814T020000 "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" 2pyra 3 3.000000 2021-08-13T22:37:20.079Z,1628894240.079 [CommandLine](IMPORTANT): Scheduling command #3 of 3 with id=2pyra 2021-08-13T22:37:20.080Z,1628894240.080 [CommandLine](IMPORTANT): Scheduled #38 (#3 of 3 with id='2pyra'): "set Smear.YoYoDownPitch -12 degree;set Smear.NeedCommsTimeVeryLong 8 h;run" at 2021-08-14T02:00:00Z 2021-08-13T22:37:20.081Z,1628894240.081 [CommandLine](FAULT): Scheduling was paused by a command at 2021-08-13T19:30:07Z 2021-08-13T22:37:40.813Z,1628894260.813 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=44861, MT Status=1, MTMSN=3171 2021-08-13T22:37:41.390Z,1628894261.390 [CommandLine](IMPORTANT): got command schedule resume 2021-08-13T22:37:41.390Z,1628894261.390 [CommandLine](IMPORTANT): Scheduling is resumed 2021-08-13T22:42:29.207Z,1628894549.207 [CommandLine](IMPORTANT): got command load ./Missions/Science/sci2.xml 2021-08-13T22:42:31.455Z,1628894551.455 [CommandLine](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2021-08-13T22:42:31.537Z,1628894551.537 [MissionManager](IMPORTANT): Started mission Default 2021-08-13T22:42:41.130Z,1628894561.130 [CommandLine](IMPORTANT): got command set sci2.MissionTimeout 9.000000 hour 2021-08-13T22:42:41.131Z,1628894561.131 [CommandLine](IMPORTANT): got command set sci2.NeedCommsTime 45.000000 minute 2021-08-13T22:42:41.132Z,1628894561.132 [CommandLine](IMPORTANT): got command set sci2.Lat1 41.950752 degree 2021-08-13T22:42:41.132Z,1628894561.132 [CommandLine](IMPORTANT): got command set sci2.Lon1 -87.203873 degree 2021-08-13T22:42:41.133Z,1628894561.133 [CommandLine](IMPORTANT): got command set sci2.YoYoMinDepth 5.000000 meter 2021-08-13T22:42:41.134Z,1628894561.134 [CommandLine](IMPORTANT): got command set sci2.YoYoMaxDepth 60.000000 meter 2021-08-13T22:42:41.135Z,1628894561.135 [CommandLine](IMPORTANT): got command set sci2.MaxDepth 130.000000 meter 2021-08-13T22:42:41.135Z,1628894561.135 [CommandLine](IMPORTANT): got command run 2021-08-13T22:42:41.137Z,1628894561.137 [CommandLine](IMPORTANT): Running 2021-08-13T22:42:41.257Z,1628894561.257 [MissionManager](IMPORTANT): Started mission sci2 2021-08-13T23:31:02.408Z,1628897462.408 [CBIT](IMPORTANT): Beginning ground fault scan 2021-08-13T23:31:13.646Z,1628897473.646 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.001504 CHAN A1 (24V): 0.005271 CHAN A2 (12V): -0.005437 CHAN A3 (5V): -0.007131 CHAN B0 (3.3V): -0.002456 CHAN B1 (3.15aV): -0.001743 CHAN B2 (3.15bV): -0.038320 CHAN B3 (GND): -0.000681 OPEN: 0.012245 Full Scale Calc: 4.765 mA, -1.589 mA 2021-08-14T00:22:51.356Z,1628900571.356 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=44894, MT Status=1, MTMSN=3172