2023-04-20T20:38:19.347Z,1682023099.347 [Supervisor](IMPORTANT): Reading configuration overrides from Data/persisted.cfg 2023-04-20T20:38:23.540Z,1682023103.540 [StratificationFrontDetector](IMPORTANT): thresholdVTHI set to: 0.050012 degC 2023-04-20T20:38:24.113Z,1682023104.113 [SBIT](IMPORTANT): git: 2023-04-14_A 2023-04-20T20:38:24.113Z,1682023104.113 [SBIT](IMPORTANT): Kernel Release: 2.6.27.8 2023-04-20T20:39:35.718Z,1682023175.718 [SBIT](IMPORTANT): Beginning Startup BIT 2023-04-20T20:39:35.726Z,1682023175.726 [CBIT](IMPORTANT): Beginning ground fault scan 2023-04-20T20:39:46.677Z,1682023186.677 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.003668 CHAN A1 (24V): 0.004217 CHAN A2 (12V): -0.004955 CHAN A3 (5V): -0.004349 CHAN B0 (3.3V): -0.001685 CHAN B1 (3.15aV): -0.001509 CHAN B2 (3.15bV): -0.001066 CHAN B3 (GND): 0.000220 OPEN: 0.012169 Full Scale: +/- 1 mA 2023-04-20T20:40:29.444Z,1682023229.444 [SBIT](IMPORTANT): SBIT PASSED 2023-04-20T20:40:29.444Z,1682023229.444 [SBIT](IMPORTANT): Listing configuration overrides from Data/persisted.cfg 2023-04-20T20:40:29.445Z,1682023229.445 [SBIT](IMPORTANT): CBIT.gfScanTimeout=2 hour; 2023-04-20T20:40:29.445Z,1682023229.445 [SBIT](IMPORTANT): CBIT.stopDepth=60 meter; 2023-04-20T20:40:29.445Z,1682023229.445 [SBIT](IMPORTANT): DVL_micro.loadAtStartup=1 bool; 2023-04-20T20:40:29.445Z,1682023229.445 [SBIT](IMPORTANT): Depth_Keller.offset=-0.8 decibar; 2023-04-20T20:40:29.445Z,1682023229.445 [SBIT](IMPORTANT): ESPComponent.sampleTimeout=4 minute; 2023-04-20T20:40:29.445Z,1682023229.445 [SBIT](IMPORTANT): ElevatorServo.offsetAngle=1 degree; 2023-04-20T20:40:29.446Z,1682023229.446 [SBIT](IMPORTANT): Express linearApproximation VerticalHomogeneityIndexCalculator.vertical_salinity_homogeneity_index 0.050000 practical_salinity_unit; 2023-04-20T20:40:29.446Z,1682023229.446 [SBIT](IMPORTANT): Express linearApproximation VerticalHomogeneityIndexCalculator.vertical_temperature_homogeneity_index 0.050000 celsius; 2023-04-20T20:40:29.446Z,1682023229.446 [SBIT](IMPORTANT): Express none WetLabsBB2FL.BackscatteringCoeff470nm; 2023-04-20T20:40:29.446Z,1682023229.446 [SBIT](IMPORTANT): Express none WetLabsBB2FL.BackscatteringCoeff650nm; 2023-04-20T20:40:29.446Z,1682023229.446 [SBIT](IMPORTANT): Express linearApproximation depth 5.000000 meter; 2023-04-20T20:40:29.446Z,1682023229.446 [SBIT](IMPORTANT): Express linearApproximation latitude 0.005000 degree; 2023-04-20T20:40:29.446Z,1682023229.446 [SBIT](IMPORTANT): Express linearApproximation longitude 0.005000 degree; 2023-04-20T20:40:29.446Z,1682023229.446 [SBIT](IMPORTANT): StratificationFrontDetector.loadAtStartup=1 bool; 2023-04-20T20:40:29.447Z,1682023229.447 [SBIT](IMPORTANT): StratificationFrontDetector.threshold_VTHI=0.05 celsius; 2023-04-20T20:40:29.447Z,1682023229.447 [SBIT](IMPORTANT): StratificationFrontDetector.verbosity=1 count; 2023-04-20T20:40:29.447Z,1682023229.447 [SBIT](IMPORTANT): VerticalControl.buoyancyNeutral=191.501740 cubic_centimeter; 2023-04-20T20:40:29.447Z,1682023229.447 [SBIT](IMPORTANT): VerticalControl.massDefault=12.944775 millimeter; 2023-04-20T20:40:29.447Z,1682023229.447 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth3=20 meter; 2023-04-20T20:40:29.447Z,1682023229.447 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth4=30 meter; 2023-04-20T20:40:29.447Z,1682023229.447 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.loadAtStartup=1 bool; 2023-04-20T20:40:29.838Z,1682023229.838 [MissionManager](IMPORTANT): Started mission Startup 2023-04-20T20:41:32.403Z,1682023292.403 [MissionManager](IMPORTANT): Started mission Default 2023-04-20T20:49:03.501Z,1682023743.501 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 7.511589 min 2023-04-20T20:49:31.186Z,1682023771.186 [DataOverHttps](IMPORTANT): SBD MOMSN=18242699, MTMSN=20230420T204926 2023-04-20T20:49:40.040Z,1682023780.040 [CommandExec](IMPORTANT): got command schedule asap "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h" 3hoib 1 3.000000 2023-04-20T20:49:40.041Z,1682023780.041 [CommandExec](IMPORTANT): Scheduling command #1 of 3 with id=3hoib 2023-04-20T20:49:40.042Z,1682023780.042 [CommandExec](IMPORTANT): Scheduled #1 (#1 of 3 with id='3hoib'): "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h", ASAP 2023-04-20T20:49:41.034Z,1682023781.034 [DataOverHttps](IMPORTANT): SBD MTMSN=20230420T204935 2023-04-20T20:49:51.197Z,1682023791.197 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.SendSampleStatusAndData 0 bool;set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m" 3hoib 2 3.000000 2023-04-20T20:49:51.197Z,1682023791.197 [CommandExec](IMPORTANT): Scheduling command #2 of 3 with id=3hoib 2023-04-20T20:49:51.198Z,1682023791.198 [CommandExec](IMPORTANT): Scheduled #2 (#2 of 3 with id='3hoib'): "set IsothermDepthSampling.SendSampleStatusAndData 0 bool;set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m", ASAP 2023-04-20T20:49:52.134Z,1682023792.134 [DataOverHttps](IMPORTANT): SBD MTMSN=20230420T204946 2023-04-20T20:49:59.644Z,1682023799.644 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.DeepBoundChl 25 m;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;run" 3hoib 3 3.000000 2023-04-20T20:49:59.645Z,1682023799.645 [CommandExec](IMPORTANT): Scheduling command #3 of 3 with id=3hoib 2023-04-20T20:49:59.646Z,1682023799.646 [CommandExec](IMPORTANT): Scheduled #3 (#3 of 3 with id='3hoib'): "set IsothermDepthSampling.DeepBoundChl 25 m;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;run", ASAP 2023-04-20T20:49:59.795Z,1682023799.795 [CommandExec](IMPORTANT): got command load ./Missions/Science/isotherm_depth_sampling.xml 2023-04-20T20:50:23.416Z,1682023823.416 [CommandExec](IMPORTANT): Loaded ./Missions/Science/isotherm_depth_sampling.xml 2023-04-20T20:50:52.767Z,1682023852.767 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.NumSamplers 2 count 2023-04-20T20:50:52.801Z,1682023852.801 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MissionTimeout 6 hour 2023-04-20T20:50:52.801Z,1682023852.801 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNoFiring 1 hour 2023-04-20T20:51:20.141Z,1682023880.141 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendSampleStatusAndData 0 bool 2023-04-20T20:51:20.142Z,1682023880.142 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendDataToMultipleModems 0 bool 2023-04-20T20:51:20.143Z,1682023880.143 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SampleAtPeakChl 1 bool 2023-04-20T20:51:20.162Z,1682023880.162 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 3 meter 2023-04-20T20:51:54.007Z,1682023914.007 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 25 meter 2023-04-20T20:51:54.012Z,1682023914.012 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType2 -10 count 2023-04-20T20:51:54.013Z,1682023914.013 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 meter 2023-04-20T20:51:54.013Z,1682023914.013 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 10 minute 2023-04-20T20:51:54.014Z,1682023914.014 [CommandExec](IMPORTANT): got command run 2023-04-20T20:51:54.055Z,1682023914.055 [CommandExec](IMPORTANT): Running 2023-04-20T20:51:54.381Z,1682023914.381 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling 2023-04-20T20:51:54.495Z,1682023914.495 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 240.00 hours. 2023-04-20T20:54:42.076Z,1682024082.076 [IsothermDepthSampling:StayAwayFromWallsAndShore:FarEnoughFromWallsAndShore:A](IMPORTANT): Far enough from walls and shore. Latitude = 36.696513 arcdeg , longitude = -121.854951 arcdeg . Distance from shore = 3414.259033 m . OffshoreDistanceTurnBack (MinOffshore + MarginMinOffshore) = 2000.000000 m + 100.000000 m . Shortest distance nan m to side. MinDistFromPolygonSides = 200.000000 m . 2023-04-20T20:54:44.098Z,1682024084.098 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.305378 m 2023-04-20T20:55:53.630Z,1682024153.630 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , nan K , 0.000000 m , nan degC , nan m , 10.000000 min . 2023-04-20T21:00:12.978Z,1682024412.978 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoUp:B](IMPORTANT): Go up from 28.060722 m 2023-04-20T21:01:20.509Z,1682024480.509 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:SetChlPeakTempDepth:L](IMPORTANT): Set peak-chl depth and temp. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlTemperatureSet, PeakChlSet = 25.328075 m , 2.173600 ug/l , 8.109266 m , 12.169182 degC , 0.894400 ug/l 2023-04-20T21:01:20.869Z,1682024480.869 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 1.000000 count . Target depth = 8.109266 m . 2023-04-20T21:01:21.280Z,1682024481.280 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -6.000000 count 2023-04-20T21:05:10.757Z,1682024710.757 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 8.085079 m , settling for 10.000000 min 2023-04-20T21:15:13.450Z,1682025313.450 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::|summary:' 2023-04-20T21:15:23.585Z,1682025323.585 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-04-20T21:15:23.915Z,1682025323.915 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-04-20T21:16:17.077Z,1682025377.077 [ESPComponent](IMPORTANT): ESP has connected as client 2023-04-20T21:16:17.890Z,1682025377.890 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -6 2023-04-20T21:16:17.891Z,1682025377.891 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-04-20T21:16:18.357Z,1682025378.357 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 8.663520 m in 11.971552 degC water with 2.326480 ug/l chlorophyll fluorescence. 2023-04-20T21:16:19.097Z,1682025379.097 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG 2023-04-20T21:16:19.502Z,1682025379.502 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-04-20T21:16:21.140Z,1682025381.140 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE 2023-04-20T21:16:57.883Z,1682025417.883 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PRIMING (@14,archive_bac) 2023-04-20T21:17:00.727Z,1682025420.727 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PRIMING (@100.0) 2023-04-20T21:17:00.728Z,1682025420.728 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-04-20T21:17:01.131Z,1682025421.131 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-04-20T21:19:14.454Z,1682025554.454 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_FILTERING (@0.0) 2023-04-20T21:19:14.857Z,1682025554.857 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-04-20T22:16:10.378Z,1682028970.378 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PAUSED (@1000.0) 2023-04-20T22:16:10.781Z,1682028970.781 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PROCESSING (@1000.0) 2023-04-20T22:16:12.803Z,1682028972.803 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2023-04-20T22:16:13.205Z,1682028973.205 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PROCESSED (@14,archive_bac) 2023-04-20T22:28:17.586Z,1682029697.586 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING (@14,archive_bac) 2023-04-20T22:28:28.091Z,1682029708.091 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-04-20T22:28:28.495Z,1682029708.495 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED 2023-04-20T22:33:28.269Z,1682030008.269 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence completed normally. 2023-04-20T22:33:29.125Z,1682030009.125 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 1.000000 count completed. 2023-04-20T22:33:45.729Z,1682030025.729 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -10.000000 count , nan K , 0.000000 m , nan degC , nan m , 5.000000 min . 2023-04-20T22:33:49.326Z,1682030029.326 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 2.000000 count . Target depth = 8.109266 m . 2023-04-20T22:33:49.743Z,1682030029.743 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -10.000000 count 2023-04-20T22:34:49.934Z,1682030089.934 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 8.153740 m , settling for 5.000000 min 2023-04-20T22:39:46.959Z,1682030386.959 [CBIT](IMPORTANT): Beginning ground fault scan 2023-04-20T22:39:57.836Z,1682030397.836 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.433298 CHAN A1 (24V): 0.595006 CHAN A2 (12V): 0.254776 CHAN A3 (5V): 0.086274 CHAN B0 (3.3V): 0.056476 CHAN B1 (3.15aV): 0.052232 CHAN B2 (3.15bV): 0.052112 CHAN B3 (GND): -0.003185 OPEN: 0.012437 Full Scale: +/- 1 mA 2023-04-20T22:40:02.692Z,1682030402.692 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-04-20T22:40:02.795Z,1682030402.795 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-04-20T22:40:55.558Z,1682030455.558 [ESPComponent](IMPORTANT): ESP has connected as client 2023-04-20T22:40:56.374Z,1682030456.374 [ESPComponent](IMPORTANT): [sample #2] Setting cartridge argument to -10 2023-04-20T22:40:56.374Z,1682030456.374 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-04-20T22:40:56.841Z,1682030456.841 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 8.462930 m in 11.552149 degC water with 3.288480 ug/l chlorophyll fluorescence. 2023-04-20T22:40:57.173Z,1682030457.173 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_LOG 2023-04-20T22:40:57.578Z,1682030457.578 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-04-20T22:40:59.598Z,1682030459.598 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_LOADING_CARTRIDGE 2023-04-20T22:41:37.169Z,1682030497.169 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PRIMING (@25,daSPR_phyto) 2023-04-20T22:41:39.189Z,1682030499.189 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PRIMING (@100.0) 2023-04-20T22:41:39.595Z,1682030499.595 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-04-20T22:41:39.000Z,1682030500.000 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-04-20T22:43:57.357Z,1682030637.357 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_FILTERING (@0.0) 2023-04-20T22:43:57.762Z,1682030637.762 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-04-20T23:44:50.397Z,1682034290.397 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PAUSED (@1000.0) 2023-04-20T23:44:50.802Z,1682034290.802 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_PROCESSING (@1000.0) 2023-04-20T23:44:52.822Z,1682034292.822 [ESPComponent](IMPORTANT): Processing timeoutMinutes=120.000000 issuedCmd_=Cmd.startProcessing 2023-04-20T23:44:53.226Z,1682034293.226 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_WAITING_FOR_PROCESSED (@25,daSPR_phyto) 2023-04-21T00:39:58.156Z,1682037598.156 [CBIT](IMPORTANT): Beginning ground fault scan 2023-04-21T00:40:09.062Z,1682037609.062 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.491084 CHAN A1 (24V): 0.594945 CHAN A2 (12V): 0.266260 CHAN A3 (5V): 0.082747 CHAN B0 (3.3V): 0.064554 CHAN B1 (3.15aV): 0.051112 CHAN B2 (3.15bV): 0.050332 CHAN B3 (GND): -0.006062 OPEN: 0.012387 Full Scale: +/- 1 mA 2023-04-21T00:41:00.613Z,1682037660.613 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPING (@25,daSPR_phyto) 2023-04-21T00:41:11.926Z,1682037671.926 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-04-21T00:41:12.330Z,1682037672.330 [ESPComponent](IMPORTANT): [sample #2] ESP sampling state: S_STOPPED 2023-04-21T00:46:12.104Z,1682037972.104 [ESPComponent](IMPORTANT): [sample #2] ESP sampling sequence completed normally. 2023-04-21T00:46:12.959Z,1682037972.959 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 2.000000 count completed. 2023-04-21T00:46:16.189Z,1682037976.189 [MissionManager](IMPORTANT): Started mission Default 2023-04-21T00:51:45.638Z,1682038305.638 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-21T00:57:16.103Z,1682038636.103 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 10.992046 min 2023-04-21T00:57:17.705Z,1682038637.705 [NAL9602](FAULT): GPS failed to acquire within timeout. 2023-04-21T00:58:30.093Z,1682038710.093 [DataOverHttps](IMPORTANT): SBD MTMSN=20230421T005824 2023-04-21T00:58:38.562Z,1682038718.562 [CommandExec](IMPORTANT): got command ! echo i > /dev/loadA6;echo i > /dev/loadA7 2023-04-21T01:03:02.926Z,1682038982.926 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-21T01:08:23.296Z,1682039303.296 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 22.111823 min 2023-04-21T01:08:24.911Z,1682039304.911 [NAL9602](FAULT): GPS failed to acquire within timeout. 2023-04-21T01:14:10.515Z,1682039650.515 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-21T01:18:55.718Z,1682039935.718 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 32.652401 min 2023-04-21T01:23:59.531Z,1682040239.531 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-21T01:24:26.204Z,1682040266.204 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 38.159928 min 2023-04-21T01:30:00.057Z,1682040600.057 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 43.724032 min 2023-04-21T01:31:37.330Z,1682040697.330 [DataOverHttps](IMPORTANT): SBD MTMSN=20230421T013132 2023-04-21T01:31:47.809Z,1682040707.809 [CommandExec](IMPORTANT): got command schedule asap "load Science/profile_station.xml;set profile_station.MissionTimeout 12 h;set profile_station.NeedCommsTime 20 min;set profile_station.Lat 36.693 degree;set profile_station.Lon -121.864 degree;set profile_station.YoYoMaxDepth 35 m" 3i1k0 1 2.000000 2023-04-21T01:31:47.809Z,1682040707.809 [CommandExec](IMPORTANT): Scheduling command #1 of 2 with id=3i1k0 2023-04-21T01:31:47.810Z,1682040707.810 [CommandExec](IMPORTANT): Scheduled #4 (#1 of 2 with id='3i1k0'): "load Science/profile_station.xml;set profile_station.MissionTimeout 12 h;set profile_station.NeedCommsTime 20 min;set profile_station.Lat 36.693 degree;set profile_station.Lon -121.864 degree;set profile_station.YoYoMaxDepth 35 m", ASAP 2023-04-21T01:31:48.701Z,1682040708.701 [DataOverHttps](IMPORTANT): SBD MTMSN=20230421T013143 2023-04-21T01:31:56.350Z,1682040716.350 [CommandExec](IMPORTANT): got command schedule asap "set profile_station.MaxDepth 50 m;run" 3i1k0 2 2.000000 2023-04-21T01:31:56.351Z,1682040716.351 [CommandExec](IMPORTANT): Scheduling command #2 of 2 with id=3i1k0 2023-04-21T01:31:56.352Z,1682040716.352 [CommandExec](IMPORTANT): Scheduled #5 (#2 of 2 with id='3i1k0'): "set profile_station.MaxDepth 50 m;run", ASAP 2023-04-21T01:31:56.507Z,1682040716.507 [CommandExec](IMPORTANT): got command load ./Missions/Science/profile_station.xml 2023-04-21T01:31:58.690Z,1682040718.690 [CommandExec](IMPORTANT): Loaded ./Missions/Science/profile_station.xml 2023-04-21T01:32:18.423Z,1682040738.423 [CommandExec](IMPORTANT): got command set profile_station.MissionTimeout 12 hour 2023-04-21T01:32:18.424Z,1682040738.424 [CommandExec](IMPORTANT): got command set profile_station.NeedCommsTime 20 minute 2023-04-21T01:32:18.424Z,1682040738.424 [CommandExec](IMPORTANT): got command set profile_station.Lat 36.693 degree 2023-04-21T01:32:18.425Z,1682040738.425 [CommandExec](IMPORTANT): got command set profile_station.Lon -121.864 degree 2023-04-21T01:32:18.426Z,1682040738.426 [CommandExec](IMPORTANT): got command set profile_station.YoYoMaxDepth 35 meter 2023-04-21T01:32:22.069Z,1682040742.069 [CommandExec](IMPORTANT): got command set profile_station.MaxDepth 50 meter 2023-04-21T01:32:22.069Z,1682040742.069 [CommandExec](IMPORTANT): got command run 2023-04-21T01:32:22.073Z,1682040742.073 [CommandExec](IMPORTANT): Running 2023-04-21T01:32:22.325Z,1682040742.325 [MissionManager](IMPORTANT): Started mission profile_station 2023-04-21T01:35:04.701Z,1682040904.701 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-21T01:38:37.751Z,1682041117.751 [StratificationFrontDetector](IMPORTANT): Initial vertical homogeneity condition (0 = stratified, 1 = homogeneous): 0 2023-04-21T01:47:23.787Z,1682041643.787 [StratificationFrontDetector](IMPORTANT): Front detection is now enabled. Present vertical homogeneity condition (0 = stratified, 1 = homogeneous), VTHI, VSHI, countSameWaterType_, countOppositeWaterType_, frontDetectionEnabled_ = 0, 1.216516, nan, 5, 0, 1 2023-04-21T02:28:07.899Z,1682044087.899 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=3361, MT Status=1, MTMSN=2603 2023-04-21T02:28:08.432Z,1682044088.432 [CommandExec](IMPORTANT): got command stop 2023-04-21T02:28:08.433Z,1682044088.433 [CommandExec](IMPORTANT): Scheduling is paused 2023-04-21T02:28:09.136Z,1682044089.136 [MissionManager](IMPORTANT): Started mission Default 2023-04-21T02:35:02.221Z,1682044502.221 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 6.877742 min 2023-04-21T02:37:44.558Z,1682044664.558 [DataOverHttps](IMPORTANT): SBD MTMSN=20230421T023739 2023-04-21T02:37:52.916Z,1682044672.916 [CommandExec](IMPORTANT): got command schedule asap "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.MissionTimeout 4 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h;set IsothermDepthSampling.SendSampleStatusAndData 0 bool" 3i4lz 1 4.000000 2023-04-21T02:37:52.916Z,1682044672.916 [CommandExec](IMPORTANT): Scheduling command #1 of 4 with id=3i4lz 2023-04-21T02:37:52.918Z,1682044672.918 [CommandExec](IMPORTANT): Scheduled #6 (#1 of 4 with id='3i4lz'): "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.MissionTimeout 4 h;set IsothermDepthSampling.MaxWaitNoFiring 1 h;set IsothermDepthSampling.SendSampleStatusAndData 0 bool", ASAP 2023-04-21T02:37:53.838Z,1682044673.838 [DataOverHttps](IMPORTANT): SBD MTMSN=20230421T023748 2023-04-21T02:38:01.456Z,1682044681.456 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m;set IsothermDepthSampling.DeepBoundChl 25 m" 3i4lz 2 4.000000 2023-04-21T02:38:01.457Z,1682044681.457 [CommandExec](IMPORTANT): Scheduling command #2 of 4 with id=3i4lz 2023-04-21T02:38:01.458Z,1682044681.458 [CommandExec](IMPORTANT): Scheduled #7 (#2 of 4 with id='3i4lz'): "set IsothermDepthSampling.SendDataToMultipleModems 0 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.ShallowBoundChl 3 m;set IsothermDepthSampling.DeepBoundChl 25 m", ASAP 2023-04-21T02:38:02.362Z,1682044682.362 [DataOverHttps](IMPORTANT): SBD MTMSN=20230421T023757 2023-04-21T02:38:10.092Z,1682044690.092 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.CartridgeType1 -10 count;set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;set IsothermDepthSampling.RiseFromTurningDepth 6.0 m" 3i4lz 3 4.000000 2023-04-21T02:38:10.093Z,1682044690.093 [CommandExec](IMPORTANT): Scheduling command #3 of 4 with id=3i4lz 2023-04-21T02:38:10.094Z,1682044690.094 [CommandExec](IMPORTANT): Scheduled #8 (#3 of 4 with id='3i4lz'): "set IsothermDepthSampling.CartridgeType1 -10 count;set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 m;set IsothermDepthSampling.WaitDepUndulation1 10 min;set IsothermDepthSampling.RiseFromTurningDepth 6.0 m", ASAP 2023-04-21T02:38:11.017Z,1682044691.017 [DataOverHttps](IMPORTANT): SBD MTMSN=20230421T023805 2023-04-21T02:38:18.839Z,1682044698.839 [CommandExec](IMPORTANT): got command schedule asap "set IsothermDepthSampling.DepChangeThreshAttitudeFlip 4.0 m;run" 3i4lz 4 4.000000 2023-04-21T02:38:18.840Z,1682044698.840 [CommandExec](IMPORTANT): Scheduling command #4 of 4 with id=3i4lz 2023-04-21T02:38:18.841Z,1682044698.841 [CommandExec](IMPORTANT): Scheduled #9 (#4 of 4 with id='3i4lz'): "set IsothermDepthSampling.DepChangeThreshAttitudeFlip 4.0 m;run", ASAP 2023-04-21T02:38:18.993Z,1682044698.993 [CommandExec](IMPORTANT): got command load ./Missions/Science/isotherm_depth_sampling.xml 2023-04-21T02:38:34.969Z,1682044714.969 [CommandExec](IMPORTANT): Loaded ./Missions/Science/isotherm_depth_sampling.xml 2023-04-21T02:39:04.940Z,1682044744.940 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MissionTimeout 4 hour 2023-04-21T02:39:04.941Z,1682044744.941 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNoFiring 1 hour 2023-04-21T02:39:04.941Z,1682044744.941 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendSampleStatusAndData 0 bool 2023-04-21T02:39:31.657Z,1682044771.657 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendDataToMultipleModems 0 bool 2023-04-21T02:39:31.658Z,1682044771.658 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SampleAtPeakChl 1 bool 2023-04-21T02:39:31.659Z,1682044771.659 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 3 meter 2023-04-21T02:39:31.660Z,1682044771.660 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 25 meter 2023-04-21T02:40:08.652Z,1682044808.652 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType1 -10 count 2023-04-21T02:40:08.653Z,1682044808.653 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChlCommon 0 meter 2023-04-21T02:40:08.654Z,1682044808.654 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 10 minute 2023-04-21T02:40:08.655Z,1682044808.655 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.RiseFromTurningDepth 6.0 meter 2023-04-21T02:40:09.304Z,1682044809.304 [CBIT](IMPORTANT): Beginning ground fault scan 2023-04-21T02:40:14.888Z,1682044814.888 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-21T02:40:16.421Z,1682044816.421 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepChangeThreshAttitudeFlip 4.0 meter 2023-04-21T02:40:16.421Z,1682044816.421 [CommandExec](IMPORTANT): got command run 2023-04-21T02:40:16.436Z,1682044816.436 [CommandExec](IMPORTANT): Running 2023-04-21T02:40:16.560Z,1682044816.560 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling 2023-04-21T02:40:16.692Z,1682044816.692 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 240.00 hours. 2023-04-21T02:40:20.239Z,1682044820.239 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): -0.004724 CHAN A1 (24V): 0.004464 CHAN A2 (12V): -0.004914 CHAN A3 (5V): 0.002051 CHAN B0 (3.3V): -0.001566 CHAN B1 (3.15aV): 0.061469 CHAN B2 (3.15bV): -0.000431 CHAN B3 (GND): -0.000874 OPEN: 0.012289 Full Scale: +/- 1 mA 2023-04-21T02:41:30.428Z,1682044890.428 [IsothermDepthSampling:StayAwayFromWallsAndShore:FarEnoughFromWallsAndShore:A](IMPORTANT): Far enough from walls and shore. Latitude = 36.690371 arcdeg , longitude = -121.868318 arcdeg . Distance from shore = 4431.520996 m . OffshoreDistanceTurnBack (MinOffshore + MarginMinOffshore) = 2000.000000 m + 100.000000 m . Shortest distance nan m to side 0 count . MinDistFromPolygonSides = 200.000000 m . 2023-04-21T02:41:32.457Z,1682044892.457 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.521685 m 2023-04-21T02:42:41.963Z,1682044961.963 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -10.000000 count , nan K , 0.000000 m , nan degC , nan m , 10.000000 min . 2023-04-21T02:46:09.657Z,1682045169.657 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-21T02:46:48.059Z,1682045208.059 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoUp:B](IMPORTANT): Go up from 28.029327 m 2023-04-21T02:48:42.843Z,1682045322.843 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:SetChlPeakTempDepth:L](IMPORTANT): Set peak-chl depth and temp. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlTemperatureSet, PeakChlSet = 21.813732 m , 3.608800 ug/l , 11.340633 m , 10.916095 degC , 11.094200 ug/l 2023-04-21T02:48:43.209Z,1682045323.209 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 1.000000 count . Target depth = 11.340633 m . 2023-04-21T02:48:43.617Z,1682045323.617 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -10.000000 count 2023-04-21T02:51:49.245Z,1682045509.245 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 11.309788 m , settling for 10.000000 min 2023-04-21T03:02:01.976Z,1682046121.976 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-04-21T03:02:02.150Z,1682046122.150 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-04-21T03:02:55.288Z,1682046175.288 [ESPComponent](IMPORTANT): ESP has connected as client 2023-04-21T03:02:56.092Z,1682046176.092 [ESPComponent](IMPORTANT): [sample #3] Setting cartridge argument to -10 2023-04-21T03:02:56.093Z,1682046176.093 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-04-21T03:02:56.559Z,1682046176.559 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 11.436782 m in 11.917597 degC water with 3.330080 ug/l chlorophyll fluorescence. 2023-04-21T03:02:56.897Z,1682046176.897 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_LOG 2023-04-21T03:02:57.301Z,1682046177.301 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-04-21T03:02:59.322Z,1682046179.322 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_LOADING_CARTRIDGE 2023-04-21T03:03:36.930Z,1682046216.930 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PRIMING (@23,daSPR_phyto) 2023-04-21T03:03:39.757Z,1682046219.757 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PRIMING (@100.0) 2023-04-21T03:03:39.759Z,1682046219.759 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-04-21T03:03:40.162Z,1682046220.162 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-04-21T03:05:57.525Z,1682046357.525 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_FILTERING (@0.0) 2023-04-21T03:05:57.929Z,1682046357.929 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-04-21T04:08:56.662Z,1682050136.662 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PAUSED (@1000.0) 2023-04-21T04:08:57.066Z,1682050137.066 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_PROCESSING (@1000.0) 2023-04-21T04:08:59.086Z,1682050139.086 [ESPComponent](IMPORTANT): Processing timeoutMinutes=120.000000 issuedCmd_=Cmd.startProcessing 2023-04-21T04:08:59.489Z,1682050139.489 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_WAITING_FOR_PROCESSED (@23,daSPR_phyto) 2023-04-21T04:40:20.364Z,1682052020.364 [CBIT](IMPORTANT): Beginning ground fault scan 2023-04-21T04:40:31.231Z,1682052031.231 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): 0.472078 CHAN A1 (24V): 0.631818 CHAN A2 (12V): 0.272035 CHAN A3 (5V): 0.090844 CHAN B0 (3.3V): 0.049976 CHAN B1 (3.15aV): 0.050134 CHAN B2 (3.15bV): 0.048902 CHAN B3 (GND): -0.007167 OPEN: 0.012253 Full Scale: +/- 1 mA 2023-04-21T05:04:22.470Z,1682053462.470 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPING (@23,daSPR_phyto) 2023-04-21T05:04:33.782Z,1682053473.782 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-04-21T05:04:34.186Z,1682053474.186 [ESPComponent](IMPORTANT): [sample #3] ESP sampling state: S_STOPPED 2023-04-21T05:09:33.953Z,1682053773.953 [ESPComponent](IMPORTANT): [sample #3] ESP sampling sequence completed normally. 2023-04-21T05:09:34.840Z,1682053774.840 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 1.000000 count completed. 2023-04-21T05:09:37.813Z,1682053777.813 [MissionManager](IMPORTANT): Started mission Default 2023-04-21T05:15:14.648Z,1682054114.648 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-21T05:20:40.050Z,1682054440.050 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.030180 min 2023-04-21T05:20:41.666Z,1682054441.666 [NAL9602](FAULT): GPS failed to acquire within timeout. 2023-04-21T05:20:42.432Z,1682054442.432 [NAL9602](FAULT): LCB fault: Invalid Command. Hardware Overcurrent Shutdown. Current Limiter Activated. 2023-04-21T05:26:26.697Z,1682054786.697 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-21T05:31:11.613Z,1682055071.613 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 21.556989 min 2023-04-21T05:36:15.864Z,1682055375.864 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-21T05:36:26.009Z,1682055386.009 [DataOverHttps](IMPORTANT): SBD MTMSN=20230421T053620 2023-04-21T05:36:33.662Z,1682055393.662 [CommandExec](IMPORTANT): got command schedule resume 2023-04-21T05:36:33.663Z,1682055393.663 [CommandExec](IMPORTANT): Scheduling is resumed 2023-04-21T05:36:43.347Z,1682055403.347 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 27.085655 min 2023-04-21T05:40:31.563Z,1682055631.563 [DataOverHttps](IMPORTANT): SBD MTMSN=20230421T054026 2023-04-21T05:40:41.158Z,1682055641.158 [CommandExec](IMPORTANT): got command load ./Missions/Science/profile_station.xml 2023-04-21T05:40:44.230Z,1682055644.230 [CommandExec](IMPORTANT): Loaded ./Missions/Science/profile_station.xml 2023-04-21T05:41:08.774Z,1682055668.774 [CommandExec](IMPORTANT): got command set profile_station.MissionTimeout 12 hour 2023-04-21T05:41:08.774Z,1682055668.774 [CommandExec](IMPORTANT): got command set profile_station.Lat 36.658 degree 2023-04-21T05:41:08.775Z,1682055668.775 [CommandExec](IMPORTANT): got command set profile_station.Lon -121.874 degree 2023-04-21T05:41:08.777Z,1682055668.777 [CommandExec](IMPORTANT): got command set profile_station.YoYoMaxDepth 40 meter 2023-04-21T05:41:08.778Z,1682055668.778 [CommandExec](IMPORTANT): got command set profile_station.MaxDepth 50 meter 2023-04-21T05:41:08.778Z,1682055668.778 [CommandExec](IMPORTANT): got command run 2023-04-21T05:41:08.785Z,1682055668.785 [CommandExec](IMPORTANT): Running 2023-04-21T05:41:08.964Z,1682055668.964 [MissionManager](IMPORTANT): Started mission profile_station 2023-04-21T05:42:51.375Z,1682055771.375 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=3363, MT Status=1, MTMSN=2604 2023-04-21T05:42:51.950Z,1682055771.950 [CommandExec](IMPORTANT): got command ! echo i > /dev/loadA6;echo i > /dev/loadA7 2023-04-21T06:40:31.536Z,1682059231.536 [CBIT](IMPORTANT): Beginning ground fault scan 2023-04-21T06:40:42.504Z,1682059242.504 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.004037 CHAN A1 (24V): 0.003529 CHAN A2 (12V): -0.004702 CHAN A3 (5V): 0.001098 CHAN B0 (3.3V): -0.002146 CHAN B1 (3.15aV): -0.001711 CHAN B2 (3.15bV): 0.016992 CHAN B3 (GND): 0.000203 OPEN: 0.011991 Full Scale: +/- 1 mA 2023-04-21T06:45:56.635Z,1682059556.635 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=3364, MT Status=1, MTMSN=2605 2023-04-21T06:45:57.468Z,1682059557.468 [CommandExec](IMPORTANT): got command load ./Missions/Science/profile_station.xml 2023-04-21T06:45:59.437Z,1682059559.437 [CommandExec](IMPORTANT): Loaded ./Missions/Science/profile_station.xml 2023-04-21T06:45:59.547Z,1682059559.547 [MissionManager](IMPORTANT): Started mission Default 2023-04-21T06:46:17.930Z,1682059577.930 [CommandExec](IMPORTANT): got command set profile_station.MissionTimeout 12 hour 2023-04-21T06:46:17.931Z,1682059577.931 [CommandExec](IMPORTANT): got command set profile_station.Lat 36.658 degree 2023-04-21T06:46:17.932Z,1682059577.932 [CommandExec](IMPORTANT): got command set profile_station.Lon -121.874 degree 2023-04-21T06:46:17.933Z,1682059577.933 [CommandExec](IMPORTANT): got command set profile_station.YoYoMaxDepth 40 meter 2023-04-21T06:46:17.933Z,1682059577.933 [CommandExec](IMPORTANT): got command set profile_station.MaxDepth 50 meter 2023-04-21T06:46:17.934Z,1682059577.934 [CommandExec](IMPORTANT): got command run 2023-04-21T06:46:18.005Z,1682059578.005 [CommandExec](IMPORTANT): Running 2023-04-21T06:46:18.044Z,1682059578.044 [MissionManager](IMPORTANT): Started mission profile_station 2023-04-21T06:54:06.870Z,1682060046.870 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-21T07:55:29.706Z,1682063729.706 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-21T08:01:08.893Z,1682064068.893 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-21T08:40:42.624Z,1682066442.624 [CBIT](IMPORTANT): Beginning ground fault scan 2023-04-21T08:40:53.883Z,1682066453.883 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.004218 CHAN A1 (24V): 0.003647 CHAN A2 (12V): 0.006258 CHAN A3 (5V): -0.003152 CHAN B0 (3.3V): -0.001048 CHAN B1 (3.15aV): -0.001028 CHAN B2 (3.15bV): -0.001032 CHAN B3 (GND): -0.001042 OPEN: 0.012336 Full Scale: +/- 1 mA 2023-04-21T09:02:19.759Z,1682067739.759 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-21T09:08:04.817Z,1682068084.817 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-21T10:09:04.817Z,1682071744.817 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-21T10:40:54.147Z,1682073654.147 [CBIT](IMPORTANT): Beginning ground fault scan 2023-04-21T10:41:05.451Z,1682073665.451 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.004457 CHAN A1 (24V): 0.003475 CHAN A2 (12V): -0.003822 CHAN A3 (5V): -0.003011 CHAN B0 (3.3V): -0.002043 CHAN B1 (3.15aV): -0.001152 CHAN B2 (3.15bV): -0.000981 CHAN B3 (GND): -0.018254 OPEN: 0.012719 Full Scale: +/- 1 mA 2023-04-21T10:52:17.541Z,1682074337.541 [RudderServo](FAULT): Rudder uart error - getPosition..serial timeout 2023-04-21T11:15:37.689Z,1682075737.689 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-21T11:21:17.972Z,1682076077.972 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-21T12:21:50.876Z,1682079710.876 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-04-21T12:41:05.787Z,1682080865.787 [CBIT](IMPORTANT): Beginning ground fault scan 2023-04-21T12:41:17.174Z,1682080877.174 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.004589 CHAN A1 (24V): 0.003364 CHAN A2 (12V): 0.005596 CHAN A3 (5V): -0.003182 CHAN B0 (3.3V): -0.002278 CHAN B1 (3.15aV): -0.000655 CHAN B2 (3.15bV): -0.001193 CHAN B3 (GND): -0.001251 OPEN: 0.012531 Full Scale: +/- 1 mA 2023-04-21T13:28:05.785Z,1682083685.785 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=3367, MT Status=1, MTMSN=2606 2023-04-21T13:28:06.317Z,1682083686.317 [CommandExec](IMPORTANT): got command stop 2023-04-21T13:28:06.317Z,1682083686.317 [CommandExec](IMPORTANT): Scheduling is paused 2023-04-21T13:28:06.675Z,1682083686.675 [MissionManager](IMPORTANT): Started mission Default 2023-04-21T13:31:03.369Z,1682083863.369 [DataOverHttps](IMPORTANT): SBD MTMSN=20230421T133058 2023-04-21T13:31:10.957Z,1682083870.957 [CommandExec](IMPORTANT): got command schedule resume 2023-04-21T13:31:10.957Z,1682083870.957 [CommandExec](IMPORTANT): Scheduling is resumed 2023-04-21T13:33:55.506Z,1682084035.506 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 5.807011 min 2023-04-21T13:37:13.672Z,1682084233.672 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=3368, MT Status=1, MTMSN=2607