2022-06-06T03:01:14.703Z,1654484474.703 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.HeadingLeavingSide0 210 degree 2022-06-06T03:01:14.705Z,1654484474.705 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.HeadingLeavingSide2 30 degree 2022-06-06T03:01:14.706Z,1654484474.706 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.HeadingLeavingSide3 120 degree 2022-06-06T03:01:14.706Z,1654484474.706 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxDepth 30 meter 2022-06-06T03:01:14.709Z,1654484474.709 [CommandExec](IMPORTANT): got command restart logs 2022-06-06T03:02:22.836Z,1654484542.836 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundSampler 45 meter 2022-06-06T03:02:22.837Z,1654484542.837 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 2 meter 2022-06-06T03:02:22.838Z,1654484542.838 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 15 meter 2022-06-06T03:02:22.839Z,1654484542.839 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeTypeCommon NaN count 2022-06-06T03:03:08.084Z,1654484588.084 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType1 -6 count 2022-06-06T03:03:08.085Z,1654484588.085 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType2 -10 count 2022-06-06T03:03:08.085Z,1654484588.085 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChl1 0 meter 2022-06-06T03:03:08.086Z,1654484588.086 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChl2 0 meter 2022-06-06T03:03:27.009Z,1654484607.009 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 20 minute 2022-06-06T03:03:27.010Z,1654484607.010 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation2 5.0 minute 2022-06-06T03:03:27.010Z,1654484607.010 [CommandExec](IMPORTANT): got command run 2022-06-06T03:03:27.022Z,1654484607.022 [CommandExec](IMPORTANT): Running 2022-06-06T03:03:27.027Z,1654484607.027 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling 2022-06-06T03:03:27.167Z,1654484607.167 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 21.00 hours. 2022-06-06T03:04:25.557Z,1654484665.557 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T03:05:06.075Z,1654484706.075 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.385625 m 2022-06-06T03:06:10.697Z,1654484770.697 [DVL_micro](FAULT): Failed to initialize within timeout. 2022-06-06T03:06:15.632Z,1654484775.632 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , nan K , 0.000000 m , nan degC , nan m , 20.000000 min . 2022-06-06T03:08:56.783Z,1654484936.783 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoUp:B](IMPORTANT): Go up from 18.058701 m 2022-06-06T03:10:04.617Z,1654485004.617 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T03:10:37.815Z,1654485037.815 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:SetChlPeakTempDepth:L](IMPORTANT): Set peak-chl depth and temp. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlTemperatureSet, PeakChlSet = 12.741902 m , 4.846400 ug/l , 9.610150 m , 16.103489 degC , 5.331563 ug/l 2022-06-06T03:10:38.209Z,1654485038.209 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 1.000000 count . Target depth = 9.610150 m . 2022-06-06T03:10:38.584Z,1654485038.584 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -6.000000 count 2022-06-06T03:12:03.047Z,1654485123.047 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 9.571327 m , settling for 20.000000 min 2022-06-06T03:32:15.957Z,1654486335.957 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-06-06T03:32:16.115Z,1654486336.115 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-06-06T03:33:12.030Z,1654486392.030 [ESPComponent](IMPORTANT): ESP has connected as client 2022-06-06T03:33:12.843Z,1654486392.843 [ESPComponent](IMPORTANT): [sample #7] Setting cartridge argument to -6 2022-06-06T03:33:12.844Z,1654486392.844 [ESPComponent](IMPORTANT): [sample #7] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-06-06T03:33:13.299Z,1654486393.299 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 9.747720 m in 15.891047 degC water with 5.482880 ug/l chlorophyll fluorescence. 2022-06-06T03:33:13.646Z,1654486393.646 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PREPARING_SHOW_LOG 2022-06-06T03:33:14.050Z,1654486394.050 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-06-06T03:33:16.071Z,1654486396.071 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_LOADING_CARTRIDGE 2022-06-06T03:33:55.663Z,1654486435.663 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PRIMING (@24,archive_bac) 2022-06-06T03:33:58.090Z,1654486438.090 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PRIMING (@100.0) 2022-06-06T03:33:58.091Z,1654486438.091 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-06-06T03:33:58.494Z,1654486438.494 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-06-06T03:35:02.821Z,1654486502.821 [IsothermDepthSampling:StandardEnvelopes:C.OffshoreEnvelope](IMPORTANT): ACTIVE 2022-06-06T03:36:09.795Z,1654486569.795 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_FILTERING (@0.0) 2022-06-06T03:36:10.199Z,1654486570.199 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-06-06T03:50:01.250Z,1654487401.250 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PAUSED (@229.8) 2022-06-06T03:50:01.654Z,1654487401.654 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PROCESSING (@229.8) 2022-06-06T03:50:03.675Z,1654487403.675 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2022-06-06T03:50:04.078Z,1654487404.078 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PROCESSED (@24,archive_bac) 2022-06-06T04:02:08.906Z,1654488128.906 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_STOPPING (@24,archive_bac) 2022-06-06T04:02:18.603Z,1654488138.603 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-06-06T04:02:19.028Z,1654488139.028 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_STOPPED 2022-06-06T04:07:18.843Z,1654488438.843 [ESPComponent](IMPORTANT): [sample #7] ESP sampling sequence completed normally. 2022-06-06T04:07:19.899Z,1654488439.899 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 1.000000 count completed. 2022-06-06T04:07:21.913Z,1654488441.913 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataCntSamples:A](IMPORTANT): CntSamples = 1.000000 count 2022-06-06T04:07:23.116Z,1654488443.116 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleNumber:A](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2022-06-06T04:07:24.329Z,1654488444.329 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPCartridgeType:A](IMPORTANT): Science:ESPComponent.cartridge = -6 count 2022-06-06T04:07:25.529Z,1654488445.529 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleVolume:A](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2022-06-06T04:07:27.156Z,1654488447.156 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleDep:A](IMPORTANT): Universal:depth = 9.956878 m 2022-06-06T04:07:28.772Z,1654488448.772 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleChl:A](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 5.116800 ug/l 2022-06-06T04:07:36.173Z,1654488456.173 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:07:45.304Z,1654488465.304 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -10.000000 count , nan K , 0.000000 m , nan degC , nan m , 5.000000 min . 2022-06-06T04:07:48.946Z,1654488468.946 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 2.000000 count . Target depth = 9.610150 m . 2022-06-06T04:07:49.365Z,1654488469.365 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -10.000000 count 2022-06-06T04:07:50.053Z,1654488470.053 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:08:03.943Z,1654488483.943 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:08:11.996Z,1654488491.996 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 9.574916 m , settling for 5.000000 min 2022-06-06T04:08:17.809Z,1654488497.809 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:08:31.965Z,1654488511.965 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:08:45.857Z,1654488525.857 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:08:59.741Z,1654488539.741 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:09:13.629Z,1654488553.629 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:09:27.745Z,1654488567.745 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:09:41.605Z,1654488581.605 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:09:55.473Z,1654488595.473 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:10:09.333Z,1654488609.333 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:10:23.461Z,1654488623.461 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:10:37.333Z,1654488637.333 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:10:51.209Z,1654488651.209 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:11:05.081Z,1654488665.081 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:11:19.201Z,1654488679.201 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:11:33.073Z,1654488693.073 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:11:46.942Z,1654488706.942 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:12:00.803Z,1654488720.803 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:12:14.926Z,1654488734.926 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:12:28.797Z,1654488748.797 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:12:42.669Z,1654488762.669 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:12:56.565Z,1654488776.565 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T04:13:24.729Z,1654488804.729 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-06-06T04:13:24.950Z,1654488804.950 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-06-06T04:14:21.721Z,1654488861.721 [ESPComponent](IMPORTANT): ESP has connected as client 2022-06-06T04:14:22.532Z,1654488862.532 [ESPComponent](IMPORTANT): [sample #8] Setting cartridge argument to -10 2022-06-06T04:14:22.534Z,1654488862.534 [ESPComponent](IMPORTANT): [sample #8] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-06-06T04:14:23.008Z,1654488863.008 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 9.475273 m in 15.808252 degC water with 5.144880 ug/l chlorophyll fluorescence. 2022-06-06T04:14:23.341Z,1654488863.341 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PREPARING_SHOW_LOG 2022-06-06T04:14:23.743Z,1654488863.743 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-06-06T04:14:25.762Z,1654488865.762 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_LOADING_CARTRIDGE 2022-06-06T04:15:06.162Z,1654488906.162 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PRIMING (@23,daSPR_phyto) 2022-06-06T04:15:08.588Z,1654488908.588 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PRIMING (@100.0) 2022-06-06T04:15:08.590Z,1654488908.590 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-06-06T04:15:08.990Z,1654488908.990 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-06-06T04:17:22.310Z,1654489042.310 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_FILTERING (@0.0) 2022-06-06T04:17:22.716Z,1654489042.716 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-06-06T04:39:33.581Z,1654490373.581 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PAUSED (@376.1) 2022-06-06T04:39:33.982Z,1654490373.982 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PROCESSING (@376.1) 2022-06-06T04:39:36.003Z,1654490376.003 [ESPComponent](IMPORTANT): Processing timeoutMinutes=120.000000 issuedCmd_=Cmd.startProcessing 2022-06-06T04:39:36.407Z,1654490376.407 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PROCESSED (@23,daSPR_phyto) 2022-06-06T05:40:29.842Z,1654494029.842 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_STOPPING (@23,daSPR_phyto) 2022-06-06T05:40:40.752Z,1654494040.752 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-06-06T05:40:41.162Z,1654494041.162 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_STOPPED 2022-06-06T05:45:40.934Z,1654494340.934 [ESPComponent](IMPORTANT): [sample #8] ESP sampling sequence completed normally. 2022-06-06T05:45:41.813Z,1654494341.813 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 2.000000 count completed. 2022-06-06T05:45:43.846Z,1654494343.846 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataCntSamples:A](IMPORTANT): CntSamples = 2.000000 count 2022-06-06T05:45:45.058Z,1654494345.058 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleNumber:A](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2022-06-06T05:45:46.281Z,1654494346.281 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPCartridgeType:A](IMPORTANT): Science:ESPComponent.cartridge = -10 count 2022-06-06T05:45:47.451Z,1654494347.451 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleVolume:A](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2022-06-06T05:45:49.070Z,1654494349.070 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleDep:A](IMPORTANT): Universal:depth = 9.920071 m 2022-06-06T05:45:50.685Z,1654494350.685 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleChl:A](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 3.109600 ug/l 2022-06-06T05:45:53.689Z,1654494353.689 [MissionManager](IMPORTANT): Started mission Default 2022-06-06T05:45:58.093Z,1654494358.093 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T05:46:11.965Z,1654494371.965 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T05:51:29.845Z,1654494689.845 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T05:57:00.001Z,1654495020.001 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.098322 min 2022-06-06T05:57:01.603Z,1654495021.603 [NAL9602](FAULT): GPS failed to acquire within timeout. 2022-06-06T05:57:02.413Z,1654495022.413 [NAL9602](FAULT): LCB fault: LCB Watchdog Reset. 2022-06-06T05:59:13.127Z,1654495153.127 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T055906 2022-06-06T05:59:20.783Z,1654495160.783 [CommandExec](IMPORTANT): got command schedule clear 2022-06-06T05:59:20.783Z,1654495160.783 [CommandExec](IMPORTANT): Cleared 0 scheduled commands. 2022-06-06T06:02:47.186Z,1654495367.186 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T06:03:56.182Z,1654495436.182 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T060349 2022-06-06T06:04:03.715Z,1654495443.715 [CommandExec](IMPORTANT): got command schedule pause 2022-06-06T06:04:03.715Z,1654495443.715 [CommandExec](IMPORTANT): Scheduling is paused 2022-06-06T06:07:49.796Z,1654495669.796 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 21.928503 min 2022-06-06T06:07:51.396Z,1654495671.396 [NAL9602](FAULT): GPS failed to acquire within timeout. 2022-06-06T06:13:36.706Z,1654496016.706 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T06:18:36.787Z,1654496316.787 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 32.710162 min 2022-06-06T06:18:38.309Z,1654496318.309 [NAL9602](FAULT): GPS failed to acquire within timeout. 2022-06-06T06:19:50.943Z,1654496390.943 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T061944 2022-06-06T06:19:58.529Z,1654496398.529 [CommandExec](IMPORTANT): got command schedule "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 3 h;set IsothermDepthSampling.MaxWaitNotAchievingDepth 0.5 h" 2j884 1 6.000000 2022-06-06T06:19:58.529Z,1654496398.529 [CommandExec](IMPORTANT): Scheduling command #1 of 6 with id=2j884 2022-06-06T06:19:58.530Z,1654496398.530 [CommandExec](IMPORTANT): Scheduled #64 (#1 of 6 with id='2j884'): "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 3 h;set IsothermDepthSampling.MaxWaitNotAchievingDepth 0.5 h", AFTER MISSION 2022-06-06T06:19:58.530Z,1654496398.530 [CommandExec](FAULT): Scheduling was paused by a command at 2022-06-06T06:04:03Z 2022-06-06T06:19:59.423Z,1654496399.423 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T061953 2022-06-06T06:20:06.959Z,1654496406.959 [CommandExec](IMPORTANT): got command schedule "set IsothermDepthSampling.SendSampleStatusAndData 1 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.InitialDiveDuration 1 min;set IsothermDepthSampling.SpeedSampling 1 m/s" 2j884 2 6.000000 2022-06-06T06:20:06.959Z,1654496406.959 [CommandExec](IMPORTANT): Scheduling command #2 of 6 with id=2j884 2022-06-06T06:20:06.962Z,1654496406.962 [CommandExec](IMPORTANT): Scheduled #65 (#2 of 6 with id='2j884'): "set IsothermDepthSampling.SendSampleStatusAndData 1 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.InitialDiveDuration 1 min;set IsothermDepthSampling.SpeedSampling 1 m/s", AFTER MISSION 2022-06-06T06:20:06.962Z,1654496406.962 [CommandExec](FAULT): Scheduling was paused by a command at 2022-06-06T06:04:03Z 2022-06-06T06:20:07.902Z,1654496407.902 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T062001 2022-06-06T06:20:15.520Z,1654496415.520 [CommandExec](IMPORTANT): got command schedule "set IsothermDepthSampling.HeadingLeavingSide0 210 degree;set IsothermDepthSampling.HeadingLeavingSide2 30 degree;set IsothermDepthSampling.HeadingLeavingSide3 120 degree;set IsothermDepthSampling.MaxDepth 30 m" 2j884 3 6.000000 2022-06-06T06:20:15.521Z,1654496415.521 [CommandExec](IMPORTANT): Scheduling command #3 of 6 with id=2j884 2022-06-06T06:20:15.522Z,1654496415.522 [CommandExec](IMPORTANT): Scheduled #66 (#3 of 6 with id='2j884'): "set IsothermDepthSampling.HeadingLeavingSide0 210 degree;set IsothermDepthSampling.HeadingLeavingSide2 30 degree;set IsothermDepthSampling.HeadingLeavingSide3 120 degree;set IsothermDepthSampling.MaxDepth 30 m", AFTER MISSION 2022-06-06T06:20:15.523Z,1654496415.523 [CommandExec](FAULT): Scheduling was paused by a command at 2022-06-06T06:04:03Z 2022-06-06T06:20:16.507Z,1654496416.507 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T062010 2022-06-06T06:20:24.079Z,1654496424.079 [CommandExec](IMPORTANT): got command schedule "set IsothermDepthSampling.DeepBoundSampler 45 m;set IsothermDepthSampling.ShallowBoundChl 2 m;set IsothermDepthSampling.DeepBoundChl 15 m;set IsothermDepthSampling.CartridgeTypeCommon NaN count" 2j884 4 6.000000 2022-06-06T06:20:24.079Z,1654496424.079 [CommandExec](IMPORTANT): Scheduling command #4 of 6 with id=2j884 2022-06-06T06:20:24.080Z,1654496424.080 [CommandExec](IMPORTANT): Scheduled #67 (#4 of 6 with id='2j884'): "set IsothermDepthSampling.DeepBoundSampler 45 m;set IsothermDepthSampling.ShallowBoundChl 2 m;set IsothermDepthSampling.DeepBoundChl 15 m;set IsothermDepthSampling.CartridgeTypeCommon NaN count", AFTER MISSION 2022-06-06T06:20:24.080Z,1654496424.080 [CommandExec](FAULT): Scheduling was paused by a command at 2022-06-06T06:04:03Z 2022-06-06T06:20:25.062Z,1654496425.062 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T062018 2022-06-06T06:20:32.751Z,1654496432.751 [CommandExec](IMPORTANT): got command schedule "set IsothermDepthSampling.CartridgeType1 -6 count;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.DepDiffFromPeakChl1 0 m;set IsothermDepthSampling.DepDiffFromPeakChl2 0 m" 2j884 5 6.000000 2022-06-06T06:20:32.751Z,1654496432.751 [CommandExec](IMPORTANT): Scheduling command #5 of 6 with id=2j884 2022-06-06T06:20:32.752Z,1654496432.752 [CommandExec](IMPORTANT): Scheduled #68 (#5 of 6 with id='2j884'): "set IsothermDepthSampling.CartridgeType1 -6 count;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.DepDiffFromPeakChl1 0 m;set IsothermDepthSampling.DepDiffFromPeakChl2 0 m", AFTER MISSION 2022-06-06T06:20:32.753Z,1654496432.753 [CommandExec](FAULT): Scheduling was paused by a command at 2022-06-06T06:04:03Z 2022-06-06T06:20:33.658Z,1654496433.658 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T062027 2022-06-06T06:20:43.900Z,1654496443.900 [CommandExec](IMPORTANT): got command schedule "set IsothermDepthSampling.WaitDepUndulation1 20 min;set IsothermDepthSampling.WaitDepUndulation2 5.0 min;run" 2j884 6 6.000000 2022-06-06T06:20:43.900Z,1654496443.900 [CommandExec](IMPORTANT): Scheduling command #6 of 6 with id=2j884 2022-06-06T06:20:43.901Z,1654496443.901 [CommandExec](IMPORTANT): Scheduled #69 (#6 of 6 with id='2j884'): "set IsothermDepthSampling.WaitDepUndulation1 20 min;set IsothermDepthSampling.WaitDepUndulation2 5.0 min;run", AFTER MISSION 2022-06-06T06:20:43.902Z,1654496443.902 [CommandExec](FAULT): Scheduling was paused by a command at 2022-06-06T06:04:03Z 2022-06-06T06:21:12.471Z,1654496472.471 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T062106 2022-06-06T06:21:20.165Z,1654496480.165 [CommandExec](IMPORTANT): got command schedule asap "load Science/trackPatch_yoyo.xml;set trackPatch_yoyo.MissionTimeout 6 h;set trackPatch_yoyo.MaxDepth 20 m;set trackPatch_yoyo.MinOffshore 1500 m;set trackPatch_yoyo.NeedCommsTimePatchTracking 300 min" 2j8aw 1 2.000000 2022-06-06T06:21:20.166Z,1654496480.166 [CommandExec](IMPORTANT): Scheduling command #1 of 2 with id=2j8aw 2022-06-06T06:21:20.167Z,1654496480.167 [CommandExec](IMPORTANT): Scheduled #70 (#1 of 2 with id='2j8aw'): "load Science/trackPatch_yoyo.xml;set trackPatch_yoyo.MissionTimeout 6 h;set trackPatch_yoyo.MaxDepth 20 m;set trackPatch_yoyo.MinOffshore 1500 m;set trackPatch_yoyo.NeedCommsTimePatchTracking 300 min", ASAP 2022-06-06T06:21:21.083Z,1654496481.083 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T062114 2022-06-06T06:21:28.601Z,1654496488.601 [CommandExec](IMPORTANT): got command schedule asap "set trackPatch_yoyo.NumRoundsBtnCrossLegSurfacings 5 count;set trackPatch_yoyo.WpMaxDistance 1000 m;set trackPatch_yoyo.PatchTrackingYoYoMaxDepth 20 m;set trackPatch_yoyo.PeakShallowBnd 2 m;set trackPatch_yoyo.PeakDeepBnd 20 m;run" 2j8aw 2 2.000000 2022-06-06T06:21:28.602Z,1654496488.602 [CommandExec](IMPORTANT): Scheduling command #2 of 2 with id=2j8aw 2022-06-06T06:21:28.603Z,1654496488.603 [CommandExec](IMPORTANT): Scheduled #71 (#2 of 2 with id='2j8aw'): "set trackPatch_yoyo.NumRoundsBtnCrossLegSurfacings 5 count;set trackPatch_yoyo.WpMaxDistance 1000 m;set trackPatch_yoyo.PatchTrackingYoYoMaxDepth 20 m;set trackPatch_yoyo.PeakShallowBnd 2 m;set trackPatch_yoyo.PeakDeepBnd 20 m;run", ASAP 2022-06-06T06:21:28.728Z,1654496488.728 [CommandExec](IMPORTANT): got command load ./Missions/Science/trackPatch_yoyo.xml 2022-06-06T06:21:31.923Z,1654496491.923 [CommandExec](IMPORTANT): Loaded ./Missions/Science/trackPatch_yoyo.xml 2022-06-06T06:22:04.319Z,1654496524.319 [CommandExec](IMPORTANT): got command set trackPatch_yoyo.MissionTimeout 6 hour 2022-06-06T06:22:04.319Z,1654496524.319 [CommandExec](IMPORTANT): got command set trackPatch_yoyo.MaxDepth 20 meter 2022-06-06T06:22:04.321Z,1654496524.321 [CommandExec](IMPORTANT): got command set trackPatch_yoyo.MinOffshore 1500 meter 2022-06-06T06:22:04.322Z,1654496524.322 [CommandExec](IMPORTANT): got command set trackPatch_yoyo.NeedCommsTimePatchTracking 300 minute 2022-06-06T06:22:35.502Z,1654496555.502 [CommandExec](IMPORTANT): got command set trackPatch_yoyo.NumRoundsBtnCrossLegSurfacings 5 count 2022-06-06T06:22:35.503Z,1654496555.503 [CommandExec](IMPORTANT): got command set trackPatch_yoyo.WpMaxDistance 1000 meter 2022-06-06T06:22:35.504Z,1654496555.504 [CommandExec](IMPORTANT): got command set trackPatch_yoyo.PatchTrackingYoYoMaxDepth 20 meter 2022-06-06T06:22:35.524Z,1654496555.524 [CommandExec](IMPORTANT): got command set trackPatch_yoyo.PeakShallowBnd 2 meter 2022-06-06T06:22:35.525Z,1654496555.525 [CommandExec](IMPORTANT): got command set trackPatch_yoyo.PeakDeepBnd 20 meter 2022-06-06T06:22:35.525Z,1654496555.525 [CommandExec](IMPORTANT): got command run 2022-06-06T06:22:35.527Z,1654496555.527 [CommandExec](IMPORTANT): Running 2022-06-06T06:22:35.677Z,1654496555.677 [MissionManager](IMPORTANT): Started mission trackPatch_yoyo 2022-06-06T06:24:23.937Z,1654496663.937 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T06:25:39.726Z,1654496739.726 [trackPatch_yoyo:PatchTracking:CrossLegToPatchCenter:B](IMPORTANT): Bearing for CrossLeg: 270.000000 arcdeg 2022-06-06T06:25:42.632Z,1654496742.632 [trackPatch_yoyo:PatchTracking:CrossLegSearchForPeak:B](IMPORTANT): Bearing for continued CrossLeg: 270.000000 arcdeg 2022-06-06T06:26:21.613Z,1654496781.613 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:26:35.494Z,1654496795.494 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:26:49.614Z,1654496809.614 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:27:03.485Z,1654496823.485 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:27:17.345Z,1654496837.345 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:27:31.209Z,1654496851.209 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:27:45.325Z,1654496865.325 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:27:59.185Z,1654496879.185 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:28:13.045Z,1654496893.045 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:28:26.918Z,1654496906.918 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:28:49.095Z,1654496929.095 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:29:02.957Z,1654496942.957 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:29:16.821Z,1654496956.821 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:29:30.681Z,1654496970.681 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:29:44.801Z,1654496984.801 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:29:58.662Z,1654496998.662 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:30:12.521Z,1654497012.521 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:30:26.381Z,1654497026.381 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:30:40.494Z,1654497040.494 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:30:54.357Z,1654497054.357 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:31:19.317Z,1654497079.317 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:31:33.201Z,1654497093.201 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T06:42:35.672Z,1654497755.672 [trackPatch_yoyo:SyslogWpMaxDistanceReached:SyslogWpMaxDistanceReachedChl:A](IMPORTANT): WpMaxDistance reached. Patch value is 4.590695 ug/l at 34.378151 arcdeg , -119.549795 arcdeg , distance = 334.264706 m 2022-06-06T06:42:38.490Z,1654497758.490 [trackPatch_yoyo:PatchTracking:InLeg:B](IMPORTANT): Bearing for InLeg: 90.000000 arcdeg 2022-06-06T06:46:32.904Z,1654497992.904 [CBIT](IMPORTANT): Beginning ground fault scan 2022-06-06T06:46:44.236Z,1654498004.236 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.003348 CHAN A1 (24V): 0.003053 CHAN A2 (12V): -0.004566 CHAN A3 (5V): -0.003623 CHAN B0 (3.3V): 0.002241 CHAN B1 (3.15aV): -0.001741 CHAN B2 (3.15bV): -0.001644 CHAN B3 (GND): -0.001880 OPEN: 0.012025 Full Scale: +/- 1 mA 2022-06-06T06:48:17.434Z,1654498097.434 [trackPatch_yoyo:PatchTracking:InLeg:F](IMPORTANT): Bearing for OutLeg: 0.000000 arcdeg 2022-06-06T06:54:06.527Z,1654498446.527 [trackPatch_yoyo:PatchTracking:ChlPatchDetection:B](IMPORTANT): Peak found before WpMaxDistance is reached. Patch value is 4.590695 ug/l at 34.378151 arcdeg , -119.549795 arcdeg , distance = 352.973131 m 2022-06-06T06:54:08.934Z,1654498448.934 [trackPatch_yoyo:PatchTracking:CrossLegToPatchCenter:B](IMPORTANT): Bearing for CrossLeg: 180.000000 arcdeg 2022-06-06T07:00:08.129Z,1654498808.129 [trackPatch_yoyo:PatchTracking:CrossLegSearchForPeak:B](IMPORTANT): Bearing for continued CrossLeg: 180.000000 arcdeg 2022-06-06T07:16:58.993Z,1654499818.993 [trackPatch_yoyo:SyslogWpMaxDistanceReached:SyslogWpMaxDistanceReachedChl:A](IMPORTANT): WpMaxDistance reached. Patch value is 4.722527 ug/l at 34.373840 arcdeg , -119.553193 arcdeg , distance = 233.232417 m 2022-06-06T07:17:01.821Z,1654499821.821 [trackPatch_yoyo:PatchTracking:InLeg:B](IMPORTANT): Bearing for InLeg: 0.000000 arcdeg 2022-06-06T07:20:58.209Z,1654500058.209 [trackPatch_yoyo:PatchTracking:InLeg:F](IMPORTANT): Bearing for OutLeg: -270.000000 arcdeg 2022-06-06T07:23:50.094Z,1654500230.094 [trackPatch_yoyo:PatchTracking:ChlPatchDetection:B](IMPORTANT): Peak found before WpMaxDistance is reached. Patch value is 5.251108 ug/l at 34.372832 arcdeg , -119.553418 arcdeg , distance = 63.279918 m 2022-06-06T07:23:52.531Z,1654500232.531 [trackPatch_yoyo:PatchTracking:CrossLegToPatchCenter:B](IMPORTANT): Bearing for CrossLeg: -90.000000 arcdeg 2022-06-06T07:24:58.773Z,1654500298.773 [trackPatch_yoyo:PatchTracking:CrossLegSearchForPeak:B](IMPORTANT): Bearing for continued CrossLeg: -90.000000 arcdeg 2022-06-06T07:41:49.618Z,1654501309.618 [trackPatch_yoyo:SyslogWpMaxDistanceReached:SyslogWpMaxDistanceReachedChl:A](IMPORTANT): WpMaxDistance reached. Patch value is 5.402695 ug/l at 34.373538 arcdeg , -119.557329 arcdeg , distance = 495.216093 m 2022-06-06T07:41:52.439Z,1654501312.439 [trackPatch_yoyo:PatchTracking:InLeg:B](IMPORTANT): Bearing for InLeg: 90.000000 arcdeg 2022-06-06T07:45:36.263Z,1654501536.263 [trackPatch_yoyo:PatchTracking:ChlPatchDetection:B](IMPORTANT): Peak found before WpMaxDistance is reached. Patch value is 5.402695 ug/l at 34.373538 arcdeg , -119.557329 arcdeg , distance = 412.435009 m 2022-06-06T07:50:13.814Z,1654501813.814 [trackPatch_yoyo:PatchTracking:InLeg:F](IMPORTANT): Bearing for OutLeg: 0.000000 arcdeg 2022-06-06T07:57:48.750Z,1654502268.750 [trackPatch_yoyo:PatchTracking:ChlPatchDetection:B](IMPORTANT): Peak found before WpMaxDistance is reached. Patch value is 5.303643 ug/l at 34.374604 arcdeg , -119.559811 arcdeg , distance = 322.352653 m 2022-06-06T07:57:51.186Z,1654502271.186 [trackPatch_yoyo:PatchTracking:CrossLegToPatchCenter:B](IMPORTANT): Bearing for CrossLeg: 180.000000 arcdeg 2022-06-06T07:59:04.912Z,1654502344.912 [ThrusterHE](FAULT): getSpeed error serial timeout 2022-06-06T07:59:04.912Z,1654502344.912 [ThrusterHE](FAULT): Thruster uart error: serial timeout 2022-06-06T08:03:20.927Z,1654502600.927 [trackPatch_yoyo:PatchTracking:CrossLegSearchForPeak:B](IMPORTANT): Bearing for continued CrossLeg: 180.000000 arcdeg 2022-06-06T08:16:34.481Z,1654503394.481 [trackPatch_yoyo:PatchTracking:ChlPatchDetection:B](IMPORTANT): Peak found before WpMaxDistance is reached. Patch value is 5.325743 ug/l at 34.374439 arcdeg , -119.561410 arcdeg , distance = 460.482641 m 2022-06-06T08:16:36.475Z,1654503396.475 [trackPatch_yoyo:PatchTracking:InLeg:B](IMPORTANT): Bearing for InLeg: 0.000000 arcdeg 2022-06-06T08:18:07.485Z,1654503487.485 [ElevatorServo](FAULT): Elevator uart error - getPosition.serial timeout 2022-06-06T08:23:43.608Z,1654503823.608 [ElevatorServo](FAULT): Elevator uart error - getPosition.serial timeout 2022-06-06T08:24:22.723Z,1654503862.723 [trackPatch_yoyo:PatchTracking:InLeg:F](IMPORTANT): Bearing for OutLeg: -270.000000 arcdeg 2022-06-06T08:37:15.183Z,1654504635.183 [trackPatch_yoyo:PatchTracking:ChlPatchDetection:B](IMPORTANT): Peak found before WpMaxDistance is reached. Patch value is 5.425847 ug/l at 34.373601 arcdeg , -119.562014 arcdeg , distance = 406.518537 m 2022-06-06T08:37:18.023Z,1654504638.023 [trackPatch_yoyo:PatchTracking:CrossLegToPatchCenterThenSurface:B](IMPORTANT): Bearing for CrossLeg: -90.000000 arcdeg 2022-06-06T08:50:11.423Z,1654505411.423 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T08:51:04.361Z,1654505464.361 [trackPatch_yoyo:PatchTracking:CrossLegSearchForPeak:B](IMPORTANT): Bearing for continued CrossLeg: -90.000000 arcdeg 2022-06-06T08:56:04.609Z,1654505764.609 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T09:03:18.523Z,1654506198.523 [trackPatch_yoyo:PatchTracking:ChlPatchDetection:B](IMPORTANT): Peak found before WpMaxDistance is reached. Patch value is 4.987225 ug/l at 34.375393 arcdeg , -119.564999 arcdeg , distance = 678.841560 m 2022-06-06T09:03:20.536Z,1654506200.536 [trackPatch_yoyo:PatchTracking:InLeg:B](IMPORTANT): Bearing for InLeg: 90.000000 arcdeg 2022-06-06T09:14:47.376Z,1654506887.376 [trackPatch_yoyo:PatchTracking:InLeg:F](IMPORTANT): Bearing for OutLeg: 0.000000 arcdeg 2022-06-06T09:25:58.815Z,1654507558.815 [trackPatch_yoyo:PatchTracking:ChlPatchDetection:B](IMPORTANT): Peak found before WpMaxDistance is reached. Patch value is 4.781311 ug/l at 34.377235 arcdeg , -119.568042 arcdeg , distance = 493.116835 m 2022-06-06T09:26:01.232Z,1654507561.232 [trackPatch_yoyo:PatchTracking:CrossLegToPatchCenter:B](IMPORTANT): Bearing for CrossLeg: 180.000000 arcdeg 2022-06-06T09:34:21.821Z,1654508061.821 [trackPatch_yoyo:PatchTracking:CrossLegSearchForPeak:B](IMPORTANT): Bearing for continued CrossLeg: 180.000000 arcdeg 2022-06-06T09:51:12.314Z,1654509072.314 [trackPatch_yoyo:SyslogWpMaxDistanceReached:SyslogWpMaxDistanceReachedChl:A](IMPORTANT): WpMaxDistance reached. Patch value is 5.081487 ug/l at 34.376953 arcdeg , -119.570419 arcdeg , distance = 568.745437 m 2022-06-06T09:51:15.158Z,1654509075.158 [trackPatch_yoyo:PatchTracking:InLeg:B](IMPORTANT): Bearing for InLeg: 0.000000 arcdeg 2022-06-06T09:51:30.483Z,1654509090.483 [trackPatch_yoyo:PatchTracking:ChlPatchDetection:B](IMPORTANT): Peak found before WpMaxDistance is reached. Patch value is 5.081487 ug/l at 34.376953 arcdeg , -119.570419 arcdeg , distance = 613.955332 m 2022-06-06T10:00:50.849Z,1654509650.849 [trackPatch_yoyo:PatchTracking:InLeg:F](IMPORTANT): Bearing for OutLeg: -270.000000 arcdeg 2022-06-06T10:05:47.055Z,1654509947.055 [MassServo](FAULT): Bad Operand Error 2022-06-06T10:14:30.162Z,1654510470.162 [trackPatch_yoyo:PatchTracking:ChlPatchDetection:B](IMPORTANT): Peak found before WpMaxDistance is reached. Patch value is 4.813552 ug/l at 34.375975 arcdeg , -119.571617 arcdeg , distance = 468.375649 m 2022-06-06T10:14:32.568Z,1654510472.568 [trackPatch_yoyo:PatchTracking:CrossLegToPatchCenter:B](IMPORTANT): Bearing for CrossLeg: -90.000000 arcdeg 2022-06-06T10:17:54.673Z,1654510674.673 [ThrusterHE](FAULT): Could not get status:serial timeout 2022-06-06T10:22:27.765Z,1654510947.765 [trackPatch_yoyo:PatchTracking:CrossLegSearchForPeak:B](IMPORTANT): Bearing for continued CrossLeg: -90.000000 arcdeg 2022-06-06T10:36:10.333Z,1654511770.333 [trackPatch_yoyo:PatchTracking:ChlPatchDetection:B](IMPORTANT): Peak found before WpMaxDistance is reached. Patch value is 4.675630 ug/l at 34.377030 arcdeg , -119.573058 arcdeg , distance = 603.597489 m 2022-06-06T10:36:12.344Z,1654511772.344 [trackPatch_yoyo:PatchTracking:InLeg:B](IMPORTANT): Bearing for InLeg: 90.000000 arcdeg 2022-06-06T10:46:23.030Z,1654512383.030 [trackPatch_yoyo:PatchTracking:InLeg:F](IMPORTANT): Bearing for OutLeg: 0.000000 arcdeg 2022-06-06T11:01:59.490Z,1654513319.490 [trackPatch_yoyo:PatchTracking:ChlPatchDetection:B](IMPORTANT): Peak found before WpMaxDistance is reached. Patch value is 4.398852 ug/l at 34.379109 arcdeg , -119.575832 arcdeg , distance = 724.198878 m 2022-06-06T11:02:01.920Z,1654513321.920 [trackPatch_yoyo:PatchTracking:CrossLegToPatchCenter:B](IMPORTANT): Bearing for CrossLeg: 180.000000 arcdeg 2022-06-06T11:14:16.011Z,1654514056.011 [trackPatch_yoyo:PatchTracking:CrossLegSearchForPeak:B](IMPORTANT): Bearing for continued CrossLeg: 180.000000 arcdeg 2022-06-06T11:31:06.835Z,1654515066.835 [trackPatch_yoyo:SyslogWpMaxDistanceReached:SyslogWpMaxDistanceReachedChl:A](IMPORTANT): WpMaxDistance reached. Patch value is 4.553950 ug/l at 34.376001 arcdeg , -119.579431 arcdeg , distance = 231.109657 m 2022-06-06T11:31:09.659Z,1654515069.659 [trackPatch_yoyo:PatchTracking:InLeg:B](IMPORTANT): Bearing for InLeg: 0.000000 arcdeg 2022-06-06T11:35:04.389Z,1654515304.389 [trackPatch_yoyo:PatchTracking:InLeg:F](IMPORTANT): Bearing for OutLeg: -270.000000 arcdeg 2022-06-06T11:36:50.275Z,1654515410.275 [trackPatch_yoyo:PatchTracking:ChlPatchDetection:B](IMPORTANT): Peak found before WpMaxDistance is reached. Patch value is 4.792891 ug/l at 34.375519 arcdeg , -119.579561 arcdeg , distance = 13.060221 m 2022-06-06T11:36:52.695Z,1654515412.695 [trackPatch_yoyo:PatchTracking:CrossLegToPatchCenter:B](IMPORTANT): Bearing for CrossLeg: -90.000000 arcdeg 2022-06-06T11:37:08.462Z,1654515428.462 [trackPatch_yoyo:PatchTracking:CrossLegSearchForPeak:B](IMPORTANT): Bearing for continued CrossLeg: -90.000000 arcdeg 2022-06-06T11:53:08.211Z,1654516388.211 [trackPatch_yoyo:PatchTracking:ChlPatchDetection:B](IMPORTANT): Peak found before WpMaxDistance is reached. Patch value is 4.419018 ug/l at 34.375736 arcdeg , -119.582730 arcdeg , distance = 593.931045 m 2022-06-06T11:53:10.234Z,1654516390.234 [trackPatch_yoyo:PatchTracking:InLeg:B](IMPORTANT): Bearing for InLeg: 90.000000 arcdeg 2022-06-06T12:03:11.199Z,1654516991.199 [trackPatch_yoyo:PatchTracking:InLeg:F](IMPORTANT): Bearing for OutLeg: 0.000000 arcdeg 2022-06-06T12:03:51.312Z,1654517031.312 [ThrusterHE](FAULT): getSpeed error serial timeout 2022-06-06T12:03:51.313Z,1654517031.313 [ThrusterHE](FAULT): Thruster uart error: serial timeout 2022-06-06T12:15:18.578Z,1654517718.578 [Radio_Surface](FAULT): LCB fault: Hardware Overcurrent Shutdown. 2022-06-06T12:20:04.905Z,1654518004.905 [trackPatch_yoyo:SyslogWpMaxDistanceReached:SyslogWpMaxDistanceReachedChl:A](IMPORTANT): WpMaxDistance reached. Patch value is 3.907335 ug/l at 34.377472 arcdeg , -119.585506 arcdeg , distance = 689.548676 m 2022-06-06T12:20:08.539Z,1654518008.539 [trackPatch_yoyo:PatchTracking:CrossLegToPatchCenterThenSurface:B](IMPORTANT): Bearing for CrossLeg: 180.000000 arcdeg 2022-06-06T12:22:36.417Z,1654518156.417 [MissionManager](IMPORTANT): Started mission Default 2022-06-06T12:26:59.386Z,1654518419.386 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T122653 2022-06-06T12:27:07.116Z,1654518427.116 [CommandExec](IMPORTANT): got command stop 2022-06-06T12:27:07.116Z,1654518427.116 [CommandExec](IMPORTANT): got command schedule resume 2022-06-06T12:27:07.116Z,1654518427.116 [CommandExec](IMPORTANT): Scheduling is resumed 2022-06-06T12:27:07.257Z,1654518427.257 [CommandExec](IMPORTANT): got command load ./Missions/Science/isotherm_depth_sampling.xml 2022-06-06T12:27:23.481Z,1654518443.481 [CommandExec](IMPORTANT): Loaded ./Missions/Science/isotherm_depth_sampling.xml 2022-06-06T12:28:00.737Z,1654518480.737 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.NumSamplers 2 count 2022-06-06T12:28:00.738Z,1654518480.738 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MissionTimeout 6 hour 2022-06-06T12:28:00.739Z,1654518480.739 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNoFiring 3 hour 2022-06-06T12:28:00.739Z,1654518480.739 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNotAchievingDepth 0.5 hour 2022-06-06T12:28:23.633Z,1654518503.633 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T12:28:35.417Z,1654518515.417 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendSampleStatusAndData 1 bool 2022-06-06T12:28:35.418Z,1654518515.418 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SampleAtPeakChl 1 bool 2022-06-06T12:28:35.418Z,1654518515.418 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.InitialDiveDuration 1 minute 2022-06-06T12:28:35.419Z,1654518515.419 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SpeedSampling 1 meter_per_second 2022-06-06T12:29:16.577Z,1654518556.577 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.HeadingLeavingSide0 210 degree 2022-06-06T12:29:16.578Z,1654518556.578 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.HeadingLeavingSide2 30 degree 2022-06-06T12:29:16.579Z,1654518556.579 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.HeadingLeavingSide3 120 degree 2022-06-06T12:29:16.579Z,1654518556.579 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxDepth 30 meter 2022-06-06T12:29:57.495Z,1654518597.495 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundSampler 45 meter 2022-06-06T12:29:57.495Z,1654518597.495 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 2 meter 2022-06-06T12:29:57.496Z,1654518597.496 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 15 meter 2022-06-06T12:29:57.497Z,1654518597.497 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeTypeCommon NaN count 2022-06-06T12:30:25.813Z,1654518625.813 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType1 -6 count 2022-06-06T12:30:25.814Z,1654518625.814 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType2 -10 count 2022-06-06T12:30:25.815Z,1654518625.815 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChl1 0 meter 2022-06-06T12:30:25.815Z,1654518625.815 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChl2 0 meter 2022-06-06T12:30:46.325Z,1654518646.325 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 20 minute 2022-06-06T12:30:46.326Z,1654518646.326 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation2 5.0 minute 2022-06-06T12:30:46.327Z,1654518646.327 [CommandExec](IMPORTANT): got command run 2022-06-06T12:30:46.330Z,1654518646.330 [CommandExec](IMPORTANT): Running 2022-06-06T12:30:46.642Z,1654518646.642 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling 2022-06-06T12:30:46.782Z,1654518646.782 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 21.00 hours. 2022-06-06T12:35:51.762Z,1654518951.762 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T12:36:05.517Z,1654518965.517 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.359142 m 2022-06-06T12:37:15.033Z,1654519035.033 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , nan K , 0.000000 m , nan degC , nan m , 20.000000 min . 2022-06-06T12:39:21.094Z,1654519161.094 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoUp:B](IMPORTANT): Go up from 18.055981 m 2022-06-06T12:41:10.564Z,1654519270.564 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:SetChlPeakTempDepth:L](IMPORTANT): Set peak-chl depth and temp. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlTemperatureSet, PeakChlSet = 12.803374 m , 2.828800 ug/l , 14.582609 m , 15.443599 degC , 3.788716 ug/l 2022-06-06T12:41:10.971Z,1654519270.971 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 1.000000 count . Target depth = 14.582609 m . 2022-06-06T12:41:11.389Z,1654519271.389 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -6.000000 count 2022-06-06T12:43:27.113Z,1654519407.113 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 14.597795 m , settling for 20.000000 min 2022-06-06T12:46:44.372Z,1654519604.372 [CBIT](IMPORTANT): Beginning ground fault scan 2022-06-06T12:46:55.238Z,1654519615.238 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): -0.002607 CHAN A1 (24V): 0.003166 CHAN A2 (12V): -0.005732 CHAN A3 (5V): -0.003846 CHAN B0 (3.3V): -0.001182 CHAN B1 (3.15aV): -0.001676 CHAN B2 (3.15bV): -0.001052 CHAN B3 (GND): -0.000483 OPEN: 0.012091 Full Scale: +/- 1 mA 2022-06-06T13:03:40.001Z,1654520620.001 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-06-06T13:03:40.357Z,1654520620.357 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-06-06T13:04:36.729Z,1654520676.729 [ESPComponent](IMPORTANT): ESP has connected as client 2022-06-06T13:04:37.551Z,1654520677.551 [ESPComponent](IMPORTANT): [sample #9] Setting cartridge argument to -6 2022-06-06T13:04:37.551Z,1654520677.551 [ESPComponent](IMPORTANT): [sample #9] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-06-06T13:04:38.011Z,1654520678.011 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 14.439808 m in 15.463526 degC water with 3.949920 ug/l chlorophyll fluorescence. 2022-06-06T13:04:38.350Z,1654520678.350 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PREPARING_SHOW_LOG 2022-06-06T13:04:38.755Z,1654520678.755 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-06-06T13:04:40.776Z,1654520680.776 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_LOADING_CARTRIDGE 2022-06-06T13:05:20.372Z,1654520720.372 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_PRIMING (@22,archive_bac) 2022-06-06T13:05:22.791Z,1654520722.791 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PRIMING (@100.0) 2022-06-06T13:05:22.792Z,1654520722.792 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-06-06T13:05:23.194Z,1654520723.194 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-06-06T13:07:33.690Z,1654520853.690 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_FILTERING (@0.0) 2022-06-06T13:07:34.094Z,1654520854.094 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-06-06T13:40:47.067Z,1654522847.067 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PAUSED (@535.0) 2022-06-06T13:40:47.470Z,1654522847.470 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PROCESSING (@535.0) 2022-06-06T13:40:49.490Z,1654522849.490 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2022-06-06T13:40:49.894Z,1654522849.894 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_PROCESSED (@22,archive_bac) 2022-06-06T13:52:54.279Z,1654523574.279 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_STOPPING (@22,archive_bac) 2022-06-06T13:53:03.578Z,1654523583.578 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-06-06T13:53:04.090Z,1654523584.090 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_STOPPED 2022-06-06T13:58:03.859Z,1654523883.859 [ESPComponent](IMPORTANT): [sample #9] ESP sampling sequence completed normally. 2022-06-06T13:58:04.730Z,1654523884.730 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 1.000000 count completed. 2022-06-06T13:58:06.763Z,1654523886.763 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataCntSamples:A](IMPORTANT): CntSamples = 1.000000 count 2022-06-06T13:58:07.965Z,1654523887.965 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleNumber:A](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2022-06-06T13:58:09.209Z,1654523889.209 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPCartridgeType:A](IMPORTANT): Science:ESPComponent.cartridge = -6 count 2022-06-06T13:58:10.369Z,1654523890.369 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleVolume:A](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2022-06-06T13:58:12.010Z,1654523892.010 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleDep:A](IMPORTANT): Universal:depth = 13.920966 m 2022-06-06T13:58:13.664Z,1654523893.664 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleChl:A](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 4.066400 ug/l 2022-06-06T13:58:20.953Z,1654523900.953 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T13:58:30.186Z,1654523910.186 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -10.000000 count , nan K , 0.000000 m , nan degC , nan m , 5.000000 min . 2022-06-06T13:58:33.815Z,1654523913.815 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 2.000000 count . Target depth = 14.582609 m . 2022-06-06T13:58:34.225Z,1654523914.225 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -10.000000 count 2022-06-06T13:58:34.817Z,1654523914.817 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T13:58:38.692Z,1654523918.692 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 14.622036 m , settling for 5.000000 min 2022-06-06T13:58:48.685Z,1654523928.685 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T13:59:02.549Z,1654523942.549 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T13:59:16.673Z,1654523956.673 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T13:59:30.538Z,1654523970.538 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T13:59:44.410Z,1654523984.410 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T13:59:58.288Z,1654523998.288 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T14:00:12.417Z,1654524012.417 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T14:00:26.281Z,1654524026.281 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T14:00:40.150Z,1654524040.150 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T14:00:54.022Z,1654524054.022 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T14:01:08.141Z,1654524068.141 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T14:01:22.013Z,1654524082.013 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T14:01:35.873Z,1654524095.873 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T14:01:49.741Z,1654524109.741 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T14:02:03.857Z,1654524123.857 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T14:02:17.725Z,1654524137.725 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T14:02:31.607Z,1654524151.607 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T14:02:45.481Z,1654524165.481 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T14:02:59.599Z,1654524179.599 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T14:03:13.464Z,1654524193.464 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T14:03:27.329Z,1654524207.329 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T14:03:41.205Z,1654524221.205 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T14:03:51.417Z,1654524231.417 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-06-06T14:03:51.592Z,1654524231.592 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-06-06T14:04:45.538Z,1654524285.538 [ESPComponent](IMPORTANT): ESP has connected as client 2022-06-06T14:04:46.349Z,1654524286.349 [ESPComponent](IMPORTANT): [sample #10] Setting cartridge argument to -10 2022-06-06T14:04:46.350Z,1654524286.350 [ESPComponent](IMPORTANT): [sample #10] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-06-06T14:04:46.889Z,1654524286.889 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 14.128775 m in 15.419245 degC water with 3.827200 ug/l chlorophyll fluorescence. 2022-06-06T14:04:47.155Z,1654524287.155 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PREPARING_SHOW_LOG 2022-06-06T14:04:47.558Z,1654524287.558 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-06-06T14:04:49.580Z,1654524289.580 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_LOADING_CARTRIDGE 2022-06-06T14:05:29.978Z,1654524329.978 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PRIMING (@21,daSPR_phyto) 2022-06-06T14:05:32.816Z,1654524332.816 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PRIMING (@100.0) 2022-06-06T14:05:32.828Z,1654524332.828 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-06-06T14:05:33.218Z,1654524333.218 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-06-06T14:07:42.506Z,1654524462.506 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_FILTERING (@0.0) 2022-06-06T14:07:42.910Z,1654524462.910 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-06-06T14:41:44.366Z,1654526504.366 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PAUSED (@562.9) 2022-06-06T14:41:44.770Z,1654526504.770 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PROCESSING (@562.9) 2022-06-06T14:41:46.792Z,1654526506.792 [ESPComponent](IMPORTANT): Processing timeoutMinutes=120.000000 issuedCmd_=Cmd.startProcessing 2022-06-06T14:41:47.194Z,1654526507.194 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PROCESSED (@21,daSPR_phyto) 2022-06-06T15:42:35.878Z,1654530155.878 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_STOPPING (@21,daSPR_phyto) 2022-06-06T15:42:46.791Z,1654530166.791 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-06-06T15:42:47.244Z,1654530167.244 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_STOPPED 2022-06-06T15:47:47.414Z,1654530467.414 [ESPComponent](IMPORTANT): [sample #10] ESP sampling sequence completed normally. 2022-06-06T15:47:48.299Z,1654530468.299 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 2.000000 count completed. 2022-06-06T15:47:50.327Z,1654530470.327 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataCntSamples:A](IMPORTANT): CntSamples = 2.000000 count 2022-06-06T15:47:51.520Z,1654530471.520 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleNumber:A](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2022-06-06T15:47:52.769Z,1654530472.769 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPCartridgeType:A](IMPORTANT): Science:ESPComponent.cartridge = -10 count 2022-06-06T15:47:53.982Z,1654530473.982 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleVolume:A](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2022-06-06T15:47:55.628Z,1654530475.628 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleDep:A](IMPORTANT): Universal:depth = 13.902123 m 2022-06-06T15:47:57.227Z,1654530477.227 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleChl:A](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 4.326400 ug/l 2022-06-06T15:48:00.125Z,1654530480.125 [MissionManager](IMPORTANT): Started mission Default 2022-06-06T15:48:04.501Z,1654530484.501 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T15:48:18.370Z,1654530498.370 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T15:48:32.233Z,1654530512.233 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T15:53:48.646Z,1654530828.646 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T15:59:23.199Z,1654531163.199 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.377976 min 2022-06-06T15:59:24.800Z,1654531164.800 [NAL9602](FAULT): GPS failed to acquire within timeout. 2022-06-06T15:59:24.819Z,1654531164.819 [CBIT](CRITICAL): Data Fault in component: NAL9602 2022-06-06T15:59:25.236Z,1654531165.236 [CommandExec](FAULT): Scheduling is paused 2022-06-06T16:06:40.037Z,1654531600.037 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T16:10:04.892Z,1654531804.892 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 22.072786 min 2022-06-06T16:13:08.270Z,1654531988.270 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T161302 2022-06-06T16:13:15.793Z,1654531995.793 [CommandExec](IMPORTANT): got command schedule clear 2022-06-06T16:13:15.793Z,1654531995.793 [CommandExec](IMPORTANT): Cleared 0 scheduled commands. 2022-06-06T16:13:15.793Z,1654531995.793 [CommandExec](IMPORTANT): got command schedule pause 2022-06-06T16:13:15.793Z,1654531995.793 [CommandExec](IMPORTANT): Scheduling is paused 2022-06-06T16:14:18.167Z,1654532058.167 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T161411 2022-06-06T16:14:25.781Z,1654532065.781 [CommandExec](IMPORTANT): got command schedule "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 3 h;set IsothermDepthSampling.MaxWaitNotAchievingDepth 0.5 h" 2jzr0 1 6.000000 2022-06-06T16:14:25.782Z,1654532065.782 [CommandExec](IMPORTANT): Scheduling command #1 of 6 with id=2jzr0 2022-06-06T16:14:25.783Z,1654532065.783 [CommandExec](IMPORTANT): Scheduled #72 (#1 of 6 with id='2jzr0'): "load Science/isotherm_depth_sampling.xml;set IsothermDepthSampling.NumSamplers 2 count;set IsothermDepthSampling.MissionTimeout 6 h;set IsothermDepthSampling.MaxWaitNoFiring 3 h;set IsothermDepthSampling.MaxWaitNotAchievingDepth 0.5 h", AFTER MISSION 2022-06-06T16:14:25.783Z,1654532065.783 [CommandExec](FAULT): Scheduling was paused by a command at 2022-06-06T16:13:15Z 2022-06-06T16:14:26.763Z,1654532066.763 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T161420 2022-06-06T16:14:34.588Z,1654532074.588 [CommandExec](IMPORTANT): got command schedule "set IsothermDepthSampling.SendSampleStatusAndData 1 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.InitialDiveDuration 1 min;set IsothermDepthSampling.SpeedSampling 1 m/s" 2jzr0 2 6.000000 2022-06-06T16:14:34.589Z,1654532074.589 [CommandExec](IMPORTANT): Scheduling command #2 of 6 with id=2jzr0 2022-06-06T16:14:34.590Z,1654532074.590 [CommandExec](IMPORTANT): Scheduled #73 (#2 of 6 with id='2jzr0'): "set IsothermDepthSampling.SendSampleStatusAndData 1 bool;set IsothermDepthSampling.SampleAtPeakChl 1 bool;set IsothermDepthSampling.InitialDiveDuration 1 min;set IsothermDepthSampling.SpeedSampling 1 m/s", AFTER MISSION 2022-06-06T16:14:34.590Z,1654532074.590 [CommandExec](FAULT): Scheduling was paused by a command at 2022-06-06T16:13:15Z 2022-06-06T16:14:35.566Z,1654532075.566 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T161429 2022-06-06T16:14:46.262Z,1654532086.262 [CommandExec](IMPORTANT): got command schedule "set IsothermDepthSampling.HeadingLeavingSide0 210 degree;set IsothermDepthSampling.HeadingLeavingSide2 30 degree;set IsothermDepthSampling.HeadingLeavingSide3 120 degree;set IsothermDepthSampling.MaxDepth 30 m" 2jzr0 3 6.000000 2022-06-06T16:14:46.262Z,1654532086.262 [CommandExec](IMPORTANT): Scheduling command #3 of 6 with id=2jzr0 2022-06-06T16:14:46.263Z,1654532086.263 [CommandExec](IMPORTANT): Scheduled #74 (#3 of 6 with id='2jzr0'): "set IsothermDepthSampling.HeadingLeavingSide0 210 degree;set IsothermDepthSampling.HeadingLeavingSide2 30 degree;set IsothermDepthSampling.HeadingLeavingSide3 120 degree;set IsothermDepthSampling.MaxDepth 30 m", AFTER MISSION 2022-06-06T16:14:46.264Z,1654532086.264 [CommandExec](FAULT): Scheduling was paused by a command at 2022-06-06T16:13:15Z 2022-06-06T16:14:47.151Z,1654532087.151 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T161440 2022-06-06T16:14:57.707Z,1654532097.707 [CommandExec](IMPORTANT): got command schedule "set IsothermDepthSampling.DeepBoundSampler 45 m;set IsothermDepthSampling.ShallowBoundChl 2 m;set IsothermDepthSampling.DeepBoundChl 15 m;set IsothermDepthSampling.CartridgeTypeCommon NaN count" 2jzr0 4 6.000000 2022-06-06T16:14:57.707Z,1654532097.707 [CommandExec](IMPORTANT): Scheduling command #4 of 6 with id=2jzr0 2022-06-06T16:14:57.709Z,1654532097.709 [CommandExec](IMPORTANT): Scheduled #75 (#4 of 6 with id='2jzr0'): "set IsothermDepthSampling.DeepBoundSampler 45 m;set IsothermDepthSampling.ShallowBoundChl 2 m;set IsothermDepthSampling.DeepBoundChl 15 m;set IsothermDepthSampling.CartridgeTypeCommon NaN count", AFTER MISSION 2022-06-06T16:14:57.709Z,1654532097.709 [CommandExec](FAULT): Scheduling was paused by a command at 2022-06-06T16:13:15Z 2022-06-06T16:14:58.603Z,1654532098.603 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T161452 2022-06-06T16:15:06.343Z,1654532106.343 [CommandExec](IMPORTANT): got command schedule "set IsothermDepthSampling.CartridgeType1 -6 count;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.DepDiffFromPeakChl1 0 m;set IsothermDepthSampling.DepDiffFromPeakChl2 0 m" 2jzr0 5 6.000000 2022-06-06T16:15:06.344Z,1654532106.344 [CommandExec](IMPORTANT): Scheduling command #5 of 6 with id=2jzr0 2022-06-06T16:15:06.345Z,1654532106.345 [CommandExec](IMPORTANT): Scheduled #76 (#5 of 6 with id='2jzr0'): "set IsothermDepthSampling.CartridgeType1 -6 count;set IsothermDepthSampling.CartridgeType2 -10 count;set IsothermDepthSampling.DepDiffFromPeakChl1 0 m;set IsothermDepthSampling.DepDiffFromPeakChl2 0 m", AFTER MISSION 2022-06-06T16:15:06.345Z,1654532106.345 [CommandExec](FAULT): Scheduling was paused by a command at 2022-06-06T16:13:15Z 2022-06-06T16:15:07.314Z,1654532107.314 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T161501 2022-06-06T16:15:09.674Z,1654532109.674 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T16:15:14.909Z,1654532114.909 [CommandExec](IMPORTANT): got command schedule "set IsothermDepthSampling.WaitDepUndulation1 20 min;set IsothermDepthSampling.WaitDepUndulation2 5.0 min;run" 2jzr0 6 6.000000 2022-06-06T16:15:14.909Z,1654532114.909 [CommandExec](IMPORTANT): Scheduling command #6 of 6 with id=2jzr0 2022-06-06T16:15:14.911Z,1654532114.911 [CommandExec](IMPORTANT): Scheduled #77 (#6 of 6 with id='2jzr0'): "set IsothermDepthSampling.WaitDepUndulation1 20 min;set IsothermDepthSampling.WaitDepUndulation2 5.0 min;run", AFTER MISSION 2022-06-06T16:15:14.911Z,1654532114.911 [CommandExec](FAULT): Scheduling was paused by a command at 2022-06-06T16:13:15Z 2022-06-06T16:15:50.498Z,1654532150.498 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 27.832784 min 2022-06-06T16:18:08.819Z,1654532288.819 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T161802 2022-06-06T16:18:16.401Z,1654532296.401 [CommandExec](IMPORTANT): got command schedule asap "load Science/trackPatch_yoyo.xml;set trackPatch_yoyo.MissionTimeout 6 h;set trackPatch_yoyo.MaxDepth 20 m;set trackPatch_yoyo.MinOffshore 1500 m;set trackPatch_yoyo.NeedCommsTimePatchTracking 300 min" 2jzxr 1 2.000000 2022-06-06T16:18:16.401Z,1654532296.401 [CommandExec](IMPORTANT): Scheduling command #1 of 2 with id=2jzxr 2022-06-06T16:18:16.402Z,1654532296.402 [CommandExec](IMPORTANT): Scheduled #78 (#1 of 2 with id='2jzxr'): "load Science/trackPatch_yoyo.xml;set trackPatch_yoyo.MissionTimeout 6 h;set trackPatch_yoyo.MaxDepth 20 m;set trackPatch_yoyo.MinOffshore 1500 m;set trackPatch_yoyo.NeedCommsTimePatchTracking 300 min", ASAP 2022-06-06T16:18:17.367Z,1654532297.367 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T161811 2022-06-06T16:18:24.955Z,1654532304.955 [CommandExec](IMPORTANT): got command schedule asap "set trackPatch_yoyo.NumRoundsBtnCrossLegSurfacings 5 count;set trackPatch_yoyo.WpMaxDistance 1000 m;set trackPatch_yoyo.PatchTrackingYoYoMaxDepth 20 m;set trackPatch_yoyo.PeakShallowBnd 2 m;set trackPatch_yoyo.PeakDeepBnd 20 m;run" 2jzxr 2 2.000000 2022-06-06T16:18:24.955Z,1654532304.955 [CommandExec](IMPORTANT): Scheduling command #2 of 2 with id=2jzxr 2022-06-06T16:18:24.956Z,1654532304.956 [CommandExec](IMPORTANT): Scheduled #79 (#2 of 2 with id='2jzxr'): "set trackPatch_yoyo.NumRoundsBtnCrossLegSurfacings 5 count;set trackPatch_yoyo.WpMaxDistance 1000 m;set trackPatch_yoyo.PatchTrackingYoYoMaxDepth 20 m;set trackPatch_yoyo.PeakShallowBnd 2 m;set trackPatch_yoyo.PeakDeepBnd 20 m;run", ASAP 2022-06-06T16:18:25.084Z,1654532305.084 [CommandExec](IMPORTANT): got command load ./Missions/Science/trackPatch_yoyo.xml 2022-06-06T16:18:28.327Z,1654532308.327 [CommandExec](IMPORTANT): Loaded ./Missions/Science/trackPatch_yoyo.xml 2022-06-06T16:18:59.725Z,1654532339.725 [CommandExec](IMPORTANT): got command set trackPatch_yoyo.MissionTimeout 6 hour 2022-06-06T16:18:59.726Z,1654532339.726 [CommandExec](IMPORTANT): got command set trackPatch_yoyo.MaxDepth 20 meter 2022-06-06T16:18:59.727Z,1654532339.727 [CommandExec](IMPORTANT): got command set trackPatch_yoyo.MinOffshore 1500 meter 2022-06-06T16:18:59.727Z,1654532339.727 [CommandExec](IMPORTANT): got command set trackPatch_yoyo.NeedCommsTimePatchTracking 300 minute 2022-06-06T16:19:40.259Z,1654532380.259 [CommandExec](IMPORTANT): got command set trackPatch_yoyo.NumRoundsBtnCrossLegSurfacings 5 count 2022-06-06T16:19:40.260Z,1654532380.260 [CommandExec](IMPORTANT): got command set trackPatch_yoyo.WpMaxDistance 1000 meter 2022-06-06T16:19:40.262Z,1654532380.262 [CommandExec](IMPORTANT): got command set trackPatch_yoyo.PatchTrackingYoYoMaxDepth 20 meter 2022-06-06T16:19:40.263Z,1654532380.263 [CommandExec](IMPORTANT): got command set trackPatch_yoyo.PeakShallowBnd 2 meter 2022-06-06T16:19:40.263Z,1654532380.263 [CommandExec](IMPORTANT): got command set trackPatch_yoyo.PeakDeepBnd 20 meter 2022-06-06T16:19:40.264Z,1654532380.264 [CommandExec](IMPORTANT): got command run 2022-06-06T16:19:40.266Z,1654532380.266 [CommandExec](IMPORTANT): Running 2022-06-06T16:19:40.374Z,1654532380.374 [MissionManager](IMPORTANT): Started mission trackPatch_yoyo 2022-06-06T16:20:54.674Z,1654532454.674 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T16:22:19.287Z,1654532539.287 [trackPatch_yoyo:PatchTracking:CrossLegToPatchCenter:B](IMPORTANT): Bearing for CrossLeg: 270.000000 arcdeg 2022-06-06T16:22:22.166Z,1654532542.166 [trackPatch_yoyo:PatchTracking:CrossLegSearchForPeak:B](IMPORTANT): Bearing for continued CrossLeg: 270.000000 arcdeg 2022-06-06T16:23:10.598Z,1654532590.598 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:23:24.710Z,1654532604.710 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:23:38.573Z,1654532618.573 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:23:52.473Z,1654532632.473 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:24:06.339Z,1654532646.339 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:24:20.450Z,1654532660.450 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:24:34.313Z,1654532674.313 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:24:48.181Z,1654532688.181 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:25:02.041Z,1654532702.041 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:25:26.009Z,1654532726.009 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:25:39.869Z,1654532739.869 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:25:53.729Z,1654532753.729 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:26:07.590Z,1654532767.590 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:26:21.706Z,1654532781.706 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:26:35.586Z,1654532795.586 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:26:49.489Z,1654532809.489 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:27:03.353Z,1654532823.353 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:27:17.471Z,1654532837.471 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:27:19.837Z,1654532839.837 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T16:27:31.329Z,1654532851.329 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:27:50.741Z,1654532870.741 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:28:04.621Z,1654532884.621 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T16:39:16.167Z,1654533556.167 [trackPatch_yoyo:SyslogWpMaxDistanceReached:SyslogWpMaxDistanceReachedChl:A](IMPORTANT): WpMaxDistance reached. Patch value is 4.006858 ug/l at 34.376914 arcdeg , -119.613244 arcdeg , distance = 748.140627 m 2022-06-06T16:39:18.982Z,1654533558.982 [trackPatch_yoyo:PatchTracking:InLeg:B](IMPORTANT): Bearing for InLeg: 90.000000 arcdeg 2022-06-06T16:51:55.399Z,1654534315.399 [trackPatch_yoyo:PatchTracking:InLeg:F](IMPORTANT): Bearing for OutLeg: 0.000000 arcdeg 2022-06-06T17:04:32.536Z,1654535072.536 [trackPatch_yoyo:PatchTracking:ChlPatchDetection:B](IMPORTANT): Peak found before WpMaxDistance is reached. Patch value is 4.006858 ug/l at 34.376914 arcdeg , -119.613244 arcdeg , distance = 856.023576 m 2022-06-06T17:04:34.956Z,1654535074.956 [trackPatch_yoyo:PatchTracking:CrossLegToPatchCenter:B](IMPORTANT): Bearing for CrossLeg: 180.000000 arcdeg 2022-06-06T17:19:01.711Z,1654535941.711 [trackPatch_yoyo:PatchTracking:CrossLegSearchForPeak:B](IMPORTANT): Bearing for continued CrossLeg: 180.000000 arcdeg 2022-06-06T17:35:52.580Z,1654536952.580 [trackPatch_yoyo:SyslogWpMaxDistanceReached:SyslogWpMaxDistanceReachedChl:A](IMPORTANT): WpMaxDistance reached. Patch value is 5.885351 ug/l at 34.373274 arcdeg , -119.619511 arcdeg , distance = 241.719938 m 2022-06-06T17:35:55.395Z,1654536955.395 [trackPatch_yoyo:PatchTracking:InLeg:B](IMPORTANT): Bearing for InLeg: 0.000000 arcdeg 2022-06-06T17:40:00.636Z,1654537200.636 [trackPatch_yoyo:PatchTracking:InLeg:F](IMPORTANT): Bearing for OutLeg: -270.000000 arcdeg 2022-06-06T17:42:53.580Z,1654537373.580 [trackPatch_yoyo:PatchTracking:ChlPatchDetection:B](IMPORTANT): Peak found before WpMaxDistance is reached. Patch value is 7.237220 ug/l at 34.371726 arcdeg , -119.619866 arcdeg , distance = 106.885045 m 2022-06-06T17:42:55.994Z,1654537375.994 [trackPatch_yoyo:PatchTracking:CrossLegToPatchCenter:B](IMPORTANT): Bearing for CrossLeg: -90.000000 arcdeg 2022-06-06T17:44:46.296Z,1654537486.296 [trackPatch_yoyo:PatchTracking:CrossLegSearchForPeak:B](IMPORTANT): Bearing for continued CrossLeg: -90.000000 arcdeg 2022-06-06T18:01:36.815Z,1654538496.815 [trackPatch_yoyo:SyslogWpMaxDistanceReached:SyslogWpMaxDistanceReachedChl:A](IMPORTANT): WpMaxDistance reached. Patch value is 6.856321 ug/l at 34.373373 arcdeg , -119.626792 arcdeg , distance = 287.504499 m 2022-06-06T18:01:39.629Z,1654538499.629 [trackPatch_yoyo:PatchTracking:InLeg:B](IMPORTANT): Bearing for InLeg: 90.000000 arcdeg 2022-06-06T18:06:31.095Z,1654538791.095 [trackPatch_yoyo:PatchTracking:InLeg:F](IMPORTANT): Bearing for OutLeg: 0.000000 arcdeg 2022-06-06T18:09:01.216Z,1654538941.216 [trackPatch_yoyo:PatchTracking:ChlPatchDetection:B](IMPORTANT): Peak found before WpMaxDistance is reached. Patch value is 7.087199 ug/l at 34.373519 arcdeg , -119.628250 arcdeg , distance = 183.432460 m 2022-06-06T18:09:03.628Z,1654538943.628 [trackPatch_yoyo:PatchTracking:CrossLegToPatchCenter:B](IMPORTANT): Bearing for CrossLeg: 180.000000 arcdeg 2022-06-06T18:12:11.499Z,1654539131.499 [trackPatch_yoyo:PatchTracking:CrossLegSearchForPeak:B](IMPORTANT): Bearing for continued CrossLeg: 180.000000 arcdeg 2022-06-06T18:24:15.472Z,1654539855.472 [trackPatch_yoyo:PatchTracking:ChlPatchDetection:B](IMPORTANT): Peak found before WpMaxDistance is reached. Patch value is 8.184272 ug/l at 34.373591 arcdeg , -119.629008 arcdeg , distance = 453.627162 m 2022-06-06T18:24:17.505Z,1654539857.505 [trackPatch_yoyo:PatchTracking:InLeg:B](IMPORTANT): Bearing for InLeg: 0.000000 arcdeg 2022-06-06T18:31:56.470Z,1654540316.470 [trackPatch_yoyo:PatchTracking:InLeg:F](IMPORTANT): Bearing for OutLeg: -270.000000 arcdeg 2022-06-06T18:44:26.732Z,1654541066.732 [trackPatch_yoyo:PatchTracking:ChlPatchDetection:B](IMPORTANT): Peak found before WpMaxDistance is reached. Patch value is 8.414643 ug/l at 34.373146 arcdeg , -119.628851 arcdeg , distance = 438.059789 m 2022-06-06T18:44:29.556Z,1654541069.556 [trackPatch_yoyo:PatchTracking:CrossLegToPatchCenterThenSurface:B](IMPORTANT): Bearing for CrossLeg: -90.000000 arcdeg 2022-06-06T18:46:55.569Z,1654541215.569 [CBIT](IMPORTANT): Beginning ground fault scan 2022-06-06T18:47:06.840Z,1654541226.840 [CBIT](IMPORTANT): Ground fault detected mA: CHAN A0 (Batt): -0.009287 CHAN A1 (24V): 0.003173 CHAN A2 (12V): -0.005332 CHAN A3 (5V): -0.002714 CHAN B0 (3.3V): -0.002331 CHAN B1 (3.15aV): -0.052990 CHAN B2 (3.15bV): -0.001420 CHAN B3 (GND): -0.000943 OPEN: 0.012330 Full Scale: +/- 1 mA 2022-06-06T18:56:35.466Z,1654541795.466 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T185629 2022-06-06T18:56:47.572Z,1654541807.572 [CommandExec](IMPORTANT): got command stop 2022-06-06T18:56:47.572Z,1654541807.572 [CommandExec](IMPORTANT): got command schedule resume 2022-06-06T18:56:47.572Z,1654541807.572 [CommandExec](IMPORTANT): Scheduling is resumed 2022-06-06T18:56:48.022Z,1654541808.022 [CommandExec](IMPORTANT): got command load ./Missions/Science/isotherm_depth_sampling.xml 2022-06-06T18:57:16.743Z,1654541836.743 [CommandExec](IMPORTANT): Loaded ./Missions/Science/isotherm_depth_sampling.xml 2022-06-06T18:57:16.948Z,1654541836.948 [MissionManager](IMPORTANT): Started mission Default 2022-06-06T18:57:43.968Z,1654541863.968 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.NumSamplers 2 count 2022-06-06T18:57:43.977Z,1654541863.977 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MissionTimeout 6 hour 2022-06-06T18:57:43.978Z,1654541863.978 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNoFiring 3 hour 2022-06-06T18:57:43.978Z,1654541863.978 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxWaitNotAchievingDepth 0.5 hour 2022-06-06T18:57:48.734Z,1654541868.734 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T18:58:19.693Z,1654541899.693 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SendSampleStatusAndData 1 bool 2022-06-06T18:58:19.693Z,1654541899.693 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SampleAtPeakChl 1 bool 2022-06-06T18:58:19.694Z,1654541899.694 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.InitialDiveDuration 1 minute 2022-06-06T18:58:19.695Z,1654541899.695 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.SpeedSampling 1 meter_per_second 2022-06-06T18:59:11.880Z,1654541951.880 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.HeadingLeavingSide0 210 degree 2022-06-06T18:59:11.880Z,1654541951.880 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.HeadingLeavingSide2 30 degree 2022-06-06T18:59:11.890Z,1654541951.890 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.HeadingLeavingSide3 120 degree 2022-06-06T18:59:11.891Z,1654541951.891 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.MaxDepth 30 meter 2022-06-06T18:59:40.773Z,1654541980.773 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundSampler 45 meter 2022-06-06T18:59:40.774Z,1654541980.774 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.ShallowBoundChl 2 meter 2022-06-06T18:59:40.774Z,1654541980.774 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DeepBoundChl 15 meter 2022-06-06T18:59:40.775Z,1654541980.775 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeTypeCommon NaN count 2022-06-06T19:00:08.662Z,1654542008.662 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType1 -6 count 2022-06-06T19:00:08.663Z,1654542008.663 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.CartridgeType2 -10 count 2022-06-06T19:00:08.664Z,1654542008.664 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChl1 0 meter 2022-06-06T19:00:08.664Z,1654542008.664 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.DepDiffFromPeakChl2 0 meter 2022-06-06T19:00:21.423Z,1654542021.423 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation1 20 minute 2022-06-06T19:00:21.424Z,1654542021.424 [CommandExec](IMPORTANT): got command set IsothermDepthSampling.WaitDepUndulation2 5.0 minute 2022-06-06T19:00:21.425Z,1654542021.425 [CommandExec](IMPORTANT): got command run 2022-06-06T19:00:21.428Z,1654542021.428 [CommandExec](IMPORTANT): Running 2022-06-06T19:00:21.680Z,1654542021.680 [MissionManager](IMPORTANT): Started mission IsothermDepthSampling 2022-06-06T19:00:21.734Z,1654542021.734 [IsothermDepthSampling:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 21.00 hours. 2022-06-06T19:05:27.338Z,1654542327.338 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T19:05:38.675Z,1654542338.675 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoDown:B](IMPORTANT): Go down from 0.395499 m 2022-06-06T19:06:48.226Z,1654542408.226 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -6.000000 count , nan K , 0.000000 m , nan degC , nan m , 20.000000 min . 2022-06-06T19:08:40.556Z,1654542520.556 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:LogGoUp:B](IMPORTANT): Go up from 18.049709 m 2022-06-06T19:10:26.813Z,1654542626.813 [IsothermDepthSampling:FindPeakChlVertical:FindPeak:SetChlPeakTempDepth:L](IMPORTANT): Set peak-chl depth and temp. DepthLogged, ChlLogged, PeakChlDepthSet, PeakChlTemperatureSet, PeakChlSet = 12.750869 m , 1.060800 ug/l , 14.708162 m , 16.165339 degC , 2.469480 ug/l 2022-06-06T19:10:27.236Z,1654542627.236 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 1.000000 count . Target depth = 14.708162 m . 2022-06-06T19:10:27.629Z,1654542627.629 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -6.000000 count 2022-06-06T19:12:54.696Z,1654542774.696 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 14.713600 m , settling for 20.000000 min 2022-06-06T19:33:07.541Z,1654543987.541 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-06-06T19:33:07.725Z,1654543987.725 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-06-06T19:34:04.110Z,1654544044.110 [ESPComponent](IMPORTANT): ESP has connected as client 2022-06-06T19:34:04.926Z,1654544044.926 [ESPComponent](IMPORTANT): [sample #11] Setting cartridge argument to -6 2022-06-06T19:34:04.927Z,1654544044.927 [ESPComponent](IMPORTANT): [sample #11] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-06-06T19:34:05.411Z,1654544045.411 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 14.563243 m in 16.507593 degC water with 1.149200 ug/l chlorophyll fluorescence. 2022-06-06T19:34:05.727Z,1654544045.727 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PREPARING_SHOW_LOG 2022-06-06T19:34:06.130Z,1654544046.130 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-06-06T19:34:08.151Z,1654544048.151 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_LOADING_CARTRIDGE 2022-06-06T19:34:47.744Z,1654544087.744 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PRIMING (@20,archive_bac) 2022-06-06T19:34:49.767Z,1654544089.767 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PRIMING (@100.0) 2022-06-06T19:34:50.167Z,1654544090.167 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-06-06T19:34:50.571Z,1654544090.571 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-06-06T19:37:00.258Z,1654544220.258 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_FILTERING (@0.0) 2022-06-06T19:37:00.664Z,1654544220.664 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-06-06T20:20:40.252Z,1654546840.252 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PAUSED (@724.4) 2022-06-06T20:20:40.652Z,1654546840.652 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PROCESSING (@724.4) 2022-06-06T20:20:42.671Z,1654546842.671 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2022-06-06T20:20:43.074Z,1654546843.074 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PROCESSED (@20,archive_bac) 2022-06-06T20:32:47.462Z,1654547567.462 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_STOPPING (@20,archive_bac) 2022-06-06T20:32:56.756Z,1654547576.756 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-06-06T20:32:57.159Z,1654547577.159 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_STOPPED 2022-06-06T20:37:56.942Z,1654547876.942 [ESPComponent](IMPORTANT): [sample #11] ESP sampling sequence completed normally. 2022-06-06T20:37:57.816Z,1654547877.816 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 1.000000 count completed. 2022-06-06T20:37:59.819Z,1654547879.819 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataCntSamples:A](IMPORTANT): CntSamples = 1.000000 count 2022-06-06T20:38:01.063Z,1654547881.063 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleNumber:A](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2022-06-06T20:38:02.275Z,1654547882.275 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPCartridgeType:A](IMPORTANT): Science:ESPComponent.cartridge = -6 count 2022-06-06T20:38:03.473Z,1654547883.473 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleVolume:A](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2022-06-06T20:38:05.111Z,1654547885.111 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleDep:A](IMPORTANT): Universal:depth = 15.359905 m 2022-06-06T20:38:06.706Z,1654547886.706 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleChl:A](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 4.274400 ug/l 2022-06-06T20:38:14.089Z,1654547894.089 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:38:23.275Z,1654547903.275 [IsothermDepthSampling:SetSampleOptions:N](IMPORTANT): Set CartridgeType (if ESP), TempDiffFromPeakChl, DepDiffFromPeakChl, TempDesignated, DepthDesignated, WaitDepthUndulation to -10.000000 count , nan K , 0.000000 m , nan degC , nan m , 5.000000 min . 2022-06-06T20:38:26.923Z,1654547906.923 [IsothermDepthSampling:TakeSamples:FiringOnDepth:E](IMPORTANT): Taking sample No. 2.000000 count . Target depth = 14.708162 m . 2022-06-06T20:38:27.291Z,1654547907.291 [IsothermDepthSampling:TakeSamples:FiringOnDepth:F](IMPORTANT): If ESP, requesting ESP cartridge type: -10.000000 count 2022-06-06T20:38:27.949Z,1654547907.949 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:38:41.838Z,1654547921.838 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:38:55.706Z,1654547935.706 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:39:06.503Z,1654547946.503 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 14.741423 m , settling for 5.000000 min 2022-06-06T20:39:09.818Z,1654547949.818 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:39:23.685Z,1654547963.685 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:39:37.548Z,1654547977.548 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:39:51.425Z,1654547991.425 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:40:05.555Z,1654548005.555 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:40:19.421Z,1654548019.421 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:40:33.282Z,1654548033.282 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:40:47.141Z,1654548047.141 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:41:01.257Z,1654548061.257 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:41:15.141Z,1654548075.141 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:41:29.022Z,1654548089.022 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:41:42.885Z,1654548102.885 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:41:57.013Z,1654548117.013 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:42:10.885Z,1654548130.885 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:42:24.777Z,1654548144.777 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:42:38.641Z,1654548158.641 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:42:52.761Z,1654548172.761 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:43:06.633Z,1654548186.633 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:43:20.494Z,1654548200.494 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:43:34.366Z,1654548214.366 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T20:44:19.241Z,1654548259.241 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2022-06-06T20:44:19.421Z,1654548259.421 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2022-06-06T20:45:14.194Z,1654548314.194 [ESPComponent](IMPORTANT): ESP has connected as client 2022-06-06T20:45:15.005Z,1654548315.005 [ESPComponent](IMPORTANT): [sample #12] Setting cartridge argument to -10 2022-06-06T20:45:15.005Z,1654548315.005 [ESPComponent](IMPORTANT): [sample #12] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2022-06-06T20:45:15.543Z,1654548315.543 [IsothermDepthSampling:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 15.489615 m in 15.882013 degC water with 4.142320 ug/l chlorophyll fluorescence. 2022-06-06T20:45:15.810Z,1654548315.810 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PREPARING_SHOW_LOG 2022-06-06T20:45:16.214Z,1654548316.214 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PREPARING_SHOW_STATUS 2022-06-06T20:45:18.234Z,1654548318.234 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_LOADING_CARTRIDGE 2022-06-06T20:45:58.634Z,1654548358.634 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PRIMING (@19,daSPR_phyto) 2022-06-06T20:46:01.469Z,1654548361.469 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PRIMING (@100.0) 2022-06-06T20:46:01.470Z,1654548361.470 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2022-06-06T20:46:01.872Z,1654548361.872 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2022-06-06T20:48:10.745Z,1654548490.745 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_FILTERING (@0.0) 2022-06-06T20:48:11.150Z,1654548491.150 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2022-06-06T21:18:40.194Z,1654550320.194 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PAUSED (@505.1) 2022-06-06T21:18:40.600Z,1654550320.600 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PROCESSING (@505.1) 2022-06-06T21:18:42.618Z,1654550322.618 [ESPComponent](IMPORTANT): Processing timeoutMinutes=120.000000 issuedCmd_=Cmd.startProcessing 2022-06-06T21:18:43.023Z,1654550323.023 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PROCESSED (@19,daSPR_phyto) 2022-06-06T22:17:09.393Z,1654553829.393 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_STOPPING (@19,daSPR_phyto) 2022-06-06T22:17:20.303Z,1654553840.303 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2022-06-06T22:17:20.707Z,1654553840.707 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_STOPPED 2022-06-06T22:22:20.645Z,1654554140.645 [ESPComponent](IMPORTANT): [sample #12] ESP sampling sequence completed normally. 2022-06-06T22:22:21.531Z,1654554141.531 [IsothermDepthSampling:TakeSamples:FiringOnDepth:TriggerOnDepth:C](IMPORTANT): Sample No. 2.000000 count completed. 2022-06-06T22:22:23.624Z,1654554143.624 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataCntSamples:A](IMPORTANT): CntSamples = 2.000000 count 2022-06-06T22:22:24.743Z,1654554144.743 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleNumber:A](IMPORTANT): Science:ESPComponent.sample_number = 0 count 2022-06-06T22:22:25.976Z,1654554145.976 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPCartridgeType:A](IMPORTANT): Science:ESPComponent.cartridge = -10 count 2022-06-06T22:22:27.180Z,1654554147.180 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataESPSampleVolume:A](IMPORTANT): Science:ESPComponent.sampleVolume = nan ml 2022-06-06T22:22:28.787Z,1654554148.787 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleDep:A](IMPORTANT): Universal:depth = 14.926783 m 2022-06-06T22:22:30.434Z,1654554150.434 [IsothermDepthSampling:SendData:SendDataTo1Modem:SendDataSampleChl:A](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water = 3.130400 ug/l 2022-06-06T22:22:33.280Z,1654554153.280 [MissionManager](IMPORTANT): Started mission Default 2022-06-06T22:22:37.753Z,1654554157.753 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T22:22:51.617Z,1654554171.617 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T22:23:05.481Z,1654554185.481 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T22:28:16.834Z,1654554496.834 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T22:34:03.324Z,1654554843.324 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.494327 min 2022-06-06T22:34:04.937Z,1654554844.937 [NAL9602](FAULT): GPS failed to acquire within timeout. 2022-06-06T22:39:49.785Z,1654555189.785 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T22:44:54.874Z,1654555494.874 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 22.353611 min 2022-06-06T22:44:56.489Z,1654555496.489 [NAL9602](FAULT): GPS failed to acquire within timeout. 2022-06-06T22:50:41.627Z,1654555841.627 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T22:55:41.885Z,1654556141.885 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 33.136473 min 2022-06-06T22:55:43.461Z,1654556143.461 [NAL9602](FAULT): GPS failed to acquire within timeout. 2022-06-06T23:01:28.521Z,1654556488.521 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T23:06:30.767Z,1654556790.767 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 43.951453 min 2022-06-06T23:06:32.378Z,1654556792.378 [NAL9602](FAULT): GPS failed to acquire within timeout. 2022-06-06T23:12:17.286Z,1654557137.286 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T23:14:59.518Z,1654557299.518 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T231453 2022-06-06T23:15:07.088Z,1654557307.088 [CommandExec](IMPORTANT): got command ibit 2022-06-06T23:15:07.407Z,1654557307.407 [IBIT](IMPORTANT): Beginning Initiated BIT 2022-06-06T23:15:07.407Z,1654557307.407 [IBIT](IMPORTANT): Beginning control surface checks. 2022-06-06T23:15:07.414Z,1654557307.414 [CBIT](IMPORTANT): Beginning ground fault scan 2022-06-06T23:15:18.307Z,1654557318.307 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): 0.001960 CHAN A1 (24V): 0.002820 CHAN A2 (12V): -0.002136 CHAN A3 (5V): -0.003017 CHAN B0 (3.3V): -0.001732 CHAN B1 (3.15aV): 0.002938 CHAN B2 (3.15bV): -0.000411 CHAN B3 (GND): -0.000937 OPEN: 0.011751 Full Scale: +/- 1 mA 2022-06-06T23:15:53.524Z,1654557353.524 [IBIT](IMPORTANT): Communications Status: Fix Status: 1 Iridium Signal Strength: 1 Latitude: 34.389042 Longitude: -119.648880 2022-06-06T23:15:53.951Z,1654557353.951 [IBIT](FAULT): Warning: Battery Data not active. Expected only when running primaries. Threshold checking not active. 2022-06-06T23:15:54.348Z,1654557354.348 [IBIT](IMPORTANT): bitHumidityThreshold: 55.000000 % 2022-06-06T23:15:54.348Z,1654557354.348 [IBIT](IMPORTANT): bitPressureThreshold: 0.750000 psi 2022-06-06T23:15:54.367Z,1654557354.367 [IBIT](IMPORTANT): Pressure:9.479980 PSI 2022-06-06T23:15:54.367Z,1654557354.367 [IBIT](IMPORTANT): Humidity:20.388231 % 2022-06-06T23:15:54.748Z,1654557354.748 [IBIT](IMPORTANT): Vehicle Pitch:-2.957728 degrees 2022-06-06T23:15:54.749Z,1654557354.749 [IBIT](IMPORTANT): Vehicle Roll:-6.486839 degrees 2022-06-06T23:15:54.749Z,1654557354.749 [IBIT](IMPORTANT): Vehicle Heading:27.508850 degrees 2022-06-06T23:15:55.146Z,1654557355.146 [IBIT](IMPORTANT): surfaceThreshold: 1.000000 m 2022-06-06T23:15:55.147Z,1654557355.147 [IBIT](IMPORTANT): buoyancyNeutral: 90.000000 cc 2022-06-06T23:15:55.147Z,1654557355.147 [IBIT](IMPORTANT): massDefault: -3.500000 cm 2022-06-06T23:15:55.147Z,1654557355.147 [IBIT](IMPORTANT): stopDepth: 215.000000 m 2022-06-06T23:15:55.147Z,1654557355.147 [IBIT](IMPORTANT): abortDepth: 250.000000 m 2022-06-06T23:15:55.147Z,1654557355.147 [IBIT](IMPORTANT): IBIT PASSED 2022-06-06T23:17:21.262Z,1654557441.262 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 54.792619 min 2022-06-06T23:20:11.411Z,1654557611.411 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T23:26:47.901Z,1654558007.901 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 64.236955 min 2022-06-06T23:28:16.455Z,1654558096.455 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T232810 2022-06-06T23:28:25.082Z,1654558105.082 [CommandExec](IMPORTANT): got command schedule asap "load Science/sci2.xml;set sci2.MissionTimeout 2 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 34.405 degree;set sci2.Lon1 -119.618 degree;set sci2.Speed 1 m/s;set sci2.YoYoMaxDepth 10 m;set sci2.MaxDepth 20 m" 2kjug 1 2.000000 2022-06-06T23:28:25.082Z,1654558105.082 [CommandExec](IMPORTANT): Scheduling command #1 of 2 with id=2kjug 2022-06-06T23:28:25.083Z,1654558105.083 [CommandExec](IMPORTANT): Scheduled #80 (#1 of 2 with id='2kjug'): "load Science/sci2.xml;set sci2.MissionTimeout 2 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 34.405 degree;set sci2.Lon1 -119.618 degree;set sci2.Speed 1 m/s;set sci2.YoYoMaxDepth 10 m;set sci2.MaxDepth 20 m", ASAP 2022-06-06T23:28:25.991Z,1654558105.991 [DataOverHttps](IMPORTANT): SBD MTMSN=20220606T232819 2022-06-06T23:28:33.731Z,1654558113.731 [CommandExec](IMPORTANT): got command schedule asap "set sci2.MinOffshore 2 km;run" 2kjug 2 2.000000 2022-06-06T23:28:33.732Z,1654558113.732 [CommandExec](IMPORTANT): Scheduling command #2 of 2 with id=2kjug 2022-06-06T23:28:33.733Z,1654558113.733 [CommandExec](IMPORTANT): Scheduled #81 (#2 of 2 with id='2kjug'): "set sci2.MinOffshore 2 km;run", ASAP 2022-06-06T23:28:33.849Z,1654558113.849 [CommandExec](IMPORTANT): got command load ./Missions/Science/sci2.xml 2022-06-06T23:28:36.364Z,1654558116.364 [CommandExec](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2022-06-06T23:28:59.145Z,1654558139.145 [CommandExec](IMPORTANT): got command set sci2.MissionTimeout 2 hour 2022-06-06T23:28:59.146Z,1654558139.146 [CommandExec](IMPORTANT): got command set sci2.NeedCommsTime 45 minute 2022-06-06T23:28:59.146Z,1654558139.146 [CommandExec](IMPORTANT): got command set sci2.Lat1 34.405 degree 2022-06-06T23:28:59.147Z,1654558139.147 [CommandExec](IMPORTANT): got command set sci2.Lon1 -119.618 degree 2022-06-06T23:28:59.148Z,1654558139.148 [CommandExec](IMPORTANT): got command set sci2.Speed 1 meter_per_second 2022-06-06T23:28:59.150Z,1654558139.150 [CommandExec](IMPORTANT): got command set sci2.YoYoMaxDepth 10 meter 2022-06-06T23:28:59.150Z,1654558139.150 [CommandExec](IMPORTANT): got command set sci2.MaxDepth 20 meter 2022-06-06T23:29:03.536Z,1654558143.536 [CommandExec](IMPORTANT): got command set sci2.MinOffshore 2 kilometer 2022-06-06T23:29:03.549Z,1654558143.549 [CommandExec](IMPORTANT): got command run 2022-06-06T23:29:03.551Z,1654558143.551 [CommandExec](IMPORTANT): Running 2022-06-06T23:29:03.858Z,1654558143.858 [MissionManager](IMPORTANT): Started mission sci2 2022-06-06T23:31:58.047Z,1654558318.047 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T23:33:38.873Z,1654558418.873 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:33:52.997Z,1654558432.997 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:34:06.862Z,1654558446.862 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:34:20.721Z,1654558460.721 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:34:50.477Z,1654558490.477 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:35:04.589Z,1654558504.589 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:35:18.450Z,1654558518.450 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:35:32.309Z,1654558532.309 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:35:46.177Z,1654558546.177 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:36:10.389Z,1654558570.389 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:36:24.253Z,1654558584.253 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:36:38.114Z,1654558598.114 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:36:51.989Z,1654558611.989 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:37:06.122Z,1654558626.122 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:37:29.078Z,1654558649.078 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:37:42.941Z,1654558662.941 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:37:54.885Z,1654558674.885 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-06T23:37:56.806Z,1654558676.806 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:38:10.921Z,1654558690.921 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:38:24.782Z,1654558704.782 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:38:51.253Z,1654558731.253 [DAT](FAULT): Ack receipt timeout failure. 2022-06-06T23:39:05.117Z,1654558745.117 [DAT](FAULT): Ack receipt timeout failure. 2022-06-07T00:21:41.162Z,1654561301.162 [CommandExec](IMPORTANT): got command stop 2022-06-07T00:21:41.162Z,1654561301.162 [CommandExec](IMPORTANT): Scheduling is paused 2022-06-07T00:21:41.691Z,1654561301.691 [MissionManager](IMPORTANT): Started mission Default 2022-06-07T00:23:04.796Z,1654561384.796 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-07T00:24:33.102Z,1654561473.102 [DataOverHttps](IMPORTANT): SBD MTMSN=20220607T002426 2022-06-07T00:24:43.957Z,1654561483.957 [CommandExec](IMPORTANT): got command stop 2022-06-07T00:28:02.373Z,1654561682.373 [CommandExec](IMPORTANT): got command get DAT.sbdAddress 2022-06-07T00:28:02.374Z,1654561682.374 [CommandExec](IMPORTANT): DAT.sbdAddress -1 enum 2022-06-07T00:28:50.446Z,1654561730.446 [DataOverHttps](IMPORTANT): SBD MTMSN=20220607T002844 2022-06-07T00:28:56.736Z,1654561736.736 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 7.243696 min 2022-06-07T00:28:58.366Z,1654561738.366 [CommandExec](IMPORTANT): got command resume 2022-06-07T00:29:00.519Z,1654561740.519 [MissionManager](IMPORTANT): Resuming from info in Logs/20220606T030114/Science_sci2_xml.state 2022-06-07T00:29:00.547Z,1654561740.547 [CommandExec](IMPORTANT): Resuming mission and schedule 2022-06-07T00:29:00.547Z,1654561740.547 [CommandExec](IMPORTANT): Scheduling is resumed 2022-06-07T00:29:00.758Z,1654561740.758 [MissionManager](IMPORTANT): Started mission sci2 2022-06-07T00:34:00.535Z,1654562040.535 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-07T01:00:43.169Z,1654563643.169 [ElevatorServo](FAULT): Elevator uart error - getPosition.serial timeout 2022-06-07T01:07:30.338Z,1654564050.338 [sci2:Lap:Wpt1:A.Waypoint](IMPORTANT): Reached Waypoint: 34.404998,-119.617991 2022-06-07T01:07:33.152Z,1654564053.152 [MissionManager](IMPORTANT): Started mission Default 2022-06-07T01:18:18.310Z,1654564698.310 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 10.746238 min 2022-06-07T01:18:34.896Z,1654564714.896 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=47202, MT Status=1, MTMSN=3500 2022-06-07T01:18:35.419Z,1654564715.419 [CommandExec](IMPORTANT): got command stop 2022-06-07T01:18:35.419Z,1654564715.419 [CommandExec](IMPORTANT): Scheduling is paused 2022-06-07T01:18:35.420Z,1654564715.420 [CommandExec](IMPORTANT): got command schedule clear 2022-06-07T01:18:35.420Z,1654564715.420 [CommandExec](IMPORTANT): Cleared 0 scheduled commands. 2022-06-07T01:24:12.150Z,1654565052.150 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 16.642284 min 2022-06-07T01:26:37.688Z,1654565197.688 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=47203, MT Status=1, MTMSN=3501 2022-06-07T01:26:38.160Z,1654565198.160 [CommandExec](IMPORTANT): got command stop 2022-06-07T01:26:38.160Z,1654565198.160 [CommandExec](IMPORTANT): got command schedule clear 2022-06-07T01:26:38.160Z,1654565198.160 [CommandExec](IMPORTANT): Cleared 0 scheduled commands. 2022-06-07T01:30:02.659Z,1654565402.659 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 22.485002 min 2022-06-07T01:34:45.891Z,1654565685.891 [DataOverHttps](IMPORTANT): SBD MTMSN=20220607T013439 2022-06-07T01:34:57.053Z,1654565697.053 [CommandExec](IMPORTANT): got command schedule asap "load Science/sci2.xml;set sci2.MissionTimeout 2 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 34.376 degree;set sci2.Lon1 -119.62 degree;set sci2.Speed 1 m/s;set sci2.YoYoMaxDepth 15 m;set sci2.MaxDepth 40 m" 2kpov 1 2.000000 2022-06-07T01:34:57.054Z,1654565697.054 [CommandExec](IMPORTANT): Scheduling command #1 of 2 with id=2kpov 2022-06-07T01:34:57.055Z,1654565697.055 [CommandExec](IMPORTANT): Scheduled #82 (#1 of 2 with id='2kpov'): "load Science/sci2.xml;set sci2.MissionTimeout 2 h;set sci2.NeedCommsTime 45 min;set sci2.Lat1 34.376 degree;set sci2.Lon1 -119.62 degree;set sci2.Speed 1 m/s;set sci2.YoYoMaxDepth 15 m;set sci2.MaxDepth 40 m", ASAP 2022-06-07T01:34:57.974Z,1654565697.974 [DataOverHttps](IMPORTANT): SBD MTMSN=20220607T013451 2022-06-07T01:35:06.211Z,1654565706.211 [CommandExec](IMPORTANT): got command schedule asap "set sci2.MinOffshore 2 km;run" 2kpov 2 2.000000 2022-06-07T01:35:06.212Z,1654565706.212 [CommandExec](IMPORTANT): Scheduling command #2 of 2 with id=2kpov 2022-06-07T01:35:06.213Z,1654565706.213 [CommandExec](IMPORTANT): Scheduled #83 (#2 of 2 with id='2kpov'): "set sci2.MinOffshore 2 km;run", ASAP 2022-06-07T01:35:06.362Z,1654565706.362 [CommandExec](IMPORTANT): got command load ./Missions/Science/sci2.xml 2022-06-07T01:35:08.187Z,1654565708.187 [CommandExec](IMPORTANT): Loaded ./Missions/Science/sci2.xml 2022-06-07T01:35:18.441Z,1654565718.441 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-07T01:35:22.878Z,1654565722.878 [CommandExec](IMPORTANT): got command set sci2.MissionTimeout 2 hour 2022-06-07T01:35:22.879Z,1654565722.879 [CommandExec](IMPORTANT): got command set sci2.NeedCommsTime 45 minute 2022-06-07T01:35:22.880Z,1654565722.880 [CommandExec](IMPORTANT): got command set sci2.Lat1 34.376 degree 2022-06-07T01:35:22.880Z,1654565722.880 [CommandExec](IMPORTANT): got command set sci2.Lon1 -119.62 degree 2022-06-07T01:35:22.921Z,1654565722.921 [CommandExec](IMPORTANT): got command set sci2.Speed 1 meter_per_second 2022-06-07T01:35:22.922Z,1654565722.922 [CommandExec](IMPORTANT): got command set sci2.YoYoMaxDepth 15 meter 2022-06-07T01:35:22.923Z,1654565722.923 [CommandExec](IMPORTANT): got command set sci2.MaxDepth 40 meter 2022-06-07T01:35:25.435Z,1654565725.435 [CommandExec](IMPORTANT): got command set sci2.MinOffshore 2 kilometer 2022-06-07T01:35:25.435Z,1654565725.435 [CommandExec](IMPORTANT): got command run 2022-06-07T01:35:25.437Z,1654565725.437 [CommandExec](IMPORTANT): Running 2022-06-07T01:35:25.709Z,1654565725.709 [MissionManager](IMPORTANT): Started mission sci2 2022-06-07T01:41:24.647Z,1654566084.647 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-07T01:48:43.554Z,1654566523.554 [Radio_Surface](FAULT): LCB fault: LCB Watchdog Reset. Invalid Command. Current Limiter Activated. 2022-06-07T02:11:25.384Z,1654567885.384 [DVL_micro](FAULT): Failed to initialize within timeout. 2022-06-07T02:11:44.378Z,1654567904.378 [DVL_micro](FAULT): Failed to initialize within timeout. 2022-06-07T02:11:44.497Z,1654567904.497 [CBIT](CRITICAL): Communications Fault in component: DVL_micro 2022-06-07T02:11:44.978Z,1654567904.978 [CommandExec](FAULT): Scheduling is paused 2022-06-07T02:11:45.600Z,1654567905.600 [MissionManager](IMPORTANT): Started mission Default 2022-06-07T02:14:59.903Z,1654568099.903 [DVL_micro](FAULT): DVL failed to acquire valid data within timeout. 2022-06-07T02:17:05.550Z,1654568225.550 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2022-06-07T02:22:50.261Z,1654568570.261 [Default:CheckIn:E](IMPORTANT): Default mission has been running for 11.071131 min 2022-06-07T02:22:51.874Z,1654568571.874 [NAL9602](FAULT): GPS failed to acquire within timeout. 2022-06-07T02:22:51.894Z,1654568571.894 [CBIT](CRITICAL): Data Fault in component: NAL9602 2022-06-07T02:24:33.394Z,1654568673.394 [DataOverHttps](IMPORTANT): SBD MTMSN=20220607T022427