2024-08-30T17:01:40.251Z,1725037300.251 [CommandExec](IMPORTANT): got command schedule clear 2024-08-30T17:01:40.251Z,1725037300.251 [CommandExec](IMPORTANT): Cleared 0 scheduled commands. 2024-08-30T17:01:40.252Z,1725037300.252 [CommandExec](IMPORTANT): got command schedule resume 2024-08-30T17:01:40.252Z,1725037300.252 [CommandExec](IMPORTANT): Scheduling is resumed 2024-08-30T17:01:40.252Z,1725037300.252 [CommandExec](IMPORTANT): got command restart logs 2024-08-30T17:01:57.396Z,1725037317.396 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=16150, MT Status=1, MTMSN=4021 2024-08-30T17:01:58.213Z,1725037318.213 [CommandExec](IMPORTANT): got command schedule asap "load Science/circle_sample.xml;set CircleSample.NumSamplers 1 count;set CircleSample.MissionTimeout 1 h;set CircleSample.UseOtherLRAUVSignals 1 bool;set CircleSample.AcousticTargetDepth 0 m;set CircleSample.WaitBeforeFiring 1 min" 3doio 1 3.000000 2024-08-30T17:01:58.214Z,1725037318.214 [CommandExec](IMPORTANT): Scheduling command #1 of 3 with id=3doio 2024-08-30T17:01:58.215Z,1725037318.215 [CommandExec](IMPORTANT): Scheduled #6 (#1 of 3 with id='3doio'): "load Science/circle_sample.xml;set CircleSample.NumSamplers 1 count;set CircleSample.MissionTimeout 1 h;set CircleSample.UseOtherLRAUVSignals 1 bool;set CircleSample.AcousticTargetDepth 0 m;set CircleSample.WaitBeforeFiring 1 min", ASAP 2024-08-30T17:02:35.292Z,1725037355.292 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=16151, MT Status=1, MTMSN=4022 2024-08-30T17:02:36.025Z,1725037356.025 [CommandExec](IMPORTANT): got command schedule asap "set CircleSample.MaxWaitFirstSample 5 min;set CircleSample.MaxWaitMustFire 10 min;set CircleSample.MaxWaitStopMission 0.5 h;set CircleSample.DepthCircle 10 m;set CircleSample.CircleYoYoMinDepth 5 m" 3doio 2 3.000000 2024-08-30T17:02:36.026Z,1725037356.026 [CommandExec](IMPORTANT): Scheduling command #2 of 3 with id=3doio 2024-08-30T17:02:36.027Z,1725037356.027 [CommandExec](IMPORTANT): Scheduled #7 (#2 of 3 with id='3doio'): "set CircleSample.MaxWaitFirstSample 5 min;set CircleSample.MaxWaitMustFire 10 min;set CircleSample.MaxWaitStopMission 0.5 h;set CircleSample.DepthCircle 10 m;set CircleSample.CircleYoYoMinDepth 5 m", ASAP 2024-08-30T17:02:51.302Z,1725037371.302 [NAL9602](IMPORTANT): SBD MO Status=1, MOMSN=16152, MT Status=1, MTMSN=4023 2024-08-30T17:02:52.070Z,1725037372.070 [CommandExec](IMPORTANT): got command schedule asap "set CircleSample.CircleYoYoMaxDepth 20 m;set CircleSample.CenterLatitude 36.797 degree;set CircleSample.CenterLongitude -121.847 degree;set CircleSample.Settle1 1 min;run" 3doio 3 3.000000 2024-08-30T17:02:52.070Z,1725037372.070 [CommandExec](IMPORTANT): Scheduling command #3 of 3 with id=3doio 2024-08-30T17:02:52.071Z,1725037372.071 [CommandExec](IMPORTANT): Scheduled #8 (#3 of 3 with id='3doio'): "set CircleSample.CircleYoYoMaxDepth 20 m;set CircleSample.CenterLatitude 36.797 degree;set CircleSample.CenterLongitude -121.847 degree;set CircleSample.Settle1 1 min;run", ASAP 2024-08-30T17:02:52.228Z,1725037372.228 [CommandExec](IMPORTANT): got command load ./Missions/Science/circle_sample.xml 2024-08-30T17:03:06.122Z,1725037386.122 [CommandExec](IMPORTANT): Loaded ./Missions/Science/circle_sample.xml id=CircleSample 2024-08-30T17:03:26.230Z,1725037406.230 [CommandExec](IMPORTANT): got command set CircleSample.NumSamplers 1 count 2024-08-30T17:03:26.231Z,1725037406.231 [CommandExec](IMPORTANT): got command set CircleSample.MissionTimeout 1 hour 2024-08-30T17:03:26.231Z,1725037406.231 [CommandExec](IMPORTANT): got command set CircleSample.UseOtherLRAUVSignals 1 bool 2024-08-30T17:03:26.232Z,1725037406.232 [CommandExec](IMPORTANT): got command set CircleSample.AcousticTargetDepth 0 meter 2024-08-30T17:03:26.233Z,1725037406.233 [CommandExec](IMPORTANT): got command set CircleSample.WaitBeforeFiring 1 minute 2024-08-30T17:03:46.759Z,1725037426.759 [CommandExec](IMPORTANT): got command set CircleSample.MaxWaitFirstSample 5 minute 2024-08-30T17:03:46.759Z,1725037426.759 [CommandExec](IMPORTANT): got command set CircleSample.MaxWaitMustFire 10 minute 2024-08-30T17:03:46.760Z,1725037426.760 [CommandExec](IMPORTANT): got command set CircleSample.MaxWaitStopMission 0.5 hour 2024-08-30T17:03:46.761Z,1725037426.761 [CommandExec](IMPORTANT): got command set CircleSample.DepthCircle 10 meter 2024-08-30T17:03:46.770Z,1725037426.770 [CommandExec](IMPORTANT): got command set CircleSample.CircleYoYoMinDepth 5 meter 2024-08-30T17:04:01.052Z,1725037441.052 [CommandExec](IMPORTANT): got command set CircleSample.CircleYoYoMaxDepth 20 meter 2024-08-30T17:04:01.053Z,1725037441.053 [CommandExec](IMPORTANT): got command set CircleSample.CenterLatitude 36.797 degree 2024-08-30T17:04:01.054Z,1725037441.054 [CommandExec](IMPORTANT): got command set CircleSample.CenterLongitude -121.847 degree 2024-08-30T17:04:01.054Z,1725037441.054 [CommandExec](IMPORTANT): got command set CircleSample.Settle1 1 minute 2024-08-30T17:04:01.055Z,1725037441.055 [CommandExec](IMPORTANT): got command run 2024-08-30T17:04:01.060Z,1725037441.060 [CommandExec](IMPORTANT): Running 2024-08-30T17:04:01.228Z,1725037441.228 [MissionManager](IMPORTANT): Started mission CircleSample 2024-08-30T17:04:01.294Z,1725037441.294 [CircleSample:AbortDrift:B.AbortDrift](IMPORTANT): Acoustic timeout set to: 24.00 hours. 2024-08-30T17:04:02.834Z,1725037442.834 [CircleSample:MissionStartComms:A](IMPORTANT): Mission start comms. 2024-08-30T17:06:41.019Z,1725037601.019 [CircleSample:CircleAndSample:B](IMPORTANT): Circle around location 36.797001 arcdeg , -121.847000 arcdeg , at radius = 20.000000 m and depth = 10.000000 m . 2024-08-30T17:06:43.236Z,1725037603.236 [CircleSample:SetSampleOptions:E](IMPORTANT): Set CartridgeType (if ESP), SettleDuration to -1.000000 count , 1.000000 min . 2024-08-30T17:11:41.800Z,1725037901.800 [CircleSample:CircleAndSample:Sampling:FiringOnMaxWaitOrNotReceivingOtherLRAUVSampleStartFirstSample:F](IMPORTANT): Elapsed time since start or last firing(= 5.027554 min ) is longer than MaxWaitFirstSample (= 5.000000 min ) for the 1st sample, or longer than MaxWaitMustFire (= 10.000000 min ) for non-1st samples. Firing sample No. 1.000000 count 2024-08-30T17:11:44.247Z,1725037904.247 [CircleSample:SendSampleStartMessage:SampleStartSignal:B](IMPORTANT): Set _.sampleStart to 1 bool 2024-08-30T17:11:54.584Z,1725037914.584 [DATMMP](FAULT): Buffer send receipt timeout failure. 2024-08-30T17:12:16.254Z,1725037936.254 [DATMMP](FAULT): Buffer send receipt timeout failure. 2024-08-30T17:12:27.090Z,1725037947.090 [DATMMP](FAULT): Buffer send receipt timeout failure. 2024-08-30T17:12:37.938Z,1725037957.938 [DATMMP](FAULT): Buffer send receipt timeout failure. 2024-08-30T17:12:48.773Z,1725037968.773 [DATMMP](FAULT): Buffer send receipt timeout failure. 2024-08-30T17:12:59.613Z,1725037979.613 [DATMMP](FAULT): Buffer send receipt timeout failure. 2024-08-30T17:13:10.462Z,1725037990.462 [DATMMP](FAULT): Buffer send receipt timeout failure. 2024-08-30T17:13:32.133Z,1725038012.133 [DATMMP](FAULT): Buffer send receipt timeout failure. 2024-08-30T17:13:42.978Z,1725038022.978 [DATMMP](FAULT): Buffer send receipt timeout failure. 2024-08-30T17:14:04.654Z,1725038044.654 [DATMMP](FAULT): Buffer send receipt timeout failure. 2024-08-30T17:14:15.507Z,1725038055.507 [DATMMP](FAULT): Buffer send receipt timeout failure. 2024-08-30T17:14:26.342Z,1725038066.342 [DATMMP](FAULT): Buffer send receipt timeout failure. 2024-08-30T17:14:30.760Z,1725038070.760 [CircleSample:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At 10.030318 m , settling for 1.000000 min 2024-08-30T17:14:37.182Z,1725038077.182 [DATMMP](FAULT): Buffer send receipt timeout failure. 2024-08-30T17:14:48.026Z,1725038088.026 [DATMMP](FAULT): Buffer send receipt timeout failure. 2024-08-30T17:14:58.866Z,1725038098.866 [DATMMP](FAULT): Buffer send receipt timeout failure. 2024-08-30T17:15:33.332Z,1725038133.332 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::|summary:' 2024-08-30T17:15:43.473Z,1725038143.473 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.5.2:10.89.5.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2024-08-30T17:15:43.844Z,1725038143.844 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2024-08-30T17:16:47.092Z,1725038207.092 [ESPComponent](IMPORTANT): ESP has connected as client 2024-08-30T17:16:47.995Z,1725038207.995 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -1 2024-08-30T17:16:47.996Z,1725038207.996 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2024-08-30T17:16:48.375Z,1725038208.375 [CircleSample:SampleAtDepth:sample:SampleWrapper:SampleESP:C](IMPORTANT): ESP sampling at 9.677157 m in 12.384211 degC water with 1.508000 ug/l chlorophyll fluorescence. 2024-08-30T17:16:49.106Z,1725038209.106 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG 2024-08-30T17:16:49.511Z,1725038209.511 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS 2024-08-30T17:16:51.127Z,1725038211.127 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE 2024-08-30T17:16:53.152Z,1725038213.152 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING 2024-08-30T17:16:55.571Z,1725038215.571 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2024-08-30T17:16:55.976Z,1725038215.976 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED 2024-08-30T17:21:55.815Z,1725038515.815 [ESPComponent](CRITICAL): [sample #1] ESP sampling sequence terminated with error: In state S_LOADING_CARTRIDGE got exception while awaiting result for cmd='Cmd.loadCartridge -1' exception=<>. Elapsed time since command issued: 2.0292 2024-08-30T17:21:55.998Z,1725038515.998 [CommandExec](FAULT): Scheduling is paused 2024-08-30T17:21:57.023Z,1725038517.023 [MissionManager](IMPORTANT): Started mission Default 2024-08-30T17:46:32.050Z,1725039992.050 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=16238, MT Status=1, MTMSN=4024 2024-08-30T17:46:32.895Z,1725039992.895 [CommandExec](IMPORTANT): got command load ./Missions/Science/profile_station.tl 2024-08-30T17:46:39.404Z,1725039999.404 [CommandExec](IMPORTANT): Loaded ./Missions/Science/profile_station.tl id=profile_station 2024-08-30T17:46:56.587Z,1725040016.587 [CommandExec](IMPORTANT): got command set profile_station.NeedCommsTime 30 minute 2024-08-30T17:46:56.588Z,1725040016.588 [CommandExec](IMPORTANT): got command set profile_station.Lat 36.797 degree 2024-08-30T17:46:56.589Z,1725040016.589 [CommandExec](IMPORTANT): got command set profile_station.Lon -121.847 degree 2024-08-30T17:46:56.590Z,1725040016.590 [CommandExec](IMPORTANT): got command set profile_station.YoYoMaxDepth 20 meter 2024-08-30T17:46:56.590Z,1725040016.590 [CommandExec](IMPORTANT): got command set profile_station.MaxDepth 50 meter 2024-08-30T17:46:56.591Z,1725040016.591 [CommandExec](IMPORTANT): got command run 2024-08-30T17:46:56.592Z,1725040016.592 [CommandExec](IMPORTANT): Running 2024-08-30T17:46:56.666Z,1725040016.666 [MissionManager](IMPORTANT): Started mission profile_station 2024-08-30T17:49:09.957Z,1725040149.957 [profile_station:O.AltitudeEnvelope](IMPORTANT): Altitude envelope ACTIVE 2024-08-30T17:49:09.961Z,1725040149.961 [profile_station:StandardEnvelopes:A.AltitudeEnvelope](IMPORTANT): Altitude envelope ACTIVE 2024-08-30T18:05:26.212Z,1725041126.212 [NAL9602](IMPORTANT): SBD MO Status=0, MOMSN=16300, MT Status=1, MTMSN=4025 2024-08-30T18:05:26.782Z,1725041126.782 [CommandExec](IMPORTANT): got command restart system 2024-08-30T18:05:29.857Z,1725041129.857 [MissionManager](IMPORTANT): Started mission Default