2025-09-07T08:30:33.839Z,1757233833.839 [ESPComponent](IMPORTANT): [sample #7] ESP log summary report (4 messages):
@00:37:56.30 Selecting Cartridge 47
@00:37:56.74 Slide::Error in LRAUV -- Storage Carousel (SC) positionErr at 48 - 47 counts (sensed 48 - 40 counts)
@00:37:56.76 Retry #1 of 4
@01:22:46.58 Sampled  1000.0ml

2025-09-07T08:30:33.840Z,1757233833.840 [ESPComponent](IMPORTANT): [sample #7] ESP Cartridge 47: S_FILTERING: start: 2025-09-07T07:43:17.359Z end: 2025-09-07T08:22:48.224Z Sampled:  1000.0ml
2025-09-07T09:44:50.085Z,1757238290.085 [ESPComponent](IMPORTANT): [sample #8] ESP log summary report (2 messages):
@01:48:47.33 Selecting Cartridge 46
@02:37:01.57 Sampled  1000.0ml

2025-09-07T09:44:50.088Z,1757238290.088 [ESPComponent](IMPORTANT): [sample #8] ESP Cartridge 46: S_FILTERING: start: 2025-09-07T08:54:06.687Z end: 2025-09-07T09:37:04.172Z Sampled:  1000.0ml
2025-09-07T10:38:55.706Z,1757241535.706 [ESPComponent](IMPORTANT): [sample #9] ESP log summary report (3 messages):
@03:02:36.12 Selecting Cartridge 45
@03:31:07.58 Cartridge::Sampler::Stuffed in FILTERING -- Cartridge clogged
@03:31:08.12 Sampled  468.8ml

2025-09-07T10:38:55.728Z,1757241535.728 [ESPComponent](IMPORTANT): [sample #9] ESP Cartridge 45: S_FILTERING: start: 2025-09-07T10:07:57.356Z end: 2025-09-07T10:31:09.964Z Sampled:  468.8ml
2025-09-07T07:17:22.890Z,1757229442.890 [CommandExec](IMPORTANT): got command restart logs
2025-09-07T07:20:33.668Z,1757229633.668 [RDI_Pathfinder](IMPORTANT): Expecting PD13 message format
2025-09-07T07:23:00.947Z,1757229780.947 [CircleSample:CircleAndSample:Sampling:FiringOnMaxWaitNotFirstSample:G](IMPORTANT): Elapsed time since first sample start (=  1440.029687 min ) is longer than MaximumWaitFireSinceFirstSampleStart (=  1440.000000 min ), or elapsed time since last sample end (=  513.870117 min ) is longer than MaximumWaitFireEndToStart (=  nan min ). Fire sample No. 7.000000 count 
2025-09-07T07:26:27.771Z,1757229987.771 [CircleSample:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At  90.097694 m , settling for  10.000000 min 
2025-09-07T07:26:48.318Z,1757230008.318 [DAT](FAULT): failed to enter online mode
2025-09-07T07:26:48.318Z,1757230008.318 [DAT](FAULT): Failure returning to online mode
2025-09-07T07:31:05.854Z,1757230265.854 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T07:31:22.296Z,1757230282.296 [BPC1](FAULT): Failed to receive data from 29 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 36, 37, 39, 44, 54, 58.
2025-09-07T07:36:40.511Z,1757230600.511 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2025-09-07T07:36:40.679Z,1757230600.679 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2025-09-07T07:37:34.254Z,1757230654.254 [ESPComponent](IMPORTANT): ESP has connected as client
2025-09-07T07:37:35.113Z,1757230655.113 [ESPComponent](IMPORTANT): [sample #7] Setting cartridge argument to -1
2025-09-07T07:37:35.114Z,1757230655.114 [ESPComponent](IMPORTANT): [sample #7] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2025-09-07T07:37:35.849Z,1757230655.849 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PREPARING_SHOW_LOG
2025-09-07T07:37:36.287Z,1757230656.287 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PREPARING_SHOW_STATUS
2025-09-07T07:37:37.174Z,1757230657.174 [CircleSample:SampleAtDepth:sample:SampleWrapper:SampleESP:G](IMPORTANT): ESP sampling at  90.244576 m  in  9.921320 degC  water with  0.123600 ug/l chlorophyll fluorescence.
2025-09-07T07:37:38.305Z,1757230658.305 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_LOADING_CARTRIDGE
2025-09-07T07:38:17.923Z,1757230697.923 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PRIMING (@47,aRNAl_bac)
2025-09-07T07:38:20.768Z,1757230700.768 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PRIMING (@200.0)
2025-09-07T07:38:20.769Z,1757230700.769 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=84.169998 issuedCmd_=Cmd.startFiltering
2025-09-07T07:38:21.258Z,1757230701.258 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_FILTERING (@200.0)
2025-09-07T07:38:54.390Z,1757230734.390 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T07:43:17.359Z,1757230997.359 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_FILTERING (@0.0)
2025-09-07T07:43:17.762Z,1757230997.762 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2025-09-07T07:46:35.606Z,1757231195.606 [DAT](FAULT): failed to enter command mode
2025-09-07T07:46:59.458Z,1757231219.458 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T07:54:48.670Z,1757231688.670 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T08:02:38.186Z,1757232158.186 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T08:08:31.138Z,1757232511.138 [DAT](FAULT): failed to enter command mode
2025-09-07T08:10:42.342Z,1757232642.342 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T08:12:24.046Z,1757232744.046 [BPC1](FAULT): Failed to receive data from 29 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 36, 37, 39, 44, 54, 58.
2025-09-07T08:17:04.587Z,1757233024.587 [DAT](FAULT): failed to initialize, no bytes available on serial interface
2025-09-07T08:19:14.182Z,1757233154.182 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T08:22:47.781Z,1757233367.781 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PAUSED (@1000.0)
2025-09-07T08:22:48.224Z,1757233368.224 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_PROCESSING (@1000.0)
2025-09-07T08:22:50.239Z,1757233370.239 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing
2025-09-07T08:22:50.594Z,1757233370.594 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_WAITING_FOR_PROCESSED (@47,aRNAl_bac)
2025-09-07T08:25:26.334Z,1757233526.334 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_STOPPING (@47,aRNAl_bac)
2025-09-07T08:25:33.244Z,1757233533.244 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2025-09-07T08:25:33.606Z,1757233533.606 [ESPComponent](IMPORTANT): [sample #7] ESP sampling state: S_STOPPED
2025-09-07T08:27:03.818Z,1757233623.818 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T08:30:33.438Z,1757233833.438 [ESPComponent](IMPORTANT): [sample #7] ESP sampling sequence completed normally.
2025-09-07T08:30:34.336Z,1757233834.336 [ESPComponent](FAULT): LCB 1 fault:  Invalid Command. Current Limiter Activated.
2025-09-07T08:30:35.901Z,1757233835.901 [CircleSample:SendSampleInfo:SampleInfo:C](IMPORTANT): CntSamples =  7.000000 count 
2025-09-07T08:30:36.329Z,1757233836.329 [CircleSample:SendSampleInfo:SampleInfo:D](IMPORTANT): Science:ESPComponent.sample_number =  0 count 
2025-09-07T08:30:36.687Z,1757233836.687 [CircleSample:SendSampleInfo:SampleInfo:E](IMPORTANT): Science:ESPComponent.cartridge =  -1 count 
2025-09-07T08:30:37.143Z,1757233837.143 [CircleSample:SendSampleInfo:SampleInfo:F](IMPORTANT): Science:ESPComponent.sampleVolume =  nan ml 
2025-09-07T08:30:37.527Z,1757233837.527 [CircleSample:SendSampleInfo:SampleInfo:G](IMPORTANT): Universal:depth =  91.178986 m 
2025-09-07T08:30:37.928Z,1757233837.928 [CircleSample:SendSampleInfo:SampleInfo:H](IMPORTANT): Universal:sea_water_temperature =  10.269892 degC 
2025-09-07T08:30:38.325Z,1757233838.325 [CircleSample:SendSampleInfo:SampleInfo:I](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water =  0.144000 ug/l 
2025-09-07T08:30:39.531Z,1757233839.531 [CircleSample:CircleAndSample:Sampling:FiringOnMaxWaitNotFirstSample:Q](IMPORTANT): Sample No. 7.000000 count  completed.
2025-09-07T08:30:52.152Z,1757233852.152 [CircleSample:SetSampleOptions:U](IMPORTANT): CntSamples, DepthCircle, CircleYoYoMinDepth, CircleYoYoMaxDepth, CartridgeType (if ESP), SettleDuration,  MaximumWaitStopMission, MaximumWaitFireEndToStart, MaximumWaitFireSinceFirstSampleStart to  8.000000 count ,  45.000000 m ,  nan m ,  nan m ,  -1.000000 count ,  10.000000 min , 120.000000 min , 0.000000 min , nan min .
2025-09-07T08:30:55.821Z,1757233855.821 [CircleSample:CircleAndSample:Sampling:FiringOnMaxWaitNotFirstSample:G](IMPORTANT): Elapsed time since first sample start (=  1507.943229 min ) is longer than MaximumWaitFireSinceFirstSampleStart (=  nan min ), or elapsed time since last sample end (=  0.272264 min ) is longer than MaximumWaitFireEndToStart (=  0.000000 min ). Fire sample No. 8.000000 count 
2025-09-07T08:33:18.686Z,1757233998.686 [DAT](FAULT): failed to enter command mode
2025-09-07T08:35:08.886Z,1757234108.886 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T08:37:23.501Z,1757234243.501 [CircleSample:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At  44.950584 m , settling for  10.000000 min 
2025-09-07T08:42:57.786Z,1757234577.786 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T08:47:36.338Z,1757234856.338 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2025-09-07T08:47:36.495Z,1757234856.495 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2025-09-07T08:48:25.976Z,1757234905.976 [ESPComponent](IMPORTANT): ESP has connected as client
2025-09-07T08:48:26.818Z,1757234906.818 [ESPComponent](IMPORTANT): [sample #8] Setting cartridge argument to -1
2025-09-07T08:48:26.819Z,1757234906.819 [ESPComponent](IMPORTANT): [sample #8] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2025-09-07T08:48:27.585Z,1757234907.585 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PREPARING_SHOW_LOG
2025-09-07T08:48:27.990Z,1757234907.990 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PREPARING_SHOW_STATUS
2025-09-07T08:48:28.873Z,1757234908.873 [CircleSample:SampleAtDepth:sample:SampleWrapper:SampleESP:G](IMPORTANT): ESP sampling at  45.102684 m  in  11.389338 degC  water with  0.230400 ug/l chlorophyll fluorescence.
2025-09-07T08:48:30.029Z,1757234910.029 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_LOADING_CARTRIDGE
2025-09-07T08:49:07.627Z,1757234947.627 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PRIMING (@46,aRNAl_bac)
2025-09-07T08:49:09.629Z,1757234949.629 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PRIMING (@200.0)
2025-09-07T08:49:10.039Z,1757234950.039 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=84.169998 issuedCmd_=Cmd.startFiltering
2025-09-07T08:49:10.432Z,1757234950.432 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_FILTERING (@200.0)
2025-09-07T08:50:47.254Z,1757235047.254 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T08:53:25.841Z,1757235205.841 [BPC1](FAULT): Failed to receive data from 26 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 6, 7, 8, 9, 10, 11, 12, 13, 15, 16, 17, 18, 24, 26, 27, 33, 34, 37, 39, 44, 54, 58.
2025-09-07T08:54:06.687Z,1757235246.687 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_FILTERING (@0.0)
2025-09-07T08:54:07.049Z,1757235247.049 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2025-09-07T08:58:37.617Z,1757235517.617 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T09:04:09.574Z,1757235849.574 [DAT](FAULT): failed to set DatVerbose
2025-09-07T09:06:42.443Z,1757236002.443 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T09:14:32.890Z,1757236472.890 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T09:22:22.813Z,1757236942.813 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T09:28:16.438Z,1757237296.438 [DAT](FAULT): failed to set verbose
2025-09-07T09:30:19.826Z,1757237419.826 [DAT](FAULT): failed to enter command mode
2025-09-07T09:30:57.318Z,1757237457.318 [DAT](FAULT): failed to set DatVerbose
2025-09-07T09:30:59.191Z,1757237459.191 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T09:34:27.820Z,1757237667.820 [BPC1](FAULT): Failed to receive data from 26 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 6, 7, 8, 9, 10, 11, 12, 13, 15, 16, 17, 18, 24, 26, 27, 33, 34, 37, 39, 44, 54, 58.
2025-09-07T09:37:03.765Z,1757237823.765 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PAUSED (@1000.0)
2025-09-07T09:37:04.172Z,1757237824.172 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_PROCESSING (@1000.0)
2025-09-07T09:37:06.251Z,1757237826.251 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing
2025-09-07T09:37:06.652Z,1757237826.652 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_WAITING_FOR_PROCESSED (@46,aRNAl_bac)
2025-09-07T09:38:20.106Z,1757237900.106 [DAT](FAULT): failed to set time
2025-09-07T09:39:04.327Z,1757237944.327 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T09:39:42.650Z,1757237982.650 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_STOPPING (@46,aRNAl_bac)
2025-09-07T09:39:49.450Z,1757237989.450 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2025-09-07T09:39:49.853Z,1757237989.853 [ESPComponent](IMPORTANT): [sample #8] ESP sampling state: S_STOPPED
2025-09-07T09:44:49.669Z,1757238289.669 [ESPComponent](IMPORTANT): [sample #8] ESP sampling sequence completed normally.
2025-09-07T09:44:50.479Z,1757238290.479 [ESPComponent](FAULT): LCB 2 fault:  Hardware Overcurrent Shutdown.
2025-09-07T09:44:52.146Z,1757238292.146 [CircleSample:SendSampleInfo:SampleInfo:C](IMPORTANT): CntSamples =  8.000000 count 
2025-09-07T09:44:52.519Z,1757238292.519 [CircleSample:SendSampleInfo:SampleInfo:D](IMPORTANT): Science:ESPComponent.sample_number =  0 count 
2025-09-07T09:44:52.994Z,1757238292.994 [CircleSample:SendSampleInfo:SampleInfo:E](IMPORTANT): Science:ESPComponent.cartridge =  -1 count 
2025-09-07T09:44:53.342Z,1757238293.342 [CircleSample:SendSampleInfo:SampleInfo:F](IMPORTANT): Science:ESPComponent.sampleVolume =  nan ml 
2025-09-07T09:44:53.730Z,1757238293.730 [CircleSample:SendSampleInfo:SampleInfo:G](IMPORTANT): Universal:depth =  45.366261 m 
2025-09-07T09:44:54.143Z,1757238294.143 [CircleSample:SendSampleInfo:SampleInfo:H](IMPORTANT): Universal:sea_water_temperature =  11.380213 degC 
2025-09-07T09:44:54.622Z,1757238294.622 [CircleSample:SendSampleInfo:SampleInfo:I](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water =  0.228000 ug/l 
2025-09-07T09:44:55.762Z,1757238295.762 [CircleSample:CircleAndSample:Sampling:FiringOnMaxWaitNotFirstSample:Q](IMPORTANT): Sample No. 8.000000 count  completed.
2025-09-07T09:45:08.301Z,1757238308.301 [CircleSample:SetSampleOptions:U](IMPORTANT): CntSamples, DepthCircle, CircleYoYoMinDepth, CircleYoYoMaxDepth, CartridgeType (if ESP), SettleDuration,  MaximumWaitStopMission, MaximumWaitFireEndToStart, MaximumWaitFireSinceFirstSampleStart to  9.000000 count ,  5.000000 m ,  nan m ,  nan m ,  -1.000000 count ,  10.000000 min , 120.000000 min , 0.000000 min , nan min .
2025-09-07T09:45:11.950Z,1757238311.950 [CircleSample:CircleAndSample:Sampling:FiringOnMaxWaitNotFirstSample:G](IMPORTANT): Elapsed time since first sample start (=  1582.212240 min ) is longer than MaximumWaitFireSinceFirstSampleStart (=  nan min ), or elapsed time since last sample end (=  0.269599 min ) is longer than MaximumWaitFireEndToStart (=  0.000000 min ). Fire sample No. 9.000000 count 
2025-09-07T09:46:02.318Z,1757238362.318 [DAT](FAULT): failed to enter command mode
2025-09-07T09:47:09.686Z,1757238429.686 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T09:51:07.714Z,1757238667.714 [CircleSample:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At  4.853534 m , settling for  10.000000 min 
2025-09-07T09:54:59.514Z,1757238899.514 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T10:01:20.694Z,1757239280.694 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2025-09-07T10:01:20.835Z,1757239280.835 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2025-09-07T10:02:13.738Z,1757239333.738 [ESPComponent](IMPORTANT): ESP has connected as client
2025-09-07T10:02:14.578Z,1757239334.578 [ESPComponent](IMPORTANT): [sample #9] Setting cartridge argument to -1
2025-09-07T10:02:14.579Z,1757239334.579 [ESPComponent](IMPORTANT): [sample #9] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2025-09-07T10:02:15.346Z,1757239335.346 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PREPARING_SHOW_LOG
2025-09-07T10:02:15.753Z,1757239335.753 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PREPARING_SHOW_STATUS
2025-09-07T10:02:16.631Z,1757239336.631 [CircleSample:SampleAtDepth:sample:SampleWrapper:SampleESP:G](IMPORTANT): ESP sampling at  5.193659 m  in  15.954950 degC  water with  1.374000 ug/l chlorophyll fluorescence.
2025-09-07T10:02:17.769Z,1757239337.769 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_LOADING_CARTRIDGE
2025-09-07T10:02:49.926Z,1757239369.926 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T10:02:55.492Z,1757239375.492 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_PRIMING (@45,aRNAl_bac)
2025-09-07T10:02:57.493Z,1757239377.493 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PRIMING (@200.0)
2025-09-07T10:02:57.892Z,1757239377.892 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=84.169998 issuedCmd_=Cmd.startFiltering
2025-09-07T10:02:58.293Z,1757239378.293 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_FILTERING (@200.0)
2025-09-07T10:07:57.356Z,1757239677.356 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_FILTERING (@0.0)
2025-09-07T10:07:57.758Z,1757239677.758 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2025-09-07T10:09:27.266Z,1757239767.266 [DAT](FAULT): failed to set DatVerbose
2025-09-07T10:10:56.354Z,1757239856.354 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T10:15:29.676Z,1757240129.676 [BPC1](FAULT): Battery stick #5 (s/n: 00C2) reported TERMINATE_DISCHARGE_ALARM. Status code: 0x48C0.
2025-09-07T10:15:29.679Z,1757240129.679 [BPC1](FAULT): Battery stick #14 (s/n: 0129) reported TERMINATE_DISCHARGE_ALARM. Status code: 0x48C0.
2025-09-07T10:15:29.691Z,1757240129.691 [BPC1](FAULT): Failed to receive data from 25 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 6, 7, 8, 9, 10, 11, 12, 13, 15, 16, 17, 18, 24, 26, 27, 33, 34, 39, 44, 54, 58.
2025-09-07T10:16:28.863Z,1757240188.863 [DAT](FAULT): failed to set local address
2025-09-07T10:17:27.368Z,1757240247.368 [DAT](FAULT): failed to set DatVerbose
2025-09-07T10:19:17.954Z,1757240357.954 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T10:27:09.310Z,1757240829.310 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T10:31:09.543Z,1757241069.543 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PAUSED (@468.8)
2025-09-07T10:31:09.965Z,1757241069.965 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_PROCESSING (@468.8)
2025-09-07T10:31:11.985Z,1757241071.985 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing
2025-09-07T10:31:12.370Z,1757241072.370 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_WAITING_FOR_PROCESSED (@45,aRNAl_bac)
2025-09-07T10:33:47.959Z,1757241227.959 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_STOPPING (@45,aRNAl_bac)
2025-09-07T10:33:54.821Z,1757241234.821 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2025-09-07T10:33:55.259Z,1757241235.259 [ESPComponent](IMPORTANT): [sample #9] ESP sampling state: S_STOPPED
2025-09-07T10:35:00.586Z,1757241300.586 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T10:35:47.643Z,1757241347.643 [BPC1](FAULT): Failed to receive data from all battery packs.
2025-09-07T10:38:55.285Z,1757241535.285 [ESPComponent](IMPORTANT): [sample #9] ESP sampling sequence completed normally.
2025-09-07T10:38:56.105Z,1757241536.105 [ESPComponent](FAULT): LCB 1 fault: LCB Watchdog Reset. Hardware Overcurrent Shutdown. Current Limiter Activated.
2025-09-07T10:38:57.732Z,1757241537.732 [CircleSample:SendSampleInfo:SampleInfo:C](IMPORTANT): CntSamples =  9.000000 count 
2025-09-07T10:38:58.148Z,1757241538.148 [CircleSample:SendSampleInfo:SampleInfo:D](IMPORTANT): Science:ESPComponent.sample_number =  0 count 
2025-09-07T10:38:58.597Z,1757241538.597 [CircleSample:SendSampleInfo:SampleInfo:E](IMPORTANT): Science:ESPComponent.cartridge =  -1 count 
2025-09-07T10:38:58.970Z,1757241538.970 [CircleSample:SendSampleInfo:SampleInfo:F](IMPORTANT): Science:ESPComponent.sampleVolume =  nan ml 
2025-09-07T10:38:59.345Z,1757241539.345 [CircleSample:SendSampleInfo:SampleInfo:G](IMPORTANT): Universal:depth =  4.022453 m 
2025-09-07T10:38:59.765Z,1757241539.765 [CircleSample:SendSampleInfo:SampleInfo:H](IMPORTANT): Universal:sea_water_temperature =  15.871515 degC 
2025-09-07T10:39:00.153Z,1757241540.153 [CircleSample:SendSampleInfo:SampleInfo:I](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water =  1.356000 ug/l 
2025-09-07T10:39:01.380Z,1757241541.380 [CircleSample:CircleAndSample:Sampling:FiringOnMaxWaitNotFirstSample:Q](IMPORTANT): Sample No. 9.000000 count  completed.
2025-09-07T10:39:02.179Z,1757241542.179 [CircleSample:CircleAndSample:Sampling:FiringOnMaxWaitNotFirstSample:Surfacing:A](IMPORTANT): After sampling, surface for GPS fix.
2025-09-07T10:39:15.274Z,1757241555.274 [CircleSample:SetSampleOptions:U](IMPORTANT): CntSamples, DepthCircle, CircleYoYoMinDepth, CircleYoYoMaxDepth, CartridgeType (if ESP), SettleDuration,  MaximumWaitStopMission, MaximumWaitFireEndToStart, MaximumWaitFireSinceFirstSampleStart to  10.000000 count ,  90.000000 m ,  4.000000 m ,  90.000000 m ,  -1.000000 count ,  10.000000 min , 660.000000 min , nan min , 2160.000000 min .
2025-09-07T10:40:58.987Z,1757241658.987 [DAT](FAULT): failed to set remote address
2025-09-07T10:41:14.368Z,1757241674.368 [DAT](FAULT): failed to set remote address
2025-09-07T10:41:29.751Z,1757241689.751 [DAT](FAULT): failed to set remote address
2025-09-07T10:42:16.631Z,1757241736.631 [DAT](FAULT): failed to set remote address
2025-09-07T10:43:08.335Z,1757241788.335 [DAT](FAULT): failed to set remote address
2025-09-07T10:43:23.715Z,1757241803.715 [DAT](FAULT): failed to set remote address
2025-09-07T10:44:12.127Z,1757241852.127 [DAT](FAULT): failed to set remote address
2025-09-07T10:44:27.499Z,1757241867.499 [DAT](FAULT): failed to set remote address
2025-09-07T10:45:29.958Z,1757241929.958 [DAT](FAULT): failed to enter online mode
2025-09-07T10:45:29.958Z,1757241929.958 [DAT](FAULT): Failure returning to online mode
2025-09-07T10:46:27.839Z,1757241987.839 [DAT](FAULT): failed to set local address
2025-09-07T11:16:49.735Z,1757243809.735 [BPC1](FAULT): Failed to receive data from 27 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 39, 44, 54, 58.
2025-09-07T11:26:43.283Z,1757244403.283 [DAT](FAULT): failed to enter online mode
2025-09-07T11:26:43.283Z,1757244403.283 [DAT](FAULT): Failure returning to online mode
2025-09-07T11:28:01.675Z,1757244481.675 [DAT](FAULT): failed to enter command mode
2025-09-07T11:29:00.274Z,1757244540.274 [DAT](FAULT): failed to enter command mode
2025-09-07T11:29:45.699Z,1757244585.699 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T11:36:44.862Z,1757245004.862 [DAT](FAULT): failed to set verbose
2025-09-07T11:37:51.966Z,1757245071.966 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T11:42:38.955Z,1757245358.955 [CircleSample:L.AltitudeEnvelope](IMPORTANT): Altitude envelope ACTIVE. Altitude:4.000000m. At depth:68.405037m.
2025-09-07T11:42:38.961Z,1757245358.961 [CircleSample:StandardEnvelopes:A.AltitudeEnvelope](IMPORTANT): Altitude envelope ACTIVE. Altitude:4.000000m. At depth:68.405037m.
2025-09-07T11:45:41.745Z,1757245541.745 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T11:49:48.008Z,1757245788.008 [GFScanner](IMPORTANT): Beginning ground fault scan
2025-09-07T11:49:52.446Z,1757245792.446 [GFScanner](IMPORTANT): No ground fault detected
mA:
CHAN A0 (Batt): 0.003684
CHAN A1 (24V): 0.003346
CHAN A2 (12V): -0.015890
CHAN A3 (5V): -0.002936
CHAN B0 (3.3V): 0.000003
CHAN B1 (3.15aV): -0.000414
CHAN B2 (3.15bV): -0.001757
CHAN B3 (GND): -0.003033
OPEN: 0.005244
Full Scale: +/- 1 mA
2025-09-07T11:53:12.902Z,1757245992.902 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2025-09-07T11:57:51.712Z,1757246271.712 [BPC1](FAULT): Battery stick #37 (s/n: 00A3) reported TERMINATE_DISCHARGE_ALARM. Status code: 0x48C0.
2025-09-07T11:57:51.720Z,1757246271.720 [BPC1](FAULT): Failed to receive data from 28 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 24, 26, 27, 32, 33, 34, 39, 44, 54, 58.
2025-09-07T12:02:50.623Z,1757246570.623 [DAT](FAULT): failed to enter online mode
2025-09-07T12:02:50.623Z,1757246570.623 [DAT](FAULT): Failure returning to online mode
2025-09-07T12:03:50.727Z,1757246630.727 [DAT](FAULT): failed to set DatVerbose
2025-09-07T12:05:40.542Z,1757246740.542 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T12:11:33.830Z,1757247093.830 [DAT](FAULT): failed to enter command mode
2025-09-07T12:13:45.898Z,1757247225.898 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T12:21:36.003Z,1757247696.003 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T12:29:26.002Z,1757248166.002 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T12:34:59.047Z,1757248499.047 [DAT](FAULT): failed to set time
2025-09-07T12:37:31.392Z,1757248651.392 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T12:38:53.581Z,1757248733.581 [BPC1](FAULT): Failed to receive data from 29 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 24, 26, 27, 32, 33, 34, 37, 39, 44, 54, 58.
2025-09-07T12:45:21.810Z,1757249121.810 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T12:53:11.446Z,1757249591.446 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T13:04:05.354Z,1757250245.354 [DAT](FAULT): failed to enter online mode
2025-09-07T13:04:05.355Z,1757250245.355 [DAT](FAULT): Failure returning to online mode
2025-09-07T13:06:36.802Z,1757250396.802 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T13:08:58.354Z,1757250538.354 [CircleSample:L.AltitudeEnvelope](IMPORTANT): Altitude envelope ACTIVE. Altitude:2.000000m. At depth:84.651848m.
2025-09-07T13:08:58.358Z,1757250538.358 [CircleSample:StandardEnvelopes:A.AltitudeEnvelope](IMPORTANT): Altitude envelope ACTIVE. Altitude:2.000000m. At depth:84.651848m.
2025-09-07T13:14:26.942Z,1757250866.942 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T13:19:55.204Z,1757251195.204 [BPC1](FAULT): Failed to receive data from 29 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 24, 26, 27, 32, 33, 34, 37, 39, 44, 54, 58.
2025-09-07T13:20:07.090Z,1757251207.090 [ThrusterHE](FAULT): Could not get status:serial timeout
2025-09-07T13:20:58.814Z,1757251258.814 [ThrusterHE](FAULT): Could not get status:serial timeout
2025-09-07T13:22:09.423Z,1757251329.423 [DAT](FAULT): failed to set transmit power
2025-09-07T13:22:32.674Z,1757251352.674 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T13:30:22.602Z,1757251822.602 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T13:38:25.983Z,1757252305.983 [DAT](FAULT): failed to enter command mode
2025-09-07T13:38:28.335Z,1757252308.335 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T13:40:21.572Z,1757252421.572 [RDI_Pathfinder](IMPORTANT): Expecting PD13 message format
2025-09-07T13:45:48.031Z,1757252748.031 [DAT](FAULT): failed to enter command mode
2025-09-07T13:46:25.043Z,1757252785.043 [DAT](FAULT): failed to enter command mode
2025-09-07T13:46:48.846Z,1757252808.846 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T13:54:39.147Z,1757253279.147 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T14:00:57.168Z,1757253657.168 [BPC1](FAULT): Failed to receive data from 29 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 24, 26, 27, 32, 33, 34, 37, 39, 44, 54, 58.
2025-09-07T14:02:29.145Z,1757253749.145 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T14:22:21.191Z,1757254941.191 [DAT](FAULT): failed to enter online mode
2025-09-07T14:22:21.191Z,1757254941.191 [DAT](FAULT): Failure returning to online mode
2025-09-07T14:24:52.745Z,1757255092.745 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T14:32:42.518Z,1757255562.518 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T14:40:32.306Z,1757256032.306 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T14:40:47.022Z,1757256047.022 [ThrusterHE](FAULT): getSpeed error serial timeout
2025-09-07T14:40:47.023Z,1757256047.023 [ThrusterHE](FAULT): Thruster uart error: serial timeout
2025-09-07T14:41:58.736Z,1757256118.736 [BPC1](FAULT): Failed to receive data from 29 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 24, 26, 27, 32, 33, 34, 37, 39, 44, 54, 58.
2025-09-07T14:48:22.646Z,1757256502.646 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T14:56:13.394Z,1757256973.394 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T15:04:04.006Z,1757257444.006 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T15:09:10.900Z,1757257750.900 [RDI_Pathfinder](IMPORTANT): Expecting PD13 message format
2025-09-07T15:11:55.408Z,1757257915.408 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T15:18:23.699Z,1757258303.699 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2025-09-07T15:19:47.606Z,1757258387.606 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T15:23:00.556Z,1757258580.556 [BPC1](FAULT): Failed to receive data from 30 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 24, 26, 27, 32, 33, 34, 36, 37, 39, 44, 54, 58.
2025-09-07T15:25:38.736Z,1757258738.736 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2025-09-07T15:25:39.539Z,1757258739.539 [NAL9602](FAULT): GPS failed to acquire within timeout.
2025-09-07T15:26:11.250Z,1757258771.250 [MassServo](FAULT): Overload Error
2025-09-07T15:33:35.739Z,1757259215.739 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2025-09-07T15:33:40.240Z,1757259220.240 [DAT](FAULT): failed to enter online mode
2025-09-07T15:33:40.240Z,1757259220.240 [DAT](FAULT): Failure returning to online mode
2025-09-07T15:33:41.174Z,1757259221.174 [DAT](FAULT): LCB fault:  Invalid Command.
2025-09-07T15:36:38.987Z,1757259398.987 [DAT](FAULT): failed to set DatVerbose
2025-09-07T15:36:40.635Z,1757259400.635 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T15:36:52.507Z,1757259412.507 [RDI_Pathfinder](IMPORTANT): Expecting PD13 message format
2025-09-07T15:44:32.573Z,1757259872.573 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T15:52:24.802Z,1757260344.802 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T16:00:16.650Z,1757260816.650 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T16:04:02.347Z,1757261042.347 [BPC1](FAULT): Failed to receive data from 29 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 24, 26, 27, 32, 33, 34, 36, 37, 39, 44, 54, 58.
2025-09-07T16:08:08.394Z,1757261288.394 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T16:13:13.855Z,1757261593.855 [RDI_Pathfinder](IMPORTANT): Expecting PD13 message format
2025-09-07T16:16:00.506Z,1757261760.506 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T16:23:52.423Z,1757262232.423 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T16:31:05.931Z,1757262665.931 [DAT](FAULT): failed to set remote address
2025-09-07T16:45:04.344Z,1757263504.344 [BPC1](FAULT): Failed to receive data from 28 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 36, 37, 39, 44, 54, 58.
2025-09-07T16:47:44.643Z,1757263664.643 [DAT](FAULT): failed to enter online mode
2025-09-07T16:47:44.643Z,1757263664.643 [DAT](FAULT): Failure returning to online mode
2025-09-07T16:50:18.025Z,1757263818.025 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T16:58:10.254Z,1757264290.254 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T16:59:51.831Z,1757264391.831 [RDI_Pathfinder](IMPORTANT): Expecting PD13 message format
2025-09-07T17:06:02.494Z,1757264762.494 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T17:13:54.344Z,1757265234.344 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T17:21:46.438Z,1757265706.438 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T17:26:06.069Z,1757265966.069 [BPC1](FAULT): Failed to receive data from 28 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 36, 37, 39, 44, 54, 58.
2025-09-07T17:29:38.440Z,1757266178.440 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T17:33:03.240Z,1757266383.240 [RDI_Pathfinder](IMPORTANT): Expecting PD13 message format
2025-09-07T17:36:28.530Z,1757266588.530 [DAT](FAULT): failed to enter command mode
2025-09-07T17:39:00.799Z,1757266740.799 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2025-09-07T17:49:48.378Z,1757267388.378 [GFScanner](IMPORTANT): Beginning ground fault scan
2025-09-07T17:49:52.931Z,1757267392.931 [GFScanner](IMPORTANT): No ground fault detected
mA:
CHAN A0 (Batt): -0.000421
CHAN A1 (24V): 0.018391
CHAN A2 (12V): -0.001573
CHAN A3 (5V): -0.003880
CHAN B0 (3.3V): -0.000073
CHAN B1 (3.15aV): 0.000142
CHAN B2 (3.15bV): 0.000939
CHAN B3 (GND): -0.002840
OPEN: 0.005523
Full Scale: +/- 1 mA
2025-09-07T17:51:09.884Z,1757267469.884 [RDI_Pathfinder](IMPORTANT): Expecting PD13 message format
2025-09-07T17:58:59.763Z,1757267939.763 [DAT](FAULT): failed to enter online mode
2025-09-07T17:58:59.763Z,1757267939.763 [DAT](FAULT): Failure returning to online mode
2025-09-07T18:01:33.361Z,1757268093.361 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T18:07:05.843Z,1757268425.843 [DAT](FAULT): failed to enter command mode
2025-09-07T18:07:08.317Z,1757268428.317 [BPC1](FAULT): Failed to receive data from 27 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 37, 39, 44, 54, 58.
2025-09-07T18:09:41.697Z,1757268581.697 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T18:17:33.518Z,1757269053.518 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T18:23:06.907Z,1757269386.907 [DAT](FAULT): failed to set local address
2025-09-07T18:25:41.210Z,1757269541.210 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T18:33:33.189Z,1757270013.189 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T18:40:42.095Z,1757270442.095 [RDI_Pathfinder](IMPORTANT): Expecting PD13 message format
2025-09-07T18:41:08.907Z,1757270468.907 [DAT](FAULT): failed to set transmit power
2025-09-07T20:32:31.539Z,1757277151.539 [ESPComponent](IMPORTANT): [sample #10] ESP log summary report (2 messages):
@12:38:13.61 Selecting Cartridge 44
@13:24:43.19 Sampled  1000.0ml

2025-09-07T20:32:31.540Z,1757277151.540 [ESPComponent](IMPORTANT): [sample #10] ESP Cartridge 44: S_FILTERING: start: 2025-09-07T19:43:33.572Z end: 2025-09-07T20:24:45.931Z Sampled:  1000.0ml
2025-09-07T21:41:47.188Z,1757281307.188 [ESPComponent](IMPORTANT): [sample #11] ESP log summary report (2 messages):
@13:50:36.69 Selecting Cartridge 43
@14:33:59.27 Sampled  1000.0ml

2025-09-07T21:41:47.190Z,1757281307.190 [ESPComponent](IMPORTANT): [sample #11] ESP Cartridge 43: S_FILTERING: start: 2025-09-07T20:55:56.389Z end: 2025-09-07T21:34:01.660Z Sampled:  1000.0ml
2025-09-07T22:37:57.944Z,1757284677.944 [ESPComponent](IMPORTANT): [sample #12] ESP log summary report (5 messages):
@14:59:37.70 Selecting Cartridge 42
@14:59:38.33 Slide::Error in LRAUV -- Storage Carousel (SC) positionErr at 42 + 31 counts (sensed 42 + 38 counts)
@14:59:38.35 Retry #1 of 4
@15:30:10.39 Cartridge::Sampler::Stuffed in FILTERING -- Cartridge clogged
@15:30:10.55 Sampled  537.5ml

2025-09-07T22:37:57.954Z,1757284677.954 [ESPComponent](IMPORTANT): [sample #12] ESP Cartridge 42: S_FILTERING: start: 2025-09-07T22:04:59.092Z end: 2025-09-07T22:30:12.349Z Sampled:  537.5ml
2025-09-07T18:44:03.822Z,1757270643.822 [RudderServo](FAULT): Rudder uart error - getPosition..serial timeout
2025-09-07T18:48:10.432Z,1757270890.432 [BPC1](FAULT): Failed to receive data from 27 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 37, 39, 44, 54, 58.
2025-09-07T18:48:10.486Z,1757270890.486 [DAT](FAULT): failed to enter online mode
2025-09-07T18:48:10.486Z,1757270890.486 [DAT](FAULT): Failure returning to online mode
2025-09-07T18:50:01.127Z,1757271001.127 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2025-09-07T18:50:43.791Z,1757271043.791 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T18:51:35.724Z,1757271095.724 [CircleSample:L.AltitudeEnvelope](IMPORTANT): Altitude envelope ACTIVE. Altitude:3.000000m. At depth:82.890106m.
2025-09-07T18:51:35.728Z,1757271095.728 [CircleSample:StandardEnvelopes:A.AltitudeEnvelope](IMPORTANT): Altitude envelope ACTIVE. Altitude:3.000000m. At depth:82.890106m.
2025-09-07T18:57:22.544Z,1757271442.544 [RDI_Pathfinder](IMPORTANT): Expecting PD13 message format
2025-09-07T18:58:35.590Z,1757271515.590 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T19:05:14.164Z,1757271914.164 [DAT](FAULT): failed to set local address
2025-09-07T19:06:43.166Z,1757272003.166 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T19:12:15.999Z,1757272335.999 [DAT](FAULT): failed to set local address
2025-09-07T19:14:41.991Z,1757272481.991 [DAT](FAULT): failed to set verbose
2025-09-07T19:15:06.142Z,1757272506.142 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T19:22:57.410Z,1757272977.410 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T19:23:00.868Z,1757272980.868 [CircleSample:CircleAndSample:Sampling:FiringOnMaxWaitNotFirstSample:G](IMPORTANT): Elapsed time since first sample start (=  2160.028776 min ) is longer than MaximumWaitFireSinceFirstSampleStart (=  2160.000000 min ), or elapsed time since last sample end (=  523.991309 min ) is longer than MaximumWaitFireEndToStart (=  nan min ). Fire sample No. 10.000000 count 
2025-09-07T19:24:54.116Z,1757273094.116 [RDI_Pathfinder](IMPORTANT): Expecting PD13 message format
2025-09-07T19:26:45.411Z,1757273205.411 [CircleSample:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At  90.077393 m , settling for  10.000000 min 
2025-09-07T19:29:12.129Z,1757273352.129 [BPC1](FAULT): Failed to receive data from 27 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 37, 39, 44, 54, 58.
2025-09-07T19:30:19.610Z,1757273419.610 [DAT](FAULT): failed to set transmit power
2025-09-07T19:30:57.275Z,1757273457.275 [RDI_Pathfinder](IMPORTANT): Expecting PD13 message format
2025-09-07T19:31:04.673Z,1757273464.673 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T19:36:58.203Z,1757273818.203 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2025-09-07T19:36:58.354Z,1757273818.354 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2025-09-07T19:37:20.738Z,1757273840.738 [DAT](FAULT): failed to set verbose
2025-09-07T19:37:52.330Z,1757273872.330 [ESPComponent](IMPORTANT): ESP has connected as client
2025-09-07T19:37:53.151Z,1757273873.151 [ESPComponent](IMPORTANT): [sample #10] Setting cartridge argument to -1
2025-09-07T19:37:53.152Z,1757273873.152 [ESPComponent](IMPORTANT): [sample #10] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2025-09-07T19:37:53.963Z,1757273873.963 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PREPARING_SHOW_LOG
2025-09-07T19:37:54.346Z,1757273874.346 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PREPARING_SHOW_STATUS
2025-09-07T19:37:55.251Z,1757273875.251 [CircleSample:SampleAtDepth:sample:SampleWrapper:SampleESP:G](IMPORTANT): ESP sampling at  89.161987 m  in  10.180628 degC  water with  0.129600 ug/l chlorophyll fluorescence.
2025-09-07T19:37:56.378Z,1757273876.378 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_LOADING_CARTRIDGE
2025-09-07T19:38:34.145Z,1757273914.145 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PRIMING (@44,aRNAl_bac)
2025-09-07T19:38:36.938Z,1757273916.938 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PRIMING (@200.0)
2025-09-07T19:38:36.939Z,1757273916.939 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=84.169998 issuedCmd_=Cmd.startFiltering
2025-09-07T19:38:37.360Z,1757273917.360 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_FILTERING (@200.0)
2025-09-07T19:38:41.927Z,1757273921.927 [DAT](FAULT): failed to enter command mode
2025-09-07T19:39:28.394Z,1757273968.394 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T19:43:33.572Z,1757274213.572 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_FILTERING (@0.0)
2025-09-07T19:43:34.014Z,1757274214.014 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2025-09-07T19:45:22.845Z,1757274322.845 [DAT](FAULT): failed to set transmit power
2025-09-07T19:47:05.903Z,1757274425.903 [DAT](FAULT): failed to enter command mode
2025-09-07T19:47:52.334Z,1757274472.334 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T19:55:55.082Z,1757274955.082 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T20:01:28.018Z,1757275288.018 [DAT](FAULT): failed to set DatVerbose
2025-09-07T20:04:04.150Z,1757275444.150 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T20:10:14.302Z,1757275814.302 [BPC1](FAULT): Failed to receive data from 27 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 37, 39, 44, 54, 58.
2025-09-07T20:11:57.063Z,1757275917.063 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T20:17:46.592Z,1757276266.592 [RDI_Pathfinder](IMPORTANT): Expecting PD13 message format
2025-09-07T20:19:20.037Z,1757276360.037 [DAT](FAULT): failed to set local address
2025-09-07T20:20:05.342Z,1757276405.342 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T20:24:45.494Z,1757276685.494 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PAUSED (@1000.0)
2025-09-07T20:24:45.932Z,1757276685.932 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_PROCESSING (@1000.0)
2025-09-07T20:24:47.954Z,1757276687.954 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing
2025-09-07T20:24:48.326Z,1757276688.326 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_WAITING_FOR_PROCESSED (@44,aRNAl_bac)
2025-09-07T20:25:59.675Z,1757276759.675 [DAT](FAULT): failed to enter command mode
2025-09-07T20:27:23.977Z,1757276843.977 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_STOPPING (@44,aRNAl_bac)
2025-09-07T20:27:30.854Z,1757276850.854 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2025-09-07T20:27:31.346Z,1757276851.346 [ESPComponent](IMPORTANT): [sample #10] ESP sampling state: S_STOPPED
2025-09-07T20:28:14.406Z,1757276894.406 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T20:32:31.134Z,1757277151.134 [ESPComponent](IMPORTANT): [sample #10] ESP sampling sequence completed normally.
2025-09-07T20:32:33.679Z,1757277153.679 [CircleSample:SendSampleInfo:SampleInfo:C](IMPORTANT): CntSamples =  10.000000 count 
2025-09-07T20:32:34.111Z,1757277154.111 [CircleSample:SendSampleInfo:SampleInfo:D](IMPORTANT): Science:ESPComponent.sample_number =  0 count 
2025-09-07T20:32:34.522Z,1757277154.522 [CircleSample:SendSampleInfo:SampleInfo:E](IMPORTANT): Science:ESPComponent.cartridge =  -1 count 
2025-09-07T20:32:34.940Z,1757277154.940 [CircleSample:SendSampleInfo:SampleInfo:F](IMPORTANT): Science:ESPComponent.sampleVolume =  nan ml 
2025-09-07T20:32:35.295Z,1757277155.295 [CircleSample:SendSampleInfo:SampleInfo:G](IMPORTANT): Universal:depth =  88.673828 m 
2025-09-07T20:32:35.728Z,1757277155.728 [CircleSample:SendSampleInfo:SampleInfo:H](IMPORTANT): Universal:sea_water_temperature =  10.422602 degC 
2025-09-07T20:32:36.132Z,1757277156.132 [CircleSample:SendSampleInfo:SampleInfo:I](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water =  0.168000 ug/l 
2025-09-07T20:32:37.316Z,1757277157.316 [CircleSample:CircleAndSample:Sampling:FiringOnMaxWaitNotFirstSample:Q](IMPORTANT): Sample No. 10.000000 count  completed.
2025-09-07T20:32:49.911Z,1757277169.911 [CircleSample:SetSampleOptions:U](IMPORTANT): CntSamples, DepthCircle, CircleYoYoMinDepth, CircleYoYoMaxDepth, CartridgeType (if ESP), SettleDuration,  MaximumWaitStopMission, MaximumWaitFireEndToStart, MaximumWaitFireSinceFirstSampleStart to  11.000000 count ,  45.000000 m ,  nan m ,  nan m ,  -1.000000 count ,  10.000000 min , 120.000000 min , 0.000000 min , nan min .
2025-09-07T20:32:53.525Z,1757277173.525 [CircleSample:CircleAndSample:Sampling:FiringOnMaxWaitNotFirstSample:G](IMPORTANT): Elapsed time since first sample start (=  2229.905469 min ) is longer than MaximumWaitFireSinceFirstSampleStart (=  nan min ), or elapsed time since last sample end (=  0.269808 min ) is longer than MaximumWaitFireEndToStart (=  0.000000 min ). Fire sample No. 11.000000 count 
2025-09-07T20:36:06.334Z,1757277366.334 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T20:39:08.200Z,1757277548.200 [CircleSample:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At  44.950588 m , settling for  10.000000 min 
2025-09-07T20:41:38.843Z,1757277698.843 [DAT](FAULT): failed to set DatVerbose
2025-09-07T20:44:13.774Z,1757277853.774 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T20:49:20.914Z,1757278160.914 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2025-09-07T20:49:21.031Z,1757278161.031 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2025-09-07T20:50:15.341Z,1757278215.341 [ESPComponent](IMPORTANT): ESP has connected as client
2025-09-07T20:50:16.136Z,1757278216.136 [ESPComponent](IMPORTANT): [sample #11] Setting cartridge argument to -1
2025-09-07T20:50:16.136Z,1757278216.136 [ESPComponent](IMPORTANT): [sample #11] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2025-09-07T20:50:17.020Z,1757278217.020 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PREPARING_SHOW_LOG
2025-09-07T20:50:17.344Z,1757278217.344 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PREPARING_SHOW_STATUS
2025-09-07T20:50:18.198Z,1757278218.198 [CircleSample:SampleAtDepth:sample:SampleWrapper:SampleESP:G](IMPORTANT): ESP sampling at  45.560272 m  in  11.422388 degC  water with  0.253200 ug/l chlorophyll fluorescence.
2025-09-07T20:50:19.358Z,1757278219.358 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_LOADING_CARTRIDGE
2025-09-07T20:50:56.965Z,1757278256.965 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PRIMING (@43,aRNAl_bac)
2025-09-07T20:50:58.983Z,1757278258.983 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PRIMING (@200.0)
2025-09-07T20:50:59.386Z,1757278259.386 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=84.169998 issuedCmd_=Cmd.startFiltering
2025-09-07T20:50:59.765Z,1757278259.765 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_FILTERING (@200.0)
2025-09-07T20:51:16.395Z,1757278276.395 [BPC1](FAULT): Failed to receive data from 28 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 37, 38, 39, 44, 54, 58.
2025-09-07T20:52:07.158Z,1757278327.158 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T20:55:56.389Z,1757278556.389 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_FILTERING (@0.0)
2025-09-07T20:55:56.859Z,1757278556.859 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2025-09-07T21:00:00.582Z,1757278800.582 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T21:07:00.826Z,1757279220.826 [DAT](FAULT): failed to enter command mode
2025-09-07T21:08:09.063Z,1757279289.063 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T21:10:12.598Z,1757279412.598 [BPC1](FAULT): Failed to receive data from all battery packs.
2025-09-07T21:15:54.071Z,1757279754.071 [DAT](FAULT): failed to enter command mode
2025-09-07T21:16:18.667Z,1757279778.667 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T21:23:20.314Z,1757280200.314 [DAT](FAULT): failed to enter command mode
2025-09-07T21:24:32.330Z,1757280272.330 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T21:29:29.758Z,1757280569.758 [BPC1](FAULT): Failed to receive data from all battery packs.
2025-09-07T21:32:27.206Z,1757280747.206 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T21:34:01.271Z,1757280841.271 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PAUSED (@1000.0)
2025-09-07T21:34:01.660Z,1757280841.660 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_PROCESSING (@1000.0)
2025-09-07T21:34:03.689Z,1757280843.689 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing
2025-09-07T21:34:04.087Z,1757280844.087 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_WAITING_FOR_PROCESSED (@43,aRNAl_bac)
2025-09-07T21:36:39.776Z,1757280999.776 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_STOPPING (@43,aRNAl_bac)
2025-09-07T21:36:46.691Z,1757281006.691 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2025-09-07T21:36:47.189Z,1757281007.189 [ESPComponent](IMPORTANT): [sample #11] ESP sampling state: S_STOPPED
2025-09-07T21:37:59.599Z,1757281079.599 [DAT](FAULT): failed to enter command mode
2025-09-07T21:40:42.521Z,1757281242.521 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T21:41:46.828Z,1757281306.828 [ESPComponent](IMPORTANT): [sample #11] ESP sampling sequence completed normally.
2025-09-07T21:41:49.259Z,1757281309.259 [CircleSample:SendSampleInfo:SampleInfo:C](IMPORTANT): CntSamples =  11.000000 count 
2025-09-07T21:41:49.636Z,1757281309.636 [CircleSample:SendSampleInfo:SampleInfo:D](IMPORTANT): Science:ESPComponent.sample_number =  0 count 
2025-09-07T21:41:50.048Z,1757281310.048 [CircleSample:SendSampleInfo:SampleInfo:E](IMPORTANT): Science:ESPComponent.cartridge =  -1 count 
2025-09-07T21:41:50.462Z,1757281310.462 [CircleSample:SendSampleInfo:SampleInfo:F](IMPORTANT): Science:ESPComponent.sampleVolume =  nan ml 
2025-09-07T21:41:50.902Z,1757281310.902 [CircleSample:SendSampleInfo:SampleInfo:G](IMPORTANT): Universal:depth =  44.707752 m 
2025-09-07T21:41:51.340Z,1757281311.340 [CircleSample:SendSampleInfo:SampleInfo:H](IMPORTANT): Universal:sea_water_temperature =  11.736109 degC 
2025-09-07T21:41:51.785Z,1757281311.785 [CircleSample:SendSampleInfo:SampleInfo:I](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water =  0.336000 ug/l 
2025-09-07T21:41:52.913Z,1757281312.913 [CircleSample:CircleAndSample:Sampling:FiringOnMaxWaitNotFirstSample:Q](IMPORTANT): Sample No. 11.000000 count  completed.
2025-09-07T21:42:05.464Z,1757281325.464 [CircleSample:SetSampleOptions:U](IMPORTANT): CntSamples, DepthCircle, CircleYoYoMinDepth, CircleYoYoMaxDepth, CartridgeType (if ESP), SettleDuration,  MaximumWaitStopMission, MaximumWaitFireEndToStart, MaximumWaitFireSinceFirstSampleStart to  12.000000 count ,  5.000000 m ,  nan m ,  nan m ,  -1.000000 count ,  10.000000 min , 120.000000 min , 0.000000 min , nan min .
2025-09-07T21:42:09.140Z,1757281329.140 [CircleSample:CircleAndSample:Sampling:FiringOnMaxWaitNotFirstSample:G](IMPORTANT): Elapsed time since first sample start (=  2299.165885 min ) is longer than MaximumWaitFireSinceFirstSampleStart (=  nan min ), or elapsed time since last sample end (=  0.271939 min ) is longer than MaximumWaitFireEndToStart (=  0.000000 min ). Fire sample No. 12.000000 count 
2025-09-07T21:48:08.143Z,1757281688.143 [CircleSample:SampleAtDepth:sample:SampleWrapper:B](IMPORTANT): At  4.907557 m , settling for  10.000000 min 
2025-09-07T21:48:36.450Z,1757281716.450 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T21:56:30.333Z,1757282190.333 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T21:58:20.835Z,1757282300.835 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8
2025-09-07T21:58:20.968Z,1757282300.968 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000)
2025-09-07T21:59:14.939Z,1757282354.939 [ESPComponent](IMPORTANT): ESP has connected as client
2025-09-07T21:59:15.725Z,1757282355.725 [ESPComponent](IMPORTANT): [sample #12] Setting cartridge argument to -1
2025-09-07T21:59:15.726Z,1757282355.726 [ESPComponent](IMPORTANT): [sample #12] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT
2025-09-07T21:59:16.530Z,1757282356.530 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PREPARING_SHOW_LOG
2025-09-07T21:59:16.965Z,1757282356.965 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PREPARING_SHOW_STATUS
2025-09-07T21:59:17.799Z,1757282357.799 [CircleSample:SampleAtDepth:sample:SampleWrapper:SampleESP:G](IMPORTANT): ESP sampling at  5.319855 m  in  15.762506 degC  water with  1.312800 ug/l chlorophyll fluorescence.
2025-09-07T21:59:18.961Z,1757282358.961 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_LOADING_CARTRIDGE
2025-09-07T21:59:58.756Z,1757282398.756 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PRIMING (@42,aRNAl_bac)
2025-09-07T22:00:00.734Z,1757282400.734 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PRIMING (@200.0)
2025-09-07T22:00:01.106Z,1757282401.106 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=84.169998 issuedCmd_=Cmd.startFiltering
2025-09-07T22:00:01.517Z,1757282401.517 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_FILTERING (@200.0)
2025-09-07T22:04:24.194Z,1757282664.194 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T22:04:59.093Z,1757282699.093 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_FILTERING (@0.0)
2025-09-07T22:04:59.497Z,1757282699.497 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0)
2025-09-07T22:10:31.865Z,1757283031.865 [BPC1](FAULT): Failed to receive data from 27 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 38, 39, 44, 54, 58.
2025-09-07T22:12:18.206Z,1757283138.206 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T22:20:12.097Z,1757283612.097 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T22:28:06.026Z,1757284086.026 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T22:30:11.933Z,1757284211.933 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PAUSED (@537.5)
2025-09-07T22:30:12.349Z,1757284212.349 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_PROCESSING (@537.5)
2025-09-07T22:30:14.361Z,1757284214.361 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing
2025-09-07T22:30:14.784Z,1757284214.784 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_WAITING_FOR_PROCESSED (@42,aRNAl_bac)
2025-09-07T22:32:50.318Z,1757284370.318 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_STOPPING (@42,aRNAl_bac)
2025-09-07T22:32:57.206Z,1757284377.206 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs &
2025-09-07T22:32:57.625Z,1757284377.625 [ESPComponent](IMPORTANT): [sample #12] ESP sampling state: S_STOPPED
2025-09-07T22:36:00.186Z,1757284560.186 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T22:37:57.535Z,1757284677.535 [ESPComponent](IMPORTANT): [sample #12] ESP sampling sequence completed normally.
2025-09-07T22:37:59.985Z,1757284679.985 [CircleSample:SendSampleInfo:SampleInfo:C](IMPORTANT): CntSamples =  12.000000 count 
2025-09-07T22:38:00.431Z,1757284680.431 [CircleSample:SendSampleInfo:SampleInfo:D](IMPORTANT): Science:ESPComponent.sample_number =  0 count 
2025-09-07T22:38:00.937Z,1757284680.937 [CircleSample:SendSampleInfo:SampleInfo:E](IMPORTANT): Science:ESPComponent.cartridge =  -1 count 
2025-09-07T22:38:01.278Z,1757284681.278 [CircleSample:SendSampleInfo:SampleInfo:F](IMPORTANT): Science:ESPComponent.sampleVolume =  nan ml 
2025-09-07T22:38:01.705Z,1757284681.705 [CircleSample:SendSampleInfo:SampleInfo:G](IMPORTANT): Universal:depth =  4.378570 m 
2025-09-07T22:38:02.111Z,1757284682.111 [CircleSample:SendSampleInfo:SampleInfo:H](IMPORTANT): Universal:sea_water_temperature =  15.651087 degC 
2025-09-07T22:38:02.482Z,1757284682.482 [CircleSample:SendSampleInfo:SampleInfo:I](IMPORTANT): Universal:mass_concentration_of_chlorophyll_in_sea_water =  1.212000 ug/l 
2025-09-07T22:38:03.693Z,1757284683.693 [CircleSample:CircleAndSample:Sampling:FiringOnMaxWaitNotFirstSample:Q](IMPORTANT): Sample No. 12.000000 count  completed.
2025-09-07T22:38:04.517Z,1757284684.517 [CircleSample:CircleAndSample:Sampling:FiringOnMaxWaitNotFirstSample:Surfacing:A](IMPORTANT): After sampling, surface for GPS fix.
2025-09-07T22:38:17.590Z,1757284697.590 [CircleSample:SetSampleOptions:U](IMPORTANT): CntSamples, DepthCircle, CircleYoYoMinDepth, CircleYoYoMaxDepth, CartridgeType (if ESP), SettleDuration,  MaximumWaitStopMission, MaximumWaitFireEndToStart, MaximumWaitFireSinceFirstSampleStart to  13.000000 count ,  90.000000 m ,  4.000000 m ,  90.000000 m ,  -1.000000 count ,  10.000000 min , 660.000000 min , nan min , 2880.000000 min .
2025-09-07T22:43:06.983Z,1757284986.983 [DAT](FAULT): failed to enter online mode
2025-09-07T22:43:06.983Z,1757284986.983 [DAT](FAULT): Failure returning to online mode
2025-09-07T22:45:42.162Z,1757285142.162 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T22:51:33.676Z,1757285493.676 [BPC1](FAULT): Failed to receive data from 27 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 38, 39, 44, 54, 58.
2025-09-07T22:53:36.550Z,1757285616.550 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T22:59:08.914Z,1757285948.914 [DAT](FAULT): failed to set verbose
2025-09-07T23:00:09.042Z,1757286009.042 [DAT](FAULT): failed to set transmit power
2025-09-07T23:01:09.247Z,1757286069.247 [DAT](FAULT): failed to set local address
2025-09-07T23:01:45.743Z,1757286105.743 [DAT](FAULT): failed to enter command mode
2025-09-07T23:02:32.217Z,1757286152.217 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T23:10:26.357Z,1757286626.357 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T23:18:12.683Z,1757287092.683 [DAT](FAULT): failed to set local address
2025-09-07T23:18:36.046Z,1757287116.046 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T23:25:16.086Z,1757287516.086 [DAT](FAULT): failed to set local address
2025-09-07T23:26:46.271Z,1757287606.271 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T23:28:42.014Z,1757287722.014 [RudderServo](FAULT): Reading outside of valid range:0.000000

2025-09-07T23:28:42.678Z,1757287722.678 [RudderServo](FAULT): Rudder uart error - getPosition..serial timeout
2025-09-07T23:32:35.451Z,1757287955.451 [BPC1](FAULT): Failed to receive data from 27 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 38, 39, 44, 54, 58.
2025-09-07T23:34:53.687Z,1757288093.687 [DAT](FAULT): failed to enter command mode
2025-09-07T23:34:55.866Z,1757288095.866 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T23:42:49.842Z,1757288569.842 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T23:48:34.863Z,1757288914.863 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2025-09-07T23:49:48.639Z,1757288988.639 [GFScanner](IMPORTANT): Beginning ground fault scan
2025-09-07T23:49:52.909Z,1757288992.909 [GFScanner](IMPORTANT): No ground fault detected
mA:
CHAN A0 (Batt): 0.002310
CHAN A1 (24V): 0.019652
CHAN A2 (12V): -0.004409
CHAN A3 (5V): -0.006894
CHAN B0 (3.3V): -0.000809
CHAN B1 (3.15aV): -0.000143
CHAN B2 (3.15bV): 0.000353
CHAN B3 (GND): -0.005857
OPEN: 0.005718
Full Scale: +/- 1 mA
2025-09-07T23:52:48.390Z,1757289168.390 [DAT](FAULT): failed to enter online mode
2025-09-07T23:52:48.391Z,1757289168.391 [DAT](FAULT): Failure returning to online mode
2025-09-07T23:53:27.760Z,1757289207.760 [RDI_Pathfinder](IMPORTANT): Expecting PD13 message format
2025-09-07T23:55:23.638Z,1757289323.638 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-07T23:56:28.825Z,1757289388.825 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2025-09-08T00:02:24.387Z,1757289744.387 [DAT](FAULT): failed to enter command mode
2025-09-08T00:03:24.551Z,1757289804.551 [DAT](FAULT): failed to set DatVerbose
2025-09-08T00:03:48.202Z,1757289828.202 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T00:11:42.591Z,1757290302.591 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T00:13:37.059Z,1757290417.059 [BPC1](FAULT): Failed to receive data from 28 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 36, 38, 39, 44, 54, 58.
2025-09-08T00:19:28.399Z,1757290768.399 [DAT](FAULT): failed to set transmit power
2025-09-08T00:19:52.159Z,1757290792.159 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T00:27:46.310Z,1757291266.310 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T00:35:40.177Z,1757291740.177 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T00:41:34.335Z,1757292094.335 [DAT](FAULT): failed to enter command mode
2025-09-08T00:43:49.366Z,1757292229.366 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T00:49:43.567Z,1757292583.567 [DAT](FAULT): failed to enter command mode
2025-09-08T00:51:58.373Z,1757292718.373 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T00:54:39.076Z,1757292879.076 [BPC1](FAULT): Failed to receive data from 27 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 36, 38, 39, 44, 54, 58.
2025-09-08T00:57:39.272Z,1757293059.272 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2025-09-08T00:59:37.319Z,1757293177.319 [DAT](FAULT): failed to enter online mode
2025-09-08T00:59:37.319Z,1757293177.319 [DAT](FAULT): Failure returning to online mode
2025-09-08T01:02:22.385Z,1757293342.385 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T01:08:16.990Z,1757293696.990 [DAT](FAULT): failed to set verbose
2025-09-08T01:10:31.654Z,1757293831.654 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T01:18:41.367Z,1757294321.367 [DAT](FAULT): failed to set DatVerbose
2025-09-08T01:18:43.357Z,1757294323.357 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T01:26:36.954Z,1757294796.954 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T01:34:44.698Z,1757295284.698 [DAT](FAULT): failed to set DatVerbose
2025-09-08T01:34:46.309Z,1757295286.309 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T01:35:40.847Z,1757295340.847 [BPC1](FAULT): Failed to receive data from 27 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 36, 38, 39, 44, 54, 58.
2025-09-08T01:42:40.834Z,1757295760.834 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T01:50:48.598Z,1757296248.598 [DAT](FAULT): failed to set local address
2025-09-08T01:50:50.026Z,1757296250.026 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T01:58:44.054Z,1757296724.054 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T02:16:38.155Z,1757297798.155 [DAT](FAULT): failed to enter online mode
2025-09-08T02:16:38.155Z,1757297798.155 [DAT](FAULT): Failure returning to online mode
2025-09-08T02:16:42.804Z,1757297802.804 [BPC1](FAULT): Failed to receive data from 26 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 36, 39, 44, 54, 58.
2025-09-08T02:19:13.697Z,1757297953.697 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T02:27:08.038Z,1757298428.038 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T02:32:40.035Z,1757298760.035 [DAT](FAULT): failed to enter command mode
2025-09-08T02:35:17.194Z,1757298917.194 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T02:43:10.894Z,1757299390.894 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T02:50:59.581Z,1757299859.581 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T02:57:44.556Z,1757300264.556 [BPC1](FAULT): Failed to receive data from 26 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 36, 39, 44, 54, 58.
2025-09-08T02:58:47.894Z,1757300327.894 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T03:05:02.874Z,1757300702.874 [DAT](FAULT): failed to set local address
2025-09-08T03:06:50.866Z,1757300810.866 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T03:18:26.701Z,1757301506.701 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2025-09-08T03:20:08.043Z,1757301608.043 [DAT](FAULT): failed to enter online mode
2025-09-08T03:20:08.043Z,1757301608.043 [DAT](FAULT): Failure returning to online mode
2025-09-08T03:22:37.990Z,1757301757.990 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T03:28:10.023Z,1757302090.023 [DAT](FAULT): failed to set transmit power
2025-09-08T03:29:08.379Z,1757302148.379 [DAT](FAULT): failed to set local address
2025-09-08T03:30:12.851Z,1757302212.851 [DAT](FAULT): failed to initialize, no bytes available on serial interface
2025-09-08T03:31:38.390Z,1757302298.390 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T03:37:10.099Z,1757302630.099 [DAT](FAULT): failed to enter command mode
2025-09-08T03:38:46.084Z,1757302726.084 [BPC1](FAULT): Failed to receive data from 25 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 2, 3, 4, 5, 6, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 36, 39, 44, 54, 58.
2025-09-08T03:39:42.407Z,1757302782.407 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T03:45:13.694Z,1757303113.694 [DAT](FAULT): failed to enter command mode
2025-09-08T03:46:12.102Z,1757303172.102 [DAT](FAULT): failed to set verbose
2025-09-08T03:48:00.974Z,1757303280.974 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T03:49:59.483Z,1757303399.483 [RDI_Pathfinder](IMPORTANT): Expecting PD13 message format
2025-09-08T03:54:36.686Z,1757303676.686 [DAT](FAULT): failed to enter command mode
2025-09-08T03:56:04.361Z,1757303764.361 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T04:02:19.667Z,1757304139.667 [DAT](FAULT): failed to set local address
2025-09-08T04:04:07.710Z,1757304247.710 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T04:11:55.994Z,1757304715.994 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T04:18:31.291Z,1757305111.291 [DAT](FAULT): failed to enter command mode
2025-09-08T04:19:47.932Z,1757305187.932 [BPC1](FAULT): Failed to receive data from 26 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 2, 3, 4, 5, 6, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 36, 39, 44, 54, 58.
2025-09-08T04:19:59.009Z,1757305199.009 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T04:30:25.778Z,1757305825.778 [DAT](FAULT): failed to enter online mode
2025-09-08T04:30:25.779Z,1757305825.779 [DAT](FAULT): Failure returning to online mode
2025-09-08T04:32:26.251Z,1757305946.251 [DAT](FAULT): failed to set verbose
2025-09-08T04:33:11.042Z,1757305991.042 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T04:40:58.922Z,1757306458.922 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T04:48:47.010Z,1757306927.010 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T04:55:01.130Z,1757307301.130 [DAT](FAULT): failed to set verbose
2025-09-08T04:56:50.598Z,1757307410.598 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T05:01:57.337Z,1757307717.337 [BPC1](FAULT): Failed to receive data from 26 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 2, 3, 4, 5, 6, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 36, 39, 44, 54, 58.
2025-09-08T05:04:38.502Z,1757307878.502 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T05:12:26.057Z,1757308346.057 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T05:20:13.926Z,1757308813.926 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T05:28:01.833Z,1757309281.833 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T05:32:22.560Z,1757309542.560 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2025-09-08T05:34:20.755Z,1757309660.755 [DAT](FAULT): failed to set remote address
2025-09-08T05:38:24.939Z,1757309904.939 [RDI_Pathfinder](IMPORTANT): Expecting PD13 message format
2025-09-08T05:40:41.291Z,1757310041.291 [CircleSample:L.AltitudeEnvelope](IMPORTANT): Altitude envelope ACTIVE. Altitude:4.820000m. At depth:86.640388m.
2025-09-08T05:40:41.296Z,1757310041.296 [CircleSample:StandardEnvelopes:A.AltitudeEnvelope](IMPORTANT): Altitude envelope ACTIVE. Altitude:4.820000m. At depth:86.640388m.
2025-09-08T05:41:00.914Z,1757310060.914 [MassServo](FAULT): Overload Error
2025-09-08T05:42:59.612Z,1757310179.612 [BPC1](FAULT): Battery stick #37 (s/n: 00A3) reported TERMINATE_DISCHARGE_ALARM. Status code: 0x48C0.
2025-09-08T05:42:59.624Z,1757310179.624 [BPC1](FAULT): Failed to receive data from 26 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 2, 3, 4, 5, 6, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 36, 39, 44, 54, 58.
2025-09-08T05:49:48.963Z,1757310588.963 [GFScanner](IMPORTANT): Beginning ground fault scan
2025-09-08T05:49:53.452Z,1757310593.452 [GFScanner](IMPORTANT): No ground fault detected
mA:
CHAN A0 (Batt): -0.000316
CHAN A1 (24V): 0.014865
CHAN A2 (12V): -0.005330
CHAN A3 (5V): -0.008386
CHAN B0 (3.3V): 0.000275
CHAN B1 (3.15aV): 0.000491
CHAN B2 (3.15bV): -0.000144
CHAN B3 (GND): -0.001729
OPEN: 0.005535
Full Scale: +/- 1 mA
2025-09-08T05:54:43.658Z,1757310883.658 [DAT](FAULT): failed to enter online mode
2025-09-08T05:54:43.658Z,1757310883.658 [DAT](FAULT): Failure returning to online mode
2025-09-08T05:55:36.658Z,1757310936.658 [MassServo](FAULT): Overload Error
2025-09-08T05:56:44.239Z,1757311004.239 [DAT](FAULT): failed to enter command mode
2025-09-08T05:57:29.233Z,1757311049.233 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T06:03:43.663Z,1757311423.663 [DAT](FAULT): failed to set verbose
2025-09-08T06:05:32.634Z,1757311532.634 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T06:10:41.086Z,1757311841.086 [MassServo](FAULT): Overload Error
2025-09-08T06:12:51.075Z,1757311971.075 [DAT](FAULT): failed to enter command mode
2025-09-08T06:13:35.995Z,1757312015.995 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T06:21:15.903Z,1757312475.903 [DAT](FAULT): failed to enter command mode
2025-09-08T06:21:39.562Z,1757312499.562 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T06:23:12.306Z,1757312592.306 [RDI_Pathfinder](IMPORTANT): Expecting PD13 message format
2025-09-08T06:24:01.249Z,1757312641.249 [BPC1](FAULT): Failed to receive data from 27 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 2, 3, 4, 5, 6, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 36, 37, 39, 44, 54, 58.
2025-09-08T06:24:29.955Z,1757312669.955 [CircleSample:L.AltitudeEnvelope](IMPORTANT): Altitude envelope ACTIVE. Altitude:4.870000m. At depth:83.786972m.
2025-09-08T06:24:29.964Z,1757312669.964 [CircleSample:StandardEnvelopes:A.AltitudeEnvelope](IMPORTANT): Altitude envelope ACTIVE. Altitude:4.870000m. At depth:83.786972m.
2025-09-08T06:28:57.818Z,1757312937.818 [DAT](FAULT): failed to enter command mode
2025-09-08T06:29:42.794Z,1757312982.794 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T06:37:30.687Z,1757313450.687 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T06:38:06.398Z,1757313486.398 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2025-09-08T06:40:39.174Z,1757313639.174 [MassServo](FAULT): Overload Error
2025-09-08T06:45:18.439Z,1757313918.439 [CBIT](FAULT): Communications Fault in component: DAT
2025-09-08T06:48:28.087Z,1757314108.087 [NAL9602](FAULT): GPS failed to acquire within timeout.
2025-09-08T06:57:36.422Z,1757314656.422 [Radio_Surface](FAULT): LCB fault:  Invalid Command.
2025-09-08T07:00:42.409Z,1757314842.409 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session.
2025-09-08T07:05:03.200Z,1757315103.200 [BPC1](FAULT): Failed to receive data from 28 sticks prior to timeout. Will not retry this scan cycle. Missing stick IDs are: 1, 2, 3, 4, 5, 6, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 24, 26, 27, 33, 34, 36, 37, 39, 44, 54, 58.
2025-09-08T07:16:01.123Z,1757315761.123 [DAT](FAULT): failed to enter online mode
2025-09-08T07:16:01.123Z,1757315761.123 [DAT](FAULT): Failure returning to online mode
2025-09-08T07:17:23.980Z,1757315843.980 [CircleSample:CycleLogs:A:B](IMPORTANT): Restarting logs.