2023-05-12T18:38:35.130Z,1683916715.130 [Supervisor](IMPORTANT): Reading configuration overrides from Data/persisted.cfg 2023-05-12T18:38:37.686Z,1683916717.686 [StratificationFrontDetector](IMPORTANT): thresholdVTHI set to: 0.100000 degC 2023-05-12T18:38:39.010Z,1683916719.010 [SBIT](IMPORTANT): git: 2023-05-11 2023-05-12T18:38:39.011Z,1683916719.011 [SBIT](IMPORTANT): Kernel Release: 2.6.27.8 2023-05-12T18:38:39.819Z,1683916719.819 [DropWeight](CRITICAL): DROP WEIGHT MISSING. 2023-05-12T18:38:39.837Z,1683916719.837 [CommandExec](FAULT): Scheduling is paused 2023-05-12T18:38:39.849Z,1683916719.849 [CBIT](CRITICAL): Hardware Fault in component: DropWeight 2023-05-12T18:39:11.182Z,1683916751.182 [CommandExec](IMPORTANT): got command failComponent none DropWeight 2023-05-12T18:39:11.182Z,1683916751.182 [CommandExec](IMPORTANT): DropWeight failureMode is No Fault 2023-05-12T18:39:39.338Z,1683916779.338 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-12T18:40:03.658Z,1683916803.658 [CommandExec](IMPORTANT): got command set NAL9602.latitude_fix 36.8 degree 2023-05-12T18:40:03.659Z,1683916803.659 [CommandExec](IMPORTANT): got command set NAL9602.longitude_fix -121 degree 2023-05-12T18:40:03.660Z,1683916803.660 [CommandExec](IMPORTANT): got command set NAL9602.time_fix 1683916715 second 2023-05-12T18:40:03.662Z,1683916803.662 [CommandExec](IMPORTANT): got command set NAL9602.goodFix 1 bool 2023-05-12T18:40:15.348Z,1683916815.348 [CommandExec](IMPORTANT): got command get NAL9602.latitude_fix 2023-05-12T18:40:15.349Z,1683916815.349 [CommandExec](IMPORTANT): NAL9602.latitude_fix 36.799999 arcdeg 2023-05-12T18:40:27.248Z,1683916827.248 [CommandExec](IMPORTANT): got command show stack 2023-05-12T18:40:27.248Z,1683916827.248 [CommandExec](IMPORTANT): Behavior Stack: 2023-05-12T18:40:27.248Z,1683916827.248 [MissionManager](IMPORTANT): Mission loaded, but not running. 2023-05-12T18:40:42.822Z,1683916842.822 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-12T18:40:53.544Z,1683916853.544 [SBIT](IMPORTANT): Beginning Startup BIT 2023-05-12T18:40:53.572Z,1683916853.572 [CBIT](IMPORTANT): Beginning ground fault scan 2023-05-12T18:41:04.989Z,1683916864.989 [CBIT](IMPORTANT): No ground fault detected mA: CHAN A0 (Batt): 0.006857 CHAN A1 (24V): -0.002542 CHAN A2 (12V): -0.000560 CHAN A3 (5V): 0.000322 CHAN B0 (3.3V): 0.000901 CHAN B1 (3.15aV): 0.000854 CHAN B2 (3.15bV): 0.000322 CHAN B3 (GND): 0.000269 OPEN: 0.004596 Full Scale: +/- 1 mA 2023-05-12T18:41:46.526Z,1683916906.526 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-12T18:41:47.290Z,1683916907.290 [SBIT](IMPORTANT): SBIT PASSED 2023-05-12T18:41:47.291Z,1683916907.291 [SBIT](IMPORTANT): Listing configuration overrides from Data/persisted.cfg 2023-05-12T18:41:47.291Z,1683916907.291 [SBIT](IMPORTANT): BPC1.batteryMissingStickThreshold=12 count; 2023-05-12T18:41:47.292Z,1683916907.292 [SBIT](IMPORTANT): DAT.sbdAddress=-1 enum; 2023-05-12T18:41:47.292Z,1683916907.292 [SBIT](IMPORTANT): Depth_Keller.offset=3.6 decibar; 2023-05-12T18:41:47.292Z,1683916907.292 [SBIT](IMPORTANT): Express none CBIT.ampHoursUsed; 2023-05-12T18:41:47.292Z,1683916907.292 [SBIT](IMPORTANT): Express linearApproximation VerticalHomogeneityIndexCalculator.vertical_salinity_homogeneity_index 0.050000 practical_salinity_unit; 2023-05-12T18:41:47.292Z,1683916907.292 [SBIT](IMPORTANT): Express linearApproximation VerticalHomogeneityIndexCalculator.vertical_temperature_homogeneity_index 0.050000 celsius; 2023-05-12T18:41:47.292Z,1683916907.292 [SBIT](IMPORTANT): Express none WetLabsBB2FL.bin_mean_mass_concentration_of_chlorophyll_in_sea_water; 2023-05-12T18:41:47.292Z,1683916907.292 [SBIT](IMPORTANT): Express none height_above_sea_floor; 2023-05-12T18:41:47.292Z,1683916907.292 [SBIT](IMPORTANT): StratificationFrontDetector.loadAtStartup=1 bool; 2023-05-12T18:41:47.292Z,1683916907.292 [SBIT](IMPORTANT): StratificationFrontDetector.threshold_VTHI=0.1 celsius; 2023-05-12T18:41:47.293Z,1683916907.293 [SBIT](IMPORTANT): StratificationFrontDetector.verbosity=1 count; 2023-05-12T18:41:47.293Z,1683916907.293 [SBIT](IMPORTANT): VerticalControl.buoyancyNeutral=208.617815 cubic_centimeter; 2023-05-12T18:41:47.293Z,1683916907.293 [SBIT](IMPORTANT): VerticalControl.massDefault=28.688721 millimeter; 2023-05-12T18:41:47.293Z,1683916907.293 [SBIT](IMPORTANT): VerticalControl.massPositionLimitAft=-28 millimeter; 2023-05-12T18:41:47.293Z,1683916907.293 [SBIT](IMPORTANT): VerticalControl.massPositionLimitFwd=32 millimeter; 2023-05-12T18:41:47.293Z,1683916907.293 [SBIT](IMPORTANT): VerticalControl.surfaceThreshold=1.5 meter; 2023-05-12T18:41:47.293Z,1683916907.293 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth1=3 meter; 2023-05-12T18:41:47.294Z,1683916907.294 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth2=5 meter; 2023-05-12T18:41:47.294Z,1683916907.294 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth3=10 meter; 2023-05-12T18:41:47.294Z,1683916907.294 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.depth4=15 meter; 2023-05-12T18:41:47.294Z,1683916907.294 [SBIT](IMPORTANT): VerticalHomogeneityIndexCalculator.loadAtStartup=1 bool; 2023-05-12T18:41:47.702Z,1683916907.702 [MissionManager](IMPORTANT): Started mission Startup 2023-05-12T18:42:50.230Z,1683916970.230 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-12T18:43:10.994Z,1683916990.994 [CommandExec](IMPORTANT): got command show stack 2023-05-12T18:43:10.994Z,1683916990.994 [CommandExec](IMPORTANT): Behavior Stack: 2023-05-12T18:43:10.995Z,1683916990.995 [Startup](IMPORTANT): Priority 0: Startup:A.GoToSurface 2023-05-12T18:43:10.995Z,1683916990.995 [Startup:StartupSatComms](IMPORTANT): Priority 1: Startup:StartupSatComms:B 2023-05-12T18:43:44.279Z,1683917024.279 [MissionManager](IMPORTANT): Started mission Default 2023-05-12T18:43:53.718Z,1683917033.718 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-12T18:44:21.157Z,1683917061.157 [CommandExec](IMPORTANT): got command get NAL9602.latitude_fix 2023-05-12T18:44:21.157Z,1683917061.157 [CommandExec](IMPORTANT): NAL9602.latitude_fix 36.799999 arcdeg 2023-05-12T18:44:21.452Z,1683917061.452 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-05-12T18:44:57.238Z,1683917097.238 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-12T18:45:02.571Z,1683917102.571 [DataOverHttps](IMPORTANT): SBD MTMSN=20230512T184501 2023-05-12T18:45:10.072Z,1683917110.072 [CommandExec](IMPORTANT): got command load ./Missions/Maintenance/sample_lab.xml 2023-05-12T18:45:10.151Z,1683917110.151 [CommandExec](IMPORTANT): Loaded ./Missions/Maintenance/sample_lab.xml 2023-05-12T18:45:12.057Z,1683917112.057 [CommandExec](IMPORTANT): got command set sample_lab.CartridgeType -1 count 2023-05-12T18:45:12.057Z,1683917112.057 [CommandExec](IMPORTANT): got command run 2023-05-12T18:45:12.059Z,1683917112.059 [CommandExec](IMPORTANT): Running 2023-05-12T18:45:12.352Z,1683917112.352 [MissionManager](IMPORTANT): Started mission sample_lab 2023-05-12T18:45:12.354Z,1683917112.354 [sample_lab:SampleRepeater:A](IMPORTANT): Sampling ESP cartridge type -1.000000 count 2023-05-12T18:45:13.965Z,1683917113.965 [ESPComponent](IMPORTANT): Setting regex for ESP Log summary: 'Selecting Cartridge|Sampled|Error|Underpressure|Overpressure|Fail|Retry|Cmd::|Sampler::|summary:' 2023-05-12T18:45:24.098Z,1683917124.098 [ESPComponent](IMPORTANT): Starting PPPD with command:/sbin/pppd xonxoff asyncmap A0000 /dev/ttyTX1 linkname esp noauth local lock 115200 10.89.11.2:10.89.11.3 persist maxfail 0 holdoff 10 lcp-echo-interval 60 lcp-echo-failure 3 proxyarp ktune deflate 12 ms-dns 8.8.8.8 2023-05-12T18:45:24.239Z,1683917124.239 [ESPComponent](IMPORTANT): Waiting for ESP to connect (timeout=150.0000) 2023-05-12T18:46:00.726Z,1683917160.726 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-12T18:46:16.577Z,1683917176.577 [ESPComponent](IMPORTANT): ESP has connected as client 2023-05-12T18:46:17.394Z,1683917177.394 [ESPComponent](IMPORTANT): [sample #1] Setting cartridge argument to -1 2023-05-12T18:46:17.395Z,1683917177.395 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence starting. Sampling state: S_WAITING_INITIAL_PROMPT 2023-05-12T18:46:18.604Z,1683917178.604 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_LOG 2023-05-12T18:46:18.993Z,1683917178.993 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PREPARING_SHOW_STATUS 2023-05-12T18:46:20.608Z,1683917180.608 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_LOADING_CARTRIDGE 2023-05-12T18:46:52.528Z,1683917212.528 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PRIMING (@60,aRNAl_bac) 2023-05-12T18:46:54.948Z,1683917214.948 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PRIMING (@100.0) 2023-05-12T18:46:54.949Z,1683917214.949 [ESPComponent](IMPORTANT): Filtering timeoutMinutes=92.070000 issuedCmd_=Cmd.startFiltering 2023-05-12T18:46:55.353Z,1683917215.353 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_FILTERING (@100.0) 2023-05-12T18:47:04.426Z,1683917224.426 [DAT](FAULT): failed to initialize, no bytes available on serial interface 2023-05-12T18:47:04.677Z,1683917224.677 [CBIT](FAULT): Communications Fault in component: DAT 2023-05-12T18:49:41.397Z,1683917381.397 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_FILTERING (@0.0) 2023-05-12T18:49:41.809Z,1683917381.809 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PAUSED (@0.0) 2023-05-12T19:09:12.195Z,1683918552.195 [DropWeight](CRITICAL): DROP WEIGHT MISSING. 2023-05-12T19:09:12.248Z,1683918552.248 [CBIT](CRITICAL): Hardware Fault in component: DropWeight 2023-05-12T19:09:13.001Z,1683918553.001 [ESPComponent](IMPORTANT): [sample #1] Stop sampling requested. 2023-05-12T19:09:13.011Z,1683918553.011 [MissionManager](IMPORTANT): Started mission Default 2023-05-12T19:09:13.409Z,1683918553.409 [ESPComponent](IMPORTANT): Stop sampling requested. Issuing Cmd.pauseFiltering 2023-05-12T19:09:19.081Z,1683918559.081 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PAUSED (@533.5) 2023-05-12T19:09:19.473Z,1683918559.473 [ESPComponent](IMPORTANT): In S_PAUSED received result: 533.5 2023-05-12T19:09:19.874Z,1683918559.874 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_PROCESSING (@533.5) 2023-05-12T19:09:21.898Z,1683918561.898 [ESPComponent](IMPORTANT): Processing timeoutMinutes=30.000000 issuedCmd_=Cmd.startProcessing 2023-05-12T19:09:22.300Z,1683918562.300 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_WAITING_FOR_PROCESSED (@60,aRNAl_bac) 2023-05-12T19:09:28.355Z,1683918568.355 [NAL9602](FAULT): GPS failed to acquire within timeout. 2023-05-12T19:10:57.232Z,1683918657.232 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPING (@60,aRNAl_bac) 2023-05-12T19:11:04.910Z,1683918664.910 [ESPComponent](IMPORTANT): Syncing ESP logs with command: rsync -azPq -e 'ssh -o StrictHostKeyChecking=no' --timeout=60 esp@esp:'/var/log/esp/real /var/log/esp/real.out /var/log/esp/real.slot /var/log/esp/*.spr*' /LRAUV/ESPlogs & 2023-05-12T19:11:05.327Z,1683918665.327 [ESPComponent](IMPORTANT): [sample #1] ESP sampling state: S_STOPPED 2023-05-12T19:15:13.367Z,1683918913.367 [NAL9602](FAULT): MT Queue status failed to be acquired within timeout. Will not retry this session. 2023-05-12T19:16:05.079Z,1683918965.079 [ESPComponent](IMPORTANT): [sample #1] ESP sampling sequence completed normally. 2023-05-12T19:18:53.610Z,1683919133.610 [CommandExec](IMPORTANT): got command failComponent none DropWeight 2023-05-12T19:18:53.612Z,1683919133.612 [CommandExec](IMPORTANT): DropWeight failureMode is No Fault 2023-05-12T19:19:10.691Z,1683919150.691 [CommandExec](IMPORTANT): got command restart application