INFO 2025-06-27 03:16:38,282 process.py process_mission():429 [1] commandline = src/data/process_dorado.py --start_year 2015 --end_year 2025 --num_cores 1 -v --noinput --clobber INFO 2025-06-27 03:16:38,282 process.py process_mission():434 [1] dorado_info[mission]["comment"] = Monterey Bay Diamond Mission - 31420G QC note: Best CTD is ctd1, likely screwy between 210-240 or so but ctd2 worse anyways - ctdToUse = ctd1 INFO 2025-06-27 03:16:38,282 process.py process_mission():449 [1] Processing Monterey Bay Diamond mission 2020.314.01 by user docker_user on host 355841a7028c INFO 2025-06-27 03:16:38,282 process.py download_process():165 [1] Download and processing steps for 2020.314.01 INFO 2025-06-27 03:16:38,282 logs2netcdfs.py download_process_logs():739 [1] src_dir = /Volumes/AUVCTD/missionlogs/2020/2020314/2020.314.01 INFO 2025-06-27 03:16:38,282 logs2netcdfs.py download_process_logs():768 [1] Rsyncing /Volumes/AUVCTD/missionlogs/2020/2020314/2020.314.01 to /data/auv_data/dorado/missionlogs/2020.314.01 INFO 2025-06-27 03:16:48,052 logs2netcdfs.py download_process_logs():779 [1] Processing mission: dorado 2020.314.01 INFO 2025-06-27 03:16:48,052 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/dorado/missionlogs/2020.314.01/ctdDriver.log (24715974 bytes) INFO 2025-06-27 03:16:49,881 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/dorado/missionlogs/2020.314.01/ctdDriver2.log (24715581 bytes) INFO 2025-06-27 03:16:51,808 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/dorado/missionlogs/2020.314.01/gps.log (768020 bytes) INFO 2025-06-27 03:16:51,899 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/dorado/missionlogs/2020.314.01/navigation.log (95226374 bytes) INFO 2025-06-27 03:16:59,080 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/dorado/missionlogs/2020.314.01/isuslog.log (1600565 bytes) INFO 2025-06-27 03:16:59,232 logs2netcdfs.py _process_log_file():687 [1] Non-monotonic increasing time indices in /data/auv_data/dorado/missionlogs/2020.314.01/isuslog.log: [ 1 2 3 4 5 7 8 9 10 11 13 14 15 16 17 18 19 20 21 23 24 25 26 27 28 30 31 32 33 34 35 36 38 39 40 41 42 43] INFO 2025-06-27 03:16:59,237 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/dorado/missionlogs/2020.314.01/parosci.log (30753542 bytes) INFO 2025-06-27 03:17:01,860 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/dorado/missionlogs/2020.314.01/FLBBCD2K.log (24136983 bytes) INFO 2025-06-27 03:17:05,037 logs2netcdfs.py _process_log_file():687 [1] Non-monotonic increasing time indices in /data/auv_data/dorado/missionlogs/2020.314.01/FLBBCD2K.log: [ 1 3 8 432 435 436 438 443 454 474 982 984 986 987 990 994 1006 1010 1016 43227 43228 270608 270609 270613 270619 270626 270628 270639 270652] INFO 2025-06-27 03:17:05,144 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/dorado/missionlogs/2020.314.01/tailCone.log (15449851 bytes) INFO 2025-06-27 03:17:07,066 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/dorado/missionlogs/2020.314.01/biolume.log (17977054 bytes) INFO 2025-06-27 03:17:08,827 logs2netcdfs.py write_variables():575 [1] Expanding original timeTag to time60Hz variable for raw data INFO 2025-06-27 03:17:09,745 logs2netcdfs.py download_process_logs():807 [1] Time to process: 21.69 seconds INFO 2025-06-27 03:17:09,746 process.py download_process():198 [1] Processing file /data/auv_data/dorado/missionlogs/2020.314.01/lopc.bin (43991212 bytes) INFO 2025-06-27 03:17:09,746 lopcToNetCDF.py main():2297 [1] Processing begun: Fri Jun 27 03:17:09 2025 INFO 2025-06-27 03:17:09,746 lopcToNetCDF.py constructTimestampList():1296 [1] parosci_nc = /data/auv_data/dorado/missionnetcdfs/2020.314.01/parosci.nc INFO 2025-06-27 03:17:09,746 lopcToNetCDF.py constructTimestampList():1297 [1] Using NetCDF4 to get start and end epoch seconds for this mission from this URL: INFO 2025-06-27 03:17:09,746 lopcToNetCDF.py constructTimestampList():1300 [1] /data/auv_data/dorado/missionnetcdfs/2020.314.01/parosci.nc INFO 2025-06-27 03:17:09,750 lopcToNetCDF.py constructTimestampList():1317 [1] From associated parosci.nc file: sensor_on_time = 1604963535.9, sensor_off_time = 1605027912.7 INFO 2025-06-27 03:17:09,750 lopcToNetCDF.py constructTimestampList():1322 [1] Duration is 64376 seconds. Expecting to read 128752 L frames from the lopc.bin file. INFO 2025-06-27 03:17:09,750 lopcToNetCDF.py constructTimestampList():1330 [1] recCount not passed in, assuming we'll have 128752 records from the lopc.bin file. INFO 2025-06-27 03:17:10,489 lopcToNetCDF.py main():2321 [1] Examined sibling parosci.nc file to find startTime = 2020-11-09 23:12:15 Z and endTime = 2020-11-10 17:05:12 Z with 128752 records expected to be read from lopc.bin INFO 2025-06-27 03:17:10,489 lopcToNetCDF.py unpackLOPCbin():723 [1] >>> Unpacking LOPC data from /data/auv_data/dorado/missionlogs/2020.314.01/lopc.bin INFO 2025-06-27 03:17:10,489 lopcToNetCDF.py unpackLOPCbin():724 [1] >>> Will write to NetCDF file /data/auv_data/dorado/missionnetcdfs/2020.314.01/lopc.nc WARNING 2025-06-27 03:17:10,489 lopcToNetCDF.py readCframeData():665 [1] Unable to parse a float from the string cstr[:70] = INFO 2025-06-27 03:17:10,489 lopcToNetCDF.py openNetCDFFile():1861 [1] Will output NetCDF file to /data/auv_data/dorado/missionnetcdfs/2020.314.01/lopc.nc INFO 2025-06-27 03:17:10,490 lopcToNetCDF.py openNetCDFFile():1887 [1] missionName = 2020.314.01 INFO 2025-06-27 03:17:10,490 lopcToNetCDF.py openNetCDFFile():1910 [1] Writing bin axis for len(self.dataStructure['binSizeList']) = 994 INFO 2025-06-27 03:17:10,584 lopcToNetCDF.py unpackLOPCbin():951 [1] L Frames sample M Frames ShortLFrame LBeforeMEnd MBeforeLEnd UnknownFrame Garbled L INFO 2025-06-27 03:17:10,584 lopcToNetCDF.py unpackLOPCbin():969 [1] Count Count Count Error Error Error Error Error INFO 2025-06-27 03:17:10,584 lopcToNetCDF.py unpackLOPCbin():987 [1] -------- -------- -------- ----------- ----------- ----------- ----------- ------------ INFO 2025-06-27 03:17:15,402 lopcToNetCDF.py unpackLOPCbin():1013 [1] 10000 10135 11271 0 0 0 0 0 4.9 seconds, last L Frame: 128752 INFO 2025-06-27 03:17:19,383 lopcToNetCDF.py unpackLOPCbin():1013 [1] 20000 20135 19750 0 0 0 0 0 4.0 seconds, last L Frame: 128752 INFO 2025-06-27 03:17:23,625 lopcToNetCDF.py unpackLOPCbin():1013 [1] 30000 30135 29246 0 0 0 0 0 4.2 seconds, last L Frame: 128752 INFO 2025-06-27 03:17:27,508 lopcToNetCDF.py unpackLOPCbin():1013 [1] 40000 40135 37676 0 0 0 0 0 3.9 seconds, last L Frame: 128752 INFO 2025-06-27 03:17:31,152 lopcToNetCDF.py unpackLOPCbin():1013 [1] 50000 50135 43069 0 0 0 0 0 3.6 seconds, last L Frame: 128752 INFO 2025-06-27 03:17:34,669 lopcToNetCDF.py unpackLOPCbin():1013 [1] 60000 60135 48345 0 0 0 0 0 3.5 seconds, last L Frame: 128752 INFO 2025-06-27 03:17:38,222 lopcToNetCDF.py unpackLOPCbin():1013 [1] 70000 4599 54958 0 0 0 0 0 3.6 seconds, last L Frame: 128752 INFO 2025-06-27 03:17:41,792 lopcToNetCDF.py unpackLOPCbin():1013 [1] 80000 14599 61598 0 0 0 0 0 3.6 seconds, last L Frame: 128752 INFO 2025-06-27 03:17:45,700 lopcToNetCDF.py unpackLOPCbin():1013 [1] 90000 24599 69093 0 0 0 0 0 3.9 seconds, last L Frame: 128752 INFO 2025-06-27 03:17:49,383 lopcToNetCDF.py unpackLOPCbin():1013 [1] 100000 34599 76186 0 0 0 0 0 3.7 seconds, last L Frame: 128752 INFO 2025-06-27 03:17:53,043 lopcToNetCDF.py unpackLOPCbin():1013 [1] 110000 44599 83451 0 0 0 0 0 3.7 seconds, last L Frame: 128752 INFO 2025-06-27 03:17:57,077 lopcToNetCDF.py unpackLOPCbin():1013 [1] 120000 54599 90762 0 0 0 0 0 4.0 seconds, last L Frame: 128752 INFO 2025-06-27 03:18:02,260 lopcToNetCDF.py main():2345 [1] >>> Done reading file. INFO 2025-06-27 03:18:02,260 lopcToNetCDF.py main():2346 [1] lFrameCount = 128754, mFrameCount = 102875 INFO 2025-06-27 03:18:02,260 lopcToNetCDF.py constructTimestampList():1296 [1] parosci_nc = /data/auv_data/dorado/missionnetcdfs/2020.314.01/parosci.nc INFO 2025-06-27 03:18:02,260 lopcToNetCDF.py constructTimestampList():1297 [1] Using NetCDF4 to get start and end epoch seconds for this mission from this URL: INFO 2025-06-27 03:18:02,260 lopcToNetCDF.py constructTimestampList():1300 [1] /data/auv_data/dorado/missionnetcdfs/2020.314.01/parosci.nc INFO 2025-06-27 03:18:02,264 lopcToNetCDF.py constructTimestampList():1317 [1] From associated parosci.nc file: sensor_on_time = 1604963535.9, sensor_off_time = 1605027912.7 INFO 2025-06-27 03:18:02,264 lopcToNetCDF.py constructTimestampList():1322 [1] Duration is 64376 seconds. Expecting to read 128752 L frames from the lopc.bin file. INFO 2025-06-27 03:18:02,264 lopcToNetCDF.py constructTimestampList():1330 [1] recCount not passed in, assuming we'll have 128752 records from the lopc.bin file. INFO 2025-06-27 03:18:02,264 lopcToNetCDF.py constructTimestampList():1340 [1] Calling correctSampleCountList() with sampleCountList[0] = 136 and len(sampleCountList) = 128754 INFO 2025-06-27 03:18:02,275 lopcToNetCDF.py correctSampleCountList():1737 [1] Found overflows at indices: [65400] INFO 2025-06-27 03:18:02,276 lopcToNetCDF.py correctSampleCountList():1740 [1] Assigning values from slice starting at index 65400, i = 1 INFO 2025-06-27 03:18:02,279 lopcToNetCDF.py correctSampleCountList():1745 [1] Original sampleCountList = [ 136 137 138 ... 128888 128889 128890] INFO 2025-06-27 03:18:02,279 lopcToNetCDF.py correctSampleCountList():1746 [1] Found 0 0 values at indices: [] INFO 2025-06-27 03:18:02,279 lopcToNetCDF.py correctSampleCountList():1779 [1] Found 0 stuck values at indices: [] INFO 2025-06-27 03:18:02,280 lopcToNetCDF.py deSpike():1588 [1] d_sampleCountList = [1 1 1 ... 1 1 1] INFO 2025-06-27 03:18:02,280 lopcToNetCDF.py deSpike():1590 [1] Found 0 spike indicators at indices: [] INFO 2025-06-27 03:18:02,280 lopcToNetCDF.py correctSampleCountList():1805 [1] After despike() sampleCountList = [ 136 137 138 ... 128888 128889 128890] INFO 2025-06-27 03:18:02,280 lopcToNetCDF.py constructTimestampList():1347 [1] correctSampleCountList() returned correctedSampleCountList = [ 136 137 138 ... 128888 128889 128890] with len(correctedSampleCountList) = 128754 INFO 2025-06-27 03:18:02,280 lopcToNetCDF.py constructTimestampList():1358 [1] Subtracting 136 from all values of correctedSampleCountList INFO 2025-06-27 03:18:02,280 lopcToNetCDF.py constructTimestampList():1363 [1] Constructing timestampArray from instrument corrected sampleCount and constant deltaT = 0.500000 INFO 2025-06-27 03:18:02,281 lopcToNetCDF.py constructTimestampList():1368 [1] New re-zeroed correctedSampleCountList = [0.00000e+00 5.00000e-01 1.00000e+00 ... 6.43760e+04 6.43765e+04 6.43770e+04] INFO 2025-06-27 03:18:02,282 lopcToNetCDF.py constructTimestampList():1379 [1] timestampArray = [1.60496354e+09 1.60496354e+09 1.60496354e+09 ... 1.60502791e+09 1.60502791e+09 1.60502791e+09] INFO 2025-06-27 03:18:02,282 lopcToNetCDF.py constructTimestampList():1380 [1] timestampArray[:2] = [1604963535.9 1604963536.4, ..., timestampArray[-2:] = 1605027912.4 1605027912.9] INFO 2025-06-27 03:18:02,412 lopcToNetCDF.py constructTimestampList():1389 [1] timestampList[:2] = [np.float64(1604963535.8578057), np.float64(1604963536.3578057)], ..., timestampList[-2:] = [np.float64(1605027912.3578057), np.float64(1605027912.8578057)]] INFO 2025-06-27 03:18:02,412 lopcToNetCDF.py constructTimestampList():1394 [1] Subsampling correctedSampleCountList (len = 128754) according to what got written to the netCDF file by the binning interval INFO 2025-06-27 03:18:02,412 lopcToNetCDF.py constructTimestampList():1399 [1] lFrameCountWrittenList[:2] = [20, 41], ... lFrameCountWrittenList[-2:] = [128729, 128750] INFO 2025-06-27 03:18:02,413 lopcToNetCDF.py constructTimestampList():1420 [1] len(subSampledCorrectedSampleCountList) = 6131 INFO 2025-06-27 03:18:02,413 lopcToNetCDF.py constructTimestampList():1439 [1] len(timestampList) = 128754 INFO 2025-06-27 03:18:02,413 lopcToNetCDF.py constructTimestampList():1440 [1] timestampList[:2] = [np.float64(1604963535.8578057), np.float64(1604963536.3578057)], ..., timestampList[-2:] = [np.float64(1605027912.3578057), np.float64(1605027912.8578057)]] INFO 2025-06-27 03:18:02,413 lopcToNetCDF.py constructTimestampList():1446 [1] Subsampling timestampList (len = 128754) according to what got written to the netCDF file by the binning interval INFO 2025-06-27 03:18:02,414 lopcToNetCDF.py constructTimestampList():1457 [1] Taking indices [[np.int32(19), np.int32(40)] ... [np.int32(128728), np.int32(128749)]] from timestampList to create subSampledTimestampList INFO 2025-06-27 03:18:02,421 lopcToNetCDF.py constructTimestampList():1463 [1] len(subSampledTimestampList) = 6131 INFO 2025-06-27 03:18:02,422 lopcToNetCDF.py constructTimestampList():1477 [1] Finding elements of cFrameEsecsList that != -9999 INFO 2025-06-27 03:18:02,458 lopcToNetCDF.py closeNetCDFFile():2096 [1] Writing time axis for len(tsList) = 6131 INFO 2025-06-27 03:18:02,458 lopcToNetCDF.py closeNetCDFFile():2099 [1] tsList[:1] = [np.float64(1604963545.3578057)], ..., tsList[-2:] = [np.float64(1605027900.3578057), np.float64(1605027910.8578057)] INFO 2025-06-27 03:18:02,458 lopcToNetCDF.py closeNetCDFFile():2100 [1] Begin time = 2020-11-09 23:12:25 Z INFO 2025-06-27 03:18:02,458 lopcToNetCDF.py closeNetCDFFile():2103 [1] End time = 2020-11-10 17:05:10 Z INFO 2025-06-27 03:18:02,458 lopcToNetCDF.py closeNetCDFFile():2107 [1] Writing time axis for len(cFrameEsecsList) = 6131 INFO 2025-06-27 03:18:02,458 lopcToNetCDF.py closeNetCDFFile():2111 [1] cFrameEsecsList[:1] = [1.60496361e+09], ..., cFrameEsecsList[-2:] = [1.60499520e+09 1.60499521e+09] INFO 2025-06-27 03:18:02,459 lopcToNetCDF.py closeNetCDFFile():2116 [1] Begin time = 2020-11-09 23:13:28 Z INFO 2025-06-27 03:18:02,459 lopcToNetCDF.py closeNetCDFFile():2120 [1] End time = 2020-11-10 08:00:07 Z INFO 2025-06-27 03:18:02,463 lopcToNetCDF.py main():2381 [1] Created file: /data/auv_data/dorado/missionnetcdfs/2020.314.01/lopc.nc INFO 2025-06-27 03:18:02,464 lopcToNetCDF.py main():2384 [1] Processing finished: Fri Jun 27 03:18:02 2025 Elapsed processing time from start of processing = 52 seconds INFO 2025-06-27 03:18:02,468 process.py calibrate():227 [1] Calibration steps for 2020.314.01 INFO 2025-06-27 03:18:02,992 calibrate.py _nudge_pos():1680 [1] seg# end_sec_diff end_lon_diff end_lat_diff len(segi) seg_min u_drift (cm/s) v_drift (cm/s) start datetime of segment INFO 2025-06-27 03:18:02,994 calibrate.py _nudge_pos():1711 [1] - - - 0 0.00 - - - INFO 2025-06-27 03:18:03,955 calibrate.py _nudge_pos():1806 [1] 124: 0.050 0.0002091 -0.0003413 6651 22.17 1.399 -2.853 2020-11-09T23:36:25.388506112 INFO 2025-06-27 03:18:06,458 calibrate.py _nudge_pos():1806 [1] 364: 0.170 0.0009312 -0.0004238 7620 25.40 5.442 -3.092 2020-11-10T00:05:48.387732480 INFO 2025-06-27 03:18:07,113 calibrate.py _nudge_pos():1806 [1] 425: 0.120 0.0003497 -0.0000667 7080 23.60 2.200 -0.524 2020-11-10T00:30:24.586605824 INFO 2025-06-27 03:18:09,790 calibrate.py _nudge_pos():1806 [1] 679: 0.020 0.0004175 -0.0000797 7106 23.68 2.618 -0.624 2020-11-10T00:58:18.791915008 INFO 2025-06-27 03:18:10,079 calibrate.py _nudge_pos():1806 [1] 706: 0.150 0.0004165 -0.0000611 7370 24.56 2.519 -0.461 2020-11-10T01:23:18.789158144 INFO 2025-06-27 03:18:12,847 calibrate.py _nudge_pos():1806 [1] 964: 0.080 0.0004216 -0.0000790 7571 25.23 2.482 -0.580 2020-11-10T01:52:49.987822848 INFO 2025-06-27 03:18:13,071 calibrate.py _nudge_pos():1806 [1] 985: 0.160 0.0004297 0.0000280 6815 22.71 2.811 0.228 2020-11-10T02:15:52.993080320 INFO 2025-06-27 03:18:15,969 calibrate.py _nudge_pos():1806 [1] 1252: 0.090 0.0003809 0.0000077 7246 24.15 2.344 0.059 2020-11-10T02:44:28.185581568 INFO 2025-06-27 03:18:16,972 calibrate.py _nudge_pos():1806 [1] 1343: 0.040 0.0002982 -0.0000351 9331 31.10 1.426 -0.209 2020-11-10T03:17:04.391572224 INFO 2025-06-27 03:18:19,808 calibrate.py _nudge_pos():1806 [1] 1605: 0.200 0.0010349 0.0005007 10435 34.78 4.422 2.668 2020-11-10T03:56:12.390723584 INFO 2025-06-27 03:18:20,311 calibrate.py _nudge_pos():1806 [1] 1650: 0.130 0.0007376 0.0002806 6870 22.90 4.787 2.271 2020-11-10T04:19:50.593569792 INFO 2025-06-27 03:18:22,896 calibrate.py _nudge_pos():1806 [1] 1890: 0.080 0.0009438 0.0003465 7396 24.65 5.688 2.605 2020-11-10T04:48:28.785865472 INFO 2025-06-27 03:18:23,391 calibrate.py _nudge_pos():1806 [1] 1935: 0.160 0.0009016 0.0003936 7345 24.48 5.472 2.979 2020-11-10T05:13:41.792217600 INFO 2025-06-27 03:18:26,006 calibrate.py _nudge_pos():1806 [1] 2175: 0.080 0.0006782 0.0003724 7726 25.75 3.912 2.680 2020-11-10T05:43:25.989991680 INFO 2025-06-27 03:18:26,030 calibrate.py _nudge_pos():1806 [1] 2177: 0.100 -0.0000023 -0.0000113 25 0.08 -4.264 -26.106 2020-11-10T05:43:31.989580544 INFO 2025-06-27 03:18:26,778 calibrate.py _nudge_pos():1806 [1] 2245: 0.200 0.0001279 0.0003571 8220 27.40 0.693 2.415 2020-11-10T06:12:02.992368896 INFO 2025-06-27 03:18:27,128 calibrate.py _nudge_pos():1806 [1] 2277: 0.050 0.0002418 -0.0003011 85 0.28 128.279 -199.284 2020-11-10T06:12:51.189067008 INFO 2025-06-27 03:18:29,642 calibrate.py _nudge_pos():1806 [1] 2504: 0.160 -0.0002926 0.0003122 8135 27.11 -1.602 2.133 2020-11-10T06:43:44.192127744 INFO 2025-06-27 03:18:29,837 calibrate.py _nudge_pos():1806 [1] 2522: 0.080 0.0002453 -0.0001558 7696 25.65 1.420 -1.126 2020-11-10T07:09:40.385521152 INFO 2025-06-27 03:18:34,182 calibrate.py _nudge_pos():1806 [1] 2920: 0.190 0.0009027 -0.0004081 6055 20.18 6.642 -3.747 2020-11-10T07:36:28.385365760 INFO 2025-06-27 03:18:37,215 calibrate.py _nudge_pos():1806 [1] 3191: 0.170 0.0041132 -0.0015178 9760 32.53 18.768 -8.646 2020-11-10T08:13:30.593134080 INFO 2025-06-27 03:18:37,824 calibrate.py _nudge_pos():1806 [1] 3246: 0.080 0.0029855 0.0000489 8426 28.08 15.775 0.323 2020-11-10T08:42:29.793990656 INFO 2025-06-27 03:18:41,746 calibrate.py _nudge_pos():1806 [1] 3575: 0.050 0.0030189 0.0002721 7556 25.18 17.785 2.002 2020-11-10T09:13:08.987997184 INFO 2025-06-27 03:18:43,641 calibrate.py _nudge_pos():1806 [1] 3734: 0.160 0.0031503 0.0004179 8100 27.00 17.307 2.869 2020-11-10T09:42:46.986195968 INFO 2025-06-27 03:18:43,712 calibrate.py _nudge_pos():1806 [1] 3740: 0.150 0.0000279 0.0000241 15 0.05 88.837 95.652 2020-11-10T09:42:54.985647872 INFO 2025-06-27 03:18:43,747 calibrate.py _nudge_pos():1806 [1] 3743: 0.150 -0.0000844 -0.0000331 195 0.65 -19.347 -9.490 2020-11-10T09:43:35.992838912 INFO 2025-06-27 03:18:45,869 calibrate.py _nudge_pos():1806 [1] 3927: 0.090 0.0030309 -0.0008069 11867 39.55 11.362 -3.780 2020-11-10T10:26:12.387713792 INFO 2025-06-27 03:18:46,428 calibrate.py _nudge_pos():1806 [1] 3977: 0.030 0.0016957 -0.0002117 5776 19.25 13.059 -2.038 2020-11-10T10:46:16.395233536 INFO 2025-06-27 03:18:49,527 calibrate.py _nudge_pos():1806 [1] 4252: 0.160 0.0022592 -0.0007788 7830 26.10 12.831 -5.530 2020-11-10T11:16:56.389185536 INFO 2025-06-27 03:18:49,563 calibrate.py _nudge_pos():1806 [1] 4255: 0.100 0.0019283 -0.0003897 8061 26.87 10.636 -2.688 2020-11-10T11:43:51.588536832 INFO 2025-06-27 03:18:53,026 calibrate.py _nudge_pos():1806 [1] 4557: 0.030 0.0000400 0.0003747 6566 21.88 0.271 3.173 2020-11-10T12:10:45.787956480 INFO 2025-06-27 03:18:55,086 calibrate.py _nudge_pos():1806 [1] 4732: 0.160 0.0000111 0.0002156 8615 28.71 0.057 1.391 2020-11-10T12:42:22.788003072 INFO 2025-06-27 03:18:59,709 calibrate.py _nudge_pos():1806 [1] 5127: 0.140 0.0002593 0.0001356 8991 29.97 1.283 0.839 2020-11-10T13:18:54.987826944 INFO 2025-06-27 03:19:01,653 calibrate.py _nudge_pos():1806 [1] 5288: 0.080 0.0002884 0.0003341 8826 29.42 1.454 2.105 2020-11-10T13:51:00.185942016 INFO 2025-06-27 03:19:04,356 calibrate.py _nudge_pos():1806 [1] 5518: 0.010 0.0003363 0.0003259 7721 25.73 1.938 2.347 2020-11-10T14:20:33.394468864 INFO 2025-06-27 03:19:05,595 calibrate.py _nudge_pos():1806 [1] 5624: 0.110 0.0003363 0.0002872 7340 24.46 2.039 2.175 2020-11-10T14:46:46.386711552 INFO 2025-06-27 03:19:12,996 calibrate.py _nudge_pos():1806 [1] 6273: 0.080 0.0001369 0.0002159 7686 25.62 0.793 1.561 2020-11-10T15:23:11.587014912 INFO 2025-06-27 03:19:16,225 calibrate.py _nudge_pos():1806 [1] 6555: 0.030 0.0009012 -0.0004979 8701 29.00 4.611 -3.181 2020-11-10T15:56:52.788553216 INFO 2025-06-27 03:20:04,408 calibrate.py _nudge_pos():1862 [1] 10615: - - - 3 0.01 - - INFO 2025-06-27 03:20:04,408 calibrate.py _nudge_pos():1868 [1] Points in final series = 321277 INFO 2025-06-27 03:20:07,354 calibrate.py _geometric_depth_correction():3423 [1] ctd1: d_beg_time_diff: 10 seconds, d_end_time_diff: -1 seconds INFO 2025-06-27 03:20:09,339 calibrate.py _geometric_depth_correction():3423 [1] ctd1: d_beg_time_diff: 10 seconds, d_end_time_diff: -1 seconds INFO 2025-06-27 03:20:09,343 calibrate.py _ctd_process():2919 [1] Performing range checking of ['ctd1_salinity'] in 2020.314.01/ctd1.nc INFO 2025-06-27 03:20:09,345 calibrate.py _range_qc_combined_nc():898 [1] Setting 5 ctd1_salinity values to NaN INFO 2025-06-27 03:20:09,345 calibrate.py _range_qc_combined_nc():910 [1] Checked for data outside of these variables and ranges: [('ctd1_salinity', Range(min=30, max=40))] INFO 2025-06-27 03:20:09,345 calibrate.py _range_qc_combined_nc():936 [1] Done range checking ctd1 INFO 2025-06-27 03:20:11,743 calibrate.py _geometric_depth_correction():3423 [1] ctd2: d_beg_time_diff: 10 seconds, d_end_time_diff: -1 seconds INFO 2025-06-27 03:20:13,747 calibrate.py _geometric_depth_correction():3423 [1] ctd2: d_beg_time_diff: 10 seconds, d_end_time_diff: -1 seconds INFO 2025-06-27 03:20:13,751 calibrate.py _ctd_process():2919 [1] Performing range checking of ['ctd2_salinity'] in 2020.314.01/ctd2.nc WARNING 2025-06-27 03:20:13,753 calibrate.py _range_qc_combined_nc():890 [1] More than 500 (6685) ctd2_salinity values found outside of range. This may indicate a problem with the ctd2 data. INFO 2025-06-27 03:20:13,753 calibrate.py _range_qc_combined_nc():898 [1] Setting 6685 ctd2_salinity values to NaN INFO 2025-06-27 03:20:13,753 calibrate.py _range_qc_combined_nc():910 [1] Checked for data outside of these variables and ranges: [('ctd2_salinity', Range(min=30, max=40))] INFO 2025-06-27 03:20:13,753 calibrate.py _range_qc_combined_nc():936 [1] Done range checking ctd2 INFO 2025-06-27 03:20:16,220 calibrate.py _biolume_process():3128 [1] Checking for non-monotonic increasing time60hz INFO 2025-06-27 03:20:19,264 calibrate.py _biolume_process():3131 [1] Removing non-monotonic increasing time60hz at indices: [ 60 61 62 63 64 65 66 67 240 241 242 243 244] INFO 2025-06-27 03:20:19,841 calibrate.py _geometric_depth_correction():3423 [1] biolume: d_beg_time_diff: -4 seconds, d_end_time_diff: -1 seconds INFO 2025-06-27 03:21:52,837 calibrate.py write_netcdf():3508 [1] Writing calibrated instrument data to /data/auv_data/dorado/missionnetcdfs/2020.314.01/dorado_2020.314.01_cal.nc INFO 2025-06-27 03:21:53,229 calibrate.py write_netcdf():3512 [1] Data variables written: biolume_avg_biolume, biolume_depth, biolume_flow, biolume_raw, biolume_time, biolume_time60hz, ctd1_conductivity, ctd1_conductivity_onboard, ctd1_depth, ctd1_dissolvedO2, ctd1_flow1, ctd1_oxygen_mll, ctd1_oxygen_umolkg, ctd1_salinity, ctd1_salinity_onboard, ctd1_temperature, ctd1_temperature_onboard, ctd1_time, ctd2_conductivity, ctd2_conductivity_onboard, ctd2_depth, ctd2_flow2, ctd2_par, ctd2_salinity, ctd2_salinity_onboard, ctd2_temperature, ctd2_temperature_onboard, ctd2_time, depth_filtdepth, depth_filtpres, depth_time, ecopuck_bbp700, ecopuck_cdom, ecopuck_chl, ecopuck_time, gps_latitude, gps_longitude, gps_time, isus_nitrate, isus_quality, isus_temp, isus_time, lopc_LCcount, lopc_countListSum, lopc_flowSpeed, lopc_nonTransCount, lopc_time, lopc_transCount, navigation_depth, navigation_latitude, navigation_longitude, navigation_mWaterSpeed, navigation_pitch, navigation_posx, navigation_posy, navigation_roll, navigation_time, navigation_yaw, nudged_latitude, nudged_longitude, tailcone_propRpm, tailcone_time, time INFO 2025-06-27 03:21:53,238 process.py align():251 [1] Alignment steps for 2020.314.01 INFO 2025-06-27 03:21:53,332 align.py process_cal():139 [1] Processing dorado_2020.314.01_cal.nc from /data/auv_data/dorado/missionnetcdfs/2020.314.01 INFO 2025-06-27 03:21:53,418 align.py process_cal():206 [1] Using pitch corrected navigation_depth: mDepth from navigation.nc INFO 2025-06-27 03:21:53,427 align.py process_cal():249 [1] navigation_roll: instrument_sample_rate_hz = 5.00 INFO 2025-06-27 03:21:53,643 align.py process_cal():206 [1] Using pitch corrected navigation_depth: mDepth from navigation.nc INFO 2025-06-27 03:21:53,655 align.py process_cal():249 [1] navigation_pitch: instrument_sample_rate_hz = 5.00 INFO 2025-06-27 03:21:53,854 align.py process_cal():206 [1] Using pitch corrected navigation_depth: mDepth from navigation.nc INFO 2025-06-27 03:21:53,869 align.py process_cal():249 [1] navigation_yaw: instrument_sample_rate_hz = 5.00 INFO 2025-06-27 03:21:53,989 align.py process_cal():161 [1] Skipping navigation_posx INFO 2025-06-27 03:21:53,989 align.py process_cal():161 [1] Skipping navigation_posy INFO 2025-06-27 03:21:54,070 align.py process_cal():206 [1] Using pitch corrected navigation_depth: mDepth from navigation.nc INFO 2025-06-27 03:21:54,082 align.py process_cal():249 [1] navigation_mWaterSpeed: instrument_sample_rate_hz = 5.00 INFO 2025-06-27 03:21:54,280 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:54,291 align.py process_cal():249 [1] ctd1_temperature: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:54,466 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:54,475 align.py process_cal():249 [1] ctd1_conductivity: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:54,646 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:54,656 align.py process_cal():249 [1] ctd1_salinity: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:54,827 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:54,836 align.py process_cal():249 [1] ctd1_temperature_onboard: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:55,014 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:55,026 align.py process_cal():249 [1] ctd1_conductivity_onboard: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:55,204 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:55,214 align.py process_cal():249 [1] ctd1_salinity_onboard: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:55,391 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:55,400 align.py process_cal():249 [1] ctd1_dissolvedO2: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:55,571 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:55,581 align.py process_cal():249 [1] ctd1_oxygen_mll: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:55,752 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:55,762 align.py process_cal():249 [1] ctd1_oxygen_umolkg: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:55,931 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:55,941 align.py process_cal():249 [1] ctd1_flow1: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:56,114 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:56,126 align.py process_cal():249 [1] ctd1_depth: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:56,298 align.py process_cal():206 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:56,308 align.py process_cal():249 [1] ctd2_temperature: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:56,483 align.py process_cal():206 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:56,493 align.py process_cal():249 [1] ctd2_conductivity: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:56,664 align.py process_cal():206 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:56,674 align.py process_cal():249 [1] ctd2_salinity: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:56,847 align.py process_cal():206 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:56,858 align.py process_cal():249 [1] ctd2_temperature_onboard: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:57,034 align.py process_cal():206 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:57,044 align.py process_cal():249 [1] ctd2_conductivity_onboard: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:57,229 align.py process_cal():206 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:57,239 align.py process_cal():249 [1] ctd2_salinity_onboard: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:57,412 align.py process_cal():206 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:57,422 align.py process_cal():249 [1] ctd2_flow2: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:57,598 align.py process_cal():206 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:57,607 align.py process_cal():249 [1] ctd2_depth: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:57,779 align.py process_cal():206 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2020.314.01_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-27 03:21:57,789 align.py process_cal():249 [1] ctd2_par: instrument_sample_rate_hz = 4.00 INFO 2025-06-27 03:21:58,002 align.py process_cal():249 [1] isus_nitrate: instrument_sample_rate_hz = 0.78 INFO 2025-06-27 03:21:58,142 align.py process_cal():249 [1] isus_temp: instrument_sample_rate_hz = 0.78 INFO 2025-06-27 03:21:58,285 align.py process_cal():249 [1] isus_quality: instrument_sample_rate_hz = 0.78 INFO 2025-06-27 03:21:58,429 align.py process_cal():249 [1] biolume_flow: instrument_sample_rate_hz = 0.98 INFO 2025-06-27 03:21:58,580 align.py process_cal():249 [1] biolume_avg_biolume: instrument_sample_rate_hz = 0.98 INFO 2025-06-27 03:21:58,850 align.py process_cal():249 [1] biolume_raw: instrument_sample_rate_hz = 58.98 INFO 2025-06-27 03:22:00,464 align.py process_cal():249 [1] lopc_countListSum: instrument_sample_rate_hz = 0.10 INFO 2025-06-27 03:22:00,582 align.py process_cal():249 [1] lopc_transCount: instrument_sample_rate_hz = 0.10 INFO 2025-06-27 03:22:00,700 align.py process_cal():249 [1] lopc_nonTransCount: instrument_sample_rate_hz = 0.10 INFO 2025-06-27 03:22:00,818 align.py process_cal():249 [1] lopc_LCcount: instrument_sample_rate_hz = 0.10 INFO 2025-06-27 03:22:00,938 align.py process_cal():249 [1] lopc_flowSpeed: instrument_sample_rate_hz = 0.10 INFO 2025-06-27 03:22:01,071 align.py process_cal():249 [1] ecopuck_bbp700: instrument_sample_rate_hz = 10.41 INFO 2025-06-27 03:22:01,486 align.py process_cal():249 [1] ecopuck_cdom: instrument_sample_rate_hz = 10.41 INFO 2025-06-27 03:22:01,855 align.py process_cal():249 [1] ecopuck_chl: instrument_sample_rate_hz = 10.41 INFO 2025-06-27 03:22:02,248 align.py process_cal():249 [1] tailcone_propRpm: instrument_sample_rate_hz = 5.00 INFO 2025-06-27 03:22:02,381 align.py write_netcdf():337 [1] Writing aligned data to /data/auv_data/dorado/missionnetcdfs/2020.314.01/dorado_2020.314.01_align.nc INFO 2025-06-27 03:22:02,776 align.py write_netcdf():342 [1] Data variables written: biolume_avg_biolume, biolume_depth, biolume_flow, biolume_latitude, biolume_longitude, biolume_raw, biolume_time, biolume_time60hz, ctd1_conductivity, ctd1_conductivity_onboard, ctd1_depth, ctd1_dissolvedO2, ctd1_flow1, ctd1_latitude, ctd1_longitude, ctd1_oxygen_mll, ctd1_oxygen_umolkg, ctd1_salinity, ctd1_salinity_onboard, ctd1_temperature, ctd1_temperature_onboard, ctd1_time, ctd2_conductivity, ctd2_conductivity_onboard, ctd2_depth, ctd2_flow2, ctd2_latitude, ctd2_longitude, ctd2_par, ctd2_salinity, ctd2_salinity_onboard, ctd2_temperature, ctd2_temperature_onboard, ctd2_time, ecopuck_bbp700, ecopuck_cdom, ecopuck_chl, ecopuck_depth, ecopuck_latitude, ecopuck_longitude, ecopuck_time, isus_depth, isus_latitude, isus_longitude, isus_nitrate, isus_quality, isus_temp, isus_time, lopc_LCcount, lopc_countListSum, lopc_depth, lopc_flowSpeed, lopc_latitude, lopc_longitude, lopc_nonTransCount, lopc_time, lopc_transCount, navigation_depth, navigation_latitude, navigation_longitude, navigation_mWaterSpeed, navigation_pitch, navigation_roll, navigation_time, navigation_yaw, tailcone_depth, tailcone_latitude, tailcone_longitude, tailcone_propRpm, tailcone_time INFO 2025-06-27 03:22:02,779 process.py resample():273 [1] Resampling steps for 2020.314.01 INFO 2025-06-27 03:22:02,780 resample.py resample_mission():1185 [1] Using depth_threshold = 10.00 m INFO 2025-06-27 03:22:02,849 resample.py instruments_variables():235 [1] Reading variables from /data/auv_data/dorado/missionnetcdfs/2020.314.01/dorado_2020.314.01_align.nc mission netCDF file INFO 2025-06-27 03:22:02,860 resample.py instruments_variables():235 [1] Reading variables from /data/auv_data/dorado/missionnetcdfs/2020.314.01/dorado_2020.314.01_align.nc mission netCDF file INFO 2025-06-27 03:22:02,862 resample.py get_mission_start_end():1145 [1] navigation: 2020-11-09T23:12:52.495296000 to 2020-11-10T17:05:12.587697664 (0 days 00:00:00.139990528 before mission_end) INFO 2025-06-27 03:22:02,865 resample.py get_mission_start_end():1145 [1] ctd1 : 2020-11-09T23:12:26.607069440 to 2020-11-10T17:05:12.527701760 (0 days 00:00:00.199986432 before mission_end) INFO 2025-06-27 03:22:02,868 resample.py get_mission_start_end():1145 [1] ctd2 : 2020-11-09T23:12:26.607069440 to 2020-11-10T17:05:12.587697664 (0 days 00:00:00.139990528 before mission_end) INFO 2025-06-27 03:22:02,869 resample.py get_mission_start_end():1145 [1] isus : 2020-11-09T23:13:27.012931328 to 2020-11-10T17:05:11.917743616 (0 days 00:00:00.809944576 before mission_end) INFO 2025-06-27 03:22:02,871 resample.py get_mission_start_end():1145 [1] biolume : 2020-11-09T23:12:11.538067456 to 2020-11-10T17:05:11.677725696 (0 days 00:00:01.049962496 before mission_end) INFO 2025-06-27 03:22:02,872 resample.py get_mission_start_end():1145 [1] lopc : 2020-11-09T23:12:25.357805824 to 2020-11-10T17:05:10.857805824 (0 days 00:00:01.869882368 before mission_end) INFO 2025-06-27 03:22:02,875 resample.py get_mission_start_end():1145 [1] ecopuck : 2020-11-09T23:12:11.138129152 to 2020-11-10T17:05:12.727688192 (0 days 00:00:00 before mission_end) INFO 2025-06-27 03:22:02,879 resample.py get_mission_start_end():1145 [1] tailcone : 2020-11-09T23:12:20.687474944 to 2020-11-10T17:05:12.667692288 (0 days 00:00:00.059995904 before mission_end) INFO 2025-06-27 03:22:02,880 resample.py instruments_variables():235 [1] Reading variables from /data/auv_data/dorado/missionnetcdfs/2020.314.01/dorado_2020.314.01_align.nc mission netCDF file INFO 2025-06-27 03:22:02,880 resample.py resample_coordinates():249 [1] Resampling coordinates depth, latitude and longitude with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:03,543 resample.py resample_variable():1031 [1] Resampling navigation_roll with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:03,650 resample.py resample_variable():1031 [1] Resampling navigation_pitch with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:03,753 resample.py resample_variable():1031 [1] Resampling navigation_yaw with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:03,856 resample.py resample_variable():1031 [1] Resampling navigation_mWaterSpeed with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:03,942 resample.py resample_variable():1031 [1] Resampling ctd1_temperature with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:04,025 resample.py resample_variable():1031 [1] Resampling ctd1_conductivity with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:04,113 resample.py resample_variable():1031 [1] Resampling ctd1_salinity with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:04,194 resample.py resample_variable():1031 [1] Resampling ctd1_temperature_onboard with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:04,282 resample.py resample_variable():1031 [1] Resampling ctd1_conductivity_onboard with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:04,363 resample.py resample_variable():1031 [1] Resampling ctd1_salinity_onboard with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:04,445 resample.py resample_variable():1031 [1] Resampling ctd1_dissolvedO2 with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:04,527 resample.py resample_variable():1031 [1] Resampling ctd1_oxygen_mll with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:04,607 resample.py resample_variable():1031 [1] Resampling ctd1_oxygen_umolkg with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:04,689 resample.py resample_variable():1031 [1] Resampling ctd1_flow1 with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:04,774 resample.py resample_variable():1031 [1] Resampling ctd2_temperature with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:04,859 resample.py resample_variable():1031 [1] Resampling ctd2_conductivity with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:04,962 resample.py resample_variable():1031 [1] Resampling ctd2_salinity with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:05,045 resample.py resample_variable():1031 [1] Resampling ctd2_temperature_onboard with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:05,130 resample.py resample_variable():1031 [1] Resampling ctd2_conductivity_onboard with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:05,217 resample.py resample_variable():1031 [1] Resampling ctd2_salinity_onboard with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:05,302 resample.py resample_variable():1031 [1] Resampling ctd2_flow2 with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:05,387 resample.py resample_variable():1031 [1] Resampling ctd2_par with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:05,421 resample.py resample_variable():1031 [1] Resampling isus_nitrate with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:05,451 resample.py resample_variable():1031 [1] Resampling isus_temp with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:05,478 resample.py resample_variable():1031 [1] Resampling isus_quality with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:05,507 resample.py resample_variable():1031 [1] Resampling biolume_flow with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:05,536 resample.py resample_variable():1031 [1] Resampling biolume_avg_biolume with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:05,545 resample.py set_proxy_parameters():520 [1] Setting biolume proxy parameters for period4 INFO 2025-06-27 03:22:05,545 resample.py add_biolume_proxies():549 [1] Adding biolume proxy variables computed from biolume_raw INFO 2025-06-27 03:22:07,720 resample.py add_biolume_proxies():595 [1] Using flash_threshold = 1.0000e+11 INFO 2025-06-27 03:22:08,425 resample.py add_biolume_proxies():638 [1] Computing flashes per liter: nbflash_high, nbflash_low INFO 2025-06-27 03:22:08,682 resample.py add_biolume_proxies():666 [1] Saving flash intensity: biolume_intflash - the upper bound of the background envelope INFO 2025-06-27 03:22:08,784 resample.py add_biolume_proxies():683 [1] Saving Background bioluminescence (dinoflagellates proxy) INFO 2025-06-27 03:22:08,861 resample.py select_nighttime_bl_raw():408 [1] Extracting biolume_raw data between sunset 2020-11-10 01:52:52.394274816 and sunrise 2020-11-10 13:32:52.393843968 INFO 2025-06-27 03:22:09,024 resample.py add_biolume_proxies():700 [1] No hs2_fl700 data. Not computing adinos, diatoms, and hdinos INFO 2025-06-27 03:22:09,055 resample.py resample_variable():1031 [1] Resampling lopc_countListSum with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:09,070 resample.py resample_variable():1031 [1] Resampling lopc_transCount with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:09,083 resample.py resample_variable():1031 [1] Resampling lopc_nonTransCount with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:09,097 resample.py resample_variable():1031 [1] Resampling lopc_LCcount with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:09,110 resample.py resample_variable():1031 [1] Resampling lopc_flowSpeed with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:09,290 resample.py resample_variable():1031 [1] Resampling ecopuck_bbp700 with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:09,498 resample.py resample_variable():1031 [1] Resampling ecopuck_cdom with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:09,699 resample.py resample_variable():1031 [1] Resampling ecopuck_chl with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:09,815 resample.py resample_variable():1031 [1] Resampling tailcone_propRpm with frequency 1S following 3 point median filter INFO 2025-06-27 03:22:10,332 resample.py resample_mission():1297 [1] Saved resampled mission to /data/auv_data/dorado/missionnetcdfs/2020.314.01/dorado_2020.314.01_1S.nc INFO 2025-06-27 03:22:15,666 create_products.py _get_best_ctd():375 [1] Best CTD is ctd1 INFO 2025-06-27 03:22:39,111 create_products.py gulper_odv():522 [1] Wrote 20 Gulper data lines to /data/auv_data/dorado/missionodvs/2020.314.01/dorado_2020.314.01_1S_Gulper.txt INFO 2025-06-27 03:22:39,111 process.py archive():337 [1] Archiving steps for 2020.314.01 INFO 2025-06-27 03:22:39,112 process.py archive():347 [1] nc_file_base = /data/auv_data/dorado/missionnetcdfs/2020.314.01/dorado_2020.314.01, BASE_PATH = /data/auv_data INFO 2025-06-27 03:22:39,115 archive.py copy_to_AUVTCD():60 [1] Archiving /data/auv_data/dorado/missionnetcdfs/2020.314.01/dorado_2020.314.01 files to /Volumes/AUVCTD/surveys/2020/netcdf INFO 2025-06-27 03:22:39,119 archive.py copy_to_AUVTCD():78 [1] Removing /Volumes/AUVCTD/surveys/2020/netcdf/dorado_2020.314.01_1S.nc INFO 2025-06-27 03:22:39,250 archive.py copy_to_AUVTCD():82 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2020.314.01/dorado_2020.314.01_1S.nc /Volumes/AUVCTD/surveys/2020/netcdf done. INFO 2025-06-27 03:22:39,251 archive.py copy_to_AUVTCD():78 [1] Removing /Volumes/AUVCTD/surveys/2020/netcdf/dorado_2020.314.01_cal.nc INFO 2025-06-27 03:22:39,924 archive.py copy_to_AUVTCD():82 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2020.314.01/dorado_2020.314.01_cal.nc /Volumes/AUVCTD/surveys/2020/netcdf done. INFO 2025-06-27 03:22:39,926 archive.py copy_to_AUVTCD():78 [1] Removing /Volumes/AUVCTD/surveys/2020/netcdf/dorado_2020.314.01_align.nc INFO 2025-06-27 03:22:40,900 archive.py copy_to_AUVTCD():82 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2020.314.01/dorado_2020.314.01_align.nc /Volumes/AUVCTD/surveys/2020/netcdf done. INFO 2025-06-27 03:22:41,035 archive.py copy_to_AUVTCD():108 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2020.314.01/ctdDriver.nc /Volumes/AUVCTD/missionnetcdfs/2020/2020314/2020.314.01 done. INFO 2025-06-27 03:22:41,171 archive.py copy_to_AUVTCD():108 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2020.314.01/ctdDriver2.nc /Volumes/AUVCTD/missionnetcdfs/2020/2020314/2020.314.01 done. INFO 2025-06-27 03:22:41,195 archive.py copy_to_AUVTCD():108 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2020.314.01/gps.nc /Volumes/AUVCTD/missionnetcdfs/2020/2020314/2020.314.01 done. INFO 2025-06-27 03:22:41,635 archive.py copy_to_AUVTCD():108 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2020.314.01/navigation.nc /Volumes/AUVCTD/missionnetcdfs/2020/2020314/2020.314.01 done. INFO 2025-06-27 03:22:41,669 archive.py copy_to_AUVTCD():108 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2020.314.01/isuslog.nc /Volumes/AUVCTD/missionnetcdfs/2020/2020314/2020.314.01 done. INFO 2025-06-27 03:22:41,837 archive.py copy_to_AUVTCD():108 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2020.314.01/parosci.nc /Volumes/AUVCTD/missionnetcdfs/2020/2020314/2020.314.01 done. INFO 2025-06-27 03:22:41,959 archive.py copy_to_AUVTCD():108 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2020.314.01/FLBBCD2K.nc /Volumes/AUVCTD/missionnetcdfs/2020/2020314/2020.314.01 done. INFO 2025-06-27 03:22:42,027 archive.py copy_to_AUVTCD():108 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2020.314.01/tailCone.nc /Volumes/AUVCTD/missionnetcdfs/2020/2020314/2020.314.01 done. INFO 2025-06-27 03:22:42,289 archive.py copy_to_AUVTCD():108 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2020.314.01/biolume.nc /Volumes/AUVCTD/missionnetcdfs/2020/2020314/2020.314.01 done. INFO 2025-06-27 03:22:42,585 archive.py copy_to_AUVTCD():108 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2020.314.01/lopc.nc /Volumes/AUVCTD/missionnetcdfs/2020/2020314/2020.314.01 done. INFO 2025-06-27 03:22:42,586 archive.py copy_to_AUVTCD():116 [1] Archiving product files INFO 2025-06-27 03:22:42,593 archive.py copy_to_AUVTCD():133 [1] Removing /Volumes/AUVCTD/surveys/2020/odv/dorado_2020.314.01_1S_Gulper.txt INFO 2025-06-27 03:22:42,609 archive.py copy_to_AUVTCD():136 [1] copyfile /data/auv_data/dorado/missionodvs/2020.314.01/dorado_2020.314.01_1S_Gulper.txt /Volumes/AUVCTD/surveys/2020/odv done. INFO 2025-06-27 03:22:42,609 archive.py copy_to_AUVTCD():161 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2020.314.01/dorado_2020.314.01_processing.log /Volumes/AUVCTD/surveys/2020/netcdf