INFO 2025-06-26 15:36:07,549 process.py process_mission():429 [1] commandline = src/data/process_dorado.py --start_year 2005 --end_year 2014 --num_cores 1 -v --noinput --clobber INFO 2025-06-26 15:36:07,549 process.py process_mission():434 [1] dorado_info[mission]["comment"] = AUVCTD mission - Gulf of Mexico mission without GPS data (USBL fixes provided in a separate file) - ctdToUse = ctd1 INFO 2025-06-26 15:36:07,550 process.py process_mission():449 [1] Processing AUVCTD mission 2010.151.04 by user docker_user on host eae60d30a712 INFO 2025-06-26 15:36:07,550 process.py download_process():165 [1] Download and processing steps for 2010.151.04 INFO 2025-06-26 15:36:07,550 logs2netcdfs.py download_process_logs():739 [1] src_dir = /Volumes/AUVCTD/missionlogs/2010/2010151/2010.151.04 INFO 2025-06-26 15:36:07,550 logs2netcdfs.py download_process_logs():768 [1] Rsyncing /Volumes/AUVCTD/missionlogs/2010/2010151/2010.151.04 to /data/auv_data/dorado/missionlogs/2010.151.04 INFO 2025-06-26 15:36:09,518 logs2netcdfs.py download_process_logs():779 [1] Processing mission: dorado 2010.151.04 INFO 2025-06-26 15:36:09,518 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/dorado/missionlogs/2010.151.04/ctdDriver.log (5634918 bytes) INFO 2025-06-26 15:36:09,940 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/dorado/missionlogs/2010.151.04/ctdDriver2.log (5634911 bytes) INFO 2025-06-26 15:36:10,356 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/dorado/missionlogs/2010.151.04/gps.log (0 bytes) WARNING 2025-06-26 15:36:10,357 logs2netcdfs.py download_process_logs():790 [1] /data/auv_data/dorado/missionlogs/2010.151.04/gps.log is empty INFO 2025-06-26 15:36:10,357 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/dorado/missionlogs/2010.151.04/hydroscatlog.log (4933678 bytes) INFO 2025-06-26 15:36:10,875 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/dorado/missionlogs/2010.151.04/navigation.log (17298690 bytes) INFO 2025-06-26 15:36:12,137 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/dorado/missionlogs/2010.151.04/parosci.log (5615174 bytes) INFO 2025-06-26 15:36:12,622 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/dorado/missionlogs/2010.151.04/tailCone.log (3525739 bytes) INFO 2025-06-26 15:36:13,077 logs2netcdfs.py download_process_logs():807 [1] Time to process: 3.56 seconds WARNING 2025-06-26 15:36:13,077 process.py download_process():196 [1] No lopc.bin file for 2010.151.04 INFO 2025-06-26 15:36:13,077 process.py calibrate():227 [1] Calibration steps for 2010.151.04 INFO 2025-06-26 15:36:13,239 calibrate.py _gps_process():1989 [1] Just for the GoMx mission 2010.151.04 use data from /data/auv_data/dorado/missionnetcdfs/2010.151.04/usbl.nc that came from the missionlogs/usbl.dat file INFO 2025-06-26 15:36:13,249 calibrate.py _nudge_pos():1680 [1] seg# end_sec_diff end_lon_diff end_lat_diff len(segi) seg_min u_drift (cm/s) v_drift (cm/s) start datetime of segment INFO 2025-06-26 15:36:13,252 calibrate.py _nudge_pos():1711 [1] - - - 53116 177.05 - - - INFO 2025-06-26 15:36:13,260 calibrate.py _nudge_pos():1806 [1] 0: 0.010 -0.0014025 0.0013686 500 1.66 -136.848 152.462 2010-06-01T01:34:23.990384640 INFO 2025-06-26 15:36:13,272 calibrate.py _nudge_pos():1806 [1] 1: 0.007 -0.0022329 0.0007454 505 1.68 -215.709 82.211 2010-06-01T01:36:04.993465344 INFO 2025-06-26 15:36:13,283 calibrate.py _nudge_pos():1806 [1] 2: 0.013 -0.0024706 -0.0014762 500 1.66 -241.094 -164.465 2010-06-01T01:37:44.986615296 INFO 2025-06-26 15:36:13,293 calibrate.py _nudge_pos():1806 [1] 3: 0.010 -0.0026086 -0.0039016 500 1.66 -254.538 -434.631 2010-06-01T01:39:24.989764608 INFO 2025-06-26 15:36:13,304 calibrate.py _nudge_pos():1806 [1] 4: 0.007 -0.0025740 -0.0040283 500 1.66 -251.162 -448.747 2010-06-01T01:41:04.992914176 INFO 2025-06-26 15:36:13,314 calibrate.py _nudge_pos():1806 [1] 5: 0.014 -0.0027369 -0.0020736 500 1.66 -267.079 -231.025 2010-06-01T01:42:44.986064128 INFO 2025-06-26 15:36:13,325 calibrate.py _nudge_pos():1806 [1] 6: 0.011 -0.0022016 -0.0007139 500 1.66 -214.813 -79.532 2010-06-01T01:44:24.989213440 INFO 2025-06-26 15:36:13,335 calibrate.py _nudge_pos():1806 [1] 7: 0.008 -0.0024720 -0.0006143 500 1.66 -241.196 -68.437 2010-06-01T01:46:04.992362752 INFO 2025-06-26 15:36:13,346 calibrate.py _nudge_pos():1806 [1] 8: 0.014 -0.0022628 -0.0010818 500 1.66 -220.800 -120.527 2010-06-01T01:47:44.985512704 INFO 2025-06-26 15:36:13,357 calibrate.py _nudge_pos():1806 [1] 9: 0.011 -0.0023538 -0.0008727 500 1.66 -229.653 -97.221 2010-06-01T01:49:24.988662016 INFO 2025-06-26 15:36:13,367 calibrate.py _nudge_pos():1806 [1] 10: 0.008 -0.0021048 -0.0008093 500 1.66 -205.357 -90.152 2010-06-01T01:51:04.991811328 INFO 2025-06-26 15:36:13,378 calibrate.py _nudge_pos():1806 [1] 11: 0.005 -0.0021240 -0.0009363 500 1.66 -207.226 -104.298 2010-06-01T01:52:44.994960640 INFO 2025-06-26 15:36:13,388 calibrate.py _nudge_pos():1806 [1] 12: 0.012 -0.0020538 -0.0010782 500 1.66 -200.398 -120.125 2010-06-01T01:54:24.988110848 INFO 2025-06-26 15:36:13,399 calibrate.py _nudge_pos():1806 [1] 13: 0.009 -0.0023911 -0.0009837 500 1.66 -233.281 -109.587 2010-06-01T01:56:04.991260160 INFO 2025-06-26 15:36:13,410 calibrate.py _nudge_pos():1806 [1] 14: 0.006 -0.0019866 -0.0004507 500 1.66 -193.817 -50.208 2010-06-01T01:57:44.994409216 INFO 2025-06-26 15:36:13,420 calibrate.py _nudge_pos():1806 [1] 15: 0.012 -0.0029601 -0.0000772 495 1.65 -291.749 -8.684 2010-06-01T01:59:23.987627776 INFO 2025-06-26 15:36:13,431 calibrate.py _nudge_pos():1806 [1] 16: 0.009 -0.0030871 0.0011210 500 1.66 -301.192 124.881 2010-06-01T02:01:03.990777088 INFO 2025-06-26 15:36:13,442 calibrate.py _nudge_pos():1806 [1] 17: 0.006 -0.0061463 0.0014823 505 1.68 -593.723 163.484 2010-06-01T02:02:44.993857792 INFO 2025-06-26 15:36:13,453 calibrate.py _nudge_pos():1806 [1] 18: 0.013 -0.0069068 0.0020108 500 1.66 -673.938 224.021 2010-06-01T02:04:24.987007744 INFO 2025-06-26 15:36:13,464 calibrate.py _nudge_pos():1806 [1] 19: 0.010 -0.0061450 0.0023763 500 1.66 -599.549 264.717 2010-06-01T02:06:04.990157056 INFO 2025-06-26 15:36:13,474 calibrate.py _nudge_pos():1806 [1] 20: 0.007 -0.0055582 0.0021563 500 1.66 -542.307 240.210 2010-06-01T02:07:44.993306624 INFO 2025-06-26 15:36:13,485 calibrate.py _nudge_pos():1806 [1] 21: 0.014 -0.0050995 0.0023867 500 1.66 -497.612 265.907 2010-06-01T02:09:24.986456576 INFO 2025-06-26 15:36:13,496 calibrate.py _nudge_pos():1806 [1] 22: 0.010 -0.0047893 0.0023973 500 1.66 -467.294 267.057 2010-06-01T02:11:04.989605888 INFO 2025-06-26 15:36:13,506 calibrate.py _nudge_pos():1806 [1] 23: 0.007 -0.0047344 0.0022959 500 1.66 -461.943 255.756 2010-06-01T02:12:44.992755200 INFO 2025-06-26 15:36:13,517 calibrate.py _nudge_pos():1806 [1] 24: 0.014 -0.0043487 0.0029405 500 1.66 -424.353 327.600 2010-06-01T02:14:24.985905152 INFO 2025-06-26 15:36:13,528 calibrate.py _nudge_pos():1806 [1] 25: 0.011 -0.0041247 0.0007487 500 1.66 -402.467 83.407 2010-06-01T02:16:04.989054464 INFO 2025-06-26 15:36:13,539 calibrate.py _nudge_pos():1806 [1] 26: 0.008 -0.0035451 0.0002662 500 1.66 -345.914 29.652 2010-06-01T02:17:44.992203776 INFO 2025-06-26 15:36:13,551 calibrate.py _nudge_pos():1806 [1] 27: 0.015 -0.0028611 0.0015610 500 1.66 -279.192 173.916 2010-06-01T02:19:24.985353728 INFO 2025-06-26 15:36:13,563 calibrate.py _nudge_pos():1806 [1] 28: 0.011 -0.0031286 0.0039145 500 1.66 -305.261 436.076 2010-06-01T02:21:04.988503296 INFO 2025-06-26 15:36:13,573 calibrate.py _nudge_pos():1806 [1] 29: 0.008 -0.0032003 0.0047152 500 1.66 -312.256 525.265 2010-06-01T02:22:44.991652608 INFO 2025-06-26 15:36:13,584 calibrate.py _nudge_pos():1806 [1] 30: 0.005 -0.0027558 0.0061015 500 1.66 -268.878 679.698 2010-06-01T02:24:24.994801664 INFO 2025-06-26 15:36:13,595 calibrate.py _nudge_pos():1806 [1] 31: 0.012 -0.0026755 0.0070565 500 1.66 -261.074 786.166 2010-06-01T02:26:04.987951872 INFO 2025-06-26 15:36:13,607 calibrate.py _nudge_pos():1806 [1] 32: 0.009 -0.0023760 0.0083798 500 1.66 -231.821 933.500 2010-06-01T02:27:44.991100928 INFO 2025-06-26 15:36:13,617 calibrate.py _nudge_pos():1806 [1] 33: 0.006 -0.0022186 0.0097406 495 1.65 -218.654 1096.082 2010-06-01T02:29:23.994318848 INFO 2025-06-26 15:36:13,628 calibrate.py _nudge_pos():1806 [1] 34: 0.013 -0.0021195 0.0106009 500 1.66 -206.806 1181.045 2010-06-01T02:31:03.987469056 INFO 2025-06-26 15:36:13,639 calibrate.py _nudge_pos():1806 [1] 35: 0.009 -0.0019364 0.0118540 505 1.68 -187.044 1307.426 2010-06-01T02:32:44.990549760 INFO 2025-06-26 15:36:13,650 calibrate.py _nudge_pos():1806 [1] 36: 0.006 -0.0017609 0.0130785 500 1.66 -171.796 1456.935 2010-06-01T02:34:24.993699072 INFO 2025-06-26 15:36:13,661 calibrate.py _nudge_pos():1806 [1] 37: 0.013 -0.0009522 0.0137251 500 1.66 -92.904 1529.118 2010-06-01T02:36:04.986849024 INFO 2025-06-26 15:36:13,672 calibrate.py _nudge_pos():1806 [1] 38: 0.010 -0.0004257 0.0128592 500 1.66 -41.536 1432.500 2010-06-01T02:37:44.989998336 INFO 2025-06-26 15:36:13,683 calibrate.py _nudge_pos():1806 [1] 39: 0.007 -0.0000519 0.0107229 500 1.66 -5.063 1194.526 2010-06-01T02:39:24.993147648 WARNING 2025-06-26 15:36:13,692 calibrate.py _nudge_pos():1789 [1] abs(end_sec_diff) (66.009181184) > max_sec_diff_at_end (10) INFO 2025-06-26 15:36:13,692 calibrate.py _nudge_pos():1794 [1] Overriding end_lon_diff (-0.0007614279684844405) and end_lat_diff (0.00902919574964045) by setting them to 0 INFO 2025-06-26 15:36:13,693 calibrate.py _nudge_pos():1806 [1] 40: 66.009 0.0000000 0.0000000 170 0.56 -219.375 2970.221 2010-06-01T02:39:58.990818816 INFO 2025-06-26 15:36:13,926 calibrate.py _nudge_pos():1862 [1] 42: - - - 0 0.00 - - INFO 2025-06-26 15:36:13,926 calibrate.py _nudge_pos():1868 [1] Points in final series = 73291 WARNING 2025-06-26 15:36:14,019 calibrate.py _depth_process():2193 [1] Expected sample_rate to be 10 Hz, instead it's 7.69 Hz INFO 2025-06-26 15:36:14,596 calibrate.py _geometric_depth_correction():3423 [1] hs2: d_beg_time_diff: 4 seconds, d_end_time_diff: 0 seconds INFO 2025-06-26 15:36:15,185 calibrate.py _geometric_depth_correction():3423 [1] ctd1: d_beg_time_diff: 18 seconds, d_end_time_diff: 0 seconds INFO 2025-06-26 15:36:15,654 calibrate.py _geometric_depth_correction():3423 [1] ctd1: d_beg_time_diff: 18 seconds, d_end_time_diff: 0 seconds INFO 2025-06-26 15:36:15,656 calibrate.py _ctd_process():2919 [1] Performing range checking of ['ctd1_salinity'] in 2010.151.04/ctd1.nc INFO 2025-06-26 15:36:15,658 calibrate.py _range_qc_combined_nc():898 [1] Setting 1 ctd1_salinity values to NaN INFO 2025-06-26 15:36:15,658 calibrate.py _range_qc_combined_nc():910 [1] Checked for data outside of these variables and ranges: [('ctd1_salinity', Range(min=30, max=40))] INFO 2025-06-26 15:36:15,658 calibrate.py _range_qc_combined_nc():936 [1] Done range checking ctd1 INFO 2025-06-26 15:36:16,222 calibrate.py _geometric_depth_correction():3423 [1] ctd2: d_beg_time_diff: 18 seconds, d_end_time_diff: -1 seconds INFO 2025-06-26 15:36:16,668 calibrate.py _geometric_depth_correction():3423 [1] ctd2: d_beg_time_diff: 18 seconds, d_end_time_diff: -1 seconds INFO 2025-06-26 15:36:16,670 calibrate.py _ctd_process():2919 [1] Performing range checking of ['ctd2_salinity'] in 2010.151.04/ctd2.nc INFO 2025-06-26 15:36:16,671 calibrate.py _range_qc_combined_nc():898 [1] Setting 1 ctd2_salinity values to NaN INFO 2025-06-26 15:36:16,672 calibrate.py _range_qc_combined_nc():910 [1] Checked for data outside of these variables and ranges: [('ctd2_salinity', Range(min=30, max=40))] INFO 2025-06-26 15:36:16,672 calibrate.py _range_qc_combined_nc():936 [1] Done range checking ctd2 ERROR 2025-06-26 15:36:16,672 calibrate.py process_logs():3542 [1] Error processing isus: isus has no orig_data - likely a missing or zero-sized .log file in missionlogs/2010.151.04 ERROR 2025-06-26 15:36:16,672 calibrate.py process_logs():3542 [1] Error processing biolume: biolume has no orig_data - likely a missing or zero-sized .log file in missionlogs/2010.151.04 ERROR 2025-06-26 15:36:16,673 calibrate.py process_logs():3542 [1] Error processing lopc: lopc has no orig_data - likely a missing or zero-sized .log file in missionlogs/2010.151.04 ERROR 2025-06-26 15:36:16,673 calibrate.py process_logs():3542 [1] Error processing ecopuck: ecopuck has no orig_data - likely a missing or zero-sized .log file in missionlogs/2010.151.04 INFO 2025-06-26 15:36:16,733 calibrate.py write_netcdf():3508 [1] Writing calibrated instrument data to /data/auv_data/dorado/missionnetcdfs/2010.151.04/dorado_2010.151.04_cal.nc INFO 2025-06-26 15:36:16,808 calibrate.py write_netcdf():3512 [1] Data variables written: ctd1_conductivity, ctd1_conductivity_onboard, ctd1_depth, ctd1_dissolvedO2, ctd1_flow1, ctd1_oxygen_mll, ctd1_oxygen_umolkg, ctd1_salinity, ctd1_salinity_onboard, ctd1_temperature, ctd1_temperature_onboard, ctd1_time, ctd2_conductivity, ctd2_conductivity_onboard, ctd2_depth, ctd2_flow2, ctd2_salinity, ctd2_salinity_onboard, ctd2_temperature, ctd2_temperature_onboard, ctd2_time, depth_filtdepth, depth_filtpres, depth_time, gps_latitude, gps_longitude, gps_time, hs2_bbp420, hs2_bbp700, hs2_depth, hs2_fl700, hs2_time, navigation_depth, navigation_latitude, navigation_longitude, navigation_mWaterSpeed, navigation_pitch, navigation_posx, navigation_posy, navigation_roll, navigation_time, navigation_yaw, nudged_latitude, nudged_longitude, tailcone_propRpm, tailcone_time, time INFO 2025-06-26 15:36:16,811 process.py align():251 [1] Alignment steps for 2010.151.04 INFO 2025-06-26 15:36:16,836 align.py process_cal():139 [1] Processing dorado_2010.151.04_cal.nc from /data/auv_data/dorado/missionnetcdfs/2010.151.04 INFO 2025-06-26 15:36:16,859 align.py process_cal():206 [1] Using pitch corrected navigation_depth: mDepth from navigation.nc INFO 2025-06-26 15:36:16,863 align.py process_cal():249 [1] navigation_roll: instrument_sample_rate_hz = 5.00 INFO 2025-06-26 15:36:16,919 align.py process_cal():206 [1] Using pitch corrected navigation_depth: mDepth from navigation.nc INFO 2025-06-26 15:36:16,923 align.py process_cal():249 [1] navigation_pitch: instrument_sample_rate_hz = 5.00 INFO 2025-06-26 15:36:16,977 align.py process_cal():206 [1] Using pitch corrected navigation_depth: mDepth from navigation.nc INFO 2025-06-26 15:36:16,981 align.py process_cal():249 [1] navigation_yaw: instrument_sample_rate_hz = 5.00 INFO 2025-06-26 15:36:17,012 align.py process_cal():161 [1] Skipping navigation_posx INFO 2025-06-26 15:36:17,012 align.py process_cal():161 [1] Skipping navigation_posy INFO 2025-06-26 15:36:17,032 align.py process_cal():206 [1] Using pitch corrected navigation_depth: mDepth from navigation.nc INFO 2025-06-26 15:36:17,036 align.py process_cal():249 [1] navigation_mWaterSpeed: instrument_sample_rate_hz = 5.00 INFO 2025-06-26 15:36:17,090 align.py process_cal():206 [1] Using pitch corrected hs2_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to hs2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:17,093 align.py process_cal():249 [1] hs2_bbp420: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:17,139 align.py process_cal():206 [1] Using pitch corrected hs2_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to hs2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:17,143 align.py process_cal():249 [1] hs2_bbp700: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:17,190 align.py process_cal():206 [1] Using pitch corrected hs2_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to hs2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:17,193 align.py process_cal():249 [1] hs2_fl700: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:17,239 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:17,243 align.py process_cal():249 [1] ctd1_temperature: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:17,290 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:17,294 align.py process_cal():249 [1] ctd1_conductivity: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:17,339 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:17,343 align.py process_cal():249 [1] ctd1_salinity: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:17,390 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:17,394 align.py process_cal():249 [1] ctd1_temperature_onboard: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:17,439 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:17,443 align.py process_cal():249 [1] ctd1_conductivity_onboard: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:17,491 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:17,495 align.py process_cal():249 [1] ctd1_salinity_onboard: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:17,541 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:17,545 align.py process_cal():249 [1] ctd1_dissolvedO2: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:17,593 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:17,597 align.py process_cal():249 [1] ctd1_oxygen_mll: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:17,643 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:17,648 align.py process_cal():249 [1] ctd1_oxygen_umolkg: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:17,697 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:17,701 align.py process_cal():249 [1] ctd1_flow1: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:17,747 align.py process_cal():206 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:17,751 align.py process_cal():249 [1] ctd1_depth: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:17,799 align.py process_cal():206 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:17,803 align.py process_cal():249 [1] ctd2_temperature: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:17,850 align.py process_cal():206 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:17,854 align.py process_cal():249 [1] ctd2_conductivity: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:17,902 align.py process_cal():206 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:17,906 align.py process_cal():249 [1] ctd2_salinity: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:17,952 align.py process_cal():206 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:17,957 align.py process_cal():249 [1] ctd2_temperature_onboard: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:18,005 align.py process_cal():206 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:18,011 align.py process_cal():249 [1] ctd2_conductivity_onboard: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:18,058 align.py process_cal():206 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:18,062 align.py process_cal():249 [1] ctd2_salinity_onboard: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:18,110 align.py process_cal():206 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:18,114 align.py process_cal():249 [1] ctd2_flow2: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:18,161 align.py process_cal():206 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2010.151.04_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2025-06-26 15:36:18,165 align.py process_cal():249 [1] ctd2_depth: instrument_sample_rate_hz = 4.00 INFO 2025-06-26 15:36:18,223 align.py process_cal():249 [1] tailcone_propRpm: instrument_sample_rate_hz = 5.00 INFO 2025-06-26 15:36:18,260 align.py write_netcdf():337 [1] Writing aligned data to /data/auv_data/dorado/missionnetcdfs/2010.151.04/dorado_2010.151.04_align.nc INFO 2025-06-26 15:36:18,319 align.py write_netcdf():342 [1] Data variables written: ctd1_conductivity, ctd1_conductivity_onboard, ctd1_depth, ctd1_dissolvedO2, ctd1_flow1, ctd1_latitude, ctd1_longitude, ctd1_oxygen_mll, ctd1_oxygen_umolkg, ctd1_salinity, ctd1_salinity_onboard, ctd1_temperature, ctd1_temperature_onboard, ctd1_time, ctd2_conductivity, ctd2_conductivity_onboard, ctd2_depth, ctd2_flow2, ctd2_latitude, ctd2_longitude, ctd2_salinity, ctd2_salinity_onboard, ctd2_temperature, ctd2_temperature_onboard, ctd2_time, hs2_bbp420, hs2_bbp700, hs2_depth, hs2_fl700, hs2_latitude, hs2_longitude, hs2_time, navigation_depth, navigation_latitude, navigation_longitude, navigation_mWaterSpeed, navigation_pitch, navigation_roll, navigation_time, navigation_yaw, tailcone_depth, tailcone_latitude, tailcone_longitude, tailcone_propRpm, tailcone_time INFO 2025-06-26 15:36:18,321 process.py resample():273 [1] Resampling steps for 2010.151.04 INFO 2025-06-26 15:36:18,322 resample.py resample_mission():1185 [1] Using depth_threshold = 10.00 m INFO 2025-06-26 15:36:18,342 resample.py instruments_variables():235 [1] Reading variables from /data/auv_data/dorado/missionnetcdfs/2010.151.04/dorado_2010.151.04_align.nc mission netCDF file INFO 2025-06-26 15:36:18,346 resample.py instruments_variables():235 [1] Reading variables from /data/auv_data/dorado/missionnetcdfs/2010.151.04/dorado_2010.151.04_align.nc mission netCDF file INFO 2025-06-26 15:36:18,347 resample.py get_mission_start_end():1145 [1] navigation: 2010-05-31T22:35:40.854969856 to 2010-06-01T02:39:58.990818816 (0 days 00:00:00 before mission_end) INFO 2025-06-26 15:36:18,349 resample.py get_mission_start_end():1145 [1] hs2 : 2010-05-31T22:35:12.506911744 to 2010-06-01T02:39:58.950821376 (0 days 00:00:00.039997440 before mission_end) INFO 2025-06-26 15:36:18,351 resample.py get_mission_start_end():1145 [1] ctd1 : 2010-05-31T22:35:26.535950592 to 2010-06-01T02:39:58.960820736 (0 days 00:00:00.029998080 before mission_end) INFO 2025-06-26 15:36:18,352 resample.py get_mission_start_end():1145 [1] ctd2 : 2010-05-31T22:35:26.725937664 to 2010-06-01T02:39:58.880826112 (0 days 00:00:00.109992704 before mission_end) INFO 2025-06-26 15:36:18,354 resample.py get_mission_start_end():1145 [1] tailcone : 2010-05-31T22:35:09.927088384 to 2010-06-01T02:39:58.920823296 (0 days 00:00:00.069995520 before mission_end) INFO 2025-06-26 15:36:18,355 resample.py instruments_variables():235 [1] Reading variables from /data/auv_data/dorado/missionnetcdfs/2010.151.04/dorado_2010.151.04_align.nc mission netCDF file INFO 2025-06-26 15:36:18,355 resample.py resample_coordinates():249 [1] Resampling coordinates depth, latitude and longitude with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:18,525 resample.py resample_variable():1031 [1] Resampling navigation_roll with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:18,556 resample.py resample_variable():1031 [1] Resampling navigation_pitch with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:18,587 resample.py resample_variable():1031 [1] Resampling navigation_yaw with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:18,616 resample.py resample_variable():1031 [1] Resampling navigation_mWaterSpeed with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:18,643 resample.py resample_variable():1031 [1] Resampling hs2_bbp420 with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:18,669 resample.py resample_variable():1031 [1] Resampling hs2_bbp700 with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:18,695 resample.py resample_variable():1031 [1] Resampling hs2_fl700 with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:18,720 resample.py resample_variable():1031 [1] Resampling ctd1_temperature with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:18,744 resample.py resample_variable():1031 [1] Resampling ctd1_conductivity with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:18,767 resample.py resample_variable():1031 [1] Resampling ctd1_salinity with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:18,790 resample.py resample_variable():1031 [1] Resampling ctd1_temperature_onboard with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:18,813 resample.py resample_variable():1031 [1] Resampling ctd1_conductivity_onboard with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:18,836 resample.py resample_variable():1031 [1] Resampling ctd1_salinity_onboard with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:18,859 resample.py resample_variable():1031 [1] Resampling ctd1_dissolvedO2 with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:18,881 resample.py resample_variable():1031 [1] Resampling ctd1_oxygen_mll with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:18,904 resample.py resample_variable():1031 [1] Resampling ctd1_oxygen_umolkg with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:18,927 resample.py resample_variable():1031 [1] Resampling ctd1_flow1 with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:18,953 resample.py resample_variable():1031 [1] Resampling ctd2_temperature with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:18,977 resample.py resample_variable():1031 [1] Resampling ctd2_conductivity with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:19,001 resample.py resample_variable():1031 [1] Resampling ctd2_salinity with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:19,026 resample.py resample_variable():1031 [1] Resampling ctd2_temperature_onboard with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:19,050 resample.py resample_variable():1031 [1] Resampling ctd2_conductivity_onboard with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:19,074 resample.py resample_variable():1031 [1] Resampling ctd2_salinity_onboard with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:19,098 resample.py resample_variable():1031 [1] Resampling ctd2_flow2 with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:19,128 resample.py resample_variable():1031 [1] Resampling tailcone_propRpm with frequency 1S following 3 point median filter INFO 2025-06-26 15:36:19,301 resample.py resample_mission():1297 [1] Saved resampled mission to /data/auv_data/dorado/missionnetcdfs/2010.151.04/dorado_2010.151.04_1S.nc INFO 2025-06-26 15:36:20,938 create_products.py _get_best_ctd():380 [1] ctdToUse = ctd1 INFO 2025-06-26 15:36:30,291 create_products.py gulper_odv():522 [1] Wrote 10 Gulper data lines to /data/auv_data/dorado/missionodvs/2010.151.04/dorado_2010.151.04_1S_Gulper.txt INFO 2025-06-26 15:36:30,292 process.py archive():337 [1] Archiving steps for 2010.151.04 INFO 2025-06-26 15:36:30,292 process.py archive():347 [1] nc_file_base = /data/auv_data/dorado/missionnetcdfs/2010.151.04/dorado_2010.151.04, BASE_PATH = /data/auv_data INFO 2025-06-26 15:36:30,292 archive.py copy_to_AUVTCD():60 [1] Archiving /data/auv_data/dorado/missionnetcdfs/2010.151.04/dorado_2010.151.04 files to /Volumes/AUVCTD/surveys/2010/netcdf INFO 2025-06-26 15:36:30,293 archive.py copy_to_AUVTCD():78 [1] Removing /Volumes/AUVCTD/surveys/2010/netcdf/dorado_2010.151.04_1S.nc INFO 2025-06-26 15:36:30,306 archive.py copy_to_AUVTCD():82 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2010.151.04/dorado_2010.151.04_1S.nc /Volumes/AUVCTD/surveys/2010/netcdf done. INFO 2025-06-26 15:36:30,307 archive.py copy_to_AUVTCD():78 [1] Removing /Volumes/AUVCTD/surveys/2010/netcdf/dorado_2010.151.04_cal.nc INFO 2025-06-26 15:36:30,366 archive.py copy_to_AUVTCD():82 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2010.151.04/dorado_2010.151.04_cal.nc /Volumes/AUVCTD/surveys/2010/netcdf done. INFO 2025-06-26 15:36:30,367 archive.py copy_to_AUVTCD():78 [1] Removing /Volumes/AUVCTD/surveys/2010/netcdf/dorado_2010.151.04_align.nc INFO 2025-06-26 15:36:30,423 archive.py copy_to_AUVTCD():82 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2010.151.04/dorado_2010.151.04_align.nc /Volumes/AUVCTD/surveys/2010/netcdf done. INFO 2025-06-26 15:36:30,442 archive.py copy_to_AUVTCD():108 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2010.151.04/ctdDriver.nc /Volumes/AUVCTD/missionnetcdfs/2010/2010151/2010.151.04 done. INFO 2025-06-26 15:36:30,461 archive.py copy_to_AUVTCD():108 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2010.151.04/ctdDriver2.nc /Volumes/AUVCTD/missionnetcdfs/2010/2010151/2010.151.04 done. INFO 2025-06-26 15:36:30,480 archive.py copy_to_AUVTCD():108 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2010.151.04/hydroscatlog.nc /Volumes/AUVCTD/missionnetcdfs/2010/2010151/2010.151.04 done. INFO 2025-06-26 15:36:30,525 archive.py copy_to_AUVTCD():108 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2010.151.04/navigation.nc /Volumes/AUVCTD/missionnetcdfs/2010/2010151/2010.151.04 done. INFO 2025-06-26 15:36:30,544 archive.py copy_to_AUVTCD():108 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2010.151.04/parosci.nc /Volumes/AUVCTD/missionnetcdfs/2010/2010151/2010.151.04 done. INFO 2025-06-26 15:36:30,560 archive.py copy_to_AUVTCD():108 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2010.151.04/tailCone.nc /Volumes/AUVCTD/missionnetcdfs/2010/2010151/2010.151.04 done. INFO 2025-06-26 15:36:30,560 archive.py copy_to_AUVTCD():116 [1] Archiving product files INFO 2025-06-26 15:36:30,562 archive.py copy_to_AUVTCD():133 [1] Removing /Volumes/AUVCTD/surveys/2010/odv/dorado_2010.151.04_1S_Gulper.txt INFO 2025-06-26 15:36:30,567 archive.py copy_to_AUVTCD():136 [1] copyfile /data/auv_data/dorado/missionodvs/2010.151.04/dorado_2010.151.04_1S_Gulper.txt /Volumes/AUVCTD/surveys/2010/odv done. INFO 2025-06-26 15:36:30,567 archive.py copy_to_AUVTCD():161 [1] copyfile /data/auv_data/dorado/missionnetcdfs/2010.151.04/dorado_2010.151.04_processing.log /Volumes/AUVCTD/surveys/2010/netcdf