INFO 2025-10-20 23:02:00,605 process.py process_mission():429 [1] commandline = /src/data/process_i2map.py -v --noinput --start_year 2019 --end_year 2019 --start_yd 1 --end_yd 365 --num_cores 1 --clobber INFO 2025-10-20 23:02:00,605 process.py process_mission():449 [1] Processing i2map mission 2019.123.02 by user docker_user on host bc943cff5f21 INFO 2025-10-20 23:02:00,605 process.py download_process():165 [1] Download and processing steps for 2019.123.02 INFO 2025-10-20 23:02:00,605 logs2netcdfs.py download_process_logs():739 [1] src_dir = /Volumes/M3/master/i2MAP/2019/05/20190503/20190503/2019.123.02 INFO 2025-10-20 23:02:00,607 logs2netcdfs.py download_process_logs():768 [1] Rsyncing /Volumes/M3/master/i2MAP/2019/05/20190503/20190503/2019.123.02 to /data/auv_data/i2map/missionlogs/2019.123.02 INFO 2025-10-20 23:02:00,735 logs2netcdfs.py download_process_logs():779 [1] Processing mission: i2map 2019.123.02 INFO 2025-10-20 23:02:00,736 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/i2map/missionlogs/2019.123.02/gps.log (932 bytes) INFO 2025-10-20 23:02:00,747 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/i2map/missionlogs/2019.123.02/navigation.log (0 bytes) WARNING 2025-10-20 23:02:00,747 logs2netcdfs.py download_process_logs():790 [1] /data/auv_data/i2map/missionlogs/2019.123.02/navigation.log is empty INFO 2025-10-20 23:02:00,747 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/i2map/missionlogs/2019.123.02/parosci.log (0 bytes) WARNING 2025-10-20 23:02:00,748 logs2netcdfs.py download_process_logs():790 [1] /data/auv_data/i2map/missionlogs/2019.123.02/parosci.log is empty INFO 2025-10-20 23:02:00,748 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/i2map/missionlogs/2019.123.02/seabird25p.log (0 bytes) WARNING 2025-10-20 23:02:00,748 logs2netcdfs.py download_process_logs():790 [1] /data/auv_data/i2map/missionlogs/2019.123.02/seabird25p.log is empty INFO 2025-10-20 23:02:00,748 logs2netcdfs.py download_process_logs():788 [1] Processing file /data/auv_data/i2map/missionlogs/2019.123.02/tailCone.log (0 bytes) WARNING 2025-10-20 23:02:00,748 logs2netcdfs.py download_process_logs():790 [1] /data/auv_data/i2map/missionlogs/2019.123.02/tailCone.log is empty INFO 2025-10-20 23:02:00,748 logs2netcdfs.py download_process_logs():807 [1] Time to process: 0.01 seconds INFO 2025-10-20 23:02:00,748 process.py calibrate():227 [1] Calibration steps for 2019.123.02 ERROR 2025-10-20 23:02:00,759 calibrate.py process_logs():3542 [1] Error processing navigation: navigation has no orig_data - likely a missing or zero-sized .log file in missionlogs/2019.123.02 ERROR 2025-10-20 23:02:00,763 calibrate.py process_logs():3542 [1] Error processing gps: No navigation_longitude data in combined_nc ERROR 2025-10-20 23:02:00,764 calibrate.py process_logs():3542 [1] Error processing seabird25p: seabird25p has no orig_data - likely a missing or zero-sized .log file in missionlogs/2019.123.02 ERROR 2025-10-20 23:02:00,765 calibrate.py process_logs():3542 [1] Error processing tailcone: tailcone has no orig_data - likely a missing or zero-sized .log file in missionlogs/2019.123.02 ERROR 2025-10-20 23:02:00,765 process.py calibrate():247 [1] 2019.123.02 No depth_time variable in combined_nc INFO 2025-10-20 23:02:00,766 process.py align():251 [1] Alignment steps for 2019.123.02 ERROR 2025-10-20 23:02:00,766 process.py align():266 [1] 2019.123.02 [Errno 2] No such file or directory: '/data/auv_data/i2map/missionnetcdfs/2019.123.02/i2map_2019.123.02_cal.nc' ERROR 2025-10-20 23:02:00,766 process.py process_mission_exception_wrapper():537 [1] An exception occurred Traceback (most recent call last): File "/usr/local/lib/python3.12/site-packages/xarray/backends/file_manager.py", line 219, in _acquire_with_cache_info file = self._cache[self._key] ~~~~~~~~~~~^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/xarray/backends/lru_cache.py", line 56, in __getitem__ value = self._cache[key] ~~~~~~~~~~~^^^^^ KeyError: [, ('/data/auv_data/i2map/missionnetcdfs/2019.123.02/i2map_2019.123.02_cal.nc',), 'r', (('clobber', True), ('diskless', False), ('format', 'NETCDF4'), ('persist', False)), 'feb05977-d6a4-431f-8026-9f50eb634dab'] During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/src/data/process.py", line 263, in align netcdf_dir = align_netcdf.process_cal() ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/src/data/align.py", line 136, in process_cal self.calibrated_nc = xr.open_dataset(Path(netcdfs_dir, in_fn)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/xarray/backends/api.py", line 596, in open_dataset backend_ds = backend.open_dataset( ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/xarray/backends/netCDF4_.py", line 744, in open_dataset store = NetCDF4DataStore.open( ^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/xarray/backends/netCDF4_.py", line 524, in open return cls(manager, group=group, mode=mode, lock=lock, autoclose=autoclose) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/xarray/backends/netCDF4_.py", line 428, in __init__ self.format = self.ds.data_model ^^^^^^^ File "/usr/local/lib/python3.12/site-packages/xarray/backends/netCDF4_.py", line 533, in ds return self._acquire() ^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/xarray/backends/netCDF4_.py", line 527, in _acquire with self._manager.acquire_context(needs_lock) as root: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/xarray/backends/file_manager.py", line 207, in acquire_context file, cached = self._acquire_with_cache_info(needs_lock) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/xarray/backends/file_manager.py", line 225, in _acquire_with_cache_info file = self._opener(*self._args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "src/netCDF4/_netCDF4.pyx", line 2517, in netCDF4._netCDF4.Dataset.__init__ File "src/netCDF4/_netCDF4.pyx", line 2154, in netCDF4._netCDF4._ensure_nc_success FileNotFoundError: [Errno 2] No such file or directory: '/data/auv_data/i2map/missionnetcdfs/2019.123.02/i2map_2019.123.02_cal.nc' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/src/data/process.py", line 529, in process_mission_exception_wrapper self.process_mission(mission, src_dir=src_dir) File "/src/data/process.py", line 485, in process_mission self.align(mission) File "/src/data/process.py", line 268, in align raise InvalidCalFile(error_message) from e align.InvalidCalFile: 2019.123.02 [Errno 2] No such file or directory: '/data/auv_data/i2map/missionnetcdfs/2019.123.02/i2map_2019.123.02_cal.nc' ERROR 2025-10-20 23:02:00,768 process.py process_mission_exception_wrapper():538 [1] Failed to process to completion: 2019.123.02 INFO 2025-10-20 23:02:00,768 process.py archive():337 [1] Archiving steps for 2019.123.02 INFO 2025-10-20 23:02:00,768 process.py archive():347 [1] nc_file_base = /data/auv_data/i2map/missionnetcdfs/2019.123.02/i2map_2019.123.02, BASE_PATH = /data/auv_data INFO 2025-10-20 23:02:00,769 archive.py copy_to_AUVTCD():60 [1] Archiving /data/auv_data/i2map/missionnetcdfs/2019.123.02/i2map_2019.123.02 files to /Volumes/AUVCTD/surveys/2019/netcdf INFO 2025-10-20 23:02:00,777 archive.py copy_to_AUVTCD():108 [1] copyfile /data/auv_data/i2map/missionnetcdfs/2019.123.02/gps.nc /Volumes/AUVCTD/missionnetcdfs/2019/2019123/2019.123.02 done. INFO 2025-10-20 23:02:00,777 archive.py copy_to_AUVTCD():116 [1] Archiving product files INFO 2025-10-20 23:02:00,778 archive.py copy_to_AUVTCD():161 [1] copyfile /data/auv_data/i2map/missionnetcdfs/2019.123.02/i2map_2019.123.02_processing.log /Volumes/AUVCTD/surveys/2019/netcdf