INFO 2023-09-02 14:07:10,047 process.py process_mission():357 [1] self.commandline = 'src/data/process_dorado.py --noinput --num_cores 1 -v' INFO 2023-09-02 14:07:10,047 process.py process_mission():362 [1] dorado_info[mission]["comment"] = 'Overnight diamond pattern during CPF deployment for CANON September 2017 QC note: Best CTD is ctd2 - ctdToUse = ctd1 ' INFO 2023-09-02 14:07:10,048 process.py process_mission():374 [1] Processing CANON September 2017 Monterey Bay Diamond mission 2017.275.01 by user docker_user on host 0383e5772514 INFO 2023-09-02 14:07:10,048 process.py download_process():144 [1] Download and processing steps for 2017.275.01 INFO 2023-09-02 14:07:10,049 logs2netcdfs.py download_process_logs():664 [1] src_dir = '/Volumes/AUVCTD/missionlogs/2017/2017275/2017.275.01' INFO 2023-09-02 14:07:10,049 logs2netcdfs.py download_process_logs():692 [1] Rsyncing /Volumes/AUVCTD/missionlogs/2017/2017275/2017.275.01 to /data/auv_data/dorado/missionlogs/2017.275.01 INFO 2023-09-02 14:07:34,267 logs2netcdfs.py download_process_logs():700 [1] Processing mission: dorado 2017.275.01 INFO 2023-09-02 14:07:34,267 logs2netcdfs.py download_process_logs():709 [1] Processing file /data/auv_data/dorado/missionlogs/2017.275.01/ctdDriver.log (31150662 bytes) INFO 2023-09-02 14:07:39,762 logs2netcdfs.py download_process_logs():709 [1] Processing file /data/auv_data/dorado/missionlogs/2017.275.01/ctdDriver2.log (31149215 bytes) INFO 2023-09-02 14:07:45,255 logs2netcdfs.py download_process_logs():709 [1] Processing file /data/auv_data/dorado/missionlogs/2017.275.01/gps.log (1178204 bytes) INFO 2023-09-02 14:07:45,559 logs2netcdfs.py download_process_logs():709 [1] Processing file /data/auv_data/dorado/missionlogs/2017.275.01/hydroscatlog.log (27339838 bytes) INFO 2023-09-02 14:07:52,127 logs2netcdfs.py _process_log_file():644 [1] Non-monotonic increasing time indices in /data/auv_data/dorado/missionlogs/2017.275.01/hydroscatlog.log: [ 107 769 1033 ... 324877 325182 325350] INFO 2023-09-02 14:07:52,232 logs2netcdfs.py download_process_logs():709 [1] Processing file /data/auv_data/dorado/missionlogs/2017.275.01/navigation.log (120428998 bytes) INFO 2023-09-02 14:08:13,934 logs2netcdfs.py download_process_logs():709 [1] Processing file /data/auv_data/dorado/missionlogs/2017.275.01/parosci.log (38343590 bytes) INFO 2023-09-02 14:08:21,471 logs2netcdfs.py download_process_logs():709 [1] Processing file /data/auv_data/dorado/missionlogs/2017.275.01/tailCone.log (19537099 bytes) INFO 2023-09-02 14:08:27,042 logs2netcdfs.py download_process_logs():709 [1] Processing file /data/auv_data/dorado/missionlogs/2017.275.01/biolume.log (22734906 bytes) INFO 2023-09-02 14:08:32,792 logs2netcdfs.py write_variables():523 [1] Expanding original timeTag to time60Hz variable for raw data INFO 2023-09-02 14:08:34,037 logs2netcdfs.py _process_log_file():644 [1] Non-monotonic increasing time indices in /data/auv_data/dorado/missionlogs/2017.275.01/biolume.log: [17487 22220 30155 31484 33658 39775 46479 46604 47167 50847 55642 56324 62923 79791] INFO 2023-09-02 14:08:34,119 logs2netcdfs.py download_process_logs():726 [1] Time to process: 59.85 seconds INFO 2023-09-02 14:08:34,119 process.py download_process():172 [1] Processing file /data/auv_data/dorado/missionlogs/2017.275.01/lopc.bin (82735064 bytes) INFO 2023-09-02 14:08:34,119 lopcToNetCDF.py main():2282 [1] Processing begun: Sat Sep 2 14:08:34 2023 INFO 2023-09-02 14:08:34,119 lopcToNetCDF.py constructTimestampList():1300 [1] parosci_nc = /data/auv_data/dorado/missionnetcdfs/2017.275.01/parosci.nc INFO 2023-09-02 14:08:34,120 lopcToNetCDF.py constructTimestampList():1301 [1] Using NetCDF4 to get start and end epoch seconds for this mission from this URL: INFO 2023-09-02 14:08:34,120 lopcToNetCDF.py constructTimestampList():1304 [1] /data/auv_data/dorado/missionnetcdfs/2017.275.01/parosci.nc INFO 2023-09-02 14:08:34,124 lopcToNetCDF.py constructTimestampList():1321 [1] From associated parosci.nc file: sensor_on_time = 1506970792.2, sensor_off_time = 1507052192.0 INFO 2023-09-02 14:08:34,124 lopcToNetCDF.py constructTimestampList():1325 [1] Duration is 81399 seconds. Expecting to read 162798 L frames from the lopc.bin file. INFO 2023-09-02 14:08:34,124 lopcToNetCDF.py constructTimestampList():1335 [1] recCount not passed in, assuming we'll have 162798 records from the lopc.bin file. INFO 2023-09-02 14:08:35,883 lopcToNetCDF.py main():2304 [1] Examined sibling parosci.nc file to find startTime = 2017-10-02 18:59:52 Z and endTime = 2017-10-03 17:36:32 Z with 162798 records expected to be read from lopc.bin INFO 2023-09-02 14:08:35,883 lopcToNetCDF.py unpackLOPCbin():727 [1] >>> Unpacking LOPC data from /data/auv_data/dorado/missionlogs/2017.275.01/lopc.bin INFO 2023-09-02 14:08:35,883 lopcToNetCDF.py unpackLOPCbin():728 [1] >>> Will write to NetCDF file /data/auv_data/dorado/missionnetcdfs/2017.275.01/lopc.nc ERROR 2023-09-02 14:08:35,886 process.py download_process():193 [1] UnexpectedAreaOfCode: Encountered unexpected area of code - lopc.nc file is probably corrupt INFO 2023-09-02 14:08:35,889 process.py calibrate():197 [1] Calibration steps for 2017.275.01 INFO 2023-09-02 14:08:36,982 calibrate.py _nudge_pos():884 [1] seg# end_sec_diff end_lon_diff end_lat_diff len(segi) seg_min u_drift (cm/s) v_drift (cm/s) start datetime of segment INFO 2023-09-02 14:08:36,984 calibrate.py _nudge_pos():908 [1] - - - 0 0.00 - - - INFO 2023-09-02 14:08:37,619 calibrate.py _nudge_pos():1003 [1] 101: 0.100 0.0011166 0.0025186 4955 16.51 10.032 28.262 2017-10-02T19:17:55.447253248 INFO 2023-09-02 14:08:38,573 calibrate.py _nudge_pos():1003 [1] 210: 0.100 0.0001043 0.0017051 4440 14.80 1.045 21.353 2017-10-02T19:34:31.449022464 INFO 2023-09-02 14:08:39,369 calibrate.py _nudge_pos():1003 [1] 301: 0.100 -0.0005080 0.0009769 2580 8.60 -8.767 21.056 2017-10-02T19:44:37.447508736 INFO 2023-09-02 14:08:40,275 calibrate.py _nudge_pos():1003 [1] 403: 0.100 -0.0001838 0.0006604 2645 8.81 -3.094 13.884 2017-10-02T19:55:07.444350976 INFO 2023-09-02 14:08:41,214 calibrate.py _nudge_pos():1003 [1] 510: 0.110 0.0005106 0.0001462 2740 9.13 8.298 2.967 2017-10-02T20:06:01.439549184 INFO 2023-09-02 14:08:43,130 calibrate.py _nudge_pos():1003 [1] 728: 0.110 -0.0006681 0.0000735 3085 10.28 -9.643 1.325 2017-10-02T20:19:55.442416128 INFO 2023-09-02 14:08:44,412 calibrate.py _nudge_pos():1003 [1] 873: 0.120 0.0017334 -0.0005839 12000 40.00 6.433 -2.705 2017-10-02T21:02:19.448140032 INFO 2023-09-02 14:08:46,550 calibrate.py _nudge_pos():1003 [1] 1108: 0.110 0.0010301 -0.0001938 12120 40.40 3.786 -0.889 2017-10-02T21:46:37.446054400 INFO 2023-09-02 14:08:48,662 calibrate.py _nudge_pos():1003 [1] 1335: 0.120 0.0007511 -0.0000618 11895 39.65 2.814 -0.289 2017-10-02T22:30:02.447599616 INFO 2023-09-02 14:08:50,723 calibrate.py _nudge_pos():1003 [1] 1557: 0.120 0.0008325 -0.0000073 12265 40.88 3.025 -0.033 2017-10-02T23:14:37.444349696 INFO 2023-09-02 14:08:50,771 calibrate.py _nudge_pos():1003 [1] 1562: 0.130 0.0002295 -0.0007114 230 0.76 44.677 -172.707 2017-10-02T23:15:27.440924928 INFO 2023-09-02 14:08:51,600 calibrate.py _nudge_pos():1003 [1] 1650: 0.120 0.0003522 -0.0007231 15 0.05 1121.339 -2871.446 2017-10-02T23:16:57.444759040 INFO 2023-09-02 14:08:51,658 calibrate.py _nudge_pos():1003 [1] 1656: 0.120 0.0003582 -0.0007287 60 0.20 270.629 -686.675 2017-10-02T23:17:14.443594752 INFO 2023-09-02 14:08:52,066 calibrate.py _nudge_pos():1003 [1] 1699: 0.130 0.0004132 -0.0006943 20 0.06 969.324 -2031.553 2017-10-02T23:18:03.440238336 INFO 2023-09-02 14:08:52,152 calibrate.py _nudge_pos():1003 [1] 1708: 0.130 0.0010697 -0.0003332 12430 41.43 3.837 -1.490 2017-10-02T23:59:37.439387648 INFO 2023-09-02 14:08:52,578 calibrate.py _nudge_pos():1003 [1] 1753: 0.120 0.0011067 -0.0003104 15 0.05 3524.410 -1232.740 2017-10-03T00:00:24.446167296 INFO 2023-09-02 14:08:55,725 calibrate.py _nudge_pos():1003 [1] 2087: 0.140 -0.0001955 0.0007066 10315 34.38 -0.845 3.809 2017-10-03T00:40:25.441687808 INFO 2023-09-02 14:08:58,967 calibrate.py _nudge_pos():1003 [1] 2424: 0.140 0.0064171 0.0016235 15085 50.28 18.967 5.983 2017-10-03T01:36:18.441991680 INFO 2023-09-02 14:09:01,173 calibrate.py _nudge_pos():1003 [1] 2652: 0.140 0.0062992 0.0026111 14765 49.21 19.018 9.832 2017-10-03T02:29:18.444146688 INFO 2023-09-02 14:09:03,385 calibrate.py _nudge_pos():1003 [1] 2881: 0.140 0.0085351 0.0036686 14150 47.16 26.883 14.414 2017-10-03T03:20:17.444590592 INFO 2023-09-02 14:09:03,549 calibrate.py _nudge_pos():1003 [1] 2898: 0.150 0.0000227 -0.0000344 30 0.10 34.925 -66.020 2017-10-03T03:20:39.443083776 INFO 2023-09-02 14:09:05,514 calibrate.py _nudge_pos():1003 [1] 3101: 0.150 0.0095372 0.0042010 13945 46.48 30.474 16.748 2017-10-03T04:10:31.448117248 INFO 2023-09-02 14:09:05,526 calibrate.py _nudge_pos():1003 [1] 3102: 0.150 -0.0000497 0.0000495 35 0.11 -65.137 80.880 2017-10-03T04:10:38.447637760 INFO 2023-09-02 14:09:05,655 calibrate.py _nudge_pos():1003 [1] 3115: 0.150 -0.0003484 0.0003989 50 0.16 -316.838 452.587 2017-10-03T04:11:02.445993728 INFO 2023-09-02 14:09:05,695 calibrate.py _nudge_pos():1003 [1] 3119: 0.150 0.0000556 -0.0000769 15 0.05 177.002 -305.415 2017-10-03T04:11:08.445582848 INFO 2023-09-02 14:09:05,874 calibrate.py _nudge_pos():1003 [1] 3137: 0.150 -0.0002313 0.0002880 15 0.05 -736.086 1143.550 2017-10-03T04:11:31.444007168 INFO 2023-09-02 14:09:05,895 calibrate.py _nudge_pos():1003 [1] 3139: 0.150 0.0000764 -0.0000819 25 0.08 141.869 -189.707 2017-10-03T04:11:38.443527680 INFO 2023-09-02 14:09:06,349 calibrate.py _nudge_pos():1003 [1] 3182: 0.150 0.0000130 -0.0000132 15 0.05 41.426 -52.573 2017-10-03T04:12:26.440239616 INFO 2023-09-02 14:09:06,400 calibrate.py _nudge_pos():1003 [1] 3187: 0.150 -0.0002795 0.0002796 35 0.11 -366.328 457.238 2017-10-03T04:12:38.439417856 INFO 2023-09-02 14:09:06,412 calibrate.py _nudge_pos():1003 [1] 3188: 0.150 -0.0002395 0.0002129 20 0.06 -560.160 621.235 2017-10-03T04:12:42.449143296 INFO 2023-09-02 14:09:06,503 calibrate.py _nudge_pos():1003 [1] 3197: 0.150 0.0000040 -0.0000450 15 0.05 12.843 -178.617 2017-10-03T04:12:53.448389632 INFO 2023-09-02 14:09:06,514 calibrate.py _nudge_pos():1003 [1] 3198: 0.150 -0.0001678 0.0001840 15 0.05 -534.102 730.751 2017-10-03T04:12:56.448184064 INFO 2023-09-02 14:09:06,770 calibrate.py _nudge_pos():1003 [1] 3223: 0.150 -0.0000582 0.0000356 80 0.26 -32.825 25.018 2017-10-03T04:13:40.445170176 INFO 2023-09-02 14:09:06,781 calibrate.py _nudge_pos():1003 [1] 3224: 0.160 0.0063805 0.0067715 12610 42.03 22.541 29.854 2017-10-03T04:55:42.442401536 INFO 2023-09-02 14:09:06,834 calibrate.py _nudge_pos():1003 [1] 3229: 0.160 0.0001704 -0.0002949 15 0.05 542.089 -1171.205 2017-10-03T04:55:49.441922048 INFO 2023-09-02 14:09:06,999 calibrate.py _nudge_pos():1003 [1] 3245: 0.160 0.0002786 -0.0004407 50 0.16 253.245 -499.985 2017-10-03T04:56:17.440003840 INFO 2023-09-02 14:09:07,050 calibrate.py _nudge_pos():1003 [1] 3247: 0.160 -0.0000157 -0.0000393 30 0.10 -24.146 -75.404 2017-10-03T04:56:24.439524352 INFO 2023-09-02 14:09:07,073 calibrate.py _nudge_pos():1003 [1] 3249: 0.150 0.0000642 -0.0000910 25 0.08 118.945 -210.457 2017-10-03T04:56:31.449044224 INFO 2023-09-02 14:09:07,084 calibrate.py _nudge_pos():1003 [1] 3250: 0.150 -0.0002219 0.0002588 15 0.05 -706.184 1027.534 2017-10-03T04:56:34.448838656 INFO 2023-09-02 14:09:08,502 calibrate.py _nudge_pos():1003 [1] 3391: 0.160 -0.0000387 -0.0000347 90 0.30 -19.358 -21.677 2017-10-03T04:59:17.447672576 INFO 2023-09-02 14:09:08,605 calibrate.py _nudge_pos():1003 [1] 3402: 0.160 0.0057097 0.0052987 13420 44.73 18.950 21.951 2017-10-03T05:44:12.443052800 INFO 2023-09-02 14:09:10,578 calibrate.py _nudge_pos():1003 [1] 3608: 0.160 0.0000672 0.0000456 70 0.23 43.369 36.722 2017-10-03T05:47:53.447912960 INFO 2023-09-02 14:09:10,588 calibrate.py _nudge_pos():1003 [1] 3609: 0.150 -0.0025741 0.0007527 5740 19.13 -19.977 7.291 2017-10-03T06:07:01.449269248 INFO 2023-09-02 14:09:10,619 calibrate.py _nudge_pos():1003 [1] 3612: 0.160 0.0000113 -0.0000058 115 0.38 4.401 -2.842 2017-10-03T06:07:26.447556864 INFO 2023-09-02 14:09:12,362 calibrate.py _nudge_pos():1003 [1] 3792: 0.160 0.0000357 0.0000176 25 0.08 66.229 40.876 2017-10-03T06:10:30.444952320 INFO 2023-09-02 14:09:12,579 calibrate.py _nudge_pos():1003 [1] 3815: 0.160 0.0000053 0.0000151 15 0.05 16.782 59.851 2017-10-03T06:10:55.443239680 INFO 2023-09-02 14:09:12,808 calibrate.py _nudge_pos():1003 [1] 3839: 0.170 -0.0027304 0.0033941 12005 40.01 -10.127 15.718 2017-10-03T06:51:19.447184128 INFO 2023-09-02 14:09:15,088 calibrate.py _nudge_pos():1003 [1] 4083: 0.170 -0.0020829 0.0024799 12975 43.25 -7.146 10.626 2017-10-03T07:38:37.442768128 INFO 2023-09-02 14:09:17,203 calibrate.py _nudge_pos():1003 [1] 4307: 0.170 -0.0004834 0.0023806 12325 41.08 -1.745 10.738 2017-10-03T08:23:25.448626944 INFO 2023-09-02 14:09:20,411 calibrate.py _nudge_pos():1003 [1] 4639: 0.180 -0.0012858 0.0025374 11925 39.75 -4.797 11.829 2017-10-03T09:08:42.442500096 INFO 2023-09-02 14:09:22,679 calibrate.py _nudge_pos():1003 [1] 4866: 0.180 -0.0014052 0.0023298 13160 43.86 -4.749 9.842 2017-10-03T09:56:25.446371072 INFO 2023-09-02 14:09:24,668 calibrate.py _nudge_pos():1003 [1] 5070: 0.190 -0.0021149 0.0014302 12225 40.75 -7.692 6.504 2017-10-03T10:40:37.444696576 INFO 2023-09-02 14:09:27,116 calibrate.py _nudge_pos():1003 [1] 5310: 0.190 -0.0011746 0.0008075 6560 21.86 -7.961 6.844 2017-10-03T11:06:29.448377088 INFO 2023-09-02 14:09:33,122 calibrate.py _nudge_pos():1003 [1] 5911: 0.190 -0.0010213 0.0010576 65 0.21 -709.441 918.676 2017-10-03T11:16:43.446315264 INFO 2023-09-02 14:09:38,336 calibrate.py _nudge_pos():1003 [1] 6432: 0.200 0.0013284 0.0070746 15239 50.79 3.876 25.809 2017-10-03T12:16:12.441822464 INFO 2023-09-02 14:09:38,519 calibrate.py _nudge_pos():1003 [1] 6450: 0.200 0.0001358 -0.0000227 14 0.04 464.520 -97.150 2017-10-03T12:16:33.440384000 INFO 2023-09-02 14:09:39,704 calibrate.py _nudge_pos():1003 [1] 6565: 0.200 -0.0000135 -0.0000025 19 0.06 -33.322 -7.638 2017-10-03T12:18:34.442094848 INFO 2023-09-02 14:09:39,736 calibrate.py _nudge_pos():1003 [1] 6568: 0.200 -0.0000299 -0.0000055 14 0.04 -102.417 -23.709 2017-10-03T12:18:39.441752320 INFO 2023-09-02 14:09:39,746 calibrate.py _nudge_pos():1003 [1] 6569: 0.200 0.0000216 0.0000001 29 0.09 34.346 0.268 2017-10-03T12:18:45.441341184 INFO 2023-09-02 14:09:40,509 calibrate.py _nudge_pos():1003 [1] 6644: 0.190 0.0038485 0.0060304 14404 48.01 11.883 23.275 2017-10-03T13:08:00.448909312 INFO 2023-09-02 14:09:42,689 calibrate.py _nudge_pos():1003 [1] 6867: 0.200 0.0034145 0.0045505 15814 52.71 9.605 15.997 2017-10-03T14:04:25.447021056 INFO 2023-09-02 14:09:49,530 calibrate.py _nudge_pos():1003 [1] 7547: 0.010 0.0025855 0.0049751 15 0.05 8215.513 19756.030 2017-10-03T14:15:52.639945216 INFO 2023-09-02 14:09:50,252 calibrate.py _nudge_pos():1003 [1] 7617: 0.200 0.0026777 0.0049372 39 0.13 3134.596 7223.064 2017-10-03T14:17:15.444272640 INFO 2023-09-02 14:09:50,273 calibrate.py _nudge_pos():1003 [1] 7619: 0.200 0.0026605 0.0049472 24 0.08 5145.674 11957.869 2017-10-03T14:17:21.443861760 INFO 2023-09-02 14:09:50,941 calibrate.py _nudge_pos():1003 [1] 7686: 0.200 0.0025366 0.0049943 14 0.04 8680.136 21357.815 2017-10-03T14:18:34.448860416 INFO 2023-09-02 14:09:51,382 calibrate.py _nudge_pos():1003 [1] 7730: 0.200 0.0025915 0.0049684 14 0.04 8867.669 21247.219 2017-10-03T14:19:21.445640960 INFO 2023-09-02 14:09:51,432 calibrate.py _nudge_pos():1003 [1] 7735: 0.200 0.0025481 0.0049903 24 0.08 4928.231 12062.153 2017-10-03T14:19:31.444956160 INFO 2023-09-02 14:09:53,010 calibrate.py _nudge_pos():1003 [1] 7883: 0.010 0.0024128 0.0050393 65 0.21 1677.084 4377.403 2017-10-03T14:22:20.643365120 INFO 2023-09-02 14:09:55,727 calibrate.py _nudge_pos():1003 [1] 8156: 0.010 0.0046004 0.0048383 15045 50.15 13.606 17.878 2017-10-03T15:17:07.648189696 INFO 2023-09-02 14:09:57,495 calibrate.py _nudge_pos():1003 [1] 8322: 0.010 0.0044825 0.0048797 15 0.05 14246.685 19377.187 2017-10-03T15:19:57.646544128 INFO 2023-09-02 14:09:57,676 calibrate.py _nudge_pos():1003 [1] 8340: 0.010 0.0044459 0.0048868 20 0.06 10411.735 14298.606 2017-10-03T15:20:21.644900096 INFO 2023-09-02 14:09:57,706 calibrate.py _nudge_pos():1003 [1] 8343: 0.010 0.0043694 0.0049070 20 0.06 10232.758 14357.943 2017-10-03T15:20:27.644489216 INFO 2023-09-02 14:10:00,948 calibrate.py _nudge_pos():1003 [1] 8662: 0.010 0.0041782 0.0050402 35 0.11 5467.974 8241.239 2017-10-03T15:25:57.641882880 INFO 2023-09-02 14:10:00,980 calibrate.py _nudge_pos():1003 [1] 8665: 0.010 0.0041543 0.0050472 20 0.06 9728.852 14768.014 2017-10-03T15:26:03.641471744 INFO 2023-09-02 14:10:04,131 calibrate.py _nudge_pos():1003 [1] 8960: 0.010 -0.0000642 0.0000203 405 1.35 -7.070 2.799 2017-10-03T15:32:30.644960256 INFO 2023-09-02 14:10:05,945 calibrate.py _nudge_pos():1003 [1] 9133: 0.010 -0.0000089 -0.0000648 100 0.33 -4.003 -36.375 2017-10-03T15:35:45.641602048 INFO 2023-09-02 14:10:05,957 calibrate.py _nudge_pos():1003 [1] 9134: 0.010 -0.0000168 0.0000020 50 0.16 -15.217 2.291 2017-10-03T15:35:55.640916992 INFO 2023-09-02 14:10:06,064 calibrate.py _nudge_pos():1003 [1] 9144: 0.200 -0.0000283 -0.0001740 69 0.23 -18.515 -142.184 2017-10-03T15:36:18.449354752 INFO 2023-09-02 14:10:06,161 calibrate.py _nudge_pos():1003 [1] 9153: 0.010 -0.0000381 0.0000247 25 0.08 -70.597 57.226 2017-10-03T15:36:31.648450304 INFO 2023-09-02 14:11:21,347 calibrate.py _nudge_pos():1060 [1] 16314: - - - 2 0.00 - - INFO 2023-09-02 14:11:21,347 calibrate.py _nudge_pos():1066 [1] Points in final series = 405233 INFO 2023-09-02 14:12:22,140 calibrate.py _hs2_process():1574 [1] Number of bad hs2 points: 19 of 324283 INFO 2023-09-02 14:12:25,864 calibrate.py _geometric_depth_correction():2497 [1] hs2: d_beg_time_diff: -3 seconds, d_end_time_diff: 0 seconds, INFO 2023-09-02 14:12:30,755 calibrate.py _geometric_depth_correction():2497 [1] ctd1: d_beg_time_diff: 10 seconds, d_end_time_diff: 0 seconds, INFO 2023-09-02 14:12:34,479 calibrate.py _geometric_depth_correction():2497 [1] ctd1: d_beg_time_diff: 10 seconds, d_end_time_diff: 0 seconds, INFO 2023-09-02 14:12:34,488 calibrate.py _ctd_process():2047 [1] Performing range checking of ['ctd1_salinity'] in 2017.275.01/ctd1.nc INFO 2023-09-02 14:12:34,490 calibrate.py _range_qc_combined_nc():400 [1] Setting 2 ctd1_salinity values to NaN INFO 2023-09-02 14:12:34,491 calibrate.py _range_qc_combined_nc():414 [1] Checked for data outside of these variables and ranges: [('ctd1_salinity', Range(min=30, max=40))] INFO 2023-09-02 14:12:34,491 calibrate.py _range_qc_combined_nc():440 [1] Done range checking ctd1 INFO 2023-09-02 14:12:38,893 calibrate.py _geometric_depth_correction():2497 [1] ctd2: d_beg_time_diff: 11 seconds, d_end_time_diff: -1 seconds, INFO 2023-09-02 14:12:42,508 calibrate.py _geometric_depth_correction():2497 [1] ctd2: d_beg_time_diff: 11 seconds, d_end_time_diff: -1 seconds, INFO 2023-09-02 14:12:42,517 calibrate.py _ctd_process():2047 [1] Performing range checking of ['ctd2_salinity'] in 2017.275.01/ctd2.nc WARNING 2023-09-02 14:12:42,520 calibrate.py _range_qc_combined_nc():392 [1] More than 500 (680) ctd2_salinity values found outside of range. This may indicate a problem with the ctd2 data. INFO 2023-09-02 14:12:42,520 calibrate.py _range_qc_combined_nc():400 [1] Setting 680 ctd2_salinity values to NaN INFO 2023-09-02 14:12:42,520 calibrate.py _range_qc_combined_nc():414 [1] Checked for data outside of these variables and ranges: [('ctd2_salinity', Range(min=30, max=40))] INFO 2023-09-02 14:12:42,521 calibrate.py _range_qc_combined_nc():440 [1] Done range checking ctd2 ERROR 2023-09-02 14:12:42,521 calibrate.py process_logs():2613 [1] Error processing isus: isus has no orig_data - likely a missing or zero-sized .log file in missionlogs/2017.275.01 INFO 2023-09-02 14:12:42,678 calibrate.py _biolume_process():2223 [1] Checking for non-monotonic increasing time60hz INFO 2023-09-02 14:12:51,568 calibrate.py _biolume_process():2226 [1] Removing non-monotonic increasing time60hz at indices: [ 4800 4801 4802 ... 4799366 4799367 4799368] INFO 2023-09-02 14:12:52,724 calibrate.py _geometric_depth_correction():2497 [1] biolume: d_beg_time_diff: -8 seconds, d_end_time_diff: -1 seconds, ERROR 2023-09-02 14:14:44,750 calibrate.py process_logs():2613 [1] Error processing lopc: lopc has no orig_data - likely a missing or zero-sized .log file in missionlogs/2017.275.01 ERROR 2023-09-02 14:14:44,751 calibrate.py process_logs():2613 [1] Error processing ecopuck: ecopuck has no orig_data - likely a missing or zero-sized .log file in missionlogs/2017.275.01 INFO 2023-09-02 14:14:45,466 calibrate.py write_netcdf():2584 [1] Writing calibrated instrument data to /data/auv_data/dorado/missionnetcdfs/2017.275.01/dorado_2017.275.01_cal.nc INFO 2023-09-02 14:14:46,393 calibrate.py write_netcdf():2588 [1] Data variables written: biolume_avg_biolume, biolume_depth, biolume_flow, biolume_raw, biolume_time, biolume_time60hz, ctd1_conductivity, ctd1_conductivity_onboard, ctd1_depth, ctd1_dissolvedO2, ctd1_flow1, ctd1_oxygen_mll, ctd1_oxygen_umolkg, ctd1_salinity, ctd1_salinity_onboard, ctd1_temperature, ctd1_temperature_onboard, ctd1_time, ctd2_conductivity, ctd2_conductivity_onboard, ctd2_depth, ctd2_flow2, ctd2_salinity, ctd2_salinity_onboard, ctd2_temperature, ctd2_temperature_onboard, ctd2_time, depth_filtdepth, depth_filtpres, depth_time, gps_latitude, gps_longitude, gps_time, hs2_bb420, hs2_bb700, hs2_depth, hs2_fl700, hs2_time, navigation_depth, navigation_latitude, navigation_longitude, navigation_mWaterSpeed, navigation_pitch, navigation_posx, navigation_posy, navigation_roll, navigation_time, navigation_yaw, nudged_latitude, nudged_longitude, tailcone_propRpm, tailcone_time, time INFO 2023-09-02 14:14:46,399 process.py align():220 [1] Alignment steps for 2017.275.01 INFO 2023-09-02 14:14:46,574 align.py process_cal():145 [1] Processing dorado_2017.275.01_cal.nc from /data/auv_data/dorado/missionnetcdfs/2017.275.01 INFO 2023-09-02 14:14:46,730 align.py process_cal():221 [1] Using pitch corrected navigation_depth: mDepth from navigation.nc INFO 2023-09-02 14:14:46,741 align.py process_cal():282 [1] navigation_roll: instrument_sample_rate_hz = 5.00 INFO 2023-09-02 14:14:47,132 align.py process_cal():221 [1] Using pitch corrected navigation_depth: mDepth from navigation.nc INFO 2023-09-02 14:14:47,151 align.py process_cal():282 [1] navigation_pitch: instrument_sample_rate_hz = 5.00 INFO 2023-09-02 14:14:47,532 align.py process_cal():221 [1] Using pitch corrected navigation_depth: mDepth from navigation.nc INFO 2023-09-02 14:14:47,548 align.py process_cal():282 [1] navigation_yaw: instrument_sample_rate_hz = 5.00 INFO 2023-09-02 14:14:47,766 align.py process_cal():168 [1] Skipping navigation_posx INFO 2023-09-02 14:14:47,766 align.py process_cal():168 [1] Skipping navigation_posy INFO 2023-09-02 14:14:47,922 align.py process_cal():221 [1] Using pitch corrected navigation_depth: mDepth from navigation.nc INFO 2023-09-02 14:14:47,939 align.py process_cal():282 [1] navigation_mWaterSpeed: instrument_sample_rate_hz = 5.00 INFO 2023-09-02 14:14:48,300 align.py process_cal():221 [1] Using pitch corrected hs2_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to hs2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:48,314 align.py process_cal():282 [1] hs2_bb420: instrument_sample_rate_hz = 3.98 INFO 2023-09-02 14:14:48,633 align.py process_cal():221 [1] Using pitch corrected hs2_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to hs2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:48,647 align.py process_cal():282 [1] hs2_bb700: instrument_sample_rate_hz = 3.98 INFO 2023-09-02 14:14:48,964 align.py process_cal():221 [1] Using pitch corrected hs2_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to hs2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:48,978 align.py process_cal():282 [1] hs2_fl700: instrument_sample_rate_hz = 3.98 INFO 2023-09-02 14:14:49,297 align.py process_cal():221 [1] Using pitch corrected hs2_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to hs2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:49,310 align.py process_cal():282 [1] hs2_depth: instrument_sample_rate_hz = 3.98 INFO 2023-09-02 14:14:49,634 align.py process_cal():221 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:49,653 align.py process_cal():282 [1] ctd1_temperature: instrument_sample_rate_hz = 3.99 INFO 2023-09-02 14:14:49,981 align.py process_cal():221 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:49,996 align.py process_cal():282 [1] ctd1_conductivity: instrument_sample_rate_hz = 3.99 INFO 2023-09-02 14:14:50,319 align.py process_cal():221 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:50,334 align.py process_cal():282 [1] ctd1_salinity: instrument_sample_rate_hz = 3.99 INFO 2023-09-02 14:14:50,653 align.py process_cal():221 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:50,668 align.py process_cal():282 [1] ctd1_temperature_onboard: instrument_sample_rate_hz = 3.99 INFO 2023-09-02 14:14:50,992 align.py process_cal():221 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:51,007 align.py process_cal():282 [1] ctd1_conductivity_onboard: instrument_sample_rate_hz = 3.99 INFO 2023-09-02 14:14:51,329 align.py process_cal():221 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:51,344 align.py process_cal():282 [1] ctd1_salinity_onboard: instrument_sample_rate_hz = 3.99 INFO 2023-09-02 14:14:51,671 align.py process_cal():221 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:51,686 align.py process_cal():282 [1] ctd1_dissolvedO2: instrument_sample_rate_hz = 3.99 INFO 2023-09-02 14:14:52,005 align.py process_cal():221 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:52,021 align.py process_cal():282 [1] ctd1_oxygen_mll: instrument_sample_rate_hz = 3.99 INFO 2023-09-02 14:14:52,345 align.py process_cal():221 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:52,361 align.py process_cal():282 [1] ctd1_oxygen_umolkg: instrument_sample_rate_hz = 3.99 INFO 2023-09-02 14:14:52,684 align.py process_cal():221 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:52,699 align.py process_cal():282 [1] ctd1_flow1: instrument_sample_rate_hz = 3.99 INFO 2023-09-02 14:14:53,025 align.py process_cal():221 [1] Using pitch corrected ctd1_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to ctd1_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:53,040 align.py process_cal():282 [1] ctd1_depth: instrument_sample_rate_hz = 3.99 INFO 2023-09-02 14:14:53,370 align.py process_cal():221 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:53,386 align.py process_cal():282 [1] ctd2_temperature: instrument_sample_rate_hz = 3.99 INFO 2023-09-02 14:14:53,713 align.py process_cal():221 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:53,729 align.py process_cal():282 [1] ctd2_conductivity: instrument_sample_rate_hz = 3.99 INFO 2023-09-02 14:14:54,071 align.py process_cal():221 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:54,097 align.py process_cal():282 [1] ctd2_salinity: instrument_sample_rate_hz = 3.99 INFO 2023-09-02 14:14:54,458 align.py process_cal():221 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:54,474 align.py process_cal():282 [1] ctd2_temperature_onboard: instrument_sample_rate_hz = 3.99 INFO 2023-09-02 14:14:54,802 align.py process_cal():221 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:54,818 align.py process_cal():282 [1] ctd2_conductivity_onboard: instrument_sample_rate_hz = 3.99 INFO 2023-09-02 14:14:55,148 align.py process_cal():221 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:55,165 align.py process_cal():282 [1] ctd2_salinity_onboard: instrument_sample_rate_hz = 3.99 INFO 2023-09-02 14:14:55,493 align.py process_cal():221 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:55,509 align.py process_cal():282 [1] ctd2_flow2: instrument_sample_rate_hz = 3.99 INFO 2023-09-02 14:14:55,837 align.py process_cal():221 [1] Using pitch corrected ctd2_depth: Variable depth_filtdepth from dorado_2017.275.01_cal.nc linearly interpolated to ctd2_time and corrected for pitch using SensorOffset(x=4.5, y=0.0) INFO 2023-09-02 14:14:55,851 align.py process_cal():282 [1] ctd2_depth: instrument_sample_rate_hz = 3.99 INFO 2023-09-02 14:14:56,280 align.py process_cal():282 [1] biolume_flow: instrument_sample_rate_hz = 0.98 INFO 2023-09-02 14:14:56,580 align.py process_cal():282 [1] biolume_avg_biolume: instrument_sample_rate_hz = 0.98 INFO 2023-09-02 14:14:57,119 align.py process_cal():282 [1] biolume_raw: instrument_sample_rate_hz = 58.70 INFO 2023-09-02 14:15:00,433 align.py process_cal():282 [1] tailcone_propRpm: instrument_sample_rate_hz = 5.00 INFO 2023-09-02 14:15:00,711 align.py write_netcdf():367 [1] Writing aligned data to /data/auv_data/dorado/missionnetcdfs/2017.275.01/dorado_2017.275.01_align.nc INFO 2023-09-02 14:15:01,615 align.py write_netcdf():372 [1] Data variables written: biolume_avg_biolume, biolume_depth, biolume_flow, biolume_latitude, biolume_longitude, biolume_raw, biolume_time, biolume_time60hz, ctd1_conductivity, ctd1_conductivity_onboard, ctd1_depth, ctd1_dissolvedO2, ctd1_flow1, ctd1_latitude, ctd1_longitude, ctd1_oxygen_mll, ctd1_oxygen_umolkg, ctd1_salinity, ctd1_salinity_onboard, ctd1_temperature, ctd1_temperature_onboard, ctd1_time, ctd2_conductivity, ctd2_conductivity_onboard, ctd2_depth, ctd2_flow2, ctd2_latitude, ctd2_longitude, ctd2_salinity, ctd2_salinity_onboard, ctd2_temperature, ctd2_temperature_onboard, ctd2_time, hs2_bb420, hs2_bb700, hs2_depth, hs2_fl700, hs2_latitude, hs2_longitude, hs2_time, navigation_depth, navigation_latitude, navigation_longitude, navigation_mWaterSpeed, navigation_pitch, navigation_roll, navigation_time, navigation_yaw, tailcone_depth, tailcone_latitude, tailcone_longitude, tailcone_propRpm, tailcone_time INFO 2023-09-02 14:15:01,621 process.py resample():241 [1] Resampling steps for 2017.275.01 INFO 2023-09-02 14:15:01,809 resample.py instruments_variables():233 [1] Reading variables from /data/auv_data/dorado/missionnetcdfs/2017.275.01/dorado_2017.275.01_align.nc mission netCDF file INFO 2023-09-02 14:15:01,828 resample.py instruments_variables():233 [1] Reading variables from /data/auv_data/dorado/missionnetcdfs/2017.275.01/dorado_2017.275.01_align.nc mission netCDF file INFO 2023-09-02 14:15:01,832 resample.py get_mission_start_end():815 [1] navigation: 2017-10-02T19:00:23.049347328 to 2017-10-03T17:36:32.045189376 (0 days 00:00:00.029998080 before mission_end) INFO 2023-09-02 14:15:01,836 resample.py get_mission_start_end():815 [1] hs2 : 2017-10-02T18:59:49.821623808 to 2017-10-03T17:36:32.045189376 (0 days 00:00:00.029998080 before mission_end) INFO 2023-09-02 14:15:01,840 resample.py get_mission_start_end():815 [1] ctd1 : 2017-10-02T19:00:03.090714624 to 2017-10-03T17:36:32.075187456 (0 days 00:00:00 before mission_end) INFO 2023-09-02 14:15:01,845 resample.py get_mission_start_end():815 [1] ctd2 : 2017-10-02T19:00:03.510685952 to 2017-10-03T17:36:31.935196928 (0 days 00:00:00.139990528 before mission_end) INFO 2023-09-02 14:15:01,847 resample.py get_mission_start_end():815 [1] biolume : 2017-10-02T18:59:44.021986816 to 2017-10-03T17:36:30.705246976 (0 days 00:00:01.369940480 before mission_end) INFO 2023-09-02 14:15:01,852 resample.py get_mission_start_end():815 [1] tailcone : 2017-10-02T18:59:49.831623168 to 2017-10-03T17:36:32.005192192 (0 days 00:00:00.069995264 before mission_end) INFO 2023-09-02 14:15:01,853 resample.py instruments_variables():233 [1] Reading variables from /data/auv_data/dorado/missionnetcdfs/2017.275.01/dorado_2017.275.01_align.nc mission netCDF file INFO 2023-09-02 14:15:01,854 resample.py resample_coordinates():247 [1] Resampling coordinates depth, latitude and longitude with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:02,345 resample.py resample_variable():710 [1] Resampling navigation_roll with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:02,503 resample.py resample_variable():710 [1] Resampling navigation_pitch with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:02,655 resample.py resample_variable():710 [1] Resampling navigation_yaw with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:02,811 resample.py resample_variable():710 [1] Resampling navigation_mWaterSpeed with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:02,945 resample.py resample_variable():710 [1] Resampling hs2_bb420 with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:03,080 resample.py resample_variable():710 [1] Resampling hs2_bb700 with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:03,211 resample.py resample_variable():710 [1] Resampling hs2_fl700 with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:03,335 resample.py resample_variable():710 [1] Resampling ctd1_temperature with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:03,453 resample.py resample_variable():710 [1] Resampling ctd1_conductivity with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:03,570 resample.py resample_variable():710 [1] Resampling ctd1_salinity with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:03,684 resample.py resample_variable():710 [1] Resampling ctd1_temperature_onboard with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:03,799 resample.py resample_variable():710 [1] Resampling ctd1_conductivity_onboard with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:03,915 resample.py resample_variable():710 [1] Resampling ctd1_salinity_onboard with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:04,029 resample.py resample_variable():710 [1] Resampling ctd1_dissolvedO2 with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:04,146 resample.py resample_variable():710 [1] Resampling ctd1_oxygen_mll with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:04,261 resample.py resample_variable():710 [1] Resampling ctd1_oxygen_umolkg with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:04,375 resample.py resample_variable():710 [1] Resampling ctd1_flow1 with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:04,499 resample.py resample_variable():710 [1] Resampling ctd2_temperature with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:04,630 resample.py resample_variable():710 [1] Resampling ctd2_conductivity with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:04,768 resample.py resample_variable():710 [1] Resampling ctd2_salinity with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:04,896 resample.py resample_variable():710 [1] Resampling ctd2_temperature_onboard with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:05,025 resample.py resample_variable():710 [1] Resampling ctd2_conductivity_onboard with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:05,160 resample.py resample_variable():710 [1] Resampling ctd2_salinity_onboard with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:05,288 resample.py resample_variable():710 [1] Resampling ctd2_flow2 with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:05,342 resample.py resample_variable():710 [1] Resampling biolume_flow with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:05,385 resample.py resample_variable():710 [1] Resampling biolume_avg_biolume with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:05,401 resample.py add_biolume_proxies():493 [1] Adding biolume proxy variables computed from biolume_raw INFO 2023-09-02 14:15:10,004 resample.py add_biolume_proxies():571 [1] Zero flow values found: 75166 of 81407 - replaced with 350 ml/s INFO 2023-09-02 14:15:10,005 resample.py add_biolume_proxies():576 [1] Computing flashes per liter: nbflash_high, nbflash_low INFO 2023-09-02 14:15:10,517 resample.py add_biolume_proxies():604 [1] Saving flash intensity: biolume_intflash - the upper bound of the background envelope INFO 2023-09-02 14:15:10,782 resample.py add_biolume_proxies():624 [1] Saving Background bioluminescence (dinoflagellates proxy) INFO 2023-09-02 14:15:10,904 resample.py select_nighttime_bl_raw():422 [1] Extracting biolume_raw data between sunset 2017-10-03 02:40:23.045235200 and sunrise 2017-10-03 13:00:23.043626752 INFO 2023-09-02 14:15:11,314 resample.py add_biolume_proxies():656 [1] Using proxy_ratio_adinos = 3.9811e+13 INFO 2023-09-02 14:15:11,315 resample.py add_biolume_proxies():657 [1] Using proxy_cal_factor = 0.004700 INFO 2023-09-02 14:15:11,791 resample.py resample_variable():710 [1] Resampling tailcone_propRpm with frequency 1S following 3 point median filter INFO 2023-09-02 14:15:13,213 resample.py resample_mission():946 [1] Saved resampled mission to /data/auv_data/dorado/missionnetcdfs/2017.275.01/dorado_2017.275.01_1S.nc INFO 2023-09-02 14:15:21,982 create_products.py _get_best_ctd():107 [1] Best CTD is ctd2 INFO 2023-09-02 14:15:57,548 create_products.py gulper_odv():250 [1] Wrote 20 Gulper data lines to /data/auv_data/dorado/missionodvs/2017.275.01/dorado_2017.275.01_1S_Gulper.txt INFO 2023-09-02 14:15:57,549 process.py archive():280 [1] Archiving steps for 2017.275.01 INFO 2023-09-02 14:15:57,551 archive.py copy_to_AUVTCD():53 [1] Archiving /data/auv_data/dorado/missionnetcdfs/2017.275.01/dorado_2017.275.01 files to /Volumes/AUVCTD/surveys/2017/netcdf INFO 2023-09-02 14:15:57,791 archive.py copy_to_AUVTCD():65 [1] rsync /data/auv_data/dorado/missionnetcdfs/2017.275.01/dorado_2017.275.01_1S.nc /Volumes/AUVCTD/surveys/2017/netcdf done. INFO 2023-09-02 14:15:58,636 archive.py copy_to_AUVTCD():65 [1] rsync /data/auv_data/dorado/missionnetcdfs/2017.275.01/dorado_2017.275.01_cal.nc /Volumes/AUVCTD/surveys/2017/netcdf done. INFO 2023-09-02 14:15:59,658 archive.py copy_to_AUVTCD():65 [1] rsync /data/auv_data/dorado/missionnetcdfs/2017.275.01/dorado_2017.275.01_align.nc /Volumes/AUVCTD/surveys/2017/netcdf done. INFO 2023-09-02 14:15:59,874 archive.py copy_to_AUVTCD():80 [1] rsync /data/auv_data/dorado/missionnetcdfs/2017.275.01/ctdDriver.nc /Volumes/AUVCTD/missionnetcdfs/2017/2017275/2017.275.01 done. INFO 2023-09-02 14:16:00,070 archive.py copy_to_AUVTCD():80 [1] rsync /data/auv_data/dorado/missionnetcdfs/2017.275.01/ctdDriver2.nc /Volumes/AUVCTD/missionnetcdfs/2017/2017275/2017.275.01 done. INFO 2023-09-02 14:16:00,166 archive.py copy_to_AUVTCD():80 [1] rsync /data/auv_data/dorado/missionnetcdfs/2017.275.01/gps.nc /Volumes/AUVCTD/missionnetcdfs/2017/2017275/2017.275.01 done. INFO 2023-09-02 14:16:00,362 archive.py copy_to_AUVTCD():80 [1] rsync /data/auv_data/dorado/missionnetcdfs/2017.275.01/hydroscatlog.nc /Volumes/AUVCTD/missionnetcdfs/2017/2017275/2017.275.01 done. INFO 2023-09-02 14:16:00,822 archive.py copy_to_AUVTCD():80 [1] rsync /data/auv_data/dorado/missionnetcdfs/2017.275.01/navigation.nc /Volumes/AUVCTD/missionnetcdfs/2017/2017275/2017.275.01 done. INFO 2023-09-02 14:16:01,082 archive.py copy_to_AUVTCD():80 [1] rsync /data/auv_data/dorado/missionnetcdfs/2017.275.01/parosci.nc /Volumes/AUVCTD/missionnetcdfs/2017/2017275/2017.275.01 done. INFO 2023-09-02 14:16:01,270 archive.py copy_to_AUVTCD():80 [1] rsync /data/auv_data/dorado/missionnetcdfs/2017.275.01/tailCone.nc /Volumes/AUVCTD/missionnetcdfs/2017/2017275/2017.275.01 done. INFO 2023-09-02 14:16:01,638 archive.py copy_to_AUVTCD():80 [1] rsync /data/auv_data/dorado/missionnetcdfs/2017.275.01/biolume.nc /Volumes/AUVCTD/missionnetcdfs/2017/2017275/2017.275.01 done. INFO 2023-09-02 14:16:01,638 archive.py copy_to_AUVTCD():85 [1] Archiving product files INFO 2023-09-02 14:16:01,722 archive.py copy_to_AUVTCD():94 [1] rsync /data/auv_data/dorado/missionodvs/2017.275.01/* /Volumes/AUVCTD/surveys/2017/odv done. INFO 2023-09-02 14:16:01,723 archive.py copy_to_AUVTCD():107 [1] rsync /data/auv_data/dorado/missionnetcdfs/2017.275.01/dorado_2017.275.01_processing.log /Volumes/AUVCTD/surveys/2017/netcdf