writeMmpNetCDFandUpdateSSDS(): Processing begun: Wed Nov 11 17:16:19 2009 writeMmpNetCDFandUpdateSSDS(): Processing output from Instrument Deployment name = Profiler Package (2009-10-22T23:52:54Z - 386) UUID=061cabde-98f6-11da-92c6-00306e389969 writeMmpNetCDFandUpdateSSDS(): Removing file /mbari/ssdsdata/deployments/muce2009lab/200901/muce2009lab_mmp_20091022.nc writeMmpNetCDFandUpdateSSDS(): Executing cmd: mmpToNetCDF.py -m 1510 -s 1256255574 -e 1257465600 -z /mbari/tempbox/mccann/mmp2009_10_22 -t /mbari/tempbox/mccann/mmp2009_10_22/unpacked -n /mbari/ssdsdata/deployments/muce2009lab/200901/muce2009lab_mmp_20091022.nc 2>&1 | tee -a /mbari/ssdsdata/deployments/muce2009lab/200901/muce2009lab_mmp_20091022_processing.log INFO 2009-11-11 17:16:19,531 852 In function retreiveZipsFromDevice() INFO 2009-11-11 17:16:19,531 853 Note: The .zip files are named with timestamps that are LOCAL TIME, not GMT. INFO 2009-11-11 17:16:22,500 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256460501&endTimestampSeconds=1256460505 INFO 2009-11-11 17:16:22,531 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T014821.zip file A0000001.DAT INFO 2009-11-11 17:16:22,535 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T014821.zip file A0000000.DAT INFO 2009-11-11 17:16:22,538 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256467812&endTimestampSeconds=1256467816 INFO 2009-11-11 17:16:22,551 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T035012.zip file A0000003.DAT INFO 2009-11-11 17:16:22,554 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T035012.zip file A0000002.DAT INFO 2009-11-11 17:16:22,558 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256474916&endTimestampSeconds=1256474920 INFO 2009-11-11 17:16:22,606 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T054836.zip file C0000004.DAT INFO 2009-11-11 17:16:22,609 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T054836.zip file C0000003.DAT INFO 2009-11-11 17:16:22,612 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256489295&endTimestampSeconds=1256489299 INFO 2009-11-11 17:16:22,624 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T094815.zip file A0000006.DAT INFO 2009-11-11 17:16:22,628 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T094815.zip file A0000005.DAT INFO 2009-11-11 17:16:22,631 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256503989&endTimestampSeconds=1256503993 INFO 2009-11-11 17:16:22,644 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T135309.zip file A0000009.DAT INFO 2009-11-11 17:16:22,647 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T135309.zip file A0000008.DAT INFO 2009-11-11 17:16:22,651 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256532521&endTimestampSeconds=1256532525 INFO 2009-11-11 17:16:22,664 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T214841.zip file A0000007.DAT INFO 2009-11-11 17:16:22,667 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T214841.zip file C0000009.DAT INFO 2009-11-11 17:16:22,670 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256546911&endTimestampSeconds=1256546915 INFO 2009-11-11 17:16:22,719 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-26T014831.zip file C0000008.DAT INFO 2009-11-11 17:16:22,722 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-26T014831.zip file C0000007.DAT INFO 2009-11-11 17:16:22,724 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256561374&endTimestampSeconds=1256561378 INFO 2009-11-11 17:16:22,735 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-26T054934.zip file C0000006.DAT INFO 2009-11-11 17:16:22,742 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-26T054934.zip file C0000002.DAT INFO 2009-11-11 17:16:22,745 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256578858&endTimestampSeconds=1256578862 INFO 2009-11-11 17:16:22,755 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-26T104058.zip file C0000001.DAT INFO 2009-11-11 17:16:22,758 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256674512&endTimestampSeconds=1256674516 ERROR 2009-11-11 17:16:22,773 899 Unable to unzip file /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-27T131512.zip INFO 2009-11-11 17:16:22,774 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256762507&endTimestampSeconds=1256762511 INFO 2009-11-11 17:16:22,783 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-28T134147.zip file A0000011.DAT INFO 2009-11-11 17:16:22,787 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256773935&endTimestampSeconds=1256773939 INFO 2009-11-11 17:16:22,833 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-28T165215.zip file A0000015.DAT INFO 2009-11-11 17:16:22,837 427 In function unpackFilesInDirectory() INFO 2009-11-11 17:16:22,839 447 File counts: A = 19, C = 8, E = 0 WARNING 2009-11-11 17:16:22,839 449 File counts are not the same. There is no guarantee that following processing will succeed... INFO 2009-11-11 17:16:22,839 453 Found 19 profiles from which data can be unpacked. INFO 2009-11-11 17:16:22,839 466 Looping through profile numbers 0 to 16... INFO 2009-11-11 17:16:22,840 468 number = 0 ERROR 2009-11-11 17:16:22,840 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000000.DAT, skipping profile number 0 INFO 2009-11-11 17:16:22,840 468 number = 1 ERROR 2009-11-11 17:16:22,840 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000001.DAT, skipping profile number 1 INFO 2009-11-11 17:16:22,841 468 number = 2 ERROR 2009-11-11 17:16:22,841 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000002.DAT, skipping profile number 2 INFO 2009-11-11 17:16:22,841 468 number = 3 ERROR 2009-11-11 17:16:22,841 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000003.DAT, skipping profile number 3 INFO 2009-11-11 17:16:22,842 468 number = 4 ERROR 2009-11-11 17:16:22,842 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000004.DAT, skipping profile number 4 INFO 2009-11-11 17:16:22,842 468 number = 5 ERROR 2009-11-11 17:16:22,842 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000005.DAT, skipping profile number 5 INFO 2009-11-11 17:16:22,843 468 number = 6 ERROR 2009-11-11 17:16:22,843 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000006.DAT, skipping profile number 6 INFO 2009-11-11 17:16:22,843 468 number = 7 ERROR 2009-11-11 17:16:22,843 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000007.DAT, skipping profile number 7 INFO 2009-11-11 17:16:22,843 468 number = 8 ERROR 2009-11-11 17:16:22,844 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000008.DAT, skipping profile number 8 INFO 2009-11-11 17:16:22,844 468 number = 9 ERROR 2009-11-11 17:16:22,844 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000009.DAT, skipping profile number 9 INFO 2009-11-11 17:16:22,844 468 number = 10 ERROR 2009-11-11 17:16:22,845 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000010.DAT, skipping profile number 10 INFO 2009-11-11 17:16:22,845 468 number = 11 ERROR 2009-11-11 17:16:22,845 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000011.DAT, skipping profile number 11 INFO 2009-11-11 17:16:22,845 468 number = 12 ERROR 2009-11-11 17:16:22,846 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000012.DAT, skipping profile number 12 INFO 2009-11-11 17:16:22,846 468 number = 13 ERROR 2009-11-11 17:16:22,846 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000013.DAT, skipping profile number 13 INFO 2009-11-11 17:16:22,846 468 number = 14 ERROR 2009-11-11 17:16:22,847 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000014.DAT, skipping profile number 14 INFO 2009-11-11 17:16:22,847 468 number = 15 ERROR 2009-11-11 17:16:22,847 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000015.DAT, skipping profile number 15 INFO 2009-11-11 17:16:22,847 1016 For comparing SIAM and MMP timestamps... INFO 2009-11-11 17:16:22,847 1017 Note: The .zip files are named with timestamps that are LOCAL TIME, not GMT. INFO 2009-11-11 17:16:22,847 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T014821.zip: ['A0000000.DAT', 'A0000001.DAT'] INFO 2009-11-11 17:16:22,848 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T035012.zip: ['A0000002.DAT', 'A0000003.DAT'] INFO 2009-11-11 17:16:22,848 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T054836.zip: ['C0000003.DAT', 'C0000004.DAT'] INFO 2009-11-11 17:16:22,848 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T094815.zip: ['A0000005.DAT', 'A0000006.DAT'] INFO 2009-11-11 17:16:22,848 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T135309.zip: ['A0000008.DAT', 'A0000009.DAT'] INFO 2009-11-11 17:16:22,848 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T214841.zip: ['A0000007.DAT', 'C0000009.DAT'] INFO 2009-11-11 17:16:22,848 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-26T014831.zip: ['C0000007.DAT', 'C0000008.DAT'] INFO 2009-11-11 17:16:22,849 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-26T054934.zip: ['C0000002.DAT', 'C0000006.DAT'] INFO 2009-11-11 17:16:22,849 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-26T104058.zip: ['C0000001.DAT'] INFO 2009-11-11 17:16:22,849 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-27T131512.zip: [] INFO 2009-11-11 17:16:22,849 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-28T134147.zip: ['A0000011.DAT'] INFO 2009-11-11 17:16:22,849 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-28T165215.zip: ['A0000015.DAT'] INFO 2009-11-11 17:16:22,849 522 In function outputTxtFiles() INFO 2009-11-11 17:16:22,850 563 In function outputNetCDFFile() INFO 2009-11-11 17:16:22,853 673 Note: These begin and end times are LOCAL TIME, not GMT. INFO 2009-11-11 17:16:22,853 711 Number of values for current = 0 INFO 2009-11-11 17:16:22,853 712 Number of values for monotonic current = 0 INFO 2009-11-11 17:16:22,853 713 Number of values removed to make monotonic = 0 ERROR 2009-11-11 17:16:22,853 775 Could not create dimension for one of E, A, or C data. We need all 3 to continue. writeMmpNetCDFandUpdateSSDS(): return value from mmpToNetCDF.py = 0 writeMmpNetCDFandUpdateSSDS(): Look in directory /mbari/tempbox/mccann/mmp2009_10_22/unpacked for human readable files writeMmpNetCDFandUpdateSSDS(): File /mbari/ssdsdata/deployments/muce2009lab/200901/muce2009lab_mmp_20091022.nc does not exist. Exiting.