writeMmpNetCDFandUpdateSSDS(): Processing begun: Mon Nov 9 15:15:10 2009 writeMmpNetCDFandUpdateSSDS(): Processing output from Instrument Deployment name = Profiler Package (2009-10-22T23:52:54Z - 386) UUID=061cabde-98f6-11da-92c6-00306e389969 writeMmpNetCDFandUpdateSSDS(): Removing file /mbari/ssdsdata/deployments/muce2009/200901/muce2009_mmp_20091022.nc writeMmpNetCDFandUpdateSSDS(): Executing cmd: mmpToNetCDF.py -m 1510 -s 1256255574 -z /mbari/tempbox/mccann/mmp2009_10_22 -t /mbari/tempbox/mccann/mmp2009_10_22/unpacked -n /mbari/ssdsdata/deployments/muce2009/200901/muce2009_mmp_20091022.nc 2>&1 | tee -a /mbari/ssdsdata/deployments/muce2009/200901/muce2009_mmp_20091022_processing.log INFO 2009-11-09 15:15:10,665 852 In function retreiveZipsFromDevice() INFO 2009-11-09 15:15:10,665 853 Note: The .zip files are named with timestamps that are LOCAL TIME, not GMT. INFO 2009-11-09 15:15:13,518 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256460501&endTimestampSeconds=1256460505 INFO 2009-11-09 15:15:13,531 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T014821.zip file A0000001.DAT INFO 2009-11-09 15:15:13,535 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T014821.zip file A0000000.DAT INFO 2009-11-09 15:15:13,537 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256467812&endTimestampSeconds=1256467816 INFO 2009-11-09 15:15:13,549 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T035012.zip file A0000003.DAT INFO 2009-11-09 15:15:13,552 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T035012.zip file A0000002.DAT INFO 2009-11-09 15:15:13,555 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256474916&endTimestampSeconds=1256474920 INFO 2009-11-09 15:15:13,604 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T054836.zip file C0000004.DAT INFO 2009-11-09 15:15:13,608 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T054836.zip file C0000003.DAT INFO 2009-11-09 15:15:13,613 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256489295&endTimestampSeconds=1256489299 INFO 2009-11-09 15:15:13,624 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T094815.zip file A0000006.DAT INFO 2009-11-09 15:15:13,628 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T094815.zip file A0000005.DAT INFO 2009-11-09 15:15:13,632 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256503989&endTimestampSeconds=1256503993 INFO 2009-11-09 15:15:13,644 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T135309.zip file A0000009.DAT INFO 2009-11-09 15:15:13,647 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T135309.zip file A0000008.DAT INFO 2009-11-09 15:15:13,651 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256532521&endTimestampSeconds=1256532525 INFO 2009-11-09 15:15:13,664 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T214841.zip file A0000007.DAT INFO 2009-11-09 15:15:13,668 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T214841.zip file C0000009.DAT INFO 2009-11-09 15:15:13,672 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256546911&endTimestampSeconds=1256546915 INFO 2009-11-09 15:15:13,724 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-26T014831.zip file C0000008.DAT INFO 2009-11-09 15:15:13,730 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-26T014831.zip file C0000007.DAT INFO 2009-11-09 15:15:13,737 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256561374&endTimestampSeconds=1256561378 INFO 2009-11-09 15:15:13,746 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-26T054934.zip file C0000006.DAT INFO 2009-11-09 15:15:13,749 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-26T054934.zip file C0000002.DAT INFO 2009-11-09 15:15:13,752 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256578858&endTimestampSeconds=1256578862 INFO 2009-11-09 15:15:13,761 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-26T104058.zip file C0000001.DAT INFO 2009-11-09 15:15:13,763 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256674512&endTimestampSeconds=1256674516 ERROR 2009-11-09 15:15:13,777 899 Unable to unzip file /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-27T131512.zip INFO 2009-11-09 15:15:13,777 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256762507&endTimestampSeconds=1256762511 INFO 2009-11-09 15:15:13,786 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-28T134147.zip file A0000011.DAT INFO 2009-11-09 15:15:13,790 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1256773935&endTimestampSeconds=1256773939 INFO 2009-11-09 15:15:13,840 903 Extracting from /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-28T165215.zip file A0000015.DAT INFO 2009-11-09 15:15:13,843 427 In function unpackFilesInDirectory() INFO 2009-11-09 15:15:13,844 447 File counts: A = 11, C = 8, E = 0 WARNING 2009-11-09 15:15:13,844 449 File counts are not the same. There is no guarantee that following processing will succeed... INFO 2009-11-09 15:15:13,844 453 Found 11 profiles from which data can be unpacked. INFO 2009-11-09 15:15:13,844 466 Looping through profile numbers 0 to 16... INFO 2009-11-09 15:15:13,845 468 number = 0 ERROR 2009-11-09 15:15:13,845 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000000.DAT, skipping profile number 0 INFO 2009-11-09 15:15:13,845 468 number = 1 ERROR 2009-11-09 15:15:13,845 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000001.DAT, skipping profile number 1 INFO 2009-11-09 15:15:13,845 468 number = 2 ERROR 2009-11-09 15:15:13,845 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000002.DAT, skipping profile number 2 INFO 2009-11-09 15:15:13,845 468 number = 3 ERROR 2009-11-09 15:15:13,845 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000003.DAT, skipping profile number 3 INFO 2009-11-09 15:15:13,846 468 number = 4 ERROR 2009-11-09 15:15:13,846 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000004.DAT, skipping profile number 4 INFO 2009-11-09 15:15:13,846 468 number = 5 ERROR 2009-11-09 15:15:13,846 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000005.DAT, skipping profile number 5 INFO 2009-11-09 15:15:13,846 468 number = 6 ERROR 2009-11-09 15:15:13,846 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000006.DAT, skipping profile number 6 INFO 2009-11-09 15:15:13,846 468 number = 7 ERROR 2009-11-09 15:15:13,847 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000007.DAT, skipping profile number 7 INFO 2009-11-09 15:15:13,847 468 number = 8 ERROR 2009-11-09 15:15:13,847 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000008.DAT, skipping profile number 8 INFO 2009-11-09 15:15:13,847 468 number = 9 ERROR 2009-11-09 15:15:13,847 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000009.DAT, skipping profile number 9 INFO 2009-11-09 15:15:13,847 468 number = 10 ERROR 2009-11-09 15:15:13,847 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000010.DAT, skipping profile number 10 INFO 2009-11-09 15:15:13,847 468 number = 11 ERROR 2009-11-09 15:15:13,848 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000011.DAT, skipping profile number 11 INFO 2009-11-09 15:15:13,848 468 number = 12 ERROR 2009-11-09 15:15:13,848 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000012.DAT, skipping profile number 12 INFO 2009-11-09 15:15:13,848 468 number = 13 ERROR 2009-11-09 15:15:13,848 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000013.DAT, skipping profile number 13 INFO 2009-11-09 15:15:13,848 468 number = 14 ERROR 2009-11-09 15:15:13,848 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000014.DAT, skipping profile number 14 INFO 2009-11-09 15:15:13,849 468 number = 15 ERROR 2009-11-09 15:15:13,849 473 Could not open /mbari/tempbox/mccann/mmp2009_10_22/E0000015.DAT, skipping profile number 15 INFO 2009-11-09 15:15:13,849 1016 For comparing SIAM and MMP timestamps... INFO 2009-11-09 15:15:13,849 1017 Note: The .zip files are named with timestamps that are LOCAL TIME, not GMT. INFO 2009-11-09 15:15:13,849 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T014821.zip: ['A0000000.DAT', 'A0000001.DAT'] INFO 2009-11-09 15:15:13,849 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T035012.zip: ['A0000002.DAT', 'A0000003.DAT'] INFO 2009-11-09 15:15:13,849 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T054836.zip: ['C0000003.DAT', 'C0000004.DAT'] INFO 2009-11-09 15:15:13,849 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T094815.zip: ['A0000005.DAT', 'A0000006.DAT'] INFO 2009-11-09 15:15:13,850 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T135309.zip: ['A0000008.DAT', 'A0000009.DAT'] INFO 2009-11-09 15:15:13,850 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-25T214841.zip: ['A0000007.DAT', 'C0000009.DAT'] INFO 2009-11-09 15:15:13,850 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-26T014831.zip: ['C0000007.DAT', 'C0000008.DAT'] INFO 2009-11-09 15:15:13,850 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-26T054934.zip: ['C0000002.DAT', 'C0000006.DAT'] INFO 2009-11-09 15:15:13,850 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-26T104058.zip: ['C0000001.DAT'] INFO 2009-11-09 15:15:13,850 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-27T131512.zip: [] INFO 2009-11-09 15:15:13,850 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-28T134147.zip: ['A0000011.DAT'] INFO 2009-11-09 15:15:13,850 1023 /mbari/tempbox/mccann/mmp2009_10_22/mmp1510_2009-10-28T165215.zip: ['A0000015.DAT'] INFO 2009-11-09 15:15:13,851 522 In function outputTxtFiles() INFO 2009-11-09 15:15:13,851 563 In function outputNetCDFFile() INFO 2009-11-09 15:15:13,853 673 Note: These begin and end times are LOCAL TIME, not GMT. INFO 2009-11-09 15:15:13,854 711 Number of values for current = 0 INFO 2009-11-09 15:15:13,854 712 Number of values for monotonic current = 0 INFO 2009-11-09 15:15:13,854 713 Number of values removed to make monotonic = 0 ERROR 2009-11-09 15:15:13,854 775 Could not create dimension for one of E, A, or C data. We need all 3 to continue. writeMmpNetCDFandUpdateSSDS(): return value from mmpToNetCDF.py = 0 writeMmpNetCDFandUpdateSSDS(): Look in directory /mbari/tempbox/mccann/mmp2009_10_22/unpacked for human readable files writeMmpNetCDFandUpdateSSDS(): File /mbari/ssdsdata/deployments/muce2009/200901/muce2009_mmp_20091022.nc does not exist. Exiting.