writeMmpNetCDFandUpdateSSDS(): Processing begun: Wed Nov 11 14:56:39 2009 writeMmpNetCDFandUpdateSSDS(): Processing output from Instrument Deployment name = Profiler Package (2009-10-26T21:28:11Z - 391) UUID=061cabde-98f6-11da-92c6-00306e389969 writeMmpNetCDFandUpdateSSDS(): Removing file /mbari/ssdsdata/deployments/muce2009/200911/muce2009_mmp_20091106.nc writeMmpNetCDFandUpdateSSDS(): Executing cmd: mmpToNetCDF.py -m 1510 -s 1257465600 -z /mbari/tempbox/mccann/mmp2009_11_05 -t /mbari/tempbox/mccann/mmp2009_11_05/unpacked -n /mbari/ssdsdata/deployments/muce2009/200911/muce2009_mmp_20091106.nc 2>&1 | tee -a /mbari/ssdsdata/deployments/muce2009/200911/muce2009_mmp_20091106_processing.log INFO 2009-11-11 14:56:39,797 852 In function retreiveZipsFromDevice() INFO 2009-11-11 14:56:39,797 853 Note: The .zip files are named with timestamps that are LOCAL TIME, not GMT. INFO 2009-11-11 14:56:44,102 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1257809052&endTimestampSeconds=1257809056 INFO 2009-11-11 14:56:44,128 903 Extracting from /mbari/tempbox/mccann/mmp2009_11_05/mmp1510_2009-11-09T152412.zip file A0000048.DAT INFO 2009-11-11 14:56:44,130 903 Extracting from /mbari/tempbox/mccann/mmp2009_11_05/mmp1510_2009-11-09T152412.zip file A0000046.DAT INFO 2009-11-11 14:56:44,133 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1257810422&endTimestampSeconds=1257810426 INFO 2009-11-11 14:56:44,159 903 Extracting from /mbari/tempbox/mccann/mmp2009_11_05/mmp1510_2009-11-09T154702.zip file A0000048.DAT INFO 2009-11-11 14:56:44,162 903 Extracting from /mbari/tempbox/mccann/mmp2009_11_05/mmp1510_2009-11-09T154702.zip file A0000046.DAT INFO 2009-11-11 14:56:44,164 903 Extracting from /mbari/tempbox/mccann/mmp2009_11_05/mmp1510_2009-11-09T154702.zip file A0000045.DAT INFO 2009-11-11 14:56:44,167 903 Extracting from /mbari/tempbox/mccann/mmp2009_11_05/mmp1510_2009-11-09T154702.zip file A0000044.DAT INFO 2009-11-11 14:56:44,169 903 Extracting from /mbari/tempbox/mccann/mmp2009_11_05/mmp1510_2009-11-09T154702.zip file A0000043.DAT INFO 2009-11-11 14:56:44,172 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1257868687&endTimestampSeconds=1257868691 ERROR 2009-11-11 14:56:44,192 899 Unable to unzip file /mbari/tempbox/mccann/mmp2009_11_05/mmp1510_2009-11-10T075807.zip INFO 2009-11-11 14:56:44,192 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1257935523&endTimestampSeconds=1257935527 INFO 2009-11-11 14:56:44,212 903 Extracting from /mbari/tempbox/mccann/mmp2009_11_05/mmp1510_2009-11-11T023203.zip file A0000070.DAT INFO 2009-11-11 14:56:44,215 903 Extracting from /mbari/tempbox/mccann/mmp2009_11_05/mmp1510_2009-11-11T023203.zip file A0000069.DAT INFO 2009-11-11 14:56:44,216 903 Extracting from /mbari/tempbox/mccann/mmp2009_11_05/mmp1510_2009-11-11T023203.zip file A0000066.DAT INFO 2009-11-11 14:56:44,220 892 Retrieving zip file from binaryUrl = http://new-ssds.mbari.org:8080/servlet/GetOriginalDataServlet?deviceID=1510&recordTypeID=1&noHTMLHeader=1&outputAs=binary&startTimestampSeconds=1257962771&endTimestampSeconds=1257962775 ERROR 2009-11-11 14:56:44,240 899 Unable to unzip file /mbari/tempbox/mccann/mmp2009_11_05/mmp1510_2009-11-11T100611.zip INFO 2009-11-11 14:56:44,240 427 In function unpackFilesInDirectory() INFO 2009-11-11 14:56:44,241 447 File counts: A = 8, C = 0, E = 0 WARNING 2009-11-11 14:56:44,241 449 File counts are not the same. There is no guarantee that following processing will succeed... INFO 2009-11-11 14:56:44,241 453 Found 8 profiles from which data can be unpacked. INFO 2009-11-11 14:56:44,241 466 Looping through profile numbers 43 to 71... INFO 2009-11-11 14:56:44,241 468 number = 43 ERROR 2009-11-11 14:56:44,242 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000043.DAT, skipping profile number 43 INFO 2009-11-11 14:56:44,242 468 number = 44 ERROR 2009-11-11 14:56:44,242 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000044.DAT, skipping profile number 44 INFO 2009-11-11 14:56:44,242 468 number = 45 ERROR 2009-11-11 14:56:44,242 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000045.DAT, skipping profile number 45 INFO 2009-11-11 14:56:44,242 468 number = 46 ERROR 2009-11-11 14:56:44,243 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000046.DAT, skipping profile number 46 INFO 2009-11-11 14:56:44,243 468 number = 47 ERROR 2009-11-11 14:56:44,243 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000047.DAT, skipping profile number 47 INFO 2009-11-11 14:56:44,243 468 number = 48 ERROR 2009-11-11 14:56:44,243 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000048.DAT, skipping profile number 48 INFO 2009-11-11 14:56:44,243 468 number = 49 ERROR 2009-11-11 14:56:44,244 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000049.DAT, skipping profile number 49 INFO 2009-11-11 14:56:44,244 468 number = 50 ERROR 2009-11-11 14:56:44,244 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000050.DAT, skipping profile number 50 INFO 2009-11-11 14:56:44,244 468 number = 51 ERROR 2009-11-11 14:56:44,244 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000051.DAT, skipping profile number 51 INFO 2009-11-11 14:56:44,244 468 number = 52 ERROR 2009-11-11 14:56:44,245 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000052.DAT, skipping profile number 52 INFO 2009-11-11 14:56:44,245 468 number = 53 ERROR 2009-11-11 14:56:44,245 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000053.DAT, skipping profile number 53 INFO 2009-11-11 14:56:44,245 468 number = 54 ERROR 2009-11-11 14:56:44,245 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000054.DAT, skipping profile number 54 INFO 2009-11-11 14:56:44,245 468 number = 55 ERROR 2009-11-11 14:56:44,246 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000055.DAT, skipping profile number 55 INFO 2009-11-11 14:56:44,246 468 number = 56 ERROR 2009-11-11 14:56:44,246 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000056.DAT, skipping profile number 56 INFO 2009-11-11 14:56:44,246 468 number = 57 ERROR 2009-11-11 14:56:44,246 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000057.DAT, skipping profile number 57 INFO 2009-11-11 14:56:44,246 468 number = 58 ERROR 2009-11-11 14:56:44,247 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000058.DAT, skipping profile number 58 INFO 2009-11-11 14:56:44,247 468 number = 59 ERROR 2009-11-11 14:56:44,247 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000059.DAT, skipping profile number 59 INFO 2009-11-11 14:56:44,247 468 number = 60 ERROR 2009-11-11 14:56:44,247 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000060.DAT, skipping profile number 60 INFO 2009-11-11 14:56:44,248 468 number = 61 ERROR 2009-11-11 14:56:44,248 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000061.DAT, skipping profile number 61 INFO 2009-11-11 14:56:44,248 468 number = 62 ERROR 2009-11-11 14:56:44,248 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000062.DAT, skipping profile number 62 INFO 2009-11-11 14:56:44,248 468 number = 63 ERROR 2009-11-11 14:56:44,248 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000063.DAT, skipping profile number 63 INFO 2009-11-11 14:56:44,249 468 number = 64 ERROR 2009-11-11 14:56:44,249 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000064.DAT, skipping profile number 64 INFO 2009-11-11 14:56:44,249 468 number = 65 ERROR 2009-11-11 14:56:44,249 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000065.DAT, skipping profile number 65 INFO 2009-11-11 14:56:44,249 468 number = 66 ERROR 2009-11-11 14:56:44,249 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000066.DAT, skipping profile number 66 INFO 2009-11-11 14:56:44,250 468 number = 67 ERROR 2009-11-11 14:56:44,250 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000067.DAT, skipping profile number 67 INFO 2009-11-11 14:56:44,250 468 number = 68 ERROR 2009-11-11 14:56:44,250 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000068.DAT, skipping profile number 68 INFO 2009-11-11 14:56:44,250 468 number = 69 ERROR 2009-11-11 14:56:44,251 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000069.DAT, skipping profile number 69 INFO 2009-11-11 14:56:44,251 468 number = 70 ERROR 2009-11-11 14:56:44,251 473 Could not open /mbari/tempbox/mccann/mmp2009_11_05/E0000070.DAT, skipping profile number 70 INFO 2009-11-11 14:56:44,251 1016 For comparing SIAM and MMP timestamps... INFO 2009-11-11 14:56:44,251 1017 Note: The .zip files are named with timestamps that are LOCAL TIME, not GMT. INFO 2009-11-11 14:56:44,251 1023 /mbari/tempbox/mccann/mmp2009_11_05/mmp1510_2009-11-09T152412.zip: ['A0000046.DAT', 'A0000048.DAT'] INFO 2009-11-11 14:56:44,251 1023 /mbari/tempbox/mccann/mmp2009_11_05/mmp1510_2009-11-09T154702.zip: ['A0000043.DAT', 'A0000044.DAT', 'A0000045.DAT', 'A0000046.DAT', 'A0000048.DAT'] INFO 2009-11-11 14:56:44,251 1023 /mbari/tempbox/mccann/mmp2009_11_05/mmp1510_2009-11-10T075807.zip: [] INFO 2009-11-11 14:56:44,251 1023 /mbari/tempbox/mccann/mmp2009_11_05/mmp1510_2009-11-11T023203.zip: ['A0000066.DAT', 'A0000069.DAT', 'A0000070.DAT'] INFO 2009-11-11 14:56:44,252 1023 /mbari/tempbox/mccann/mmp2009_11_05/mmp1510_2009-11-11T100611.zip: [] INFO 2009-11-11 14:56:44,252 522 In function outputTxtFiles() INFO 2009-11-11 14:56:44,252 563 In function outputNetCDFFile() INFO 2009-11-11 14:56:44,255 673 Note: These begin and end times are LOCAL TIME, not GMT. INFO 2009-11-11 14:56:44,255 711 Number of values for current = 0 INFO 2009-11-11 14:56:44,255 712 Number of values for monotonic current = 0 INFO 2009-11-11 14:56:44,256 713 Number of values removed to make monotonic = 0 ERROR 2009-11-11 14:56:44,256 775 Could not create dimension for one of E, A, or C data. We need all 3 to continue. writeMmpNetCDFandUpdateSSDS(): return value from mmpToNetCDF.py = 0 writeMmpNetCDFandUpdateSSDS(): Look in directory /mbari/tempbox/mccann/mmp2009_11_05/unpacked for human readable files writeMmpNetCDFandUpdateSSDS(): File /mbari/ssdsdata/deployments/muce2009/200911/muce2009_mmp_20091106.nc does not exist. Exiting.