comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado

Home » Public Forums » archive » IDL 8.2.2 released
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend 
Return to the default flat view Create a new topic Submit Reply
Re: IDL 8.2.2 released [message #83261 is a reply to message #83056] Wed, 13 February 2013 02:04 Go to previous messageGo to previous message
Fabzi is currently offline  Fabzi
Messages: 305
Registered: July 2010
Senior Member
Hi Timothy

On 02/13/2013 01:43 AM, timothyja123@gmail.com wrote:
> I have been looking into your NetCDF suggestion.
>
> I have hit a problem however in that the IDL library
> does not seem to have an option to compress the NetCDF files.

Which version of IDL are you using? With 7.1.1 (patched for netCDF) and
higher this should be no problem. But you have to specify that you want
to use netCDF 4 when creating the file, with the /NETCDF4_FORMAT
keyword: http://www.exelisvis.com/docs/NCDF_CREATE.html

NetCDF4 allows you to create files larger than 2gb (upper limit for
netCDF3 files) and also to use the three compression keywords when
defining a variable (GZIP, CHUNCK_DIMENSIONS, SHUFFLE):
http://www.exelisvis.com/docs/NCDF_VARDEF.html

NetCDF is very fast, but the more you compress, the slowier it will be
though. I found almost no win in file size when going from GZIP=5 to
GZIP=9 so I suggest to stick by 5. I also noticed that creating
compressed files takes longer but that reading them is almost as fast as
uncompressed ones, but this should be tested in a proper benchmark. The
compression will be very efficient if your data is very recurrent (many
zeros for example).

And again, I highly recommend David's NCDF_FILE object, which makes it
much more fun to work with ncdf files and has no limitations (all
keywords are accessible):
http://www.idlcoyote.com/programs/ncdf_file__define.pro
(the only drawback of David's tool is that it is "all objects" and
therefore parsing a lot of files having a lot of variables/attributes is
a bit slow)

Cheers,

Fab
[Message index]
 
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Previous Topic: netCDF adding variable to an existing file
Next Topic: nearest node of Delauny tesselation

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Wed Oct 08 16:13:14 PDT 2025

Total time taken to generate the page: 0.00288 seconds