comp.lang.idl-pvwave archive: archive

Home » Public Forums » archive » IDL 8.2.2 released

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: IDL 8.2.2 released [message #83266 is a reply to message #83168]

Tue, 12 February 2013 16:43

timothyja123
Messages: 57
Registered: February 2013

Member

On Saturday, February 9, 2013 4:04:03 AM UTC+11, Fab wrote:
> On 02/08/2013 05:14 PM, Chris Torrence wrote:
>
>> In the meantime, if you are desperate for a speedup,
>
>> you could use just an unstructured
>
>> readu/writeu. It's not as flexible as the save file,
>
>> but it will be as fast (if not faster)
>
>> than the Python.
>
>
>
> I could also recommend using NetCDF 4 files, which are quite flexible
>
> and really fast to write/read. I made a small workbench test to write
>
> and read a [500,500,500] array. Funny enough, both file have same size
>
> on disk (477.8 Mb) but the IN/OUT differences are striking:
>
>
>
> % Time elapsed IDL save: 8.8444729 seconds.
>
> % Time elapsed NCDF save: 0.57288098 seconds.
>
> % Time elapsed IDL restore: 8.8600481 seconds.
>
> % Time elapsed NCDF restore: 0.63916397 seconds.
>
>
>
> Fab

I have been looking into your NetCDF suggestion. I thought I would start by converting one sav file on giving it a test. I have hit a problem however in that the IDL library does not seem to have an option to compress the NetCDF files. To give you an idea of what I'm working with my compressed IDL files are already 15GB so I need to be able to compress them. I'm I missing something? Is there a way to compress that I'm not seeing?

The NetCDF website says "NetCDF-4 only allows users to create data with the zlib library (due to licensing restrictions on the szlib library)" so I assume it should be supported.
Also the IDL documentation says "In NetCDF 4 files, data is created and accessed with the HDF5 library." The h5d_create function has a gzip param but the NCDF_CREATE does not.

Report message to a moderator

[Message index]

		IDL 8.2.2 released By: Mark Piper on Tue, 05 February 2013 09:39
		Re: IDL 8.2.2 released By: David Fanning on Wed, 06 February 2013 16:24
		Re: IDL 8.2.2 released By: Mark Piper on Thu, 07 February 2013 08:16
		Re: IDL 8.2.2 released By: Mark Piper on Wed, 06 February 2013 16:09
		Re: IDL 8.2.2 released By: tom.grydeland on Wed, 20 March 2013 02:58
		Re: IDL 8.2.2 released By: Mark Piper on Wed, 06 February 2013 16:00
		Re: IDL 8.2.2 released By: Matt[2] on Thu, 07 February 2013 08:20
		Re: IDL 8.2.2 released By: Mark Piper on Wed, 06 February 2013 15:23
		Re: IDL 8.2.2 released By: Bob[4] on Wed, 06 February 2013 13:23
		Re: IDL 8.2.2 released By: Bob[4] on Thu, 07 February 2013 10:53
		Re: IDL 8.2.2 released By: dain.cilke on Thu, 07 February 2013 14:07
		Re: IDL 8.2.2 released By: Louis Giglio on Wed, 06 February 2013 13:01
		Re: IDL 8.2.2 released By: Andy Sayer on Thu, 07 February 2013 06:22
		Re: IDL 8.2.2 released By: Fabzi on Wed, 06 February 2013 11:18
		Re: IDL 8.2.2 released By: David Fanning on Wed, 06 February 2013 10:24
		Re: IDL 8.2.2 released By: Mark Piper on Wed, 06 February 2013 09:20
		Re: IDL 8.2.2 released By: Mark Piper on Wed, 06 February 2013 09:18
		Re: IDL 8.2.2 released By: David Fanning on Wed, 06 February 2013 06:51
		Re: IDL 8.2.2 released By: Fabzi on Wed, 06 February 2013 06:37
		Re: IDL 8.2.2 released By: lecacheux.alain on Wed, 06 February 2013 04:29
		Re: IDL 8.2.2 released By: Fabzi on Wed, 06 February 2013 01:44
		Re: IDL 8.2.2 released By: wlandsman on Tue, 05 February 2013 23:29
		Re: IDL 8.2.2 released By: David Fanning on Tue, 05 February 2013 15:06
		Re: IDL 8.2.2 released By: wlandsman on Tue, 05 February 2013 14:28
		Re: IDL 8.2.2 released By: timothyja123 on Sat, 09 February 2013 02:44
		Re: IDL 8.2.2 released By: Matt Haffner on Fri, 08 February 2013 13:48
		Re: IDL 8.2.2 released By: Michael Galloy on Wed, 13 February 2013 16:19
		Re: IDL 8.2.2 released By: Mark Piper on Wed, 20 March 2013 14:10
		Re: IDL 8.2.2 released By: Fabzi on Fri, 08 February 2013 09:15
		Re: IDL 8.2.2 released By: Fabzi on Fri, 08 February 2013 09:04
		Re: IDL 8.2.2 released By: timothyja123 on Tue, 12 February 2013 16:43
		Re: IDL 8.2.2 released By: dain.cilke on Fri, 08 February 2013 08:24
		Re: IDL 8.2.2 released By: chris_torrence@NOSPAM on Fri, 08 February 2013 08:14
		Re: IDL 8.2.2 released By: Bob[4] on Thu, 07 February 2013 14:55
		Re: IDL 8.2.2 released By: dain.cilke on Thu, 07 February 2013 14:10
		Re: IDL 8.2.2 released By: Bob[4] on Thu, 07 February 2013 12:14
		Re: IDL 8.2.2 released By: David Fanning on Thu, 07 February 2013 11:15
		Re: IDL 8.2.2 released By: chris_torrence@NOSPAM on Thu, 07 February 2013 09:11
		Re: IDL 8.2.2 released By: Mark Piper on Thu, 07 February 2013 08:55
		Re: IDL 8.2.2 released By: David Fanning on Thu, 07 February 2013 08:21
		Re: IDL 8.2.2 released By: Mark Piper on Thu, 14 February 2013 08:23
		Re: IDL 8.2.2 released By: Michael Galloy on Wed, 13 February 2013 16:16
		Re: IDL 8.2.2 released By: timothyja123 on Wed, 13 February 2013 14:52
		Re: IDL 8.2.2 released By: Fabzi on Wed, 13 February 2013 02:04
		Re: IDL 8.2.2 released By: lecacheux.alain on Wed, 20 March 2013 09:07
		Re: IDL 8.2.2 released By: tom.grydeland on Thu, 21 March 2013 02:38
		Re: IDL 8.2.2 released By: Mark Piper on Thu, 21 March 2013 09:41
		Re: IDL 8.2.2 released By: chris_torrence@NOSPAM on Mon, 15 April 2013 21:08
		Re: IDL 8.2.2 released By: tom.grydeland on Fri, 26 April 2013 03:06
		Re: IDL 8.2.2 released By: chris_torrence@NOSPAM on Fri, 26 April 2013 14:33
		Re: IDL 8.2.2 released By: tushar on Thu, 25 April 2013 23:31

Previous Topic:	netCDF adding variable to an existing file
Next Topic:	nearest node of Delauny tesselation

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Wed Oct 08 17:28:32 PDT 2025

Total time taken to generate the page: 0.00463 seconds