comp.lang.idl-pvwave archive: archive

Home » Public Forums » archive » IDL 8.2.2 released

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: IDL 8.2.2 released [message #83170 is a reply to message #83056]

Fri, 08 February 2013 08:14

chris_torrence@NOSPAM is currently offline

chris_torrence@NOSPAM
Messages: 528
Registered: March 2007

Senior Member

On Thursday, February 7, 2013 9:47:13 PM UTC-7, timoth...@gmail.com wrote:
>> Also, if you have the CR number for a particular bug, I'd be happy to check on its status for you.
>
>>
>
>>
>
>>
>
>> mp
>
>
>
> Hi Mark,
>
>
>
> I would like to take you up on your offer. CRS 67311
>
> Its about the very slow restore times of large arrays from .sav files. We are using IDL in an emergency warning system where every second counts.
>
>
>
> Thanks,
>
> Tim

Hi Tim,

This bug is on the plate for IDL 8.3. I just did some quick tests, and it looks like some of the speed difference is because the IDL save files are saved in "big endian" format. When you read this on a Windows, Linux, or Mac machine, it needs to convert all of the arrays to little endian. Something we are doing in the C code must be slower than the Python big->little endian conversion.

In the meantime, if you are desperate for a speedup, you could use just an unstructured readu/writeu. It's not as flexible as the save file, but it will be as fast (if not faster) than the Python. On my Mac, using your original reproduce code, I could read that 400 Mb array in 6 seconds using a save file, and 0.6 seconds using a straight readu.

Just out of curiosity, are you using scipy's "idlsave" package to read IDL save files into Python?

-Chris
ExelisVIS

Report message to a moderator

[Message index]

		IDL 8.2.2 released By: Mark Piper on Tue, 05 February 2013 09:39
		Re: IDL 8.2.2 released By: David Fanning on Wed, 06 February 2013 16:24
		Re: IDL 8.2.2 released By: Mark Piper on Thu, 07 February 2013 08:16
		Re: IDL 8.2.2 released By: Mark Piper on Wed, 06 February 2013 16:09
		Re: IDL 8.2.2 released By: tom.grydeland on Wed, 20 March 2013 02:58
		Re: IDL 8.2.2 released By: Mark Piper on Wed, 06 February 2013 16:00
		Re: IDL 8.2.2 released By: Matt[2] on Thu, 07 February 2013 08:20
		Re: IDL 8.2.2 released By: Mark Piper on Wed, 06 February 2013 15:23
		Re: IDL 8.2.2 released By: Bob[4] on Wed, 06 February 2013 13:23
		Re: IDL 8.2.2 released By: Bob[4] on Thu, 07 February 2013 10:53
		Re: IDL 8.2.2 released By: dain.cilke on Thu, 07 February 2013 14:07
		Re: IDL 8.2.2 released By: Louis Giglio on Wed, 06 February 2013 13:01
		Re: IDL 8.2.2 released By: Andy Sayer on Thu, 07 February 2013 06:22
		Re: IDL 8.2.2 released By: Fabzi on Wed, 06 February 2013 11:18
		Re: IDL 8.2.2 released By: David Fanning on Wed, 06 February 2013 10:24
		Re: IDL 8.2.2 released By: Mark Piper on Wed, 06 February 2013 09:20
		Re: IDL 8.2.2 released By: Mark Piper on Wed, 06 February 2013 09:18
		Re: IDL 8.2.2 released By: David Fanning on Wed, 06 February 2013 06:51
		Re: IDL 8.2.2 released By: Fabzi on Wed, 06 February 2013 06:37
		Re: IDL 8.2.2 released By: lecacheux.alain on Wed, 06 February 2013 04:29
		Re: IDL 8.2.2 released By: Fabzi on Wed, 06 February 2013 01:44
		Re: IDL 8.2.2 released By: wlandsman on Tue, 05 February 2013 23:29
		Re: IDL 8.2.2 released By: David Fanning on Tue, 05 February 2013 15:06
		Re: IDL 8.2.2 released By: wlandsman on Tue, 05 February 2013 14:28
		Re: IDL 8.2.2 released By: timothyja123 on Sat, 09 February 2013 02:44
		Re: IDL 8.2.2 released By: Matt Haffner on Fri, 08 February 2013 13:48
		Re: IDL 8.2.2 released By: Michael Galloy on Wed, 13 February 2013 16:19
		Re: IDL 8.2.2 released By: Mark Piper on Wed, 20 March 2013 14:10
		Re: IDL 8.2.2 released By: Fabzi on Fri, 08 February 2013 09:15
		Re: IDL 8.2.2 released By: Fabzi on Fri, 08 February 2013 09:04
		Re: IDL 8.2.2 released By: timothyja123 on Tue, 12 February 2013 16:43
		Re: IDL 8.2.2 released By: dain.cilke on Fri, 08 February 2013 08:24
		Re: IDL 8.2.2 released By: chris_torrence@NOSPAM on Fri, 08 February 2013 08:14
		Re: IDL 8.2.2 released By: Bob[4] on Thu, 07 February 2013 14:55
		Re: IDL 8.2.2 released By: dain.cilke on Thu, 07 February 2013 14:10
		Re: IDL 8.2.2 released By: Bob[4] on Thu, 07 February 2013 12:14
		Re: IDL 8.2.2 released By: David Fanning on Thu, 07 February 2013 11:15
		Re: IDL 8.2.2 released By: chris_torrence@NOSPAM on Thu, 07 February 2013 09:11
		Re: IDL 8.2.2 released By: Mark Piper on Thu, 07 February 2013 08:55
		Re: IDL 8.2.2 released By: David Fanning on Thu, 07 February 2013 08:21
		Re: IDL 8.2.2 released By: Mark Piper on Thu, 14 February 2013 08:23
		Re: IDL 8.2.2 released By: Michael Galloy on Wed, 13 February 2013 16:16
		Re: IDL 8.2.2 released By: timothyja123 on Wed, 13 February 2013 14:52
		Re: IDL 8.2.2 released By: Fabzi on Wed, 13 February 2013 02:04
		Re: IDL 8.2.2 released By: lecacheux.alain on Wed, 20 March 2013 09:07
		Re: IDL 8.2.2 released By: tom.grydeland on Thu, 21 March 2013 02:38
		Re: IDL 8.2.2 released By: Mark Piper on Thu, 21 March 2013 09:41
		Re: IDL 8.2.2 released By: chris_torrence@NOSPAM on Mon, 15 April 2013 21:08
		Re: IDL 8.2.2 released By: tom.grydeland on Fri, 26 April 2013 03:06
		Re: IDL 8.2.2 released By: chris_torrence@NOSPAM on Fri, 26 April 2013 14:33
		Re: IDL 8.2.2 released By: tushar on Thu, 25 April 2013 23:31

Previous Topic:	netCDF adding variable to an existing file
Next Topic:	nearest node of Delauny tesselation

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Wed Oct 08 18:20:11 PDT 2025

Total time taken to generate the page: 0.00266 seconds