comp.lang.idl-pvwave archive: archive » Re: reading/writing large files

Home » Public Forums » archive » Re: reading/writing large files

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: reading/writing large files [message #83008 is a reply to message #83007]

Fri, 01 February 2013 07:46

Carsten Lechte
Messages: 124
Registered: August 2006

Senior Member

Hi, Russel

> Any ideas?

Have a look at the HDF5 scientific data format. You can write
multiple-dimensional arrays of any data type, with the option of
growing the array along one dimension, which should take care of the
appending. Upon reading, you can specify a stride and maybe even a
subarray. The libraries should be well optimised, so they could be
faster than what you have so far.

However, I have not used these features of HDF5 myself, and they may
not be accessible in IDL.

chl

Report message to a moderator

[Message index]

		Re: reading/writing large files By: Russell[1] on Fri, 01 February 2013 12:23
		Re: reading/writing large files By: Craig Markwardt on Fri, 01 February 2013 10:44
		Re: reading/writing large files By: Russell Ryan on Fri, 01 February 2013 08:49
		Re: reading/writing large files By: Craig Markwardt on Fri, 01 February 2013 08:36
		Re: reading/writing large files By: Matthew on Fri, 01 February 2013 07:52
		Re: reading/writing large files By: Carsten Lechte on Fri, 01 February 2013 07:46
		Re: reading/writing large files By: Matthew on Fri, 01 February 2013 07:40

Previous Topic:	Re: Some questions of efficiency when matching items in lists
Next Topic:	Re: continuum normalized spectra

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Fri Oct 10 09:37:14 PDT 2025

Total time taken to generate the page: 0.80277 seconds