comp.lang.idl-pvwave archive: archive » Appending data to a dataset in an HDF5 file

Home » Public Forums » archive » Appending data to a dataset in an HDF5 file

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: Appending data to a dataset in an HDF5 file [message #52411 is a reply to message #52356]

Fri, 02 February 2007 00:50

Maarten[1]
Messages: 176
Registered: November 2005

Senior Member

On Feb 1, 4:51 pm, eddie haskell <hask...@nospam.edu> wrote:
>> The title says it all, really: I'm trying to create a dataset with an
>> unlimited dimension, so that I can append data later, preferably
>> without reading the previous data.
>
> There are several possible issues as to why it is failing for you:
>
> When you create your dataset you must set the chunk_dimensions keyword
> to be able to extend the size of a dataset.
>
> You use h5d_extend to actually extend the dataset
>
> If you want to write new data in the extended space without touching the
> original data you need to use a hyperslab

Thanks, the example is really useful (you'd hope that something like
this appears
in the manual at some time in the future). For now I accumulate the
data in memory,
and dump at the end of the run. Since it seems that you need a full
array, even when
appending a few bytes, I don't think this is really practical, or good
on the memory use.
I guess it is possible to call the write routine with a different
memory space, but that
part of the documentation is quite bad.

thanks anyway.

Maarten

Report message to a moderator

[Message index]

		Appending data to a dataset in an HDF5 file By: Maarten[1] on Wed, 31 January 2007 08:40
		Re: Appending data to a dataset in an HDF5 file By: eddie haskell on Fri, 02 February 2007 07:54
		Re: Appending data to a dataset in an HDF5 file By: Maarten[1] on Mon, 05 February 2007 02:35
		Re: Appending data to a dataset in an HDF5 file By: Maarten[1] on Fri, 02 February 2007 00:50
		Re: Appending data to a dataset in an HDF5 file By: eddie haskell on Thu, 01 February 2007 08:51
		Re: Appending data to a dataset in an HDF5 file By: David Fanning on Mon, 05 February 2007 05:22

Previous Topic:	IDL job opportunities
Next Topic:	image mapping

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Fri Oct 10 01:19:36 PDT 2025

Total time taken to generate the page: 0.39664 seconds