comp.lang.idl-pvwave archive: archive » Reading h5 dataset by chunks

Home » Public Forums » archive » Reading h5 dataset by chunks

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Reading h5 dataset by chunks [message #93293]

Tue, 07 June 2016 02:33

Nikola
Messages: 53
Registered: November 2009

Member

Gentle folks,

I'm trying to read a dataset from a h5 file by chunks. Let's say that in the file I have dataset called 'temperature' that contains 3D matrix (nx x ny x nz). Normally I use H5D_READ to read the entire dataset/cube at once. Since the dimensions of the cube may be huge (I easily get out of memory), I wonder is it possible to read h5 datasets chunk by chunk (slice by slice for example)? Something like using ASSOC to read large binary files.

I'm lost in the list of h5-related IDL routines. Any help will be appreciated!

Thanks!

Nikola

Report message to a moderator

[Message index]

		Reading h5 dataset by chunks By: Nikola on Tue, 07 June 2016 02:33
		Re: Reading h5 dataset by chunks By: lecacheux.alain on Tue, 07 June 2016 05:53
		Re: Reading h5 dataset by chunks By: Michael Galloy on Thu, 09 June 2016 08:25
		Re: Reading h5 dataset by chunks By: Nikola on Fri, 17 February 2017 01:38

Previous Topic:	Coyote's New Gig
Next Topic:	k-mean clustering idl

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Fri Nov 28 06:25:45 PST 2025

Total time taken to generate the page: 0.00220 seconds