comp.lang.idl-pvwave archive: archive » "Unable to allocate memory" when using H5

Home » Public Forums » archive » "Unable to allocate memory" when using H5_parse iteratively

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: "Unable to allocate memory" when using H5_parse iteratively [message #88395 is a reply to message #88394]

Mon, 21 April 2014 15:09

David Fanning
Messages: 11724
Registered: August 2001

Senior Member

robindesvolcans@gmail.com writes:

> I'm Robin, a new member on this group, using IDL to process satellite images for volcano monitoring.
> I've written a code to process large number of data from the ozone monitoring instrument. These are HDF5 files weighing 28 Mb each.
> The code interactively calls the H5_parse function to open the files
and extract the necessary variables, which undergo some basic processing
(gridding, mapping and calculating the total SO2 mass) The variables are
overwritten at each loop iteration. However after 30-40 iterations the
H5_parse function returns me the unable to allocate memory error
message. It looks as if the H5_parse function was not emptying its
temporary memory use, but when i look at the task manager's display of
the memory use, it stays constant and low (20%).
> Does someone have an idea of how to solve the problem?

You may be overwriting the variables, but it is extremely unlikely you
are cleaning up all the pointers and other heap variables returned by
the H5_Parse function. I would try doing this at the end of each file
processed:

for j=0,whatever do begin
h5data = HD_Parse(file[j])
...
Heap_Free, h5data
endfor

Cheers,

David
--
David Fanning, Ph.D.
Fanning Software Consulting, Inc.
Coyote's Guide to IDL Programming: http://www.idlcoyote.com/
Sepore ma de ni thue. ("Perhaps thou speakest truth.")

Report message to a moderator

[Message index]

		"Unable to allocate memory" when using H5_parse iteratively By: robindesvolcans on Mon, 21 April 2014 14:59
		Re: "Unable to allocate memory" when using H5_parse iteratively By: David Fanning on Mon, 21 April 2014 15:09
		Re: "Unable to allocate memory" when using H5_parse iteratively By: robindesvolcans on Mon, 21 April 2014 16:40
		Re: "Unable to allocate memory" when using H5_parse iteratively By: james.n.sweet on Tue, 13 May 2014 08:20

Previous Topic:	Map pixel areas
Next Topic:	confused about usage of IDLanROI in Itools

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Sun Nov 30 04:21:01 PST 2025

Total time taken to generate the page: 0.00220 seconds