comp.lang.idl-pvwave archive: archive » Re: Processing getting slower and slower?

Home » Public Forums » archive » Re: Processing getting slower and slower?

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: Processing getting slower and slower? [message #47814 is a reply to message #47813]

Mon, 06 March 2006 09:02

David Fanning
Messages: 11724
Registered: August 2001

Senior Member

Zoltan Bartalis writes:

> I am processing satellite data with IDL, involving reading in data,
> processing it, storing it in several buffer arrays and writing (appending)
> it to lots of binary files (about one million) as soon as any of the buffers
> is full. Without going into more details, a more general question: has
> anyone encountered that while going through several processing cycles
> involving intensive file opening, writing and closing, the processing gets
> slower and slower for each cycle, although the operations in each cycle are
> more or less the same? I am declaring all the buffer arrays and other needed
> variables _before_ looping through the read-in of the input data files, so I
> would expect no change in the memory usage from cycle to cycle. Is this an
> IDL issue or a platform one? Running under Windows XP.

This sounds like a memory-paging-to-disk problem to me.
Are you sure you are destroying/releasing the buffer
memory when you are finished with it?

Cheers,

David

--
David Fanning, Ph.D.
Fanning Software Consulting, Inc.
Coyote's Guide to IDL Programming: http://www.dfanning.com/

Report message to a moderator

[Message index]

		Re: Processing getting slower and slower? By: Foldy Lajos on Mon, 06 March 2006 09:13
		Re: Processing getting slower and slower? By: David Fanning on Mon, 06 March 2006 09:02

Previous Topic:	Make exception when using broden/newton function
Next Topic:	Fractional Pixels Origin?

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Fri Oct 10 05:48:29 PDT 2025

Total time taken to generate the page: 0.72209 seconds