comp.lang.idl-pvwave archive: archive » Re: Speeding up multiple file reading

Home » Public Forums » archive » Re: Speeding up multiple file reading

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: Speeding up multiple file reading [message #47256 is a reply to message #47255]

Thu, 02 February 2006 07:44

David Fanning
Messages: 11724
Registered: August 2001

Senior Member

clivecook59@gmail.com writes:

> I have a program where i need to read in multiple files. Currently i
> read in 6000 binary files using a function i have written. This reads
> three columns of data out of each file. To do this i use a loop that
> calls the function to read a file who's data is then added to an array.
> At the moment it takes around 90 seconds to go through the 6000 files.
> Is there any way that i can read this data not using a loop? Or at
> least are there any tips for speeding this up?

What does your code look like for reading the three columns
of data? This is likely to be the weakest link in your process.

Cheers,

David

--
David Fanning, Ph.D.
Fanning Software Consulting, Inc.
Coyote's Guide to IDL Programming: http://www.dfanning.com/

Report message to a moderator

[Message index]

		Re: Speeding up multiple file reading By: JD Smith on Thu, 02 February 2006 08:56
		Re: Speeding up multiple file reading By: David Fanning on Thu, 02 February 2006 08:50
		Re: Speeding up multiple file reading By: clivecook59 on Thu, 02 February 2006 08:42
		Re: Speeding up multiple file reading By: David Fanning on Thu, 02 February 2006 08:15
		Re: Speeding up multiple file reading By: clivecook59 on Thu, 02 February 2006 08:08
		Re: Speeding up multiple file reading By: Maarten[1] on Thu, 02 February 2006 07:48
		Re: Speeding up multiple file reading By: David Fanning on Thu, 02 February 2006 07:44
		Re: Speeding up multiple file reading By: Paul Van Delst[1] on Thu, 02 February 2006 09:53
		Re: Speeding up multiple file reading By: news.qwest.net on Thu, 02 February 2006 09:51

Previous Topic:	Re: Array slices
Next Topic:	alternative to execute

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Fri Oct 10 01:33:13 PDT 2025

Total time taken to generate the page: 0.04032 seconds