comp.lang.idl-pvwave archive: archive » Re: Read large ascii file quickly

Home » Public Forums » archive » Re: Read large ascii file quickly

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: Read large ascii file quickly [message #74288 is a reply to message #74287]

Fri, 07 January 2011 06:39

edward.s.meinel@aero. is currently offline

edward.s.meinel@aero.
Messages: 52
Registered: February 2005

Member

On Jan 6, 4:39 pm, Paul Magdon <paulmag...@yahoo.de> wrote:
> Dear all,
> I have to read a large ascii file (2.5e+07 lines) into a 5000x5000 intarr. The code below works fine but it takes roughly 15-20min on my machine( not the oldest :) ). Any suggestions how to accelerate this?
>
> CODE:
>
> OPENR, unit, file, /GET_LUN
>
> result = INTARR(5000,5000, /NOZERO)
> count=0d
> WHILE (NOT EOF(unit)) DO BEGIN
> READF, unit, a,b,c,d,e,f
> print, count
> result(count) =FIX(f)
> count++
> ENDWHILE
>
> CLOSE, unit & FREE_LUN, unit

You could try all of the above suggestions; you could even use
READ_ASCII. But, there is no two ways about it -- reading ascii files
is slow. Always has been, always will be.

Report message to a moderator

[Message index]

		Re: Read large ascii file quickly By: Kenneth P. Bowman on Sun, 09 January 2011 12:08
		Re: Read large ascii file quickly By: David Fanning on Fri, 07 January 2011 15:19
		Re: Read large ascii file quickly By: Kenneth P. Bowman on Fri, 07 January 2011 14:40
		Re: Read large ascii file quickly By: jeanh on Fri, 07 January 2011 09:11
		Re: Read large ascii file quickly By: David Fanning on Fri, 07 January 2011 07:15
		Re: Read large ascii file quickly By: edward.s.meinel@aero. on Fri, 07 January 2011 06:39
		Re: Read large ascii file quickly By: penteado on Fri, 07 January 2011 04:27
		Re: Read large ascii file quickly By: Paul Magdon on Fri, 07 January 2011 04:01
		Re: Read large ascii file quickly By: MC on Fri, 07 January 2011 02:29
		Re: Read large ascii file quickly By: David Fanning on Thu, 06 January 2011 16:06
		Re: Read large ascii file quickly By: penteado on Thu, 06 January 2011 15:29
		Re: Read large ascii file quickly By: David Fanning on Thu, 06 January 2011 15:06
		Re: Read large ascii file quickly By: Kenneth P. Bowman on Thu, 06 January 2011 14:52
		Re: Read large ascii file quickly By: Paul Magdon on Thu, 06 January 2011 14:54
		Re: Read large ascii file quickly By: penteado on Thu, 06 January 2011 14:20
		Re: Read large ascii file quickly By: jeanh on Thu, 06 January 2011 14:07
		Re: Read large ascii file quickly By: penteado on Thu, 06 January 2011 13:57
		Re: Read large ascii file quickly By: penteado on Thu, 06 January 2011 13:53

Previous Topic:	Re: reading portions of a large binary file
Next Topic:	Re: Fitting an ellipsoid with MPFITEXPR

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Sat Oct 11 09:35:30 PDT 2025

Total time taken to generate the page: 1.75154 seconds