comp.lang.idl-pvwave archive: archive » Re: Read large ascii file quickly

Home » Public Forums » archive » Re: Read large ascii file quickly

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: Read large ascii file quickly [message #74296 is a reply to message #74295]

Thu, 06 January 2011 14:52

Kenneth P. Bowman
Messages: 585
Registered: May 2000

Senior Member

In article
<d68424af-61e3-45f0-a7f9-09f05ec6d55e@glegroupsg2000goo.googlegroups.com
> ,
Paul Magdon <paulmagdon@yahoo.de> wrote:

> I have to read a large ascii file (2.5e+07 lines) into a 5000x5000 intarr.
> The code below works fine but it takes roughly 15-20min on my machine( not the oldest :) ).
> Any suggestions how to accelerate this?

Read it one time and then write it out in some reasonable binary
format (e.g., netCDF or plain binary).

Ken Bowman

Report message to a moderator

[Message index]

		Re: Read large ascii file quickly By: Kenneth P. Bowman on Sun, 09 January 2011 12:08
		Re: Read large ascii file quickly By: David Fanning on Fri, 07 January 2011 15:19
		Re: Read large ascii file quickly By: Kenneth P. Bowman on Fri, 07 January 2011 14:40
		Re: Read large ascii file quickly By: jeanh on Fri, 07 January 2011 09:11
		Re: Read large ascii file quickly By: David Fanning on Fri, 07 January 2011 07:15
		Re: Read large ascii file quickly By: edward.s.meinel@aero. on Fri, 07 January 2011 06:39
		Re: Read large ascii file quickly By: penteado on Fri, 07 January 2011 04:27
		Re: Read large ascii file quickly By: Paul Magdon on Fri, 07 January 2011 04:01
		Re: Read large ascii file quickly By: MC on Fri, 07 January 2011 02:29
		Re: Read large ascii file quickly By: David Fanning on Thu, 06 January 2011 16:06
		Re: Read large ascii file quickly By: penteado on Thu, 06 January 2011 15:29
		Re: Read large ascii file quickly By: David Fanning on Thu, 06 January 2011 15:06
		Re: Read large ascii file quickly By: Kenneth P. Bowman on Thu, 06 January 2011 14:52
		Re: Read large ascii file quickly By: Paul Magdon on Thu, 06 January 2011 14:54
		Re: Read large ascii file quickly By: penteado on Thu, 06 January 2011 14:20
		Re: Read large ascii file quickly By: jeanh on Thu, 06 January 2011 14:07
		Re: Read large ascii file quickly By: penteado on Thu, 06 January 2011 13:57
		Re: Read large ascii file quickly By: penteado on Thu, 06 January 2011 13:53

Previous Topic:	Re: reading portions of a large binary file
Next Topic:	Re: Fitting an ellipsoid with MPFITEXPR

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Fri Oct 10 10:08:12 PDT 2025

Total time taken to generate the page: 0.88057 seconds