comp.lang.idl-pvwave archive: archive » Re: Reading a very large ascii data file

Home » Public Forums » archive » Re: Reading a very large ascii data file

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: Reading a very large ascii data file [message #26447 is a reply to message #26445]

Fri, 24 August 2001 11:11

Paul van Delst
Messages: 364
Registered: March 1997

Senior Member

Mirko Vukovic wrote:
>
> I am reading some large ascii data files in csv (comma separated
> fields) format, and would like to speed the process up.
>
> I recall someone discussing reading such files as binaries and then
> converting to ascii after finding line breaks, but was un-able to find
> the discussion on the group.
>
> Can anyone offer pointers, code, or suggestions on who might have
> discussed it (so that I can look again on the newsgroup).

Can you provide more information about your data files? E.g. are the number of columns
fixed? Are the number of lines fixed? If not, is there a maximum number of lines which the
files won't exceed?

Try the DDREAD.PRO and associated IDL code. Have a look at

http://www.dfanning.com/tips/unknown_rows.html

for some issues and a link to the source code.

paulv

--
Paul van Delst A little learning is a dangerous thing;
CIMSS @ NOAA/NCEP Drink deep, or taste not the Pierian spring;
Ph: (301)763-8000 x7274 There shallow draughts intoxicate the brain,
Fax:(301)763-8545 And drinking largely sobers us again.
Alexander Pope.

Report message to a moderator

[Message index]

		Re: Reading a very large ascii data file By: mvukovic on Tue, 28 August 2001 08:07
		Re: Reading a very large ascii data file By: R.Bauer on Sat, 25 August 2001 04:34
		Re: Reading a very large ascii data file By: R.Bauer on Sat, 25 August 2001 04:32
		Re: Reading a very large ascii data file By: mvukovic on Fri, 24 August 2001 15:22
		Re: Reading a very large ascii data file By: Paul van Delst on Fri, 24 August 2001 11:11
		Re: Reading a very large ascii data file By: Martin Schultz on Fri, 24 August 2001 11:01

Previous Topic:	Dataminer and mySQL?
Next Topic:	Now you can process your image(s) with CWT algorithm for FREE !

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Wed Oct 08 19:02:54 PDT 2025

Total time taken to generate the page: 0.00437 seconds