comp.lang.idl-pvwave archive: archive

Home » Public Forums » archive » Re: Read Large files

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: Read Large files [message #81230 is a reply to message #81229]

Tue, 28 August 2012 10:28

David Fanning
Messages: 11724
Registered: August 2001

Senior Member

Gompie writes:

> I want to read in 58 gb of data that is spread over several files ( having records)of size ranging from 7.6gb to 1gb.
> What is the fastest way to read these data files.
> Right now I read in each data record and it takes 6 hrs to do the reading.

I would think the fastest way would be to write a letter
to the Minister of Technology outlining why you need
a new, more powerful machine ASAP.

Cheers,

David

--
David Fanning, Ph.D.
Fanning Software Consulting, Inc.
Coyote's Guide to IDL Programming: http://www.idlcoyote.com/
Sepore ma de ni thui. ("Perhaps thou speakest truth.")

Report message to a moderator

[Message index]

		Re: Read Large files By: wlandsman on Tue, 28 August 2012 11:23
		Re: Read Large files By: David Fanning on Tue, 28 August 2012 10:28
		Re: Read Large files By: Gompie on Fri, 31 August 2012 18:29

Previous Topic:	Geodetic functions library GeoDLL 32 Bit and 64 Bit
Next Topic:	very simple but weird problem with CONTOUR

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Wed Oct 08 19:19:55 PDT 2025

Total time taken to generate the page: 0.00417 seconds