comp.lang.idl-pvwave archive: archive

Home » Public Forums » archive » Large data sets

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Large data sets [message #24933]

Fri, 04 May 2001 03:14

Neil Talsania
Messages: 7
Registered: January 2001

Junior Member

Hi,
I am new to IDL, and everything that I have done so far works great on
small data sets. But, I dont know how to use it for a large (>2 gig)
dataset, as I obviously just cant load that into an array. The data is on
disk and can either be tiled so that it is stored in 1024x1024 segments, or
it is stripped which is one complete row at a time. Even a complete row is
large (>80000 samples).

Any thoughts as to how I would be able to use this data?

Another question: is there thread support in IDL? I have a machine with 18
processors, so it sure would be nice to process this large dataset in 18
parallel threads. Any suggestions?

Thanks
Neil Talsania

Report message to a moderator

[Message index]

Large data sets

By: Neil Talsania on Fri, 04 May 2001 03:14

Previous Topic:	Optical Flow
Next Topic:	Re: write_ppm (newbie)

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Thu Oct 09 07:24:06 PDT 2025

Total time taken to generate the page: 0.00504 seconds