comp.lang.idl-pvwave archive: archive » Re: How to make large array

Home » Public Forums » archive » Re: How to make large array

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: How to make large array [message #24436]

Thu, 29 March 2001 00:36

Martin Schultz
Messages: 515
Registered: August 1997

Senior Member

renjie wrote:
>
> I tried to make large array, however, in Windows,
> the largest I can made is 256MB, and in Unix is 1 GB,
> it's supposed that the limitation is 2GB, do you have any
> idea about the largest array in IDL?

Hmmmm. First of all, I don't think it is necessary to create arrays
larger than a couple of MBs in memory. And they get really clumsy and
slow: you must be extremely careful about when do you pass something
by reference or by value and when IDL will make a temporary copy of
the array. Think hard whether you can come up with a solution where
most of the data resides in a file and is only accessed piecewise.

Second, I recall that Erik Korpela
(http://albert.ssl.berkeley.edu/~korpela/mmap/) wrote some stuff to
allow memory mapping of IDL arrays. From his web page it seems like
this would solve your problems in a very nice way.

Good luck,

Martin

--
[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[ [[[[[[[
[[ Dr. Martin Schultz Max-Planck-Institut fuer Meteorologie [[
[[ Bundesstr. 55, 20146 Hamburg [[
[[ phone: +49 40 41173-308 [[
[[ fax: +49 40 41173-298 [[
[[ martin.schultz@dkrz.de [[
[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[[ [[[[[[[

Report message to a moderator

[Message index]

		Re: How to make large array By: Martin Schultz on Thu, 29 March 2001 00:36
		Re: How to make large array By: Craig Markwardt on Wed, 28 March 2001 14:53
		Re: How to make large array By: renjie on Wed, 28 March 2001 13:21
		Re: How to make large array By: Mark Hadfield on Wed, 28 March 2001 13:00
		Re: How to make large array By: renjie on Wed, 28 March 2001 10:33
		Re: How to make large array By: renjie on Wed, 28 March 2001 10:09
		Re: How to make large array By: renjie on Wed, 28 March 2001 10:03
		Re: How to make large array By: Alex Schuster on Wed, 28 March 2001 08:31

Previous Topic:	Re: Truncated save file?
Next Topic:	Streamlining

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Wed Oct 08 17:00:28 PDT 2025

Total time taken to generate the page: 0.00407 seconds