Re: ASSOC vs SHMMAP vs POINT_LUNs vs READ_BINARY? [message #68947] |
Mon, 07 December 2009 09:58 |
mankoff
Messages: 131 Registered: March 2004
|
Senior Member |
|
|
On Dec 7, 7:54 am, Dave Higgins <higgins.da...@gmail.com> wrote:
> I have a large multidimensional array. I want to sort it, without
> doubling the memory requirement by making a same-size array and
> copying data over, sections at a time.
>
> I hear about:
> - ASSOC? But the raw data is not in large consecutive chunks. Does
> this preclude its use?
> - SHMMAP? Seems very low-level and risky without experience.
> - READU and lots of POINT_LUNs? Would this execute slowly?
> - READ_BINARY with the TEMPLATE keyword? I should like to hard-code
> the template rather than use the BINARY_TEMPLATE GUI. I suppose this
> is possible?
>
> I am guessing that READ_BINARY with TEMPLATE is the best option, to
> read in the data in a sorted manner straight away, assuming I can
> write my own template so no user interaction is required. Is this
> right? Thanks in advance.
> Dave
ASSOC can work as long as your chunks are regular. If your chunks are
small you can read multiple. For example, what is written as float
twice could be read as a FLTARR(2).
I think SHMMAP would require some other process (IDL or other
language) to read. I don't see any reason to use this.
Not sure about the others.
-k.
|
|
|