Re: problems plotting LARGE amounts of 2D data? [message #1842 is a reply to message #1728] |
Wed, 02 March 1994 10:17  |
mcheng
Messages: 4 Registered: February 1994
|
Junior Member |
|
|
> In article <thompson.762034802@serts.gsfc.nasa.gov> thompson@serts.gsfc.nasa.gov (William Thompson) writes:
> Somebody else mailed me privately that he thought that you were probably
> talking about database management techniques, rather than memory management
> once data had already been read into arrays. I don't know how the other
> packages you mentioned work, but I can comment on how this applies to IDL.
> ...
> It reads in what you tell
> it, whether that's an entire file all at once or piece by piece, because you've
> written an old-fashioned program to do just what you wanted to do. You have
> complete control and complete responsibility. :^)
Quite a few people have emailed me about this capability of IDL, which
I was not aware before my posting. Thanks to all who replied.
The application I have in mind is to explore a few large data files
by interactively scrolling and zooming their graphs. The combined sizes
of the files are greater than the amount of main memory. What
I want to do is to say, "plot", "zoom", or "scroll", and watch the
results appear quickly. But it seems that I have only 2 choices now:
1) Write my own program to do read data a bit at a time, effectively
doing my own memory management
2) Rely on the operating system's own virtual memory, which can be very slow.
In my previous posting I hinted at database memory managment because
a lot of research has been directed to eliminating 1) and 2) above.
Databases circumvent the operating system's own memory management
policies and implement their own policies for database queries.
In effect, I was asking if there is already something out there that
will try to do the same for me, except that my application is
"plot", "scroll", and "zoom".
Mike
|
|
|