| Large File Plotting [message #21890] |
Thu, 28 September 2000 00:00  |
Mark Przeslawski
Messages: 1
Registered: September 2000
|
Junior Member |
|
|
Does anyone have an example of plotting
very large time history data files. I tried
creating a 1 million point file and it plotted
okay. I tried a 10 million point file with
various plotting routines and it hung my
Windows 2000 machine (PIII, 700MHz,
256Mb RAM). I tried plot, live_plot,
and some of the coyote plotting
routines to no avail. What is needed is
something that can detect file size and
only display to the pixel resolution of the
screen.
Also, does anyone have experience pushing
this size data through the signal processing
routines? These are not atypical file sizes
that I need to handle.
Thanks,
Mark Przeslawski
nCode International
|
|
|
|
| Re: Large File Plotting [message #21933 is a reply to message #21890] |
Fri, 06 October 2000 00:00  |
John-David T. Smith
Messages: 384
Registered: January 2000
|
Senior Member |
|
|
Mark Przeslawski wrote:
>
> Does anyone have an example of plotting
> very large time history data files. I tried
> creating a 1 million point file and it plotted
> okay. I tried a 10 million point file with
> various plotting routines and it hung my
> Windows 2000 machine (PIII, 700MHz,
> 256Mb RAM). I tried plot, live_plot,
> and some of the coyote plotting
> routines to no avail. What is needed is
> something that can detect file size and
> only display to the pixel resolution of the
> screen.
>
> Also, does anyone have experience pushing
> this size data through the signal processing
> routines? These are not atypical file sizes
> that I need to handle.
With this many points, 2-d plots will simply not convey the information
contained in the data, no matter what the display medium. You could
indeed use averaging or exclusion techniques to reduce the number of
points plotted. A better technique in many cases is to convert your 2d
value vs. time data into a 3-d value-time-density image, where density
is the number density, i.e. dN/dvdt. You generate the density by
binning into an appropriate number of 2d time*value elements, including
estimated errors if necessary (individual points smeared out with
varying weight over several bins). This image can be displayed inside
of the plot region using whatever colormap and scaling suits you, or
even with a contour map.
Good luck,
JD
--
J.D. Smith | WORK: (607) 255-6263
Cornell Dept. of Astronomy | (607) 255-5842
304 Space Sciences Bldg. | FAX: (607) 255-5875
Ithaca, NY 14853 |
|
|
|
|
comp.lang.idl-pvwave archive
Members
Search
Help
Login
Home
