| Best form factor for a NetCDF package of a dataset [message #67251] |
Fri, 17 July 2009 17:08 |
MarioIncandenza
Messages: 231
Registered: February 2005
|
Senior Member |
|
|
Hello data wizards,
I have a largish dataset that I have been tossing around in ASCII, but
now have been asked to package as NetCDF. It consists of hourly model
output (8 variables) at 1-degree resolution. The catch is that for any
given hour, there is no data for ~90% of the globe. Thus, to package
the data as grids would waste a lot of space on zeroes. However, if I
simply package it in a "list" form, the amount of data in each file
will vary, and that may create headaches for people using it.
The "list" form would be analogous to HDF-EOS "Swath" products, which
I have used successfully. The "grid" form would be, well, a grid.
As data users, how strongly do you prefer data in simple grids? Would
you be willing to accept 8x the data volume (compressed) in exchange
for a simpler format?
Looking to collect $0.02,
--Edward H.
|
|
|
|
comp.lang.idl-pvwave archive
Members
Search
Help
Login
Home
