comp.lang.idl-pvwave archive: archive » Best form factor for a NetCDF package of a dataset

Home » Public Forums » archive » Best form factor for a NetCDF package of a dataset

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Best form factor for a NetCDF package of a dataset [message #67251]

Fri, 17 July 2009 17:08

MarioIncandenza
Messages: 231
Registered: February 2005

Senior Member

Hello data wizards,

I have a largish dataset that I have been tossing around in ASCII, but
now have been asked to package as NetCDF. It consists of hourly model
output (8 variables) at 1-degree resolution. The catch is that for any
given hour, there is no data for ~90% of the globe. Thus, to package
the data as grids would waste a lot of space on zeroes. However, if I
simply package it in a "list" form, the amount of data in each file
will vary, and that may create headaches for people using it.

The "list" form would be analogous to HDF-EOS "Swath" products, which
I have used successfully. The "grid" form would be, well, a grid.

As data users, how strongly do you prefer data in simple grids? Would
you be willing to accept 8x the data volume (compressed) in exchange
for a simpler format?

Looking to collect $0.02,

--Edward H.

Report message to a moderator

[Message index]

Best form factor for a NetCDF package of a dataset

By: MarioIncandenza on Fri, 17 July 2009 17:08

Previous Topic:	IDL Software Engineer open position
Next Topic:	Re: SIZE() vs. N_ELEMENTS()

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Fri Oct 10 00:04:48 PDT 2025

Total time taken to generate the page: 1.11876 seconds