New Tools for Creating, Browsing, and Reading netCDF Files [message #69844] |
Wed, 17 February 2010 07:48  |
David Fanning
Messages: 11724 Registered: August 2001
|
Senior Member |
|
|
Folks,
I have a general need to be able to create, browse, and write
netCDF files in an extremely flexible way. In particular, I
want to be able to copy variables and attributes from one
file to another without thinking too much about it.
To this end, I have borrowed heavily (well, I stole most of
the good ideas, really) from Mark Hadfield's Motley Library
and its wonderful netCDF routines.
http://www.dfanning.com/hadfield/IDL/README.html
When I started this project, I thought Mark's routines could
use more documentation and error handling. When I finished,
I realized I hadn't added much value to what Mark had already
provided. But, of course, hindsight is 20-20. I have learned
a lot about netCDF files in the past month or so, and certainly
enough to know I am probably going to be surprised in the future
by how little I know.
In any case, the new programs I have written have provided
me with some new tools for working with netCDF files and I
thought they might be of interest to a wider audience.
http://www.dfanning.com/progrms/ncdf_tools.zip
Because most of these tools are written as objects, and because
that scares the bejesus out of many IDL users, I have provided
an example file, NCDF_File_Examples, that shows you exactly
how to create a netCDF file, copy some of the contents to
another netCDF file, and then read the netCDF file to do
something useful in IDL.
http://www.dfanning.com/programs/ncdf_file_examples.pro
I have been particularly careful to document these
routines so they can be used by a wider audience.
In addition to Mark, I have been greatly enlightened in my
netCDF studies by IDL newsgroup regulars Paul van Delst and
Ken Bowman. I am exceedingly grateful to them and to all of
you who pester me with questions and suggestions for
improvement. Even though I already have a wife, I appreciate
you, too. :-)
Cheers,
David
--
David Fanning, Ph.D.
Fanning Software Consulting, Inc.
Coyote's Guide to IDL Programming: http://www.dfanning.com/
Sepore ma de ni thui. ("Perhaps thou speakest truth.")
|
|
|
|
Re: New Tools for Creating, Browsing, and Reading netCDF Files [message #69943 is a reply to message #69844] |
Tue, 23 February 2010 08:02   |
Paul Van Delst[1]
Messages: 1157 Registered: April 2002
|
Senior Member |
|
|
mgalloy wrote:
> On 2/22/10 10:40 AM, Paul van Delst wrote:
>> David Fanning wrote:
>>> Mark writes:
>>>
>>>> http://www.dfanning.com/programs/ncdf_tools.zip !!!!!!!!!!!!!
>>>
>>> I could put them in a tarball for you, but I have to ask
>>> myself, "Why am I doing all the work around here!?"
>>
>> With a subversion repository, you wouldn't be. Users would be
>> responsible for upgrading
>> their own working copies.
>>
>>> I'm going to talk to Mike Galloy at this week's IDL
>>> User's Group meeting. He has a nice Subversion solution
>>> for me if I would just get off my duff and use it. It
>>> involves learning something new, which I am REALLY
>>> loath to do. :-)
>>
>> It's not a perfect system, but I have to say that I found using
>> subversion was one of
>> those rare experiences where you think "Why can't everything work this
>> well?" It really is
>> a tool that will make you life easier. And, while the learning curve
>> isn't flat, it's not
>> that steep. It's a good mix of functionality and ease-of-use for those
>> of us who aren't
>> hard-core software engineering types.
>>
>> Couple it with a SCM tool (e.g. http://www.edgewall.com/trac. I use it
>> here and I believe
>> MikeG uses that for his idldoc stuff) and you'll be set! :o)
>
> Yes, I have Trac and svn setup and ready to go!
The is OT, but do you use different repositories for your different projects? I noticed
the unit testing project revision numbers are much lower than those for your idldoc
project? I presume that was done so you could use an externals defn for various projects
to see others (like you did in your unit test project for idldoc)?
Currently, we have your entire library explicitly checked into our repository. I will soon
move that to externals definitions of a tag+revision# - do you have a list (or a link to a
list) of your trac/svn project URLs on your blog? Or do they all use the same URL naming
convention?
cheers,
paulv
|
|
|
Re: New Tools for Creating, Browsing, and Reading netCDF Files [message #69945 is a reply to message #69844] |
Mon, 22 February 2010 13:11   |
Michael Galloy
Messages: 1114 Registered: April 2006
|
Senior Member |
|
|
On 2/21/10 7:32 PM, David Fanning wrote:
> Mark writes:
>
>> http://www.dfanning.com/programs/ncdf_tools.zip !!!!!!!!!!!!!
>
> I could put them in a tarball for you, but I have to ask
> myself, "Why am I doing all the work around here!?"
>
> I'm going to talk to Mike Galloy at this week's IDL
> User's Group meeting. He has a nice Subversion solution
> for me if I would just get off my duff and use it. It
> involves learning something new, which I am REALLY
> loath to do. :-)
I definitely want to talk to you about this. Also, there are community
related aspects to this that I think would be good fodder for the round
table discussion on Tuesday. I assume you will be there on Tuesday also?
> Cheers,
>
> David
>
> P.S. Anyway, don't download them yet. I just finished my
> presentation preparation and I have a slew of new programs
> to upload, including a new one for the NCDF_Tools.zip file. ;-)
>
Mike
--
www.michaelgalloy.com
Research Mathematician
Tech-X Corporation
|
|
|
Re: New Tools for Creating, Browsing, and Reading netCDF Files [message #69946 is a reply to message #69844] |
Mon, 22 February 2010 13:11   |
Michael Galloy
Messages: 1114 Registered: April 2006
|
Senior Member |
|
|
On 2/22/10 10:40 AM, Paul van Delst wrote:
> David Fanning wrote:
>> Mark writes:
>>
>>> http://www.dfanning.com/programs/ncdf_tools.zip !!!!!!!!!!!!!
>>
>> I could put them in a tarball for you, but I have to ask
>> myself, "Why am I doing all the work around here!?"
>
> With a subversion repository, you wouldn't be. Users would be responsible for upgrading
> their own working copies.
>
>> I'm going to talk to Mike Galloy at this week's IDL
>> User's Group meeting. He has a nice Subversion solution
>> for me if I would just get off my duff and use it. It
>> involves learning something new, which I am REALLY
>> loath to do. :-)
>
> It's not a perfect system, but I have to say that I found using subversion was one of
> those rare experiences where you think "Why can't everything work this well?" It really is
> a tool that will make you life easier. And, while the learning curve isn't flat, it's not
> that steep. It's a good mix of functionality and ease-of-use for those of us who aren't
> hard-core software engineering types.
>
> Couple it with a SCM tool (e.g. http://www.edgewall.com/trac. I use it here and I believe
> MikeG uses that for his idldoc stuff) and you'll be set! :o)
Yes, I have Trac and svn setup and ready to go!
Mike
--
www.michaelgalloy.com
Research Mathematician
Tech-X Corporation
|
|
|
Re: New Tools for Creating, Browsing, and Reading netCDF Files [message #69951 is a reply to message #69844] |
Mon, 22 February 2010 09:40   |
Paul Van Delst[1]
Messages: 1157 Registered: April 2002
|
Senior Member |
|
|
David Fanning wrote:
> Mark writes:
>
>> http://www.dfanning.com/programs/ncdf_tools.zip !!!!!!!!!!!!!
>
> I could put them in a tarball for you, but I have to ask
> myself, "Why am I doing all the work around here!?"
With a subversion repository, you wouldn't be. Users would be responsible for upgrading
their own working copies.
> I'm going to talk to Mike Galloy at this week's IDL
> User's Group meeting. He has a nice Subversion solution
> for me if I would just get off my duff and use it. It
> involves learning something new, which I am REALLY
> loath to do. :-)
It's not a perfect system, but I have to say that I found using subversion was one of
those rare experiences where you think "Why can't everything work this well?" It really is
a tool that will make you life easier. And, while the learning curve isn't flat, it's not
that steep. It's a good mix of functionality and ease-of-use for those of us who aren't
hard-core software engineering types.
Couple it with a SCM tool (e.g. http://www.edgewall.com/trac. I use it here and I believe
MikeG uses that for his idldoc stuff) and you'll be set! :o)
cheers,
paulv
|
|
|
Re: New Tools for Creating, Browsing, and Reading netCDF Files [message #69956 is a reply to message #69844] |
Sun, 21 February 2010 18:32   |
David Fanning
Messages: 11724 Registered: August 2001
|
Senior Member |
|
|
Mark writes:
> http://www.dfanning.com/programs/ncdf_tools.zip !!!!!!!!!!!!!
I could put them in a tarball for you, but I have to ask
myself, "Why am I doing all the work around here!?"
I'm going to talk to Mike Galloy at this week's IDL
User's Group meeting. He has a nice Subversion solution
for me if I would just get off my duff and use it. It
involves learning something new, which I am REALLY
loath to do. :-)
Cheers,
David
P.S. Anyway, don't download them yet. I just finished my
presentation preparation and I have a slew of new programs
to upload, including a new one for the NCDF_Tools.zip file. ;-)
--
David Fanning, Ph.D.
Fanning Software Consulting, Inc.
Coyote's Guide to IDL Programming: http://www.dfanning.com/
Sepore ma de ni thui. ("Perhaps thou speakest truth.")
|
|
|
|
|
Re: New Tools for Creating, Browsing, and Reading netCDF Files [message #69983 is a reply to message #69844] |
Thu, 04 March 2010 06:37  |
R.Bauer
Messages: 1424 Registered: November 1998
|
Senior Member |
|
|
David Fanning schrieb:
> Folks,
>
> I have a general need to be able to create, browse, and write
> netCDF files in an extremely flexible way. In particular, I
> want to be able to copy variables and attributes from one
> file to another without thinking too much about it.
>
> To this end, I have borrowed heavily (well, I stole most of
> the good ideas, really) from Mark Hadfield's Motley Library
> and its wonderful netCDF routines.
>
> http://www.dfanning.com/hadfield/IDL/README.html
in case you don't know i get currently
Not Found
The requested URL /hadfield/IDL/README.html was not found on this server.
|
|
|
Re: New Tools for Creating, Browsing, and Reading netCDF Files [message #69984 is a reply to message #69951] |
Thu, 04 March 2010 06:36  |
R.Bauer
Messages: 1424 Registered: November 1998
|
Senior Member |
|
|
Paul van Delst schrieb:
> David Fanning wrote:
>> Mark writes:
>>
>>> http://www.dfanning.com/programs/ncdf_tools.zip !!!!!!!!!!!!!
>> I could put them in a tarball for you, but I have to ask
>> myself, "Why am I doing all the work around here!?"
>
> With a subversion repository, you wouldn't be. Users would be responsible for upgrading
> their own working copies.
>
>> I'm going to talk to Mike Galloy at this week's IDL
>> User's Group meeting. He has a nice Subversion solution
>> for me if I would just get off my duff and use it. It
>> involves learning something new, which I am REALLY
>> loath to do. :-)
May be use mercurial. http://mercurial.selenic.com/
It is much easier to handle and you don't rely on only one server.
>
> It's not a perfect system, but I have to say that I found using subversion was one of
> those rare experiences where you think "Why can't everything work this well?" It really is
> a tool that will make you life easier. And, while the learning curve isn't flat, it's not
> that steep. It's a good mix of functionality and ease-of-use for those of us who aren't
> hard-core software engineering types.
>
working with a distributed source control management tool is more fun ;)
cheers
Reimar
> Couple it with a SCM tool (e.g. http://www.edgewall.com/trac. I use it here and I believe
> MikeG uses that for his idldoc stuff) and you'll be set! :o)
>
> cheers,
>
> paulv
|
|
|