comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado

Home » Public Forums » archive » Re: large source trees and networked paths in 7.0
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend 
Switch to threaded view of this topic Create a new topic Submit Reply
Re: large source trees and networked paths in 7.0 [message #57191] Thu, 06 December 2007 08:19
Paul Van Delst[1] is currently offline  Paul Van Delst[1]
Messages: 1157
Registered: April 2002
Senior Member
Vince Hradil wrote:
> On Dec 5, 7:11 pm, "R.G. Stockwell" <noem...@please.com> wrote:
>> <b_...@hotmail.com> wrote in message
>>

<a whole bunch of stuff>

>
> Not to be rude, but I think you should look into CVS or SVN... ;^)

+1.

:o)

My vote is for subversion of cvs.

google subclipse for an eclipse plugin.
Re: large source trees and networked paths in 7.0 [message #57195 is a reply to message #57191] Thu, 06 December 2007 07:43 Go to previous message
Vince Hradil is currently offline  Vince Hradil
Messages: 574
Registered: December 1999
Senior Member
On Dec 6, 9:34 am, "R.G. Stockwell" <noem...@please.com> wrote:
> "Vince Hradil" <hrad...@yahoo.com> wrote in message
>
> news:ef9a56bb-0e4d-4691-96b1-4118c398162b@l1g2000hsa.googleg roups.com...
>
>> On Dec 5, 7:11 pm, "R.G. Stockwell" <noem...@please.com> wrote:
>>> <b_...@hotmail.com> wrote in message
>
>>> news:4d495e40-e358-411c-8b1f-628008b93be2@e6g2000prf.googleg roups.com...
> ...
>
>> Not to be rude, but I think you should look into CVS or SVN... ;^)
>
> I use source control a lot in other areas (with Labview development mostly),
> just never seemed to need it with IDL, since my 'proprietary in house'
> source control
> is so easy.
>
> Cheers,
> bob

Oh, no... say no more. However, SVN is extremely easy to set up for
yourself. (shh... I do this, don't let this get out, though 8^)
Re: large source trees and networked paths in 7.0 [message #57196 is a reply to message #57195] Thu, 06 December 2007 07:34 Go to previous message
R.G.Stockwell is currently offline  R.G.Stockwell
Messages: 163
Registered: October 2004
Senior Member
"Vince Hradil" <hradilv@yahoo.com> wrote in message
news:ef9a56bb-0e4d-4691-96b1-4118c398162b@l1g2000hsa.googleg roups.com...
> On Dec 5, 7:11 pm, "R.G. Stockwell" <noem...@please.com> wrote:
>> <b_...@hotmail.com> wrote in message
>>
>> news:4d495e40-e358-411c-8b1f-628008b93be2@e6g2000prf.googleg roups.com...
...
>
> Not to be rude, but I think you should look into CVS or SVN... ;^)

I use source control a lot in other areas (with Labview development mostly),
just never seemed to need it with IDL, since my 'proprietary in house'
source control
is so easy.

Cheers,
bob
Re: large source trees and networked paths in 7.0 [message #57223 is a reply to message #57196] Wed, 05 December 2007 18:33 Go to previous message
Vince Hradil is currently offline  Vince Hradil
Messages: 574
Registered: December 1999
Senior Member
On Dec 5, 7:11 pm, "R.G. Stockwell" <noem...@please.com> wrote:
> <b_...@hotmail.com> wrote in message
>
> news:4d495e40-e358-411c-8b1f-628008b93be2@e6g2000prf.googleg roups.com...
>
>> On Dec 5, 3:57 pm, Rick Towler <rick.tow...@nomail.noaa.gov> wrote:
> ...
>> Presumably the Workbench is parsing every file in my (probably too
>> large) IDL source path, and examining files much more thouroughly than
>> previous versions of IDL did which only resolved the path for
>> each .pro file. This will add up to a large burden on my file server,
>> so apparently new users will have to configure the path more
>> restrictively, or set up projects for the specific libraries they want
>> to use. Unless I'm still missing something.
>
> Something like this is a killer for me because of two things.
> 1) I like to use a couple routines from Coyote, a couple from
> the astro lib, a couple from another library (for instance).
> So I will almost always require to have all of my projects open,
> with their hundreds of files that will be processed.
>
> 2) my 'trail of bread crumbs' development is going to be horrible.
> As an example, when I get a new data set, i start with an exploratory main
> routine that simply reads the data, and plots it out. I call it
> "look1.pro'.
> Then I will save it as 'look2.pro' and add some functionality now
> that I can actually see the data. Then 'look3.pro' adds some basic
> error checking, 'look4.pro' puts in some data bounds checking,
> look5.pro will allow keyword based functionality, then i finalize
> it as 'read_QWERTYData.pro'. I put all the old look*.pro routines
> in a ../devel folder so I can dig back into it if i ever need to.
> So a great deal of my code is development - not intended for final
> use, but explicitly stored with the final code so I can find it.
>
> With this setup, I guess I will have to cheat and try to fool IDL7
> into skipping the programs (like renaming them look*.pro_devel or
> something).
>
> Cheers,
> bob

Not to be rude, but I think you should look into CVS or SVN... ;^)
Re: large source trees and networked paths in 7.0 [message #57226 is a reply to message #57223] Wed, 05 December 2007 17:11 Go to previous message
R.G.Stockwell is currently offline  R.G.Stockwell
Messages: 163
Registered: October 2004
Senior Member
<b_gom@hotmail.com> wrote in message
news:4d495e40-e358-411c-8b1f-628008b93be2@e6g2000prf.googleg roups.com...
> On Dec 5, 3:57 pm, Rick Towler <rick.tow...@nomail.noaa.gov> wrote:
...
> Presumably the Workbench is parsing every file in my (probably too
> large) IDL source path, and examining files much more thouroughly than
> previous versions of IDL did which only resolved the path for
> each .pro file. This will add up to a large burden on my file server,
> so apparently new users will have to configure the path more
> restrictively, or set up projects for the specific libraries they want
> to use. Unless I'm still missing something.


Something like this is a killer for me because of two things.
1) I like to use a couple routines from Coyote, a couple from
the astro lib, a couple from another library (for instance).
So I will almost always require to have all of my projects open,
with their hundreds of files that will be processed.

2) my 'trail of bread crumbs' development is going to be horrible.
As an example, when I get a new data set, i start with an exploratory main
routine that simply reads the data, and plots it out. I call it
"look1.pro'.
Then I will save it as 'look2.pro' and add some functionality now
that I can actually see the data. Then 'look3.pro' adds some basic
error checking, 'look4.pro' puts in some data bounds checking,
look5.pro will allow keyword based functionality, then i finalize
it as 'read_QWERTYData.pro'. I put all the old look*.pro routines
in a ../devel folder so I can dig back into it if i ever need to.
So a great deal of my code is development - not intended for final
use, but explicitly stored with the final code so I can find it.

With this setup, I guess I will have to cheat and try to fool IDL7
into skipping the programs (like renaming them look*.pro_devel or
something).

Cheers,
bob
Re: large source trees and networked paths in 7.0 [message #57228 is a reply to message #57226] Wed, 05 December 2007 17:01 Go to previous message
Vince Hradil is currently offline  Vince Hradil
Messages: 574
Registered: December 1999
Senior Member
On Dec 5, 6:37 pm, Doug Edmundson <do...@ittvis.com> wrote:
> b_...@hotmail.com wrote:
>> On Dec 5, 4:29 pm, Doug Edmundson <do...@ittvis.com> wrote:
>>> Suffice it to say the IDL Workbench needs to do a smarter job with the
>>> parsing. There is a plan to improve that module.
>
>> How about an option to disable it?
>
> Yes... that's an option that has been discussed. The downside there,
> obviously, is that a lot nice functionality would become unavailable.
> Ideally we'd make it super fast so one wouldn't feel the need to disable
> it. We'll see.
>
> Cheers,
> Doug

My two cents (more):

What good is "Analyzing code..."?
Well the advantage is if you want to use Content Assistant and Balloon
Help (whatever it's called). However, emacs/idl-pvwave does this just
great using the "catalog" approach.

Even if you disable all of YOUR paths, and just use the Default, the
IDLDE still has to parse the IDL libraries for CA and BH, which can
still take some time.
Re: large source trees and networked paths in 7.0 [message #57231 is a reply to message #57228] Wed, 05 December 2007 16:37 Go to previous message
Doug Edmundson is currently offline  Doug Edmundson
Messages: 58
Registered: November 2005
Member
b_gom@hotmail.com wrote:
> On Dec 5, 4:29 pm, Doug Edmundson <do...@ittvis.com> wrote:
>> Suffice it to say the IDL Workbench needs to do a smarter job with the
>> parsing. There is a plan to improve that module.
>
> How about an option to disable it?

Yes... that's an option that has been discussed. The downside there,
obviously, is that a lot nice functionality would become unavailable.
Ideally we'd make it super fast so one wouldn't feel the need to disable
it. We'll see.

Cheers,
Doug
Re: large source trees and networked paths in 7.0 [message #57233 is a reply to message #57231] Wed, 05 December 2007 16:20 Go to previous message
b_gom is currently offline  b_gom
Messages: 105
Registered: April 2003
Senior Member
On Dec 5, 4:29 pm, Doug Edmundson <do...@ittvis.com> wrote:
>
> Suffice it to say the IDL Workbench needs to do a smarter job with the
> parsing. There is a plan to improve that module.

How about an option to disable it?
Re: large source trees and networked paths in 7.0 [message #57235 is a reply to message #57233] Wed, 05 December 2007 16:09 Go to previous message
b_gom is currently offline  b_gom
Messages: 105
Registered: April 2003
Senior Member
On Dec 5, 3:57 pm, Rick Towler <rick.tow...@nomail.noaa.gov> wrote:

> That's not how I read Doug's email (Re: IDL 7 on LINUX Question dated
> 11/30 @5:55 PST). He states that you can turn off the "Update IDL Path
> Preference" property which will allow IDL 7 to behave like earlier
> versions. I would guess (I haven't installed it yet) that you can unset
> this property, set the path appropriately, never use the projects, and
> write simple programs as before.

Well, I've tried pretending I was a new user in my group. I started
fresh with a new workspace, not defining any other projects, setting
the path to search my normal network source repository, and disabling
the 'Update IDL Path' option in the default project. Now, when I start
IDL, I can access programs from the command line, and write code the
'old fashioned' way. However, I still get the 'Analyzing Code'
progress bar which never goes away, and the network usage which stays
at ~170KB/s for as long as I care to wait.

Presumably the Workbench is parsing every file in my (probably too
large) IDL source path, and examining files much more thouroughly than
previous versions of IDL did which only resolved the path for
each .pro file. This will add up to a large burden on my file server,
so apparently new users will have to configure the path more
restrictively, or set up projects for the specific libraries they want
to use. Unless I'm still missing something.

Is there a way to disable the other fancy features in the Workbench,
which require parsing all the procedures in the path?

If not, I'm suspecting that I will have to define a set of projects
with linked resources, for all the groups of library functions that
new users are likely to need, and put these in a project folder in my
networked source tree. New users will have these projects included in
their default workspace, and will need to open the appropriate library
projects depending on what they are doing, and close them to conserve
bandwith (and a lot of CPU cycles).

(However, I've also noticed that when I close a project with a linked
path in it, and the 'Update IDL Path' option is enabled for that
project, the Workbench continues to parse the contained procedures and
the path isn't removed from the !PATH variable. This doesn't seem
right. In other words, when I open the project, the paths are added
to !PATH, but when I close the project, the paths aren't removed.)

The other option is to set up a CVS server and use the new CVS
features, but this isn't very attractive from a simplicity point of
view either.
Re: large source trees and networked paths in 7.0 [message #57249 is a reply to message #57235] Wed, 05 December 2007 15:29 Go to previous message
Doug Edmundson is currently offline  Doug Edmundson
Messages: 58
Registered: November 2005
Member
Rick Towler wrote:
> b_gom wrote:
>
>> Also, this will effectively force all users
>> to setup a workspace and juggle projects for all the libraries, which
>> means I can't just tell new users who just write simple programs to
>> ignore the projects\workspace features.
>
> That's not how I read Doug's email (Re: IDL 7 on LINUX Question dated
> 11/30 @5:55 PST). He states that you can turn off the "Update IDL Path
> Preference" property which will allow IDL 7 to behave like earlier
> versions. I would guess (I haven't installed it yet) that you can unset
> this property, set the path appropriately, never use the projects, and
> write simple programs as before.
>
> -Rick
>

When the "Update IDL Path Preference" property is turned off, the IDL
Workbench won't add/remove projects to your path, but it will still try
and parse all your PRO code in !path, open projects, open editors and
current directory. Path management and construction of the PRO code
database are distinct. The former can be turned off via that project
property; the latter can't.

The only way I can see to minimize this is what I think already has been
suggested. Namely, have the IDL Workbench manage your path (at least
with respect to the large libraries) and close those large library
projects that are not being used. Closed projects are not parsed.
Unfortunately this may not be a practical option, but it's something to
consider.

Suffice it to say the IDL Workbench needs to do a smarter job with the
parsing. There is a plan to improve that module.

Doug
Re: large source trees and networked paths in 7.0 [message #57260 is a reply to message #57249] Wed, 05 December 2007 15:10 Go to previous message
David Fanning is currently offline  David Fanning
Messages: 11724
Registered: August 2001
Senior Member
Rick Towler writes:

> I would guess (I haven't installed it yet) that you can unset
> this property, set the path appropriately, never use the projects, and
> write simple programs as before.

Well, no, I don't think so. It is possible to "Open a File"
in the normal way, but you can't "Save" it anywhere but
into a project folder. So you are going to HAVE to use
projects if you want to do any work in IDL. And the projects
have to be open for you to save a file there.

This was the biggest hurtle for me, because it interrupts
the normal flow of my work. I work with files in the coyote
directory (where they are under version control), but I want
to save them over in my web page directory where I can move
them to my web page. I couldn't save those files anymore.
I had to save them back into Coyote, and go drag them where
I wanted them. That still feels uncomfortable to me.

Cheers,

David
--
David Fanning, Ph.D.
Fanning Software Consulting, Inc.
Coyote's Guide to IDL Programming: http://www.dfanning.com/
Sepore ma de ni thui. ("Perhaps thou speakest truth.")
Re: large source trees and networked paths in 7.0 [message #57263 is a reply to message #57260] Wed, 05 December 2007 15:01 Go to previous message
Vince Hradil is currently offline  Vince Hradil
Messages: 574
Registered: December 1999
Senior Member
On Dec 5, 4:57 pm, Rick Towler <rick.tow...@nomail.noaa.gov> wrote:
> b_gom wrote:
>> Also, this will effectively force all users
>> to setup a workspace and juggle projects for all the libraries, which
>> means I can't just tell new users who just write simple programs to
>> ignore the projects\workspace features.
>
> That's not how I read Doug's email (Re: IDL 7 on LINUX Question dated
> 11/30 @5:55 PST). He states that you can turn off the "Update IDL Path
> Preference" property which will allow IDL 7 to behave like earlier
> versions. I would guess (I haven't installed it yet) that you can unset
> this property, set the path appropriately, never use the projects, and
> write simple programs as before.
>
> -Rick

You have to have a least one "project" even if it is "Default" - I
think it's an Eclipse thing.
Re: large source trees and networked paths in 7.0 [message #57264 is a reply to message #57263] Wed, 05 December 2007 14:57 Go to previous message
Rick Towler is currently offline  Rick Towler
Messages: 821
Registered: August 1998
Senior Member
b_gom wrote:

> Also, this will effectively force all users
> to setup a workspace and juggle projects for all the libraries, which
> means I can't just tell new users who just write simple programs to
> ignore the projects\workspace features.

That's not how I read Doug's email (Re: IDL 7 on LINUX Question dated
11/30 @5:55 PST). He states that you can turn off the "Update IDL Path
Preference" property which will allow IDL 7 to behave like earlier
versions. I would guess (I haven't installed it yet) that you can unset
this property, set the path appropriately, never use the projects, and
write simple programs as before.

-Rick
Re: large source trees and networked paths in 7.0 [message #57280 is a reply to message #57264] Wed, 05 December 2007 12:04 Go to previous message
David Fanning is currently offline  David Fanning
Messages: 11724
Registered: August 2001
Senior Member
b_gom@hotmail.com writes:

> Naturally this is the result of the workbench searching through the
> path, but I'm a bit concerned at how much longer this takes than in
> 6.4, and how much bandwidth will be used up on our server when we have
> 10 or 15 users signed in. Also, this will effectively force all users
> to setup a workspace and juggle projects for all the libraries, which
> means I can't just tell new users who just write simple programs to
> ignore the projects\workspace features.

I think you understand the gist of it. :-)

Cheers,

David
--
David Fanning, Ph.D.
Fanning Software Consulting, Inc.
Coyote's Guide to IDL Programming: http://www.dfanning.com/
Sepore ma de ni thui. ("Perhaps thou speakest truth.")
Re: large source trees and networked paths in 7.0 [message #57282 is a reply to message #57280] Wed, 05 December 2007 12:00 Go to previous message
b_gom is currently offline  b_gom
Messages: 105
Registered: April 2003
Senior Member
On Dec 5, 12:22 pm, David Fanning <n...@dfanning.com> wrote:

> Check the newsgroup archives for earlier this week.
> I'm in the process of writing an article about it, too.

Ah, the Linux title threw me off.

Naturally this is the result of the workbench searching through the
path, but I'm a bit concerned at how much longer this takes than in
6.4, and how much bandwidth will be used up on our server when we have
10 or 15 users signed in. Also, this will effectively force all users
to setup a workspace and juggle projects for all the libraries, which
means I can't just tell new users who just write simple programs to
ignore the projects\workspace features.
Re: large source trees and networked paths in 7.0 [message #57293 is a reply to message #57282] Wed, 05 December 2007 11:22 Go to previous message
David Fanning is currently offline  David Fanning
Messages: 11724
Registered: August 2001
Senior Member
b_gom@hotmail.com writes:

> What is the workbench doing? Exactly what does 'Analyzing Code' mean?

Check the newsgroup archives for earlier this week.
I'm in the process of writing an article about it, too.

Cheers,

DAvid
--
David Fanning, Ph.D.
Fanning Software Consulting, Inc.
Coyote's Guide to IDL Programming: http://www.dfanning.com/
Sepore ma de ni thui. ("Perhaps thou speakest truth.")
  Switch to threaded view of this topic Create a new topic Submit Reply
Previous Topic: Re: Pointers problem - Unable to dereference NULL pointer
Next Topic: Re: eclipse ridiculously slow over ssh

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Wed Oct 08 11:39:42 PDT 2025

Total time taken to generate the page: 0.00577 seconds