comp.lang.idl-pvwave archive: archive

Home » Public Forums » archive » parse subdirectories

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: parse subdirectories [message #92312 is a reply to message #92215]

Mon, 13 March 2017 10:41

wlandsman
Messages: 743
Registered: June 2000

Senior Member

I don't have an answer to your question, but do want to point out that the slowness of FILE_SEARCH() on Windows is a long-standing problem.

http://www.idlcoyote.com/code_tips/fastsearch.php

and one that I've ranted about before

https://groups.google.com/forum/#!search/file_search$20wayne /comp.lang.idl-pvwave/ABttLQ5NHHU/xgSFcodk4N0J

And just yesterday I became aware of another group at Goddard encountering this problem. Please Harris/Exelis can we get a fix for FILE_SEARCH?

Anyway, for a recursive directory search, I'm not sure that FINDFILE() or David Fanning's listfile.pro are a suitable solution. I suspect -- but am not certain -- that you do have to sort the output of the powershell as you are doing. You might have to count the number of backslashes to get the directory level. --Wayne

On Monday, March 13, 2017 at 12:32:12 PM UTC-4, Helder wrote:
> Hi,
> I have widget application that takes a directory as input and generates a widget_tree of the (sub)directory structure.
> I've have done this using basically something like (there's more to it that this...):
>
> pro dirParser::addsubtree, dir
> subs = file_search(dir+'*', /test_directory, count=cnt)
> subParent = self.widgets.treeSub[-1]
> if cnt gt 0 then foreach sub,subs do self->addSubsTree, sub, subParent
> end
>
> This works fine, meaning it returns the directory structure and that's great. However, I would like to switch the windows powershell to get the tree structure. Why? Because the above is really slow.
>
> So, I can call the powershell like this:
> spawn, 'powershell -WindowStyle Hidden "Get-ChildItem -Recurse | ?{ $_.PSIsContainer } | Select-Object FullName"', result, /noshell
>
> which gives me a very quick response with something like:
> IDL> print, transpose(result)
>
> FullName
> --------
> K:\data\sub-1\2002
> K:\data\sub-1\2004
> K:\data\sub-1\2005
> K:\data\sub-1\2017
> K:\data\sub-1\2002\02_01_26
> K:\data\sub-1\2002\02_01_28
> K:\data\sub-1\2004\04_12_02
> K:\data\sub-1\2004\04_12_03
>
> and so on (there are many more subdirectories).
> Does anybody have a good suggestion how to parse the text contained in the above result array?
>
> I know how to handle strings, but I don't have a good way to sort the subdirectories (for instance "K:\data\sub-1\2002\02_01_26" is a subdirectory of "K:\data\sub-1\2002", but comes only after all the other same level directories are listed).
>
> I would appreciate any suggestion on how to solve the directory listing chaos.
>
> Regards,
> Helder
>
> PS: Just for the time comparison: running the above powershell command over a structure of >2000 directories/subdirectories took "just" 8 seconds. The older method took minutes...

Report message to a moderator

[Message index]

		parse subdirectories By: Helder Marchetto on Mon, 13 March 2017 09:32
		Re: parse subdirectories By: wlandsman on Mon, 13 March 2017 10:41
		Re: parse subdirectories By: Helder Marchetto on Mon, 13 March 2017 16:04
		Re: parse subdirectories By: Helder Marchetto on Wed, 15 March 2017 04:06
		Re: parse subdirectories By: Helder Marchetto on Wed, 15 March 2017 08:02
		Re: parse subdirectories By: lecacheux.alain on Wed, 15 March 2017 11:23
		Re: parse subdirectories By: Helder Marchetto on Wed, 15 March 2017 13:05
		Re: parse subdirectories By: Helder Marchetto on Thu, 16 March 2017 05:29
		Re: parse subdirectories By: Matthew Argall on Thu, 16 March 2017 08:07
		Re: parse subdirectories By: bradgom on Thu, 16 March 2017 10:29
		Re: parse subdirectories By: Helder Marchetto on Fri, 17 March 2017 01:17
		Re: parse subdirectories By: Helder Marchetto on Thu, 18 May 2017 02:09

Previous Topic:	Harris seems to be deemphasizing IDL
Next Topic:	Problem writing SCATTERPLOT() with more than 4096 points to PDF file

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Wed Oct 08 16:15:46 PDT 2025

Total time taken to generate the page: 0.00426 seconds