comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado

Home » Public Forums » archive » Finding a large number of files - ls vs file_search?
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend 
Switch to threaded view of this topic Create a new topic Submit Reply
Finding a large number of files - ls vs file_search? [message #77109] Tue, 09 August 2011 01:56 Go to next message
rjp23 is currently offline  rjp23
Messages: 97
Registered: June 2010
Member
I have ascii output from some code that numbers in the tens of
thousands of files (e.g. 60,000).

I want to read these in in IDL, check the result and only select the
files where the result meets a certain condition.

I have this all coded up and it works fine for smaller sets of data
but it can take a long long time for file_search to return a result
when searching 60,000 files.

My question is would it be more efficient to spawn an ls command or
something else rather than using file_search within IDL?

Cheers

Rob
Re: Finding a large number of files - ls vs file_search? [message #77422 is a reply to message #77109] Wed, 31 August 2011 05:08 Go to previous message
rogass is currently offline  rogass
Messages: 200
Registered: April 2008
Senior Member
On 9 Aug., 10:56, Rob <rj...@le.ac.uk> wrote:
> I have ascii output from some code that numbers in the tens of
> thousands of files (e.g. 60,000).
>
> I want to read these in in IDL, check the result and only select the
> files where the result meets a certain condition.
>
> I have this all coded up and it works fine for smaller sets of data
> but it can take a long long time for file_search to return a result
> when searching 60,000 files.
>
> My question is would it be more efficient to spawn an ls command or
> something else rather than using file_search within IDL?
>
> Cheers
>
> Rob

Hi Rob,
just try the /no_sort keyword for file_search. Now it's fast, I
think :)

Cheers

CR
  Switch to threaded view of this topic Create a new topic Submit Reply
Previous Topic: Re: How to eliminate smaller blob from label_region image
Next Topic: IDL not interpreting numbers correctly?

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Wed Oct 08 19:00:09 PDT 2025

Total time taken to generate the page: 0.00528 seconds