comp.lang.idl-pvwave archive: archive » findfile gives 'Array has a corrupted descriptor' error

Home » Public Forums » archive » findfile gives 'Array has a corrupted descriptor' error

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: findfile gives 'Array has a corrupted descriptor' error [message #85401 is a reply to message #85335]

Tue, 30 July 2013 10:16

b_gom
Messages: 105
Registered: April 2003

Senior Member

Forgive the sin of continuously replying to my own post, but here is the workaround I've used. Spawning the 'dir' command takes much less time than file_search on network shares with many files:

IDL> tic & spawn, 'dir U:\somenetworkshare\* /b /aD',found,/hide & toc
% Time elapsed: 0.32800007 seconds.
IDL> tic & found=file_search('U:\somenetworkshare\*',count=count,/nosor t) & toc
% Time elapsed: 26.066000 seconds.

So, I wrote a wrapper for the file_search function that determines if the Windows OS is in use, and if the VM mode is not in use, and then does the following:

function listfiles,path,pattern,count=count,_extra=e
if n_elements(pattern) eq 0 then pattern='*'
if LMGR(/VM) then begin
return,file_search(path+pattern,/test_regular,count=count,_e xtra=e) ;forced to use slow version in VM mode.
endif
case strupcase(!version.os_family) of
'WINDOWS':begin
spawn, 'dir '+path+pattern+' /b /a-D /ON',result,/hide
count = (result[0] eq '') ? 0 : n_elements(result)
return,file_dirname(path+pattern,/mark)+result
end
'UNIX':begin
return,file_search(path+pattern,/test_regular,count=count,_e xtra=e)
end
endcase
end

P.S., I've also found that file_search is slow to return a large list of file matches (>~5000) from a given directory, but not when returning a short list of matches from the same directory. For example, in a directory of ~7000 files, file_search(path+'*') takes around 26 seconds, but file_search(path+'*.txt') returns in 0.3 seconds if there are only a few .txt files.
So, the above workaround actually costs a bit more time for cases where only small file lists are expected.

On Thursday, July 25, 2013 6:44:55 PM UTC-6, b_...@hotmail.com wrote:
> I running IDL 8.2.3 on Win7 64bit. I have an older program that uses findfile() to recursively find a set of filenames with a wildcard. I realize findfile is obsolete, but it runs *much* faster than file_search. When the findfile returns more than ~5000 files, however, I get the following error:
>
>
>
> found=file_search(uval.path+'*',count=count,/mark_dir)
>
> % Array has a corrupted descriptor: FOUND.
>
>
>
> Any ideas what is causing the error?
>
> Assuming that this is a bug that will not be fixed, does anyone have a fast alternative to file_search?
>
>
>
> Thanks

Report message to a moderator

[Message index]

		findfile gives 'Array has a corrupted descriptor' error By: b_gom on Thu, 25 July 2013 17:44
		Re: findfile gives 'Array has a corrupted descriptor' error By: David Fanning on Thu, 25 July 2013 18:05
		Re: findfile gives 'Array has a corrupted descriptor' error By: Phillip Bitzer on Fri, 26 July 2013 05:54
		Re: findfile gives 'Array has a corrupted descriptor' error By: wlandsman on Fri, 26 July 2013 08:29
		Re: findfile gives 'Array has a corrupted descriptor' error By: David Fanning on Fri, 26 July 2013 08:34
		Re: findfile gives 'Array has a corrupted descriptor' error By: b_gom on Fri, 26 July 2013 10:34
		Re: findfile gives 'Array has a corrupted descriptor' error By: b_gom on Fri, 26 July 2013 12:54
		Re: findfile gives 'Array has a corrupted descriptor' error By: b_gom on Fri, 26 July 2013 16:51
		Re: findfile gives 'Array has a corrupted descriptor' error By: b_gom on Tue, 30 July 2013 10:16

Previous Topic:	Multiple plots with plot function
Next Topic:	Ugly UNIX IDL Workbench

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Sat Oct 11 16:13:05 PDT 2025

Total time taken to generate the page: 1.60116 seconds