comp.lang.idl-pvwave archive: archive

Home » Public Forums » archive » Re: Lots of files

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: Lots of files [message #53054 is a reply to message #53053]

Fri, 16 March 2007 13:07

Paul Van Delst[1]
Messages: 1157
Registered: April 2002

Senior Member

David Fanning wrote:
> Lasse Clausen writes:
>
>> I would like to split the one file into 31. In fact, I would like to
>> open all 32 files, loop through the big file and put the data
>> according to the index into the small file. However, IDL only lets me
>> open 28 files at a time, right?
>> IDL Help for Get_lun says: The file unit number obtained is in the
>> range 100 to 128.
>> So I end up opening and closing the according small file during each
>> loop which works great, however it is excruciatingly slow due to all
>> the waiting for the hard disk.
>>
>> Ah, and the number of stations varies, sometimes its 21, sometimes 29,
>> most of the time 30, I never know what it is going to be. Therefore, I
>> can only use the point_lun procedure to skip from data to data
>> belonging to one station if I parse the stations first. Which I could
>> do, but maybe one of you has a better idea? Any thoughts?
>
> I would use the pool of LUNs from 1 to 99, rather than the
> pool IDL access with GET_LUN from 100 to 128.
>
> OPENW, 1, ...
> OPENW, 2, ...
> ...
> OPENW, 99, ...

I know you didn't intend to suggest hardwiring 99 different fileid's :o) so maybe what you
meant was something more like

nfiles = 31
fid_child = LINDGEN(nfiles)+1
fid_parent = nfiles+1

OPEN, fid_parent, fname_parent, .....
FOR i=0,nfiles-1 DO OPEN, fid_child[i], fname_child[i], ...

and then redistribute the parent file data into the child files as required.

?

cheersouzo,

paulv

--
Paul van Delst Ride lots.
CIMSS @ NOAA/NCEP/EMC Eddy Merckx

Report message to a moderator

[Message index]

		Re: Lots of files By: lasse on Sat, 17 March 2007 10:32
		Re: Lots of files By: David Fanning on Fri, 16 March 2007 14:23
		Re: Lots of files By: Paul Van Delst[1] on Fri, 16 March 2007 13:07
		Re: Lots of files By: David Fanning on Fri, 16 March 2007 13:53
		Re: Lots of files By: David Fanning on Sat, 17 March 2007 20:59
		Re: Lots of files By: Foldy Lajos on Sat, 17 March 2007 13:42

Previous Topic:	Re: mosaic_doit : the ghost
Next Topic:	replicating arrays

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Sun Nov 30 07:37:14 PST 2025

Total time taken to generate the page: 1.99591 seconds