| Re: reading large files [message #65965] |
Sun, 29 March 2009 19:04 |
R.G. Stockwell
Messages: 363
Registered: July 1999
|
Senior Member |
|
|
"ben.bighair" <ben.bighair@gmail.com> wrote in message
news:74eef0a5-9c9e-45d2-9938-252f5445312b@c11g2000yqj.google groups.com...
> On Mar 29, 8:00 pm, "R.G. Stockwell" <noemai...@please.com> wrote:
>> "R.G. Stockwell" <noemai...@please.com> wrote in message
>>
>> news:gqp1fk$vl3$1@aioe.org...
>>
>>>> > I can allocate the arrays:
>>
>>>> > tlen = 274L
>>>> > ntracks = 253574L
>>>> > ; allocate arrays
>>>> > u = dblarr(tlen,ntracks)
>>
>>>> > but I cannot read the file. Here is the error message:
>>>> > Insufficient system resources exist to complete the requested
>>>> > service.
>>
>> ok, something weird is going on, and I doubt it is with IDL.
>> I also fail reading other much smaller files.
>>
>> I think my files generated in matlab are corrupt for
>> some reason.
>>
>> cheers,
>> bob
>
> Hi,
>
> Have you tried the MatLab-IDL generic data exchange routines? They
> have never given me (much) trouble.
>
> http://www.tidewater.net/~pemaquid/gen.zip
>
> Given your hunch, these might not be helpful at all.
>
> Good luck!
> Ben
no I had not. Thanks for the link I'll take a look.
I actually can read the files now. The problem (which
I still don't understand) seems to have to do with a
networked drive. IDL must have timed out during the read
or something like that.
But now that I moved the files to the local hard drive,
they can get read in no problem.
cheers,
bob
|
|
|
|
| Re: reading large files [message #65966 is a reply to message #65965] |
Sun, 29 March 2009 18:44  |
ben.bighair
Messages: 221
Registered: April 2007
|
Senior Member |
|
|
On Mar 29, 8:00 pm, "R.G. Stockwell" <noemai...@please.com> wrote:
> "R.G. Stockwell" <noemai...@please.com> wrote in message
>
> news:gqp1fk$vl3$1@aioe.org...
>
>>>> I can allocate the arrays:
>
>>>> tlen = 274L
>>>> ntracks = 253574L
>>>> ; allocate arrays
>>>> u = dblarr(tlen,ntracks)
>
>>>> but I cannot read the file. Here is the error message:
>>>> Insufficient system resources exist to complete the requested service.
>
> ok, something weird is going on, and I doubt it is with IDL.
> I also fail reading other much smaller files.
>
> I think my files generated in matlab are corrupt for
> some reason.
>
> cheers,
> bob
Hi,
Have you tried the MatLab-IDL generic data exchange routines? They
have never given me (much) trouble.
http://www.tidewater.net/~pemaquid/gen.zip
Given your hunch, these might not be helpful at all.
Good luck!
Ben
|
|
|
|
| Re: reading large files [message #65967 is a reply to message #65966] |
Sun, 29 March 2009 17:00 |
R.G. Stockwell
Messages: 363
Registered: July 1999
|
Senior Member |
|
|
"R.G. Stockwell" <noemail87@please.com> wrote in message
news:gqp1fk$vl3$1@aioe.org...
>>> I can allocate the arrays:
>>>
>>> tlen = 274L
>>> ntracks = 253574L
>>> ; allocate arrays
>>> u = dblarr(tlen,ntracks)
>>>
>>>
>>> but I cannot read the file. Here is the error message:
>>> Insufficient system resources exist to complete the requested service.
ok, something weird is going on, and I doubt it is with IDL.
I also fail reading other much smaller files.
I think my files generated in matlab are corrupt for
some reason.
cheers,
bob
|
|
|
|
| Re: reading large files [message #65968 is a reply to message #65967] |
Sun, 29 March 2009 16:50 |
R.G. Stockwell
Messages: 363
Registered: July 1999
|
Senior Member |
|
|
"David Fanning" <news@dfanning.com> wrote in message
news:MPG.2439b4e5d9afd00c98a681@news.giganews.com...
> R.G. Stockwell writes:
>
>> i have data from matlab that I converted to binary files,
>> and I am trying to read into IDL for further processing.
>>
>> I can allocate the arrays:
>>
>> tlen = 274L
>> ntracks = 253574L
>> ; allocate arrays
>> u = dblarr(tlen,ntracks)
>>
>>
>> but I cannot read the file. Here is the error message:
>> Insufficient system resources exist to complete the requested service.
>>
>> I'm using version 6.3 on windows, is this something that is
>> fixed in IDL 7?
>
> I have no trouble executing those commands on my 32-bit
> Windows XP OS in either IDL 6.4 or 7.0.3. But I've seen that
> insufficient system resources message before. Have you
> had an opportunity to restart Windows lately? I wouldn't
> be surprised if a Windows reboot helped in this case.
Good idea, i'll give it a shot, but I should point out
that I see the error on my laptop, and on my desktop
(both 32 bit windows machines, one is IDL 6.3 the other IDL 6.3,
i haven't tried it in IDL 7 yet).
Very curious.
It seems odd that the array can get allocated. But the read command
is what fails. The file is 555,834,208 bytes which doesn't seem
too big.
cheers,
bob
|
|
|
|
| Re: reading large files [message #65969 is a reply to message #65968] |
Sun, 29 March 2009 16:40 |
David Fanning
Messages: 11724
Registered: August 2001
|
Senior Member |
|
|
R.G. Stockwell writes:
> i have data from matlab that I converted to binary files,
> and I am trying to read into IDL for further processing.
>
> I can allocate the arrays:
>
> tlen = 274L
> ntracks = 253574L
> ; allocate arrays
> u = dblarr(tlen,ntracks)
>
>
> but I cannot read the file. Here is the error message:
> Insufficient system resources exist to complete the requested service.
>
> I'm using version 6.3 on windows, is this something that is
> fixed in IDL 7?
I have no trouble executing those commands on my 32-bit
Windows XP OS in either IDL 6.4 or 7.0.3. But I've seen that
insufficient system resources message before. Have you
had an opportunity to restart Windows lately? I wouldn't
be surprised if a Windows reboot helped in this case.
Cheers,
David
--
David Fanning, Ph.D.
Fanning Software Consulting, Inc.
Coyote's Guide to IDL Programming: http://www.dfanning.com/
Sepore ma de ni thui. ("Perhaps thou speakest truth.")
|
|
|
|
comp.lang.idl-pvwave archive
Members
Search
Help
Login
Home
