comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado

Home » Public Forums » archive » Re: Input Buffer Error Reading in Large ascii Files
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend 
Switch to threaded view of this topic Create a new topic Submit Reply
Re: Input Buffer Error Reading in Large ascii Files [message #26840] Sun, 30 September 2001 17:08
David Fanning is currently offline  David Fanning
Messages: 11724
Registered: August 2001
Senior Member
Mark Hadfield (m.hadfield@niwa.cri.nz) writes:

> Nudge nudge wink wink.
> (No David, that's not sexual innuendo.)

Shoot. This newsgroup is so much more fun
when it is. :-)

Cheers,

David

--
David W. Fanning, Ph.D.
Fanning Software Consulting
Phone: 970-221-0438, E-mail: david@dfanning.com
Coyote's Guide to IDL Programming: http://www.dfanning.com/
Toll-Free IDL Book Orders: 1-888-461-0155
Re: Input Buffer Error Reading in Large ascii Files [message #26841 is a reply to message #26840] Sun, 30 September 2001 15:21 Go to previous message
Mark Hadfield is currently offline  Mark Hadfield
Messages: 783
Registered: May 1995
Senior Member
From: "Pavel A. Romashkin" <pavel.romashkin@noaa.gov>
>
>
http://groups.google.com/groups?hl=en&selm=1907200015230 85989%25bowman%40ipg
p.jussieu.fr
> [which refers to input buffer length limit of 32767 bytes for formatted
I/O]

I would never violate an IDL beta confidentiality agreement, but, you never
know, perhaps this limit could be relaxed in IDL 5.5? Nudge nudge wink wink.
(No David, that's not sexual innuendo.)

---
Mark Hadfield
m.hadfield@niwa.cri.nz http://katipo.niwa.cri.nz/~hadfield
National Institute for Water and Atmospheric Research




--
Posted from clam.niwa.cri.nz [202.36.29.1]
via Mailgate.ORG Server - http://www.Mailgate.ORG
Re: Input Buffer Error Reading in Large ascii Files [message #26844 is a reply to message #26841] Fri, 28 September 2001 11:59 Go to previous message
Craig Markwardt is currently offline  Craig Markwardt
Messages: 1869
Registered: November 1996
Senior Member
David Fanning <david@dfanning.com> writes:
> dave (gefinn@scifac.indstate.edu) writes:
>
>> unfortunately I get the following error.
>> % Compiled module: TRANSREAD.
>> % Input line is too long for input buffer of 32767 characters.
>>
>> Can anyone make a suggestion on why I am getting this error and a
>> possible work around?
>
> This kind of error often occurs when end-of-line
> characters are not in the file. This can occur,
> for example, by improper FTP transfer of an ASCII
> file from a Mac to a PC. Sometimes popping the file
> into a word processor on the target machine and saving
> it as a text file will get things sorted out.
>
> This doesn't exhaust the list of possibilities,
> of course, but I'm almost certain the problem is not
> with Craig's code. :-)

I am more than willing to believe it's a problem with my code. :-) But
I / we need more information before a judgement can be passed. Like,
which architecture is being used, what the input file looks like, etc.

One thing is that TRANSREAD is very line-oriented. It tries to read
one line at a time from the file into a string variable, and then to
parse it. For example, if Dave has a file with thousands of numbers
with no carriage returns, then TRANSREAD will fail because it tries to
read all the data at once. I can't really think of a way around this.

Yours,
Craig

--
------------------------------------------------------------ --------------
Craig B. Markwardt, Ph.D. EMAIL: craigmnet@cow.physics.wisc.edu
Astrophysics, IDL, Finance, Derivatives | Remove "net" for better response
------------------------------------------------------------ --------------
Re: Input Buffer Error Reading in Large ascii Files [message #26846 is a reply to message #26844] Fri, 28 September 2001 09:32 Go to previous message
Pavel A. Romashkin is currently offline  Pavel A. Romashkin
Messages: 531
Registered: November 2000
Senior Member
Dave,
This was discussend about a year ago. Check out

http://groups.google.com/groups?hl=en&selm=1907200015230 85989%25bowman%40ipgp.jussieu.fr

You may have to copy-paste the above URL if your news reader can not
figure out multiple URL lines.
A solution was provided - using unformatted read which is not subject to
buffer limitations.
Cheers,
Pavel
Re: Input Buffer Error Reading in Large ascii Files [message #26847 is a reply to message #26846] Fri, 28 September 2001 07:13 Go to previous message
David Fanning is currently offline  David Fanning
Messages: 11724
Registered: August 2001
Senior Member
dave (gefinn@scifac.indstate.edu) writes:

> unfortunately I get the following error.
> % Compiled module: TRANSREAD.
> % Input line is too long for input buffer of 32767 characters.
>
> Can anyone make a suggestion on why I am getting this error and a
> possible work around?

This kind of error often occurs when end-of-line
characters are not in the file. This can occur,
for example, by improper FTP transfer of an ASCII
file from a Mac to a PC. Sometimes popping the file
into a word processor on the target machine and saving
it as a text file will get things sorted out.

This doesn't exhaust the list of possibilities,
of course, but I'm almost certain the problem is not
with Craig's code. :-)

Cheers,

David
--
David W. Fanning, Ph.D.
Fanning Software Consulting
Phone: 970-221-0438, E-mail: david@dfanning.com
Coyote's Guide to IDL Programming: http://www.dfanning.com/
Toll-Free IDL Book Orders: 1-888-461-0155
  Switch to threaded view of this topic Create a new topic Submit Reply
Previous Topic: Object Graphics --> EPS Output how?
Next Topic: Global variable vs common block

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Wed Oct 08 15:52:32 PDT 2025

Total time taken to generate the page: 0.00463 seconds