comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado

Home » Public Forums » archive » Re: Simple format code issue.
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend 
Return to the default flat view Create a new topic Submit Reply
Re: Simple format code issue. [message #68999 is a reply to message #68991] Wed, 09 December 2009 13:09 Go to previous messageGo to previous message
Kenneth P. Bowman is currently offline  Kenneth P. Bowman
Messages: 585
Registered: May 2000
Senior Member
In article
<a40dd69e-ed04-4a18-969e-5c41c9acffc7@d10g2000yqh.googlegroups.com>,
polystethylene <polystethylene@hotmail.com> wrote:

> This one should be a doddle to resolve; but I can't for the life of me
> see what I'm doing wrong.
>
> I have 2 columns of data like this:
>
> 5147.475098 0.987662
> 5147.476562 0.985164
> 5147.478516 0.975080
> 5147.479980 0.991375
> 5147.481445 0.982826
> 5147.482910 0.987368
>
> etc...
>
> I would normally read this in with a format code like this:
>
> (2x,F0,3x,F0) - or sometimes drop the x's as you don't really need
> them...
>
> Anyway, this code reads the data in to 8 sig fig (1st column), and 6
> sig fig (second column)
>
> So then I tried a code of (F10.6, F0)... and I get the same issue - I
> can't get more than 4 d.p precision...
>
> I tried it with Doubles as well; but no luck. This has got to be
> simple right? Format codes are a weakness of mine, so I'm totally
> stumped.
>
> Any ideas?
>
> Cheers,
> Stefan

If you really want 11 digits of precision, make sure you are reading
into double precision floating point variables.

Ken Bowman
[Message index]
 
Read Message
Read Message
Read Message
Read Message
Read Message
Previous Topic: Re: IDL and ImageMagick
Next Topic: Two Lines Crossing Problem

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Sat Nov 29 00:47:51 PST 2025

Total time taken to generate the page: 1.92511 seconds