comp.lang.idl-pvwave archive: archive » Re: Simple format code issue.

Home » Public Forums » archive » Re: Simple format code issue.

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: Simple format code issue. [message #68990]

Wed, 09 December 2009 15:20

penteado
Messages: 866
Registered: February 2018

Senior Member
Administrator

On Dec 9, 9:06 pm, polystethylene <polystethyl...@hotmail.com> wrote:
> That's a good tip. Is it therefore the case that I could read in a
> value to 11 digits of precision - but that it won't be correct if I
> use floats instead of doubles?

Yes, it is the case. Floats are only good to some 6 digits, and
exponents to about 37. Doubles go to about 15 digits.

You may find useful to see

http://www.dfanning.com/math_tips/sky_is_falling.html

Report message to a moderator

[Message index]

		Re: Simple format code issue. By: penteado on Wed, 09 December 2009 15:20
		Re: Simple format code issue. By: polystethylene on Wed, 09 December 2009 15:06
		Re: Simple format code issue. By: Kenneth P. Bowman on Wed, 09 December 2009 13:09
		Re: Simple format code issue. By: penteado on Wed, 09 December 2009 12:09
		Re: Simple format code issue. By: polystethylene on Wed, 09 December 2009 12:07

Previous Topic:	Re: IDL and ImageMagick
Next Topic:	Two Lines Crossing Problem

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Sat Nov 29 00:47:55 PST 2025

Total time taken to generate the page: 0.40611 seconds