comp.lang.idl-pvwave archive: archive » Numbers from nowhere?

Home » Public Forums » archive » Numbers from nowhere?

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Numbers from nowhere? [message #58742]

Fri, 15 February 2008 07:08

Conor
Messages: 138
Registered: February 2007

Senior Member

I'm just curious:

print,3.3,format='(f30.28)'
3.2999999523162841796875000000

Obviously float is only good to ~6 decimal places, but IDL will still
print out additional digits. It seems that it does reach a point
where IDL will only print out zeroes. I'm just curious - where do
these extra digits come from? Does it come from rounding errors
converting binary to decimal? Or does it come from some other
nefarious location?

Report message to a moderator

[Message index]

		Numbers from nowhere? By: Conor on Fri, 15 February 2008 07:08
		Re: Numbers from nowhere? By: Norbert Hahn on Thu, 21 February 2008 08:29
		Re: NUMBERS By: d.poreh on Wed, 09 July 2008 22:02
		Re: NUMBERS By: Ingo von Borstel on Wed, 09 July 2008 05:33

Previous Topic:	Re: IDL font helper: easy embedded formatting with standard IDL fonts
Next Topic:	WIDGET_LABEL query.

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Thu Oct 09 21:15:01 PDT 2025

Total time taken to generate the page: 1.20173 seconds