comp.lang.idl-pvwave archive: archive » Re: Specify the degree of accuracy of a floating point number

Home » Public Forums » archive » Re: Specify the degree of accuracy of a floating point number

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: Specify the degree of accuracy of a floating point number [message #52594 is a reply to message #52591]

Thu, 22 February 2007 13:18

David Fanning
Messages: 11724
Registered: August 2001

Senior Member

Brian Larsen writes:

> I bet you are in a better position to understand this than I am
> however...

Well, what I know about it is that formatting numbers in
a sensible way for display (in widget programs, for example)
is EXTREMELY annoying. And double precision numbers are
perverse. (Although not usually as perverse as with your
ROUND_OFF program. I find it amusing, however, that it barfed
so convincingly on my very first try!)

NUMBER_FORMATTER is not too bad, but even there I have
to look at it cross-eyed occasionally to maintain the
fiction that it is a beautiful program. :-)

There are a couple of articles on my web page addressing
the issue for the more curious among you.

Cheers,

David
--
David Fanning, Ph.D.
Fanning Software Consulting, Inc.
Coyote's Guide to IDL Programming: http://www.dfanning.com/
Sepore ma de ni thui. ("Perhaps thou speakest truth.")

Report message to a moderator

[Message index]

		Re: Specify the degree of accuracy of a floating point number By: tochaf on Fri, 23 February 2007 02:01
		Re: Specify the degree of accuracy of a floating point number By: David Fanning on Thu, 22 February 2007 13:18
		Re: Specify the degree of accuracy of a floating point number By: Brian Larsen on Thu, 22 February 2007 12:43
		Re: Specify the degree of accuracy of a floating point number By: loknath on Thu, 22 February 2007 10:57
		Re: Specify the degree of accuracy of a floating point number By: David Fanning on Thu, 22 February 2007 10:28
		Re: Specify the degree of accuracy of a floating point number By: Brian Larsen on Thu, 22 February 2007 09:58
		Re: Specify the degree of accuracy of a floating point number By: Allan Whiteford on Thu, 22 February 2007 05:05
		Re: Specify the degree of accuracy of a floating point number By: David Fanning on Wed, 21 February 2007 22:22
		Re: Specify the degree of accuracy of a floating point number By: Kenneth Bowman on Fri, 23 February 2007 08:43

Previous Topic:	Re: Displaying slices using same scaling
Next Topic:	READ issue

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Sun Nov 30 01:42:19 PST 2025

Total time taken to generate the page: 0.09287 seconds