comp.lang.idl-pvwave archive: archive

Home » Public Forums » archive » rounding errors

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: rounding [message #32004 is a reply to message #24924]

Wed, 04 September 2002 07:40

Amar Nayegandhi
Messages: 15
Registered: May 2001

Junior Member

Hi,
Sorry for this easy question... the number should have been 'double', but
it was 'float'.
-amar

On Wed, 4 Sep 2002, Amar Nayegandhi wrote:

> Hi,
> IDL seems to round off large decimal numbers. For e.g.,
> IDL> x = 284.766117
> IDL> print, format='(I11)',x*1000000L
> 284766112
>
> IDL> x = 284.766119
> IDL> print, format='(I11)',x*1000000L
> 284766112
>
> Is there any way around this?
>
> Thanks,
> -amar
>
>
> ****************************************************
> Amar Nayegandhi
> ****************************************************
>
>

Report message to a moderator

[Message index]

		rounding errors By: Dominic R. Scales on Fri, 27 April 2001 01:51
		Re: rounding errors By: Jaco van Gorkom on Fri, 04 May 2001 06:17
		Re: rounding errors By: Paul van Delst on Wed, 02 May 2001 09:46
		Re: rounding errors By: Dominic R. Scales on Wed, 02 May 2001 00:44
		Re: rounding By: thompson on Wed, 04 September 2002 07:59
		Re: rounding By: David Fanning on Wed, 04 September 2002 07:52
		Re: rounding By: Craig Markwardt on Wed, 04 September 2002 07:45
		Re: rounding By: Amar Nayegandhi on Wed, 04 September 2002 07:40

Previous Topic:	rounding
Next Topic:	Object Graphics Book.

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Fri Oct 10 18:18:17 PDT 2025

Total time taken to generate the page: 1.11980 seconds