comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado
Home » Public Forums » archive » rounding
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend  		Switch to threaded view of this topic Create a new topic Submit Reply
rounding [message #32005] Wed, 04 September 2002 07:31
Amar Nayegandhi is currently offline  Amar Nayegandhi
Messages: 15
Registered: May 2001
Junior Member
Hi,
IDL seems to round off large decimal numbers. For e.g.,
IDL> x = 284.766117
IDL> print, format='(I11)',x*1000000L
284766112

IDL> x = 284.766119
IDL> print, format='(I11)',x*1000000L
284766112

Is there any way around this?

Thanks,
-amar


****************************************************
Amar Nayegandhi
****************************************************

Report message to a moderator

  Switch to threaded view of this topic Create a new topic Submit Reply
Previous Topic: IDL & Memory Usage...
Next Topic: rounding errors

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Wed Oct 08 15:36:48 PDT 2025

Total time taken to generate the page: 0.00487 seconds
.:: Contact :: Home ::.

Powered by: FUDforum 3.0.7.
Copyright ©2001-2013 FUDforum Bulletin Board Software