comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado
Home » Public Forums » archive » decimal numbers
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend  		Switch to threaded view of this topic Create a new topic Submit Reply
decimal numbers [message #70916] Tue, 11 May 2010 16:15
fgg is currently offline  fgg
Messages: 67
Registered: April 2010
Member
Hello,

If

IDL> a=358983

how can I get a "b" = 0.358983? (that is, b = a/10^6)?... Why do I get
the weird result below when I change "a" to double and divide it by
10^6?

IDL> b=double(a)/10^6
IDL> print, b
21.166450

Thank you!

Report message to a moderator

  Switch to threaded view of this topic Create a new topic Submit Reply
Previous Topic: Re: Polygon Smoothing
Next Topic: Re: decimal numbers

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Thu Oct 09 22:15:35 PDT 2025

Total time taken to generate the page: 1.12234 seconds
.:: Contact :: Home ::.

Powered by: FUDforum 3.0.7.
Copyright ©2001-2013 FUDforum Bulletin Board Software