comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado

Home » Public Forums » archive » decimal numbers
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend 
Switch to threaded view of this topic Create a new topic Submit Reply
decimal numbers [message #70916] Tue, 11 May 2010 16:15
fgg is currently offline  fgg
Messages: 67
Registered: April 2010
Member
Hello,

If

IDL> a=358983

how can I get a "b" = 0.358983? (that is, b = a/10^6)?... Why do I get
the weird result below when I change "a" to double and divide it by
10^6?

IDL> b=double(a)/10^6
IDL> print, b
21.166450

Thank you!
  Switch to threaded view of this topic Create a new topic Submit Reply
Previous Topic: Re: Polygon Smoothing
Next Topic: Re: decimal numbers

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Wed Oct 08 19:31:41 PDT 2025

Total time taken to generate the page: 0.00454 seconds