comp.lang.idl-pvwave archive: archive

Home » Public Forums » archive » decimal precision

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: decimal precision [message #92465 is a reply to message #92464]

Tue, 22 December 2015 13:46

David Fanning
Messages: 11724
Registered: August 2001

Senior Member

omar ali writes:

>
> Hi,
> I have a variable of 8 digits precision and i need to make it of to precision. for example
> x=7.86567123 and i want it to be x=7.87
> Hint, i do not need to print it. I need to let idl use it in memory like that x=7.87

xprime = Round(x * 100)/100.0

Cheers,

David
--
David Fanning, Ph.D.
Fanning Software Consulting, Inc.
Coyote's Guide to IDL Programming: http://www.idlcoyote.com/
Sepore ma de ni thue. ("Perhaps thou speakest truth.")

Report message to a moderator

[Message index]

		decimal precision By: omar ali on Tue, 22 December 2015 13:41
		Re: decimal precision By: David Fanning on Tue, 22 December 2015 13:46
		Re: decimal precision By: omar ali on Wed, 23 December 2015 04:37
		Re: decimal precision By: omar ali on Wed, 23 December 2015 05:18
		Re: decimal precision By: David Fanning on Wed, 23 December 2015 06:20

Previous Topic:	tiff_coordinates
Next Topic:	It's about time

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Wed Oct 08 19:28:52 PDT 2025

Total time taken to generate the page: 0.00671 seconds