comp.lang.idl-pvwave archive: archive

Home » Public Forums » archive » decimal precision

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: decimal precision [message #92473 is a reply to message #92472]

Wed, 23 December 2015 06:20

David Fanning
Messages: 11724
Registered: August 2001

Senior Member

omar ali writes:

> Details of my exact problem is as follow:
> I am writing a geotiff with the following command "example(1)". the tiff is successfully created. However, when I check the corners coordinate using other software or even in idl I find it like "example (2)". I want the coordinates to be calculated as "example(3)"

I think your idea of the way computers work is a little oversimplified.
This is always a good place to start:

https://www.idlcoyote.com/math_tips/sky_is_falling.html
https://www.idlcoyote.com/math_tips/storenum.html

I think you are in good shape without doing anything else. :-)

Cheers,

David
--
David Fanning, Ph.D.
Fanning Software Consulting, Inc.
Coyote's Guide to IDL Programming: http://www.idlcoyote.com/
Sepore ma de ni thue. ("Perhaps thou speakest truth.")

Report message to a moderator

[Message index]

		decimal precision By: omar ali on Tue, 22 December 2015 13:41
		Re: decimal precision By: David Fanning on Tue, 22 December 2015 13:46
		Re: decimal precision By: omar ali on Wed, 23 December 2015 04:37
		Re: decimal precision By: omar ali on Wed, 23 December 2015 05:18
		Re: decimal precision By: David Fanning on Wed, 23 December 2015 06:20

Previous Topic:	tiff_coordinates
Next Topic:	It's about time

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Wed Oct 08 14:01:42 PDT 2025

Total time taken to generate the page: 0.00486 seconds