comp.lang.idl-pvwave archive: archive » Re: Problems with double precision in IDL

Home » Public Forums » archive » Re: Problems with double precision in IDL

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: Problems with double precision in IDL [message #1249 is a reply to message #1241]

Wed, 16 June 1993 10:57

ryan
Messages: 4
Registered: June 1992

Junior Member

When you convert a number from single precision to double
precision, you don't gain any precision better than the rounding
from the initial assignment. Make the initial assignment to a double
rather than converting. For example

z = .32d

Ryan

|----------------------------------------------------------- ----|
| Ryan McLean ryan@physics.berkeley.edu |
| 450 LeConte Hall |
| UC Berkeley (510) 643-9690 |
| Berkeley, CA 94720 |
|----------------------------------------------------------- ----|

Report message to a moderator

[Message index]

		Re: Problems with double precision in IDL By: isaacman on Fri, 18 June 1993 18:34
		Re: Problems with double precision in IDL By: thompson on Fri, 18 June 1993 12:04
		Re: Problems with double precision in IDL By: zawodny on Fri, 18 June 1993 09:41
		Re: Problems with double precision in IDL By: ryan on Wed, 16 June 1993 10:57

Previous Topic:	Re: IDL/PV-Wave - Can they strip headers in binary files?
Next Topic:	Re: IDL under OS2.1

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Wed Oct 08 20:29:37 PDT 2025

Total time taken to generate the page: 0.40041 seconds