comp.lang.idl-pvwave archive: archive » Re: Type of array to store large numbers

Home » Public Forums » archive » Re: Type of array to store large numbers

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: Type of array to store large numbers [message #80268 is a reply to message #80267]

Fri, 25 May 2012 05:58

Fabzi
Messages: 305
Registered: July 2010

Senior Member

On 05/25/2012 02:50 PM, Sir Loin Steak wrote:
> Hi all
>
> I have a lot of numbers that have high precision (such as 401.4798584)
> and I am trying to find what sort of array to use to store these
> values. Can anyone help? I've tried floats, doubles etc, and none keep
> the precision to more than 5 d.p. Am I missing something obvious, or
> is what I'm after impossible?!!

What do you mean with "keep" the precision?

IDL> f = 401.4798584
IDL> d = 401.4798584d
IDL> print, f
401.480
IDL> print, d
401.47986
IDL> print, f, FORMAT='(F12.8)'
401.47985840
IDL> print, d, FORMAT='(F12.8)'
401.47985840

http://www.idlcoyote.com/math_tips/sky_is_falling.html

Cheers

Report message to a moderator

[Message index]

		Re: Type of array to store large numbers By: Carsten Lechte on Fri, 25 May 2012 07:02
		Re: Type of array to store large numbers By: Russell Ryan on Fri, 25 May 2012 06:36
		Re: Type of array to store large numbers By: Sir Loin Steak on Fri, 25 May 2012 06:07
		Re: Type of array to store large numbers By: Fabzi on Fri, 25 May 2012 05:58

Previous Topic:	Type of array to store large numbers
Next Topic:	Pan/Zoom Line Plots with Coyote Graphics

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Sun Nov 30 17:29:25 PST 2025

Total time taken to generate the page: 1.52312 seconds