comp.lang.idl-pvwave archive: archive » Re: Aw: Re: TOTAL gives totally different result on identical array

Home » Public Forums » archive » Re: Aw: Re: TOTAL gives totally different result on identical array

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: Aw: Re: TOTAL gives totally different result on identical array [message #76901]

Fri, 08 July 2011 06:38

David Fanning
Messages: 11724
Registered: August 2001

Senior Member

M. Suklitsch writes:

> So, if I get the discussion in your thread right there's
> "simply" a precision and/or array size problem with the
> builtin TOTAL function? That's not really reassuring
> since I am dealing with arrays of such size all the time.

Then you had better really pay attention to how computers
represent numbers! :-)

http://www.idlcoyote.com/math_tips/sky_is_falling.html
http://www.idlcoyote.com/math_tips/razoredge.html

Cheers,

David

--
David Fanning, Ph.D.
Fanning Software Consulting, Inc.
Coyote's Guide to IDL Programming: http://www.dfanning.com/
Sepore ma de ni thue. ("Perhaps thos speakest truth.")

Report message to a moderator

Previous Topic:	TOTAL gives totally different result on identical array
Next Topic:	Aw: Re: Aw: Re: TOTAL gives totally different result on identical array

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Fri Oct 10 02:00:17 PDT 2025

Total time taken to generate the page: 1.04135 seconds