comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado

Home » Public Forums » archive » Re: Strange behavior of /cumulative keyword in total()
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend 
Return to the default flat view Create a new topic Submit Reply
Re: Strange behavior of /cumulative keyword in total() [message #63369 is a reply to message #63285] Tue, 04 November 2008 12:40 Go to previous message
Chris[6] is currently offline  Chris[6]
Messages: 84
Registered: July 2008
Member
> The difference between any two entries in the array should be 0.1,
> plus a roundoff error that should be proportional to the value of
> cumul. Try this:

I see - it's not that roundoff errors are accumulating over the sum,
but that differences of 0.1 are expressed less and less precisely as
numbers grow. To bad the roundoff error isn't random, so that the
effect would wash out...

Thanks for the clarification
chris
[Message index]
 
Read Message
Read Message
Read Message
Previous Topic: Re: specialized color tables
Next Topic: segment vector with missing data

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Sat Oct 11 00:33:51 PDT 2025

Total time taken to generate the page: 0.15505 seconds