comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado

Home » Public Forums » archive » modulo operator
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend 
Return to the default flat view Create a new topic Submit Reply
Re: modulo operator [message #86448 is a reply to message #86447] Sun, 10 November 2013 14:05 Go to previous message
tom.grydeland is currently offline  tom.grydeland
Messages: 51
Registered: September 2012
Member
On Saturday, November 9, 2013 4:53:14 PM UTC+1, Sebastian Luque wrote:

> Thank you both for these pointers. I didn't expect the difference to be so large due to these numerical representation issues. So what is the canonical way to guard against this?

If you want to work with an integral number of tenths, multiply by 10 and do your mod's in integer math before dividing by 10 again.

> Seb

--T
[Message index]
 
Read Message
Read Message
Read Message
Read Message
Read Message
Previous Topic: strange !P.multi[0] behavior??
Next Topic: Feature request for DILATE function

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Sat Oct 11 10:11:31 PDT 2025

Total time taken to generate the page: 0.56153 seconds