comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado

Home » Public Forums » archive » mathematics-accuracy
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend 
Return to the default flat view Create a new topic Submit Reply
mathematics-accuracy [message #51380] Wed, 15 November 2006 13:20
creon is currently offline  creon
Messages: 3
Registered: November 2006
Junior Member
Hello. I've been having a problem on math operations with floating
point numbers. I'll be thankful if you help me out with this.
Now, I have a series of floating-point numbers - str={arr:findgen(x)},
codes.... the first element of the series is 1.20740. i need to get the
square of this, which is 1.45781. when i type
print, str.arr[0]^2
it returns 1.45780. i tried setting the data types to double - with
dindgen-, and had 1.45783. I don't know what the problem is, and how i
can fix it. please help. thanks.
[Message index]
 
Read Message
Previous Topic: Data management... but Execution halts!!! T.T
Next Topic: Re: mathematics-accuracy

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Wed Oct 08 16:01:32 PDT 2025

Total time taken to generate the page: 0.05274 seconds