comp.lang.idl-pvwave archive: archive

Home » Public Forums » archive » Re: Math error!?

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: Math error!? [message #866]

Wed, 07 April 1993 11:21

zawodny
Messages: 121
Registered: August 1992

Senior Member

In article <1pv56eINN659@tamsun.tamu.edu> woody@gergu2.tamu.edu (Woody Lee) writes:
>
> Running pv-wave 4.00 on a DEC 5000 ultrix4.2a
>
> WAVE> print,80000.958333333+0.0000115741,format='(f20.10)
> 80000.9609375000
>
>
> Why do I get this math error...
> --
> Woody Lee -=-=- woody@gergu2.tamu.edu -=-=- (409) 862-2321

Try using double precision.

IDL> print,80000.958333333D00 + 0.0000115741d00,format='(f20.10)
80000.9583449071

--
Joseph M. Zawodny (KO4LW) NASA Langley Research Center
Internet: zawodny@arbd0.larc.nasa.gov MS-475, Hampton VA, 23681-0001
Packet: ko4lw@wb0tax.va.usa

Report message to a moderator

[Message index]

Re: Math error!?

By: zawodny on Wed, 07 April 1993 11:21

Previous Topic:	Math error!?
Next Topic:	Two quick PLOT questions

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Mon Dec 01 10:18:46 PST 2025

Total time taken to generate the page: 1.60237 seconds