comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado

Home » Public Forums » archive » Floating underflow in a plot
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend 
Return to the default flat view Create a new topic Submit Reply
Re: Floating underflow in a plot [message #90785 is a reply to message #90779] Wed, 15 April 2015 12:04 Go to previous messageGo to previous message
Jeremy Bailin is currently offline  Jeremy Bailin
Messages: 618
Registered: April 2008
Senior Member
On Wednesday, April 15, 2015 at 12:58:16 PM UTC-5, miguelfigue...@gmail.com wrote:
>> Seems to be a very strange error. I can't explain it. However, are you
>> really sure, that the floating underflow error leads to missing
>> points, as you say in the answer to Craig's post?
>
> The underflow problem was not the cause of the error
>
> I found the problem : the subscript l_n for the array "resultat" can be very high so I needed this variable to have a double precision.
>
> l_n=double(l_n) fixed the problem.
>
> Thank you for your help ;)
>
> Miguel

Ah, interesting. You don't really want to be using a double for something that's fundamentally an integer. But I see that you're actually using a short integer -- any integer that you don't know a priori will never go about 32000 should always be defined as a long:

l_n=0L

And anything that is really a floating-point number should not be declared as an integer:

To=220.0

-Jeremy.
[Message index]
 
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Previous Topic: Regridding NCEP Data
Next Topic: FG-arithmetic error and moving objects

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Wed Oct 08 15:56:54 PDT 2025

Total time taken to generate the page: 0.00284 seconds