comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado

Home » Public Forums » archive » problem with FIX function
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend 
Return to the default flat view Create a new topic Submit Reply
Re: problem with FIX function [message #93884 is a reply to message #93881] Tue, 15 November 2016 06:29 Go to previous messageGo to previous message
yuxipang is currently offline  yuxipang
Messages: 3
Registered: April 2014
Junior Member
On Tuesday, November 15, 2016 at 9:12:19 AM UTC-5, AGW wrote:
> Hi, all
>
> ;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;
> IDL> x=40251.00
> IDL> print,fix(x)
> -25285
> ;;;;;;;;;;;;;;;;;;;;;;;;;;;;
> How it is result, what is the promplem?
x is beyond the limit of a signed integer range [-32,768 to +32,767] when using fix(x). Try this instead ...
print, fix(x, type=3) ; convert to long integer or
print, long(x)

Hope this helps!
[Message index]
 
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Previous Topic: Re: Divide the world into hexagons
Next Topic: Copying HDF5 datasets to a new HDF5 file

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Wed Oct 08 17:55:29 PDT 2025

Total time taken to generate the page: 0.00253 seconds