comp.lang.idl-pvwave archive: archive

Members
Search
Help
Login
Home

Home » Public Forums » archive » Re: decimal numbers

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: decimal numbers [message #70913]

Tue, 11 May 2010 16:45

fgg
Messages: 67
Registered: April 2010

Member

> Just use
>
> a=358983d-6
>
> 10^6 overflows integers (16 bit by default):
>
> IDL> print,10^6
> 16960
>
> If you want to use 10^6, use either 1d6, 1e6, or if you want integers,
> some larger integer type, such as 10L^6.
>
> See
>
> http://groups.google.com/group/comp.lang.idl-pvwave/browse_t hread/thr...

Great! Thanks a lot!

Report message to a moderator

[Message index]

		Re: decimal numbers By: fgg on Tue, 11 May 2010 16:45
		Re: decimal numbers By: penteado on Tue, 11 May 2010 16:30
		Re: decimal numbers By: R.G.Stockwell on Tue, 11 May 2010 16:25

Previous Topic:	decimal numbers
Next Topic:	Re: SST data

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Sat Oct 11 11:07:53 PDT 2025

Total time taken to generate the page: 0.24023 seconds