comp.lang.idl-pvwave archive: archive

Home » Public Forums » archive » Conversion Error?

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Conversion Error? [message #16680]

Mon, 16 August 1999 00:00

Laurent Chardon
Messages: 8
Registered: June 1999

Junior Member

I can't figure this out. Is it a bug or something that I can not understand?
This is with IDL 5.2 running on a PII 333 on Windows NT.

If I do

IDL> size=double(12990)
IDL> help,size
SIZE DOUBLE = 12990.000
IDL> c=fltarr(size)
IDL> help,c

I get

C FLOAT = Array[12990]

which is what I expect.

But... If I do

IDL> size=(double(200-70.1))/0.01
IDL> help,size
SIZE DOUBLE = 12990.000
IDL> c=fltarr(size)
IDL> help,c

I get

C FLOAT = Array[12989]

Does anyone know why??? I am starting to not trust any of my previous
calculations done with IDL. Or is this a "feature" of the Pentium II?

Any help would be appreciated...

Laurent Chardon
Trent University

Report message to a moderator

[Message index]

		Conversion Error? By: Laurent Chardon on Mon, 16 August 1999 00:00
		Re: Conversion Error? By: m218003 on Tue, 17 August 1999 00:00
		Re: Conversion Error? By: steinhh on Tue, 17 August 1999 00:00
		Re: Conversion Error? By: Med Bennett on Mon, 16 August 1999 00:00
		Re: Conversion Error? By: davidf on Mon, 16 August 1999 00:00
		Re: Conversion Error? By: Laurent Chardon on Mon, 16 August 1999 00:00
		Re: Conversion Error? By: m218003 on Mon, 16 August 1999 00:00

Previous Topic:	looking for some software to convert idl format data to text
Next Topic:	seperators in menus

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Fri Oct 10 12:11:12 PDT 2025

Total time taken to generate the page: 1.28429 seconds