comp.lang.idl-pvwave archive: archive

Home » Public Forums » archive » Re: BYTES to LONG

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: BYTES to LONG [message #22335 is a reply to message #22334]

Tue, 07 November 2000 00:00

Paul van Delst
Messages: 364
Registered: March 1997

Senior Member

"J.D. Smith" wrote:
>
> Paul van Delst wrote:
>>
>> For some reason the TOTAL returned a floating point number? Weird. Never noticed that
>> before.
>>
>
> The total() function always converts to floating point before the sum,
> to avoid overflow issues. Consider:
>
> a=total(bindgen(256))
>
> if it did the total as bytes, that would overflow. Of course, it could
> have done them as regular ints, but how should it decide, a priori? I
> for one use total a lot in testing various conditions, and it always
> bothered me that I had to test the floating result, but there's really
> no other clean solution.

You're absolutely right, of course. I've spent the last month writing a crapload of f90
code so when I saw a type that isn't what I thought I had declared it, I momentarily
freaked.

--
Paul van Delst Ph: (301) 763-8000 x7274
CIMSS @ NOAA/NCEP Fax: (301) 763-8545
Rm.207, 5200 Auth Rd. Email: pvandelst@ncep.noaa.gov
Camp Springs MD 20746

Report message to a moderator

[Message index]

		Re: BYTES to LONG By: Paul van Delst on Wed, 08 November 2000 00:00
		Re: BYTES to LONG By: Kelly Dean on Wed, 08 November 2000 00:00
		Re: BYTES to LONG By: Kelly Dean on Tue, 07 November 2000 00:00
		Re: BYTES to LONG By: Paul van Delst on Tue, 07 November 2000 00:00
		Re: BYTES to LONG By: John-David T. Smith on Tue, 07 November 2000 00:00
		Re: BYTES to LONG By: davidf on Tue, 07 November 2000 00:00
		Re: BYTES to LONG By: Paul van Delst on Tue, 07 November 2000 00:00
		Re: BYTES to LONG By: Med Bennett on Tue, 07 November 2000 00:00

Previous Topic:	Electrical Engineer/Controls Specialist Wanted
Next Topic:	Re: UTM conversion

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Sat Oct 11 06:25:47 PDT 2025

Total time taken to generate the page: 0.24029 seconds