comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado

Home » Public Forums » archive » Re: bytscl Problems
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend 
Switch to threaded view of this topic Create a new topic Submit Reply
Re: bytscl Problems [message #7920] Fri, 24 January 1997 00:00
dwu is currently offline  dwu
Messages: 14
Registered: November 1995
Junior Member
The problem comes from overflow.

I think there are some elements in your slice array which are less
than 395862411-(2^31-1). The overflow was made during operation.

Ding Wu

Phil Williams (williams@irc.chmcc.org) wrote:
: What's going on here:
:
: IDL> help,slice
: SLICE LONG = Array(64, 64)
: IDL> print,!d.n_colors
: 256
: IDL> print,max(slice)
: 395862411
: IDL> bslice = bytscl(slice)
: IDL> print,max(bslice)
: 255
: IDL> bslice = bytscl(slice,top = 100)
: IDL> print,max(bslice)
: 245
:
: Shouldn't the max of bslice now be 100? Is this a bug in bslice?
:
: Any help would be appreciated.
:
: Thanks,
: Phil
: --
  Switch to threaded view of this topic Create a new topic Submit Reply
Previous Topic: cross-correlating images
Next Topic: color buttons

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Fri Oct 10 09:10:20 PDT 2025

Total time taken to generate the page: 0.48016 seconds