Re: bytscl Problems [message #7920] |
Fri, 24 January 1997 00:00 |
dwu
Messages: 14 Registered: November 1995
|
Junior Member |
|
|
The problem comes from overflow.
I think there are some elements in your slice array which are less
than 395862411-(2^31-1). The overflow was made during operation.
Ding Wu
Phil Williams (williams@irc.chmcc.org) wrote:
: What's going on here:
:
: IDL> help,slice
: SLICE LONG = Array(64, 64)
: IDL> print,!d.n_colors
: 256
: IDL> print,max(slice)
: 395862411
: IDL> bslice = bytscl(slice)
: IDL> print,max(bslice)
: 255
: IDL> bslice = bytscl(slice,top = 100)
: IDL> print,max(bslice)
: 245
:
: Shouldn't the max of bslice now be 100? Is this a bug in bslice?
:
: Any help would be appreciated.
:
: Thanks,
: Phil
: --
|
|
|