comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado
Home » Public Forums » archive » Re: strange behaviour of bytscl by large arrays
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend  		Return to the default flat view Create a new topic Submit Reply
Re: strange behaviour of bytscl by large arrays [message #80040 is a reply to message #79961] Tue, 24 April 2012 00:59 Go to previous messageGo to previous message
Carsten Lechte is currently offline  Carsten Lechte
Messages: 124
Registered: August 2006
Senior Member
On 23/04/12 16:59, Klemen wrote:
> So this is not the precision.[...]

It totally is:

IDL> a=findgen(10000,10000)
IDL> plot, a

IDL> print, a[20000000l], a[20000000l] EQ a[20000000]+1
1.67772e+07 1

Since I tried it on a 2-cpu machine, the second half starts with the
correct value, which then stays the same for the whole second part of
the array:

IDL> print, a[60000000l], a[60000000l] EQ a[60000000]+1
5.00000e+07 1


chl

Report message to a moderator

[Message index]
 
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Read Message
Previous Topic: Using OOB Colors with Filled Contour Plots
Next Topic: IDLDE crashes when opening menus

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Wed Oct 08 18:17:03 PDT 2025

Total time taken to generate the page: 0.00540 seconds
.:: Contact :: Home ::.

Powered by: FUDforum 3.0.7.
Copyright ©2001-2013 FUDforum Bulletin Board Software