comp.lang.idl-pvwave archive
Messages from Usenet group comp.lang.idl-pvwave, compiled by Paulo Penteado

Home » Public Forums » archive » Re: an idl_opserver-like option for IDL 8.0?
Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend 
Switch to threaded view of this topic Create a new topic Submit Reply
Re: an idl_opserver-like option for IDL 8.0? [message #73268] Wed, 03 November 2010 22:46
Mark[1] is currently offline  Mark[1]
Messages: 66
Registered: February 2008
Member
I hadn't noticed the reduction in maximum array size, but it's a bit
of a worry.

Below are reports from memtest under IDL 8.0.1 on my Win32 machine. It
looks like I'll be using the command-line application or a Linux
server for any heavy lifting.

IDLDE:

IDL> memtest
Memory block # 1: 512 Mb (total: 512 Mb)
Memory block # 2: 244 Mb (total: 756 Mb)
Memory block # 3: 159 Mb (total: 915 Mb)
Memory block # 4: 116 Mb (total: 1031 Mb)
Memory block # 5: 65 Mb (total: 1096 Mb)
Memory block # 6: 63 Mb (total: 1159 Mb)
Memory block # 7: 36 Mb (total: 1195 Mb)
Memory block # 8: 30 Mb (total: 1225 Mb)
Memory block # 9: 29 Mb (total: 1254 Mb)
Memory block #10: 28 Mb (total: 1282 Mb)

Command-line:

IDL> memtest
Memory block # 1: 1197 Mb (total: 1197 Mb)
Memory block # 2: 157 Mb (total: 1354 Mb)
Memory block # 3: 107 Mb (total: 1461 Mb)
Memory block # 4: 75 Mb (total: 1536 Mb)
Memory block # 5: 66 Mb (total: 1602 Mb)
Memory block # 6: 52 Mb (total: 1654 Mb)
Memory block # 7: 29 Mb (total: 1683 Mb)
Memory block # 8: 19 Mb (total: 1702 Mb)
Memory block # 9: 18 Mb (total: 1720 Mb)
Memory block #10: 18 Mb (total: 1738 Mb)
Re: an idl_opserver-like option for IDL 8.0? [message #73278 is a reply to message #73268] Wed, 03 November 2010 17:49 Go to previous message
David Fanning is currently offline  David Fanning
Messages: 11724
Registered: August 2001
Senior Member
Paulo Penteado writes:

> Is this not the bug that was fixed in 8.0.1:
>
> "58077 59612 IDL cannot allocate sufficient memory for large arrays."

As I understand my conversation this morning, the problem
is bigger than this.

Cheers,

David


--
David Fanning, Ph.D.
Fanning Software Consulting, Inc.
Coyote's Guide to IDL Programming: http://www.dfanning.com/
Sepore ma de ni thui. ("Perhaps thou speakest truth.")
Re: an idl_opserver-like option for IDL 8.0? [message #73279 is a reply to message #73278] Wed, 03 November 2010 17:31 Go to previous message
penteado is currently offline  penteado
Messages: 866
Registered: February 2018
Senior Member
Administrator
On Nov 3, 4:17 pm, David Fanning <n...@dfanning.com> wrote:
> They are trying to sort out the problem now, but there
> is some thought to going back to a separated workbench/process
> arrangement for Windows computers. All of this is still
> to be determined, but the folks at ITTVIS understand that
> the current arrangement is not ideal.

Is this not the bug that was fixed in 8.0.1:

"58077 59612 IDL cannot allocate sufficient memory for large arrays."

?
Re: an idl_opserver-like option for IDL 8.0? [message #73300 is a reply to message #73279] Wed, 03 November 2010 11:17 Go to previous message
David Fanning is currently offline  David Fanning
Messages: 11724
Registered: August 2001
Senior Member
Doug Martin writes:

> Thanks for the suggestion! It turns out that your workaround is the
> same as the Tech Tip 4603
>
> http://www.ittvis.com/services/techtip.asp?ttid=4603
>
> I still end up being hit with the memory cap with arrays in 8.0 about
> half the size of 7.0. Shoot.

I was just on the phone with ITTVIS about another, related
problem. In IDL 7 the workbench was separated from the IDL
process. They decided to combine the workbench and the IDL
process in version 8, primarily because they had to do this
to get the Mac version running properly. But, unfortunately,
this has caused additional problems for Windows computers,
and, in particular, for 64-bit Windows computers, which is
what I am trying to run IDL 8 on. One of the problems
is extreme fragility, another is this memory issue.

They are trying to sort out the problem now, but there
is some thought to going back to a separated workbench/process
arrangement for Windows computers. All of this is still
to be determined, but the folks at ITTVIS understand that
the current arrangement is not ideal.

Cheers,

David


--
David Fanning, Ph.D.
Fanning Software Consulting, Inc.
Coyote's Guide to IDL Programming: http://www.dfanning.com/
Sepore ma de ni thui. ("Perhaps thou speakest truth.")
Re: an idl_opserver-like option for IDL 8.0? [message #73301 is a reply to message #73300] Wed, 03 November 2010 11:09 Go to previous message
Doug Martin is currently offline  Doug Martin
Messages: 2
Registered: November 2010
Junior Member
On Nov 3, 12:29 pm, David Fanning <n...@dfanning.com> wrote:
> Doug Martin writes:
>> Is anyone aware of a way to get IDL 8.0 to use a secondary routine
>> like the idl_opserver.exe of 7.0?  My problem is this:
>
>> On a Windows XP SP2 machine, 2GB memory, in IDL 7.0 I could make and
>> use reasonably large arrays - say,
>> a=fltarr(512,512,1200).  This used about 1 GB worth of memory.
>
>> In IDL 8.0, I'm stuck with arrays with a max of about 500 MB memory
>> before the good old "unable to allocate memory" message pops up.  And
>> this is after following the suggestion in Tech Tip 4603.  Before that,
>> I couldn't even get 200 MB reliably.
>
>> In any case, does anyone know of a workaround here?  
>
> There was a problem in this version of IDL. There is
> a workaround in the article:
>
>   http://www.dfanning.com/misc_tips/idl8mem.html
>
> Cheers,
>
> David
>
> --
> David Fanning, Ph.D.
> Fanning Software Consulting, Inc.
> Coyote's Guide to IDL Programming:http://www.dfanning.com/
> Sepore ma de ni thui. ("Perhaps thou speakest truth.")

Dear David -

Thanks for the suggestion! It turns out that your workaround is the
same as the Tech Tip 4603

http://www.ittvis.com/services/techtip.asp?ttid=4603

I still end up being hit with the memory cap with arrays in 8.0 about
half the size of 7.0. Shoot.

-Doug
Re: an idl_opserver-like option for IDL 8.0? [message #73302 is a reply to message #73301] Wed, 03 November 2010 10:29 Go to previous message
David Fanning is currently offline  David Fanning
Messages: 11724
Registered: August 2001
Senior Member
Doug Martin writes:

> Is anyone aware of a way to get IDL 8.0 to use a secondary routine
> like the idl_opserver.exe of 7.0? My problem is this:
>
> On a Windows XP SP2 machine, 2GB memory, in IDL 7.0 I could make and
> use reasonably large arrays - say,
> a=fltarr(512,512,1200). This used about 1 GB worth of memory.
>
> In IDL 8.0, I'm stuck with arrays with a max of about 500 MB memory
> before the good old "unable to allocate memory" message pops up. And
> this is after following the suggestion in Tech Tip 4603. Before that,
> I couldn't even get 200 MB reliably.
>
> In any case, does anyone know of a workaround here?

There was a problem in this version of IDL. There is
a workaround in the article:

http://www.dfanning.com/misc_tips/idl8mem.html

Cheers,

David

--
David Fanning, Ph.D.
Fanning Software Consulting, Inc.
Coyote's Guide to IDL Programming: http://www.dfanning.com/
Sepore ma de ni thui. ("Perhaps thou speakest truth.")
  Switch to threaded view of this topic Create a new topic Submit Reply
Previous Topic: Re: IDL function to get area cover of polygon
Next Topic: Re: capture astronomy IDL's library stderr into a file

-=] Back to Top [=-
[ Syndicate this forum (XML) ] [ RSS ] [ PDF ]

Current Time: Wed Oct 08 11:53:56 PDT 2025

Total time taken to generate the page: 0.00822 seconds