| Re: Random 'Unable to allocate memory' error [message #92118 is a reply to message #92107] |
Thu, 15 October 2015 04:01   |
Kai Heckel
Messages: 51
Registered: April 2015
|
Member |
|
|
Am Mittwoch, 14. Oktober 2015 16:59:35 UTC+2 schrieb Paul van Delst:
> Hello,
>
> On 10/14/15 07:15, Haje Korth wrote:
>> Hm, I thought you could indeed be suffering from memory
>> fragmentation,
>> but I thought this is only a windows issue. Since you are on linux, you
>> should be automatically using 64 bit as the 32 bit version is no longer
>> included in recent releases. In this case, I really don't know what
>> causes your issue. I would check with support.
>
> This is probably unrelated, but I experienced a similar issue recently.
>
> In my case it was because I was attempting to do some IDL processing on
> a frontend (or login) node of the supacomputer I was using. That is
> (somehow) restricted by the system setup. I'm guessing everything was
> working fine until I passed some memory usage limit or there were too
> many other folks on the login node - I was not doing anything too
> complicated or big.
>
> When I started an interactive job on a compute node the 'Unable to
> allocate memory' error went away. (Aside: The sysdocs said to run IDL, a
> whole node should be taken! I guess memory management is an issue in
> general with IDL.)
>
> So, if the OP is using IDL on a shared system (s/he did say "server"
> so...other users?) maybe the other users are requesting enough resources
> to make the OP's script run out of available memory in a seemingly
> random way?
>
> (I'm waving my hands about in the air trying to make the scenario seem
> reasonable :o)
>
> cheers,
>
> paulv
>
>
>>
>> On Wednesday, October 14, 2015 at 3:44:35 AM UTC-4, Kai Heckel wrote:
>>> Am Dienstag, 13. Oktober 2015 20:11:47 UTC+2 schrieb Haje Korth:
>>>> I assume this is Windows OS. Did you try the 64-bit version of IDL?
>>>>
>>>> On Tuesday, October 13, 2015 at 9:43:42 AM UTC-4, Kai Heckel
>>>> wrote:
>>>> > Hello everyone!
>>>> >
>>>> > I am currently processing a time series. For some reasons the
>>>> > 'Unable to allocate memory' error occurs sometimes. I don't know the
>>>> > reasons as the appearance ist not systematic. Sometimes the error occurs
>>>> > sometime not. I can say that is not file specific.
>>>> >
>>>> > Any Ideas?
>>>> >
>>>> > Thanks,
>>>> > Kai
>>>
>>>
>>> Thanks for your suggestions so far!
>>>
>>> I am processing on a linux server. So it shouldn't be anything Windows related.
>>
Good idea Paul but I am the only one processing on the server.... However, 32 GB of RAM should be enough for me and others to process.
Here is another idea I have:
In all processes large arrays are created. Not only one but multiple arrays. Is possible that these variables need to be deleted after they were used in each file loop?
BTW: Is it possible to delete all variable except for one?
|
|
|
|
comp.lang.idl-pvwave archive
Members
Search
Help
Login
Home
