comp.lang.idl-pvwave archive: archive » How to improve the efficiency of IDL on cluster

Home » Public Forums » archive » How to improve the efficiency of IDL on cluster

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: How to improve the efficiency of IDL on cluster [message #84568 is a reply to message #84411]

Tue, 04 June 2013 20:23

Matt Francis
Messages: 94
Registered: May 2010

Member

On Tuesday, 4 June 2013 01:09:00 UTC+10, Chang Liao wrote:
> Hi!
>
> I am currently running IDL on a Linux cluster.
>
> Due to the massive mount of remote sensing dataset, it takes days to finish just one year's calculation.
>
> I can specific the computer node, memory(48G/96G), and cores(24 cores) for my QBS job. So I am thinking shall I use multi-threading or other ways to speedup the calculation.
>
> Does anyone have any suggestion or experience in this related topics, I couldn't find too much on Exelis or Google. I do remember IDL has some demo in earlier version, but it's gone in IDL 8.0 +.
>
>
>
> Please help, thanks in advance!

Maybe it's heresy around these here parts, but in my view if you're putting IDL and cluster in the same sentence you're doing it wrong. IDL is a great Interactive Data Language but it's simply the wrong tool for the job for large parallel batch processing. You can put lipstick on a pig, but there are much better alternatives out there for doing this kind of stuff, both easier to use (for this use case) and faster.

Report message to a moderator

[Message index]

		How to improve the efficiency of IDL on cluster By: Chang Liao on Mon, 03 June 2013 08:09
		Re: How to improve the efficiency of IDL on cluster By: victor.cazcarra on Wed, 05 June 2013 08:18
		Re: How to improve the efficiency of IDL on cluster By: Matt Francis on Tue, 04 June 2013 20:23
		Re: How to improve the efficiency of IDL on cluster By: Kenneth Bowman on Tue, 04 June 2013 14:26

Previous Topic:	Re: How do I get IDL to place a string array into a netdcf file attribute?
Next Topic:	Last Box of IDL Graphics Books

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Wed Oct 08 17:24:20 PDT 2025

Total time taken to generate the page: 0.00363 seconds