comp.lang.idl-pvwave archive: archive » How to improve the efficiency of IDL on cluster

Home » Public Forums » archive » How to improve the efficiency of IDL on cluster

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: How to improve the efficiency of IDL on cluster [message #84573 is a reply to message #84411]

Tue, 04 June 2013 14:26

Kenneth Bowman
Messages: 86
Registered: November 2006

Member

On 2013-06-03 15:09:00 +0000, Chang Liao said:

> Hi!
> I am currently running IDL on a Linux cluster.
> Due to the massive mount of remote sensing dataset, it takes days to
> finish just one year's calculation.
> I can specific the computer node, memory(48G/96G), and cores(24 cores)
> for my QBS job. So I am thinking shall I use multi-threading or other
> ways to speedup the calculation.
> Does anyone have any suggestion or experience in this related topics, I
> couldn't find too much on Exelis or Google. I do remember IDL has some
> demo in earlier version, but it's gone in IDL 8.0 +.
>
> Please help, thanks in advance!

You can get some benefit from multi-threading, and you can go to fully
parallel, as Mike Galloy suggests, but first, can you trivially
parallelize the job by splitting it into independent parts. Such as,
process January as one job and February as a separate job?

If so, and memory permitting, you will probably do much better than
multi-threading.

And, of course, always vectorize first, as Craig suggested.

Ken Bowman

Report message to a moderator

[Message index]

		How to improve the efficiency of IDL on cluster By: Chang Liao on Mon, 03 June 2013 08:09
		Re: How to improve the efficiency of IDL on cluster By: victor.cazcarra on Wed, 05 June 2013 08:18
		Re: How to improve the efficiency of IDL on cluster By: Matt Francis on Tue, 04 June 2013 20:23
		Re: How to improve the efficiency of IDL on cluster By: Kenneth Bowman on Tue, 04 June 2013 14:26

Previous Topic:	Re: How do I get IDL to place a string array into a netdcf file attribute?
Next Topic:	Last Box of IDL Graphics Books

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Wed Oct 08 19:09:51 PDT 2025

Total time taken to generate the page: 0.00658 seconds