comp.lang.idl-pvwave archive: archive » Re: How to improve the efficiency of IDL on cluster

Home » Public Forums » archive » Re: How to improve the efficiency of IDL on cluster

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

Re: How to improve the efficiency of IDL on cluster [message #84395]

Mon, 03 June 2013 21:14

Craig Markwardt
Messages: 1869
Registered: November 1996

Senior Member

On Monday, June 3, 2013 11:09:00 AM UTC-4, Chang Liao wrote:
> Due to the massive mount of remote sensing dataset, it takes days to finish just one year's calculation.
>
> I can specific the computer node, memory(48G/96G), and cores(24 cores) for my QBS job. So I am thinking shall I use multi-threading or other ways to speedup the calculation.

I guess it's an obvious question but I'll ask it any way: have you already vectorized your IDL code?

I see many scientist types who prefer to write IDL code like this,
for i = 0, n_elements(v)-1 do begin
v[i] = a[i] + b[i]
endfor
even though the obvious vectorized IDL version is,
v = a + b
which is both faster *and* easier to read.

The first step is to vectorize the inner loops of your calculations.

Use the profiler to find out where your computational bottlenecks are.

Craig

Report message to a moderator

[Message index]

		Re: How to improve the efficiency of IDL on cluster By: Craig Markwardt on Mon, 03 June 2013 21:14
		Re: How to improve the efficiency of IDL on cluster By: Michael Galloy on Mon, 03 June 2013 14:25

Previous Topic:	max and min values
Next Topic:	Way to Edit Coordinates Graphically?

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Fri Oct 10 12:17:18 PDT 2025

Total time taken to generate the page: 1.44001 seconds