comp.lang.idl-pvwave archive: archive » multi-threaded IDL programming

Home » Public Forums » archive » multi-threaded IDL programming

Show: Today's Messages :: Show Polls :: Message Navigator
E-mail to friend

multi-threaded IDL programming [message #88130]

Sat, 22 March 2014 09:07

markb77
Messages: 217
Registered: July 2006

Senior Member

I want to try creating objects to do some parallel processing. For example, let's say I need to perform a specific operation on a stack of images. I can create an object that will watch an input queue and wait for an image to be available in the queue. The object would then take the image, process it, and add the results to an output queue. A separate IDL program would be generating the images and collecting the results. In principle, I could create multiple "processing" objects to act in parallel, speeding up the task.

What is the best way to accomplish this in IDL? I am not sure if there is a "queue" object class already written? Would this need to use the IDL-IDL bridge?

Mark

Report message to a moderator

Re: multi-threaded IDL programming [message #88140 is a reply to message #88130]

Mon, 24 March 2014 08:31

Craig Markwardt
Messages: 1869
Registered: November 1996

Senior Member

On Saturday, March 22, 2014 12:07:49 PM UTC-4, superchromix wrote:
> What is the best way to accomplish this in IDL? I am not sure if there is a "queue" object class already written? Would this need to use the IDL-IDL bridge?

IDL doesn't really offer multi-threaded capability, other than the "thread pool" for large vectors. If you really need to do this with IDL, the best way is to run multiple copies of IDL at the same time (easiest if you are using a Unix-like operating system).

Craig

Report message to a moderator

Re: multi-threaded IDL programming [message #88141 is a reply to message #88130]

Mon, 24 March 2014 08:43

Matthew Argall
Messages: 286
Registered: October 2011

Senior Member

Mike Galloy and Tech-X have some parallel compute software for IDL
http://michaelgalloy.com/2013/11/14/fastdl-parallel-processi ng-idl.html

Report message to a moderator

Re: multi-threaded IDL programming [message #88142 is a reply to message #88130]

Mon, 24 March 2014 08:49

Phillip Bitzer
Messages: 223
Registered: June 2006

Senior Member

Yes, you would need bridges.

I've had some success with :

http://www.iluvatar.org/~dwijn/parallelidl

You may also want to check out Mike Galloy's TaskDL.

Report message to a moderator

Re: multi-threaded IDL programming [message #88146 is a reply to message #88141]

Mon, 24 March 2014 09:47

Michael Galloy
Messages: 1114
Registered: April 2006

Senior Member

On 3/24/14, 9:43 AM, Matthew Argall wrote:
> Mike Galloy and Tech-X have some parallel compute software for IDL
> http://michaelgalloy.com/2013/11/14/fastdl-parallel-processi ng-idl.html
>

I have featured some articles on my website recently showing examples of
using mpiDL:

http://michaelgalloy.com/2014/02/25/taskdl-example.html

and TaskDL:

http://michaelgalloy.com/2014/03/11/mpidl-example.html

It seems like you are intending to run "embarassingly parallel" (no
communication between workers) tasks on a stack of images which is what
TaskDL is designed for. TaskDL runs on Linux, OS X, and Windows (but you
need to install Cygwin). It can also run across multiple nodes on Linux
and OS X.

Let me know if you have questions or need more information.

Mike
--
Michael Galloy
www.michaelgalloy.com
Modern IDL: A Guide to IDL Programming (http://modernidl.idldev.com)
Research Mathematician
Tech-X Corporation

Report message to a moderator

Re: multi-threaded IDL programming [message #88147 is a reply to message #88130]

Mon, 24 March 2014 10:43

markb77
Messages: 217
Registered: July 2006

Senior Member

Thanks for the responses. I am running on Windows, and I don't want the code to be dependent on installing Cygwin.. So I would like to check out that Parallel IDL code that Phillip linked to.

Phillip - I can't find the actual code anywhere on that web page.. Is it still available?

thanks
Mark

ps. Ideally this solution would work with the IDL Virtual machine so that it could eventually be distributed.. but I realize this is beyond the capabilities of the IDL-IDL bridge at the moment..

Report message to a moderator

Re: multi-threaded IDL programming [message #88149 is a reply to message #88147]

Mon, 24 March 2014 12:54

Phillip Bitzer
Messages: 223
Registered: June 2006

Senior Member

On Monday, March 24, 2014 12:43:04 PM UTC-5, superchromix wrote:
> Thanks for the responses. I am running on Windows, and I don't want the code to be dependent on installing Cygwin.. So I would like to check out that Parallel IDL code that Phillip linked to.
>
>
>
> Phillip - I can't find the actual code anywhere on that web page.. Is it still available?
>

Sure. On that page (http://www.iluvatar.org/~dwijn/parallelidl), there is a link toward the bottom under the heading "Download" :-)

Report message to a moderator

Previous Topic:	Printf array on a single line
Next Topic:	Trouble plotting GSHHS shapefile

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Wed Oct 08 15:17:10 PDT 2025

Total time taken to generate the page: 0.00681 seconds