An MPI Implementation of a Self-Submitting Parallel Job Queue

Details An MPI Implementation of a Self-Submitting Parallel Job Queue An MPI Implementation of a Self-Submitting Parallel Job Queue

2012-04-19

arxiv.org/abs/1204.4475v1

Computer Science

Distributed, Parallel, and Cluster Computing

Scientific paper

We present a simple and easy to apply methodology for using high-level self-submitting parallel job queues in an MPI environment. Using C++, we implemented a library of functions, MPQueue, both for testing our concepts and for use in real applications. In particular, we have applied our ideas toward solving computational combinatorics problems and for finding bifurcation diagrams of solutions of partial differential equations (PDE). Our method is general and can be applied in many situations without a lot of programming effort. The key idea is that workers themselves can easily submit new jobs to the currently running job queue. Our applications involve complicated data structures, so we employ serialization to allow data to be effortlessly passed between nodes. Using our library, one can solve large problems in parallel without being an expert in MPI. We demonstrate our methodology and the features of the library with several example programs, and give some results from our current PDE research. We show that our techniques are efficient and effective via overhead and scaling experiments.

Affiliated with

Also associated with

No associations

Rating

An MPI Implementation of a Self-Submitting Parallel Job Queue does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with An MPI Implementation of a Self-Submitting Parallel Job Queue, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and An MPI Implementation of a Self-Submitting Parallel Job Queue will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-4853