Hybrid-parallel sparse matrix-vector multiplication with explicit communication overlap on current multicore-based systems

Details Hybrid-parallel sparse matrix-vector multiplication with explicit communication overlap on current multicore-based systems Hybrid-parallel sparse matrix-vector multiplication with explicit communication overlap on current multicore-based systems

2011-06-29

arxiv.org/abs/1106.5908v1

Parallel Processing Letters 21(3), 339-358 (2011)

Computer Science

Distributed, Parallel, and Cluster Computing

16 pages, 10 figures

Scientific paper

10.1142/S0129626411000254

We evaluate optimized parallel sparse matrix-vector operations for several representative application areas on widespread multicore-based cluster configurations. First the single-socket baseline performance is analyzed and modeled with respect to basic architectural properties of standard multicore chips. Beyond the single node, the performance of parallel sparse matrix-vector operations is often limited by communication overhead. Starting from the observation that nonblocking MPI is not able to hide communication cost using standard MPI implementations, we demonstrate that explicit overlap of communication and computation can be achieved by using a dedicated communication thread, which may run on a virtual core. Moreover we identify performance benefits of hybrid MPI/OpenMP programming due to improved load balancing even without explicit communication overlap. We compare performance results for pure MPI, the widely used "vector-like" hybrid programming strategies, and explicit overlap on a modern multicore-based cluster and a Cray XE6 system.

Affiliated with

Also associated with

No associations

Rating

Hybrid-parallel sparse matrix-vector multiplication with explicit communication overlap on current multicore-based systems does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Hybrid-parallel sparse matrix-vector multiplication with explicit communication overlap on current multicore-based systems, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Hybrid-parallel sparse matrix-vector multiplication with explicit communication overlap on current multicore-based systems will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-359220