Computer Science – Distributed – Parallel – and Cluster Computing
Scientific paper
2002-06-24
Computer Science
Distributed, Parallel, and Cluster Computing
16 pages, 8 figures
Scientific paper
The efficient implementation of collective communiction operations has received much attention. Initial efforts produced "optimal" trees based on network communication models that assumed equal point-to-point latencies between any two processes. This assumption is violated in most practical settings, however, particularly in heterogeneous systems such as clusters of SMPs and wide-area "computational Grids," with the result that collective operations perform suboptimally. In response, more recent work has focused on creating topology-aware trees for collective operations that minimize communication across slower channels (e.g., a wide-area network). While these efforts have significant communication benefits, they all limit their view of the network to only two layers. We present a strategy based upon a multilayer view of the network. By creating multilevel topology-aware trees we take advantage of communication cost differences at every level in the network. We used this strategy to implement topology-aware versions of several MPI collective operations in MPICH-G2, the Globus Toolkit[tm]-enabled version of the popular MPICH implementation of the MPI standard. Using information about topology provided by MPICH-G2, we construct these multilevel topology-aware trees automatically during execution. We present results demonstrating the advantages of our multilevel approach by comparing it to the default (topology-unaware) implementation provided by MPICH and a topology-aware two-layer implementation.
Foster Ian
Gropp William
Karonis N. T.
Lusk Ewing
Supinski B. de
No associations
LandOfFree
A Multilevel Approach to Topology-Aware Collective Operations in Computational Grids does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with A Multilevel Approach to Topology-Aware Collective Operations in Computational Grids, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and A Multilevel Approach to Topology-Aware Collective Operations in Computational Grids will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-2888