A New and Efficient Algorithm-Based Fault Tolerance Scheme for A Million Way Parallelism

Details A New and Efficient Algorithm-Based Fault Tolerance Scheme for A Million Way Parallelism A New and Efficient Algorithm-Based Fault Tolerance Scheme for A Million Way Parallelism

2011-06-21

arxiv.org/abs/1106.4213v1

Computer Science

Distributed, Parallel, and Cluster Computing

11 pages, 8 figures, 1 table, submitted to conference SC 2011

Scientific paper

Fault tolerance overhead of high performance computing (HPC) applications is becoming critical to the efficient utilization of HPC systems at large scale. HPC applications typically tolerate fail-stop failures by checkpointing. Another promising method is in the algorithm level, called algorithmic recovery. These two methods can achieve high efficiency when the system scale is not very large, but will both lose their effectiveness when systems approach the scale of Exaflops, where the number of processors including in system is expected to achieve one million. This paper develops a new and efficient algorithm-based fault tolerance scheme for HPC applications. When failure occurs during the execution, we do not stop to wait for the recovery of corrupted data, but replace them with the corresponding redundant data and continue the execution. A background accelerated recovery method is also proposed to rebuild redundancy to tolerate multiple times of failures during the execution. To demonstrate the feasibility of our new scheme, we have incorporated it to the High Performance Linpack. Theoretical analysis demonstrates that our new fault tolerance scheme can still be effective even when the system scale achieves the Exaflops. Experiment using SiCortex SC5832 verifies the feasibility of the scheme, and indicates that the advantage of our scheme can be observable even in a small scale.

Affiliated with

Also associated with

No associations

Rating

A New and Efficient Algorithm-Based Fault Tolerance Scheme for A Million Way Parallelism does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with A New and Efficient Algorithm-Based Fault Tolerance Scheme for A Million Way Parallelism, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and A New and Efficient Algorithm-Based Fault Tolerance Scheme for A Million Way Parallelism will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-178775