PerfXplain: Debugging MapReduce Job Performance

Details PerfXplain: Debugging MapReduce Job Performance PerfXplain: Debugging MapReduce Job Performance

2012-03-29

arxiv.org/abs/1203.6400v1

Proceedings of the VLDB Endowment (PVLDB), Vol. 5, No. 7, pp. 598-609 (2012)

Computer Science

Databases

VLDB2012

Scientific paper

While users today have access to many tools that assist in performing large scale data analysis tasks, understanding the performance characteristics of their parallel computations, such as MapReduce jobs, remains difficult. We present PerfXplain, a system that enables users to ask questions about the relative performances (i.e., runtimes) of pairs of MapReduce jobs. PerfXplain provides a new query language for articulating performance queries and an algorithm for generating explanations from a log of past MapReduce job executions. We formally define the notion of an explanation together with three metrics, relevance, precision, and generality, that measure explanation quality. We present the explanation-generation algorithm based on techniques related to decision-tree building. We evaluate the approach on a log of past executions on Amazon EC2, and show that our approach can generate quality explanations, outperforming two naive explanation-generation methods.

Affiliated with

Also associated with

No associations

Rating

PerfXplain: Debugging MapReduce Job Performance does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with PerfXplain: Debugging MapReduce Job Performance, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and PerfXplain: Debugging MapReduce Job Performance will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-56943