Computer Science – Distributed – Parallel – and Cluster Computing
Scientific paper
2012-03-19
Computer Science
Distributed, Parallel, and Cluster Computing
This paper has been submitted to 12th International Conference on Algorithms and Architectures for Parallel Processing (ICA3PP
Scientific paper
In this paper, we present an approach to predict the total CPU utilization in terms of CPU clock tick of applications when running on MapReduce framework. Our approach has two key phases: profiling and modeling. In the profiling phase, an application is run several times with different sets of MapReduce configuration parameters to profile total CPU clock tick of the application on a given platform. In the modeling phase, multi linear regression is used to map the sets of MapReduce configuration parameters (number of Mappers, number of Reducers, size of File System (HDFS) and the size of input file) to total CPU clock ticks of the application. This derived model can be used for predicting total CPU requirements of the same application when using MapReduce framework on the same platform. Our approach aims to eliminate error-prone manual processes and presents a fully automated solution. Three standard applications (WordCount, Exim Mainlog parsing and Terasort) are used to evaluate our modeling technique on pseudo-distributed MapReduce platforms. Results show that our automated model generation procedure can effectively characterize total CPU clock tick of these applications with average prediction error of 3.5%, 4.05% and 2.75%, respectively.
Lee Young Choon
Rizvandi Nikzad Babaii
Zomaya Albert Y.
No associations
LandOfFree
On Modeling CPU Utilization of MapReduce Applications does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with On Modeling CPU Utilization of MapReduce Applications, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and On Modeling CPU Utilization of MapReduce Applications will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-212120