A Study on Using Uncertain Time Series Matching Algorithms in Map-Reduce Applications

Details A Study on Using Uncertain Time Series Matching Algorithms in Map-Reduce Applications A Study on Using Uncertain Time Series Matching Algorithms in Map-Reduce Applications

2011-12-23

arxiv.org/abs/1112.5505v3

Computer Science

Distributed, Parallel, and Cluster Computing

12 pages a version has been submitted to journal of "Concurrency and Computation: Practice and Experience", available online f

Scientific paper

In this paper, we study CPU utilization time patterns of several Map-Reduce applications. After extracting running patterns of several applications, the patterns with their statistical information are saved in a reference database to be later used to tweak system parameters to efficiently execute unknown applications in future. To achieve this goal, CPU utilization patterns of new applications along with its statistical information are compared with the already known ones in the reference database to find/predict their most probable execution patterns. Because of different patterns lengths, the Dynamic Time Warping (DTW) is utilized for such comparison; a statistical analysis is then applied to DTWs' outcomes to select the most suitable candidates. Moreover, under a hypothesis, another algorithm is proposed to classify applications under similar CPU utilization patterns. Three widely used text processing applications (WordCount, Distributed Grep, and Terasort) and another application (Exim Mainlog parsing) are used to evaluate our hypothesis in tweaking system parameters in executing similar applications. Results were very promising and showed effectiveness of our approach on 5-node Map-Reduce platform

Affiliated with

Also associated with

No associations

Rating

A Study on Using Uncertain Time Series Matching Algorithms in Map-Reduce Applications does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with A Study on Using Uncertain Time Series Matching Algorithms in Map-Reduce Applications, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and A Study on Using Uncertain Time Series Matching Algorithms in Map-Reduce Applications will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-191861