Outlier Detection Techniques for SQL and ETL Tuning

Details Outlier Detection Techniques for SQL and ETL Tuning Outlier Detection Techniques for SQL and ETL Tuning

2012-03-19

arxiv.org/abs/1203.4163v1

International Journal of Computer Applications (0975 - 8887) Volume 23 - No.8, June 2011

Computer Science

Databases

Scientific paper

RDBMS is the heart for both OLTP and OLAP types of applications. For both types of applications thousands of queries expressed in terms of SQL are executed on daily basis. All the commercial DBMS engines capture various attributes in system tables about these executed queries. These queries need to conform to best practices and need to be tuned to ensure optimal performance. While we use checklists, often tools to enforce the same, a black box technique on the queries for profiling, outlier detection is not employed for a summary level understanding. This is the motivation of the paper, as this not only points out to inefficiencies built in the system, but also has the potential to point evolving best practices and inappropriate usage. Certainly this can reduce latency in information flow and optimal utilization of hardware and software capacity. In this paper we start with formulating the problem. We explore four outlier detection techniques. We apply these techniques over rich corpora of production queries and analyze the results. We also explore benefit of an ensemble approach. We conclude with future courses of action. The same philosophy we have used for optimization of extraction, transform, load (ETL) jobs in one of our previous work. We give a brief introduction of the same in section four.

Affiliated with

Also associated with

No associations

Rating

Outlier Detection Techniques for SQL and ETL Tuning does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Outlier Detection Techniques for SQL and ETL Tuning, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Outlier Detection Techniques for SQL and ETL Tuning will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-212969