Towards a Unified Architecture for in-RDBMS Analytics

Details Towards a Unified Architecture for in-RDBMS Analytics Towards a Unified Architecture for in-RDBMS Analytics

2012-03-12

arxiv.org/abs/1203.2574v2

Computer Science

Databases

Extended version of a SIGMOD 2012 full paper

Scientific paper

The increasing use of statistical data analysis in enterprise applications has created an arms race among database vendors to offer ever more sophisticated in-database analytics. One challenge in this race is that each new statistical technique must be implemented from scratch in the RDBMS, which leads to a lengthy and complex development process. We argue that the root cause for this overhead is the lack of a unified architecture for in-database analytics. Our main contribution in this work is to take a step towards such a unified architecture. A key benefit of our unified architecture is that performance optimizations for analytics techniques can be studied generically instead of an ad hoc, per-technique fashion. In particular, our technical contributions are theoretical and empirical studies of two key factors that we found impact performance: the order data is stored, and parallelization of computations on a single-node multicore RDBMS. We demonstrate the feasibility of our architecture by integrating several popular analytics techniques into two commercial and one open-source RDBMS. Our architecture requires changes to only a few dozen lines of code to integrate a new statistical technique. We then compare our approach with the native analytics tools offered by the commercial RDBMSes on various analytics tasks, and validate that our approach achieves competitive or higher performance, while still achieving the same quality.

Affiliated with

Also associated with

No associations

Rating

Towards a Unified Architecture for in-RDBMS Analytics does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Towards a Unified Architecture for in-RDBMS Analytics, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Towards a Unified Architecture for in-RDBMS Analytics will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-489057