Controlling False Positives in Association Rule Mining

Details Controlling False Positives in Association Rule Mining Controlling False Positives in Association Rule Mining

2011-10-30

arxiv.org/abs/1110.6652v1

Proceedings of the VLDB Endowment (PVLDB), Vol. 5, No. 2, pp. 145-156 (2011)

Computer Science

Databases

VLDB2012

Scientific paper

Association rule mining is an important problem in the data mining area. It enumerates and tests a large number of rules on a dataset and outputs rules that satisfy user-specified constraints. Due to the large number of rules being tested, rules that do not represent real systematic effect in the data can satisfy the given constraints purely by random chance. Hence association rule mining often suffers from a high risk of false positive errors. There is a lack of comprehensive study on controlling false positives in association rule mining. In this paper, we adopt three multiple testing correction approaches---the direct adjustment approach, the permutation-based approach and the holdout approach---to control false positives in association rule mining, and conduct extensive experiments to study their performance. Our results show that (1) Numerous spurious rules are generated if no correction is made. (2) The three approaches can control false positives effectively. Among the three approaches, the permutation-based approach has the highest power of detecting real association rules, but it is very computationally expensive. We employ several techniques to reduce its cost effectively.

Affiliated with

Also associated with

No associations

Rating

Controlling False Positives in Association Rule Mining does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Controlling False Positives in Association Rule Mining, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Controlling False Positives in Association Rule Mining will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-146797