Quantile Based Variable Mining : Detection, FDR based Extraction and Interpretation

Details Quantile Based Variable Mining : Detection, FDR based Extraction and Interpretation Quantile Based Variable Mining : Detection, FDR based Extraction and Interpretation

2011-12-14

arxiv.org/abs/1112.3373v1

Statistics

Methodology

Scientific paper

This paper outlines a uni?ed framework for high dimensional variable selection for classification problems. Traditional approaches to ?nding interesting variables mostly utilize only partial information through moments (like mean difference). On the contrary, in this paper we address the question of variable selection in full generality from a distributional point of view. If a variable is not important for classification, then it will have similar distributional aspect under different classes. This simple and straightforward observation motivates us to quantify `How and Why' the distribution of a variable changes over classes through CR-statistic. The second contribution of our paper is to develop and investigate the FDR based thresholding technology from a completely new point of view for adaptive thresholding, which leads to a elegant algorithm called CDfdr. This paper attempts to show how all of these problems of detection, extraction and interpretation for interesting variables can be treated in a uni?ed way under one broad general theme - comparison analysis. It is proposed that a key to accomplishing this uni?cation is to think in terms of the quantile function and the comparison density. We illustrate and demonstrate the power of our methodology using three real data sets.

Affiliated with

Also associated with

No associations

Rating

Quantile Based Variable Mining : Detection, FDR based Extraction and Interpretation does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Quantile Based Variable Mining : Detection, FDR based Extraction and Interpretation, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Quantile Based Variable Mining : Detection, FDR based Extraction and Interpretation will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-561488