Tight conditions for consistency of variable selection in the context of high dimensionality

Details Tight conditions for consistency of variable selection in the context of high dimensionality Tight conditions for consistency of variable selection in the context of high dimensionality

2011-06-21

arxiv.org/abs/1106.4293v3

Mathematics

Statistics Theory

arXiv admin note: text overlap with arXiv:1102.3616

Scientific paper

We address the issue of variable selection in the regression model with very high ambient dimension, \textit i.e., when the number of variables is very large. The main focus is on the situation where the number of relevant variables, called intrinsic dimension and denoted by $d^*$, is much smaller than the ambient dimension $d$. Without assuming any parametric form of the underlying regression function, we get tight conditions making it possible to consistently estimate the set of relevant variables. These conditions relate the intrinsic dimension to the ambient dimension and to the sample size. The procedure that is provably consistent under these tight conditions is based on comparing quadratic functionals of the empirical Fourier coefficients with appropriately chosen threshold values. The asymptotic analysis reveals the presence of two quite different regimes. The first regime is when $d^*$ is fixed. In this case the situation in nonparametric regression is the same as in linear regression, \textit i.e., consistent variable selection is possible if and only if $\log d$ is small compared to the sample size $n$. The picture is different in the second regime, $d^*\to\infty$ as $n\to\infty$, where we prove that consistent variable selection in nonparametric set-up is possible only if $d^*+\log\log d$ is small compared to $\log n$. We apply these results to derive minimax separation rates for the problem of variable selection.

Affiliated with

Also associated with

No associations

Rating

Tight conditions for consistency of variable selection in the context of high dimensionality does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Tight conditions for consistency of variable selection in the context of high dimensionality, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Tight conditions for consistency of variable selection in the context of high dimensionality will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-179703