k-NN Regression Adapts to Local Intrinsic Dimension

Details k-NN Regression Adapts to Local Intrinsic Dimension k-NN Regression Adapts to Local Intrinsic Dimension

2011-10-19

arxiv.org/abs/1110.4300v1

Statistics

Machine Learning

Scientific paper

Many nonparametric regressors were recently shown to converge at rates that depend only on the intrinsic dimension of data. These regressors thus escape the curse of dimension when high-dimensional data has low intrinsic dimension (e.g. a manifold). We show that k-NN regression is also adaptive to intrinsic dimension. In particular our rates are local to a query x and depend only on the way masses of balls centered at x vary with radius. Furthermore, we show a simple way to choose k = k(x) locally at any x so as to nearly achieve the minimax rate at x in terms of the unknown intrinsic dimension in the vicinity of x. We also establish that the minimax rate does not depend on a particular choice of metric space or distribution, but rather that this minimax rate holds for any metric space and doubling measure.

Affiliated with

Also associated with

No associations

Rating

k-NN Regression Adapts to Local Intrinsic Dimension does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with k-NN Regression Adapts to Local Intrinsic Dimension, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and k-NN Regression Adapts to Local Intrinsic Dimension will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-597452