Mathematics – Statistics Theory
Scientific paper
2010-01-04
Annals of Statistics 2010, Vol. 38, No. 1, 1-50
Mathematics
Statistics Theory
Published in at http://dx.doi.org/10.1214/08-AOS648 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of
Scientific paper
10.1214/08-AOS648
We place ourselves in the setting of high-dimensional statistical inference where the number of variables $p$ in a dataset of interest is of the same order of magnitude as the number of observations $n$. We consider the spectrum of certain kernel random matrices, in particular $n\times n$ matrices whose $(i,j)$th entry is $f(X_i'X_j/p)$ or $f(\Vert X_i-X_j\Vert^2/p)$ where $p$ is the dimension of the data, and $X_i$ are independent data vectors. Here $f$ is assumed to be a locally smooth function. The study is motivated by questions arising in statistics and computer science where these matrices are used to perform, among other things, nonlinear versions of principal component analysis. Surprisingly, we show that in high-dimensions, and for the models we analyze, the problem becomes essentially linear--which is at odds with heuristics sometimes used to justify the usage of these methods. The analysis also highlights certain peculiarities of models widely studied in random matrix theory and raises some questions about their relevance as tools to model high-dimensional data encountered in practice.
No associations
LandOfFree
The spectrum of kernel random matrices does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with The spectrum of kernel random matrices, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and The spectrum of kernel random matrices will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-7043