Mathematics – Statistics Theory
Scientific paper
2009-01-28
Mathematics
Statistics Theory
This manuscript was written in late 2003; a much revised version is to appear, with discussion and later references, in the Jo
Scientific paper
Principal components analysis (PCA) is a classical method for the reduction of dimensionality of data in the form of n observations (or cases) of a vector with p variables. For a simple model of factor analysis type, it is proved that ordinary PCA can produce a consistent (for n large) estimate of the principal factor if and only if p(n) is asymptotically of smaller order than n. There may be a basis in which typical signals have sparse representations: most co-ordinates have small signal energies. If such a basis (e.g. wavelets) is used to represent the signals, then the variation in many coordinates is likely to be small. Consequently, we study a simple "sparse PCA" algorithm: select a subset of coordinates of largest variance, estimate eigenvectors from PCA on the selected subset, threshold and reexpress in the original basis. We illustrate the algorithm on some exercise ECG data, and prove that in a single factor model, under an appropriate sparsity assumption, it yields consistent estimates of the principal factor.
Johnstone Iain M.
Lu Arthur Yu
No associations
LandOfFree
Sparse Principal Components Analysis does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Sparse Principal Components Analysis, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Sparse Principal Components Analysis will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-344373