Mathematics – Statistics Theory
Scientific paper
2011-08-25
Mathematics
Statistics Theory
26 pages, 5 figures
Scientific paper
Consider a regression model with fixed design and Gaussian noise where the regression function can potentially be well approximated by a function that admits a sparse representation in a given dictionary. This paper resorts to exponential weights to exploit this underlying sparsity by implementing the principle of sparsity pattern aggregation. This model selection take on sparse estimation allows us to derive sparsity oracle inequalities in several popular frameworks including ordinary sparsity, fused sparsity and group sparsity. One striking aspect of these theoretical results is that they hold under no condition on the dictionary. Moreover, we describe an efficient implementation of the sparsity pattern aggregation principle that compares favorably to state-of-the-art procedures on some basic numerical examples.
Rigollet Philippe
Tsybakov Alexandre
No associations
LandOfFree
Sparse estimation by exponential weighting does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Sparse estimation by exponential weighting, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Sparse estimation by exponential weighting will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-319305