Sharp Oracle Inequalities for Aggregation of Affine Estimators

Mathematics – Statistics Theory

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

Scientific paper

We consider the problem of combining a (possibly uncountably infinite) set of affine estimators in non-parametric regression model with heteroscedastic Gaussian noise. Focusing on the exponentially weighted aggregate, we prove a PAC-Bayesian type inequality that leads to sharp oracle inequalities in discrete but also in continuous settings. The framework is general enough to cover the combinations of various procedures such as least square regression, kernel ridge regression, shrinking estimators and many other estimators used in the literature on statistical inverse problems. As a consequence, we show that the proposed aggregate provides an adaptive estimator in the exact minimax sense without neither discretizing the range of tuning parameters nor splitting the set of observations. We also illustrate numerically the good performance achieved by the exponentially weighted aggregate.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

Sharp Oracle Inequalities for Aggregation of Affine Estimators does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Sharp Oracle Inequalities for Aggregation of Affine Estimators, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Sharp Oracle Inequalities for Aggregation of Affine Estimators will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-432443

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.