On-line predictive linear regression

Details On-line predictive linear regression On-line predictive linear regression

2009-06-17

arxiv.org/abs/0906.3123v1

Annals of Statistics 2009, Vol. 37, No. 3, 1566-1590

Mathematics

Statistics Theory

Published in at http://dx.doi.org/10.1214/08-AOS622 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of

Scientific paper

10.1214/08-AOS622

We consider the on-line predictive version of the standard problem of linear regression; the goal is to predict each consecutive response given the corresponding explanatory variables and all the previous observations. The standard treatment of prediction in linear regression analysis has two drawbacks: (1) the classical prediction intervals guarantee that the probability of error is equal to the nominal significance level $\varepsilon$, but this property per se does not imply that the long-run frequency of error is close to $\varepsilon$; (2) it is not suitable for prediction of complex systems as it assumes that the number of observations exceeds the number of parameters. We state a general result showing that in the on-line protocol the frequency of error for the classical prediction intervals does equal the nominal significance level, up to statistical fluctuations. We also describe alternative regression models in which informative prediction intervals can be found before the number of observations exceeds the number of parameters. One of these models, which only assumes that the observations are independent and identically distributed, is popular in machine learning but greatly underused in the statistical theory of regression.

Affiliated with

Also associated with

No associations

Rating

On-line predictive linear regression does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with On-line predictive linear regression, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and On-line predictive linear regression will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-222911