Mathematics – Statistics Theory
Scientific paper
2011-06-13
Mathematics
Statistics Theory
Scientific paper
The random design setting for linear regression concerns estimators based on a random sample of covariate/response pairs. This work gives explicit bounds on the prediction error for the ordinary least squares estimator and the ridge regression estimator under mild assumptions on the covariate/response distributions. In particular, this work provides sharp results on the "out-of-sample" prediction error, as opposed to the "in-sample" (fixed design) error. Our analysis also explicitly reveals the effect of noise vs. modeling errors. The approach reveals a close connection to the more traditional fixed design setting, and our methods make use of recent advances in concentration inequalities (for vectors and matrices). We also describe an application of our results to fast least squares computations.
Hsu Daniel
Kakade Sham M.
Zhang Tong
No associations
LandOfFree
An Analysis of Random Design Linear Regression does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with An Analysis of Random Design Linear Regression, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and An Analysis of Random Design Linear Regression will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-429008