A Risk Comparison of Ordinary Least Squares vs Ridge Regression

Details A Risk Comparison of Ordinary Least Squares vs Ridge Regression A Risk Comparison of Ordinary Least Squares vs Ridge Regression

2011-05-04

arxiv.org/abs/1105.0875v1

Statistics

Machine Learning

Scientific paper

We compare the risk of ridge regression to a simple variant of ordinary least squares, in which one simply projects the data onto a finite dimensional subspace (as specified by a Principal Component Analysis) and then performs an ordinary (un-regularized) least squares regression in this subspace. This note shows that the risk of this ordinary least squares method is within a constant factor (namely 4) of the risk of ridge regression.

Affiliated with

Also associated with

No associations

Rating

A Risk Comparison of Ordinary Least Squares vs Ridge Regression does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with A Risk Comparison of Ordinary Least Squares vs Ridge Regression, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and A Risk Comparison of Ordinary Least Squares vs Ridge Regression will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-689704