Variance Estimation Using Refitted Cross-validation in Ultrahigh Dimensional Regression

Details Variance Estimation Using Refitted Cross-validation in Ultrahigh Dimensional Regression Variance Estimation Using Refitted Cross-validation in Ultrahigh Dimensional Regression

2010-04-29

arxiv.org/abs/1004.5178v2

Statistics

Methodology

Scientific paper

Variance estimation is a fundamental problem in statistical modeling. In ultrahigh dimensional linear regressions where the dimensionality is much larger than sample size, traditional variance estimation techniques are not applicable. Recent advances on variable selection in ultrahigh dimensional linear regressions make this problem accessible. One of the major problems in ultrahigh dimensional regression is the high spurious correlation between the unobserved realized noise and some of the predictors. As a result, the realized noises are actually predicted when extra irrelevant variables are selected, leading to serious underestimate of the noise level. In this paper, we propose a two-stage refitted procedure via a data splitting technique, called refitted cross-validation (RCV), to attenuate the influence of irrelevant variables with high spurious correlations. Our asymptotic results show that the resulting procedure performs as well as the oracle estimator, which knows in advance the mean regression function. The simulation studies lend further support to our theoretical claims. The naive two-stage estimator which fits the selected variables in the first stage and the plug-in one stage estimators using LASSO and SCAD are also studied and compared. Their performances can be improved by the proposed RCV method.

Affiliated with

Also associated with

No associations

Rating

Variance Estimation Using Refitted Cross-validation in Ultrahigh Dimensional Regression does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Variance Estimation Using Refitted Cross-validation in Ultrahigh Dimensional Regression, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Variance Estimation Using Refitted Cross-validation in Ultrahigh Dimensional Regression will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-284441