Concentration inequalities of the cross-validation estimator for Empirical Risk Minimiser

Details Concentration inequalities of the cross-validation estimator for Empirical Risk Minimiser Concentration inequalities of the cross-validation estimator for Empirical Risk Minimiser

2010-10-30

arxiv.org/abs/1011.0096v1

Statistics

Machine Learning

24 pages, 2 figures

Scientific paper

In this article, we derive concentration inequalities for the cross-validation estimate of the generalization error for empirical risk minimizers. In the general setting, we prove sanity-check bounds in the spirit of \cite{KR99} \textquotedblleft\textit{bounds showing that the worst-case error of this estimate is not much worse that of training error estimate} \textquotedblright . General loss functions and class of predictors with finite VC-dimension are considered. We closely follow the formalism introduced by \cite{DUD03} to cover a large variety of cross-validation procedures including leave-one-out cross-validation, $k$% -fold cross-validation, hold-out cross-validation (or split sample), and the leave-$\upsilon$-out cross-validation. In particular, we focus on proving the consistency of the various cross-validation procedures. We point out the interest of each cross-validation procedure in terms of rate of convergence. An estimation curve with transition phases depending on the cross-validation procedure and not only on the percentage of observations in the test sample gives a simple rule on how to choose the cross-validation. An interesting consequence is that the size of the test sample is not required to grow to infinity for the consistency of the cross-validation procedure.

Affiliated with

Also associated with

No associations

Rating

Concentration inequalities of the cross-validation estimator for Empirical Risk Minimiser does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Concentration inequalities of the cross-validation estimator for Empirical Risk Minimiser, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Concentration inequalities of the cross-validation estimator for Empirical Risk Minimiser will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-405406