Statistics – Machine Learning
Scientific paper
2011-11-08
Statistics
Machine Learning
Scientific paper
The popular cubic smoothing spline estimate of a regression function arises as the minimizer of the penalized sum of squares $\sum_j(Y_j - {\mu}(t_j))^2 + {\lambda}\int_a^b [{\mu}"(t)]^2 dt$, where the data are $t_j,Y_j$, $j=1,..., n$. The minimization is taken over an infinite-dimensional function space, the space of all functions with square integrable second derivatives. But the calculations can be carried out in a finite-dimensional space. The reduction from minimizing over an infinite dimensional space to minimizing over a finite dimensional space occurs for more general objective functions: the data may be related to the function ${\mu}$ in another way, the sum of squares may be replaced by a more suitable expression, or the penalty, $\int_a^b [{\mu}"(t)]^2 dt$, might take a different form. This paper reviews the Reproducing Kernel Hilbert Space structure that provides a finite-dimensional solution for a general minimization problem. Particular attention is paid to penalties based on linear differential operators. In this case, one can sometimes easily calculate the minimizer explicitly, using Green's functions.
No associations
LandOfFree
The theory and application of penalized methods or Reproducing Kernel Hilbert Spaces made easy does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with The theory and application of penalized methods or Reproducing Kernel Hilbert Spaces made easy, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and The theory and application of penalized methods or Reproducing Kernel Hilbert Spaces made easy will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-53792