Nonlinear Approximation Using Gaussian Kernels

Details Nonlinear Approximation Using Gaussian Kernels Nonlinear Approximation Using Gaussian Kernels

2009-11-14

arxiv.org/abs/0911.2803v2

Journal of Functional Analysis, vol. 259 (2010), Pages 203-219

Mathematics

Classical Analysis and ODEs

15 Pages; corrected typos; to appear in J. Funct. Anal

Scientific paper

10.1016/j.jfa.2010.02.001

It is well-known that non-linear approximation has an advantage over linear schemes in the sense that it provides comparable approximation rates to those of the linear schemes, but to a larger class of approximands. This was established for spline approximations and for wavelet approximations, and more recently by DeVore and Ron for homogeneous radial basis function (surface spline) approximations. However, no such results are known for the Gaussian function, the preferred kernel in machine learning and several engineering problems. We introduce and analyze in this paper a new algorithm for approximating functions using translates of Gaussian functions with varying tension parameters. At heart it employs the strategy for nonlinear approximation of DeVore and Ron, but it selects kernels by a method that is not straightforward. The crux of the difficulty lies in the necessity to vary the tension parameter in the Gaussian function spatially according to local information about the approximand: error analysis of Gaussian approximation schemes with varying tension are, by and large, an elusive target for approximators. We show that our algorithm is suitably optimal in the sense that it provides approximation rates similar to other established nonlinear methodologies like spline and wavelet approximations. As expected and desired, the approximation rates can be as high as needed and are essentially saturated only by the smoothness of the approximand.

Affiliated with

Also associated with

No associations

Rating

Nonlinear Approximation Using Gaussian Kernels does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Nonlinear Approximation Using Gaussian Kernels, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Nonlinear Approximation Using Gaussian Kernels will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-323488