Asymptotic Learning Curve and Renormalizable Condition in Statistical Learning Theory

Details Asymptotic Learning Curve and Renormalizable Condition in Statistical Learning Theory Asymptotic Learning Curve and Renormalizable Condition in Statistical Learning Theory

2010-01-18

arxiv.org/abs/1001.2957v2

Computer Science

Learning

Scientific paper

Bayes statistics and statistical physics have the common mathematical structure, where the log likelihood function corresponds to the random Hamiltonian. Recently, it was discovered that the asymptotic learning curves in Bayes estimation are subject to a universal law, even if the log likelihood function can not be approximated by any quadratic form. However, it is left unknown what mathematical property ensures such a universal law. In this paper, we define a renormalizable condition of the statistical estimation problem, and show that, under such a condition, the asymptotic learning curves are ensured to be subject to the universal law, even if the true distribution is unrealizable and singular for a statistical model. Also we study a nonrenormalizable case, in which the learning curves have the different asymptotic behaviors from the universal law.

Affiliated with

Also associated with

No associations

Rating

Asymptotic Learning Curve and Renormalizable Condition in Statistical Learning Theory does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Asymptotic Learning Curve and Renormalizable Condition in Statistical Learning Theory, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Asymptotic Learning Curve and Renormalizable Condition in Statistical Learning Theory will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-660138