Mathematics – Statistics Theory
Scientific paper
2011-11-08
Mathematics
Statistics Theory
Scientific paper
Many learning machines such as normal mixtures and layered neural networks are not regular but singular statistical models, because the map from a parameter to a probability distribution is not one-to-one. The conventional statistical asymptotic theory can not be applied to such learning machines because the likelihood function can not be approximated by any normal distribution. Recently, new statistical theory has been established based on algebraic geometry and it was clarified that the generalization and training errors are determined by two birational invariants, the real log canonical threshold and the singular fluctuation. However, their concrete values are left unknown. In the present paper, we propose a new concept, a quasi-regular case in statistical learning theory. A quasi-regular case is not a regular case but a singular case, however, it has the same property as a regular case. In fact, we prove that, in a quasi-regular case, two birational invariants are equal to each other, resulting that the symmetry of the generalization and training errors holds. Moreover, the concrete values of two birational invariants are explicitly obtained, the quasi-regular case is useful to study statistical learning theory.
Watanabe Sumio
Yamada Koshi
No associations
LandOfFree
Statistical Learning Theory of Quasi-Regular Cases does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Statistical Learning Theory of Quasi-Regular Cases, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Statistical Learning Theory of Quasi-Regular Cases will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-53238