Statistical Mechanics of Online Learning for Ensemble Teachers

Details Statistical Mechanics of Online Learning for Ensemble Teachers Statistical Mechanics of Online Learning for Ensemble Teachers

2006-01-21

arxiv.org/abs/physics/0601162v1

Physics

Physics and Society

11 pages, 9 figures

Scientific paper

10.1143/JPSJ.75.044002

We analyze the generalization performance of a student in a model composed of linear perceptrons: a true teacher, ensemble teachers, and the student. Calculating the generalization error of the student analytically using statistical mechanics in the framework of on-line learning, it is proven that when learning rate $\eta <1$, the larger the number $K$ and the variety of the ensemble teachers are, the smaller the generalization error is. On the other hand, when $\eta >1$, the properties are completely reversed. If the variety of the ensemble teachers is rich enough, the direction cosine between the true teacher and the student becomes unity in the limit of $\eta \to 0$ and $K \to \infty$.

Affiliated with

Also associated with

No associations

Rating

Statistical Mechanics of Online Learning for Ensemble Teachers does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Statistical Mechanics of Online Learning for Ensemble Teachers, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Statistical Mechanics of Online Learning for Ensemble Teachers will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-438458