On-line Learning of an Unlearnable True Teacher through Mobile Ensemble Teachers

Details On-line Learning of an Unlearnable True Teacher through Mobile Ensemble Teachers On-line Learning of an Unlearnable True Teacher through Mobile Ensemble Teachers

2008-05-10

arxiv.org/abs/0805.1480v1

Physics

Condensed Matter

Disordered Systems and Neural Networks

18 pages, 8 figures

Scientific paper

10.1143/JPSJ.77.094801

On-line learning of a hierarchical learning model is studied by a method from statistical mechanics. In our model a student of a simple perceptron learns from not a true teacher directly, but ensemble teachers who learn from the true teacher with a perceptron learning rule. Since the true teacher and the ensemble teachers are expressed as non-monotonic perceptron and simple ones, respectively, the ensemble teachers go around the unlearnable true teacher with the distance between them fixed in an asymptotic steady state. The generalization performance of the student is shown to exceed that of the ensemble teachers in a transient state, as was shown in similar ensemble-teachers models. Further, it is found that moving the ensemble teachers even in the steady state, in contrast to the fixed ensemble teachers, is efficient for the performance of the student.

Affiliated with

Also associated with

No associations

Rating

On-line Learning of an Unlearnable True Teacher through Mobile Ensemble Teachers does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with On-line Learning of an Unlearnable True Teacher through Mobile Ensemble Teachers, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and On-line Learning of an Unlearnable True Teacher through Mobile Ensemble Teachers will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-188781