Physics – Condensed Matter – Disordered Systems and Neural Networks
Scientific paper
1998-01-20
Physics
Condensed Matter
Disordered Systems and Neural Networks
LaTeX, 32 pages with eps-figs, accepted by J Phys A
Scientific paper
10.1088/0305-4470/31/11/005
We investigate the influence of different kinds of structure on the learning behaviour of a perceptron performing a classification task defined by a teacher rule. The underlying pattern distribution is permitted to have spatial correlations. The prior distribution for the teacher coupling vectors itself is assumed to be nonuniform. Thus classification tasks of quite different difficulty are included. As learning algorithms we discuss Hebbian learning, Gibbs learning, and Bayesian learning with different priors, using methods from statistics and the replica formalism. We find that the Hebb rule is quite sensitive to the structure of the actual learning problem, failing asymptotically in most cases. Contrarily, the behaviour of the more sophisticated methods of Gibbs and Bayes learning is influenced by the spatial correlations only in an intermediate regime of $\alpha$, where $\alpha$ specifies the size of the training set. Concerning the Bayesian case we show, how enhanced prior knowledge improves the performance.
Dirscherl G.
Krey U.
Schottky B.
No associations
LandOfFree
Generalizing with perceptrons in case of structured phase- and pattern-spaces does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Generalizing with perceptrons in case of structured phase- and pattern-spaces, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Generalizing with perceptrons in case of structured phase- and pattern-spaces will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-216948