Physics – Condensed Matter – Disordered Systems and Neural Networks
Scientific paper
1999-06-14
Physics
Condensed Matter
Disordered Systems and Neural Networks
9 pages, 3 figures, RevTex, accepted for publication in Phys. Rev. E
Scientific paper
10.1103/PhysRevE.60.2097
We consider feed-forward neural networks with one hidden layer, tree architecture and a fixed hidden-to-output Boolean function. Focusing on the saturation limit of the storage problem the influence of replica symmetry breaking on the distribution of local fields at the hidden units is investigated. These field distributions determine the probability for finding a specific activation pattern of the hidden units as well as the corresponding correlation coefficients and therefore quantify the division of labor among the hidden units. We find that although modifying the storage capacity and the distribution of local fields markedly replica symmetry breaking has only a minor effect on the correlation coefficients. Detailed numerical results are provided for the PARITY, COMMITTEE and AND machines with K=3 hidden units and nonoverlapping receptive fields.
Engel Assaf
Malzahn D.
No associations
LandOfFree
Correlations between hidden units in multilayer neural networks and replica symmetry breaking does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Correlations between hidden units in multilayer neural networks and replica symmetry breaking, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Correlations between hidden units in multilayer neural networks and replica symmetry breaking will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-347689