Techniques of replica symmetry breaking and the storage problem of the McCulloch-Pitts neuron

Physics – Condensed Matter – Disordered Systems and Neural Networks

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

103 Latex pages (with REVTeX 3.0), including 15 figures (ps, epsi, eepic), accepted for Physics Reports

Scientific paper

10.1016/S0370-1573(00)00073-9

In this article the framework for Parisi's spontaneous replica symmetry breaking is reviewed, and subsequently applied to the example of the statistical mechanical description of the storage properties of a McCulloch-Pitts neuron. The technical details are reviewed extensively, with regard to the wide range of systems where the method may be applied. Parisi's partial differential equation and related differential equations are discussed, and a Green function technique introduced for the calculation of replica averages, the key to determining the averages of physical quantities. The ensuing graph rules involve only tree graphs, as appropriate for a mean-field-like model. The lowest order Ward-Takahashi identity is recovered analytically and is shown to lead to the Goldstone modes in continuous replica symmetry breaking phases. The need for a replica symmetry breaking theory in the storage problem of the neuron has arisen due to the thermodynamical instability of formerly given solutions. Variational forms for the neuron's free energy are derived in terms of the order parameter function x(q), for different prior distribution of synapses. Analytically in the high temperature limit and numerically in generic cases various phases are identified, among them one similar to the Parisi phase in the Sherrington-Kirkpatrick model. Extensive quantities like the error per pattern change slightly with respect to the known unstable solutions, but there is a significant difference in the distribution of non-extensive quantities like the synaptic overlaps and the pattern storage stability parameter. A simulation result is also reviewed and compared to the prediction of the theory.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

Techniques of replica symmetry breaking and the storage problem of the McCulloch-Pitts neuron does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Techniques of replica symmetry breaking and the storage problem of the McCulloch-Pitts neuron, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Techniques of replica symmetry breaking and the storage problem of the McCulloch-Pitts neuron will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-530721

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.