Physics – Condensed Matter – Disordered Systems and Neural Networks
Scientific paper
2000-10-02
Phys. Rep. 342, 263-392 (2001)
Physics
Condensed Matter
Disordered Systems and Neural Networks
103 Latex pages (with REVTeX 3.0), including 15 figures (ps, epsi, eepic), accepted for Physics Reports
Scientific paper
10.1016/S0370-1573(00)00073-9
In this article the framework for Parisi's spontaneous replica symmetry breaking is reviewed, and subsequently applied to the example of the statistical mechanical description of the storage properties of a McCulloch-Pitts neuron. The technical details are reviewed extensively, with regard to the wide range of systems where the method may be applied. Parisi's partial differential equation and related differential equations are discussed, and a Green function technique introduced for the calculation of replica averages, the key to determining the averages of physical quantities. The ensuing graph rules involve only tree graphs, as appropriate for a mean-field-like model. The lowest order Ward-Takahashi identity is recovered analytically and is shown to lead to the Goldstone modes in continuous replica symmetry breaking phases. The need for a replica symmetry breaking theory in the storage problem of the neuron has arisen due to the thermodynamical instability of formerly given solutions. Variational forms for the neuron's free energy are derived in terms of the order parameter function x(q), for different prior distribution of synapses. Analytically in the high temperature limit and numerically in generic cases various phases are identified, among them one similar to the Parisi phase in the Sherrington-Kirkpatrick model. Extensive quantities like the error per pattern change slightly with respect to the known unstable solutions, but there is a significant difference in the distribution of non-extensive quantities like the synaptic overlaps and the pattern storage stability parameter. A simulation result is also reviewed and compared to the prediction of the theory.
No associations
LandOfFree
Techniques of replica symmetry breaking and the storage problem of the McCulloch-Pitts neuron does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Techniques of replica symmetry breaking and the storage problem of the McCulloch-Pitts neuron, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Techniques of replica symmetry breaking and the storage problem of the McCulloch-Pitts neuron will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-530721