Beyond storage capacity in a single model neuron: Continuous replica symmetry breaking

Physics – Condensed Matter – Disordered Systems and Neural Networks

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

15 Latex pages (with REVTeX 3.0), 4 figures (1 latex using eepic, 3 ps using psfig), accepted for Journal of Statistical Physi

Scientific paper

A single McCulloch-Pitts neuron, that is, the simple perceptron is studied, with focus on the region beyond storage capacity. It is shown that Parisi's hierarchical ansatz for the overlap matrix of the synaptic couplings with so called continuous replica symmetry breaking is a solution, and as we propose it is the exact one, to the equilibrium problem. We describe some of the most salient features of the theory and give results about the low temperature region. In particular, the basics of the Parisi technique and the way to calculate thermodynamical expectation values is explained. We have numerically extremized the replica free energy functional for some parameter settings, and thus obtained the order parameter function, i.e., the probability distribution of overlaps. That enabled us to evaluate the probability density of the local stability parameter. We also performed a simulation and found a local stability density closer to the theoretical curve than previous numerical results were.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

Beyond storage capacity in a single model neuron: Continuous replica symmetry breaking does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Beyond storage capacity in a single model neuron: Continuous replica symmetry breaking, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Beyond storage capacity in a single model neuron: Continuous replica symmetry breaking will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-475172

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.