Phase Diagram and Storage Capacity of Sequence Processing Neural Networks

Details Phase Diagram and Storage Capacity of Sequence Processing Neural Networks Phase Diagram and Storage Capacity of Sequence Processing Neural Networks

1998-05-06

arxiv.org/abs/cond-mat/9805073v1

Physics

Condensed Matter

Disordered Systems and Neural Networks

17 pages Latex2e, 2 postscript figures

Scientific paper

We solve the dynamics of Hopfield-type neural networks which store sequences of patterns, close to saturation. The asymmetry of the interaction matrix in such models leads to violation of detailed balance, ruling out an equilibrium statistical mechanical analysis. Using generating functional methods we derive exact closed equations for dynamical order parameters, viz. the sequence overlap and correlation- and response functions, in the thermodynamic limit. We calculate the time translation invariant solutions of these equations, describing stationary limit-cycles, which leads to a phase diagram. The effective retarded self-interaction usually appearing in symmetric models is here found to vanish, which causes a significantly enlarged storage capacity of $\alpha_c\sim 0.269$, compared to $\alpha_\c\sim 0.139$ for Hopfield networks storing static patterns. Our results are tested against extensive computer simulations and excellent agreement is found.

Affiliated with

Also associated with

No associations

Rating

Phase Diagram and Storage Capacity of Sequence Processing Neural Networks does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Phase Diagram and Storage Capacity of Sequence Processing Neural Networks, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Phase Diagram and Storage Capacity of Sequence Processing Neural Networks will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-142488