Gauged Neural Network: Phase Structure, Learning, and Associative Memory

Details Gauged Neural Network: Phase Structure, Learning, and Associative Memory Gauged Neural Network: Phase Structure, Learning, and Associative Memory

2002-03-06

arxiv.org/abs/cond-mat/0203136v4

Physica A356 (2005) 525-553

Physics

Condensed Matter

Disordered Systems and Neural Networks

17 pages, 18 figures. Final Version

Scientific paper

10.1016/j.physa.2005.05.083

A gauge model of neural network is introduced, which resembles the Z(2) Higgs lattice gauge theory of high-energy physics. It contains a neuron variable $S_x = \pm 1$ on each site $x$ of a 3D lattice and a synaptic-connection variable $J_{x\mu} = \pm 1$ on each link $(x,x+\hat{\mu}) (\mu=1,2,3)$. The model is regarded as a generalization of the Hopfield model of associative memory to a model of learning by converting the synaptic weight between $x$ and $x+\hat{\mu}$ to a dynamical Z(2) gauge variable $J_{x\mu}$. The local Z(2) gauge symmetry is inherited from the Hopfield model and assures us the locality of time evolutions of $S_x$ and $J_{x\mu}$ and a generalized Hebbian learning rule. At finite "temperatures", numerical simulations show that the model exhibits the Higgs, confinement, and Coulomb phases. We simulate dynamical processes of learning a pattern of $S_x$ and recalling it, and classify the parameter space according to the performance. At some parameter regions, stable column-layer structures in signal propagations are spontaneously generated. Mutual interactions between $S_x$ and $J_{x\mu}$ induce partial memory loss as expected.

Affiliated with

Also associated with

No associations

Rating

Gauged Neural Network: Phase Structure, Learning, and Associative Memory does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Gauged Neural Network: Phase Structure, Learning, and Associative Memory, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Gauged Neural Network: Phase Structure, Learning, and Associative Memory will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-124764