Stochastic transitions of attractors in associative memory models with correlated noise

Details Stochastic transitions of attractors in associative memory models with correlated noise Stochastic transitions of attractors in associative memory models with correlated noise

2006-07-21

arxiv.org/abs/cond-mat/0607557v2

Journal of the Physical Society of Japan, Vol. 75 No. 12, December, 2006, 124603

Physics

Condensed Matter

Disordered Systems and Neural Networks

21 pages

Scientific paper

10.1143/JPSJ.75.124603

We investigate dynamics of recurrent neural networks with correlated noise to analyze the noise's effect. The mechanism of correlated firing has been analyzed in various models, but its functional roles have not been discussed in sufficient detail. Aoyagi and Aoki have shown that the state transition of a network is invoked by synchronous spikes. We introduce two types of noise to each neuron: thermal independent noise and correlated noise. Due to the effects of correlated noise, the correlation between neural inputs cannot be ignored, so the behavior of the network has sample dependence. We discuss two types of associative memory models: one with auto- and weak cross-correlation connections and one with hierarchically correlated patterns. The former is similar in structure to Aoyagi and Aoki's model. We show that stochastic transition can be presented by correlated rather than thermal noise. In the latter, we show stochastic transition from a memory state to a mixture state using correlated noise. To analyze the stochastic transitions, we derive a macroscopic dynamic description as a recurrence relation form of a probability density function when the correlated noise exists. Computer simulations agree with theoretical results.

Affiliated with

Also associated with

No associations

Rating

Stochastic transitions of attractors in associative memory models with correlated noise does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Stochastic transitions of attractors in associative memory models with correlated noise, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Stochastic transitions of attractors in associative memory models with correlated noise will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-169653