Hierarchical Self-Programming in Recurrent Neural Networks

Details Hierarchical Self-Programming in Recurrent Neural Networks Hierarchical Self-Programming in Recurrent Neural Networks

2001-09-06

arxiv.org/abs/cond-mat/0109099v1

Physics

Condensed Matter

Statistical Mechanics

53 pages, 19 figures. Submitted to J. Phys. A

Scientific paper

10.1088/0305-4470/35/12/306

We study self-programming in recurrent neural networks where both neurons (the `processors') and synaptic interactions (`the programme') evolve in time simultaneously, according to specific coupled stochastic equations. The interactions are divided into a hierarchy of $L$ groups with adiabatically separated and monotonically increasing time-scales, representing sub-routines of the system programme of decreasing volatility. We solve this model in equilibrium, assuming ergodicity at every level, and find as our replica-symmetric solution a formalism with a structure similar but not identical to Parisi's $L$-step replica symmetry breaking scheme. Apart from differences in details of the equations (due to the fact that here interactions, rather than spins, are grouped into clusters with different time-scales), in the present model the block sizes $m_i$ of the emerging ultrametric solution are not restricted to the interval $[0,1]$, but are independent control parameters, defined in terms of the noise strengths of the various levels in the hierarchy, which can take any value in $[0,\infty\ket$. This is shown to lead to extremely rich phase diagrams, with an abundance of first-order transitions especially when the level of stochasticity in the interaction dynamics is chosen to be low.

Affiliated with

Also associated with

No associations

Rating

Hierarchical Self-Programming in Recurrent Neural Networks does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Hierarchical Self-Programming in Recurrent Neural Networks, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Hierarchical Self-Programming in Recurrent Neural Networks will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-384314