A Heterosynaptic Learning Rule for Neural Networks

Details A Heterosynaptic Learning Rule for Neural Networks A Heterosynaptic Learning Rule for Neural Networks

2006-08-25

arxiv.org/abs/cond-mat/0608564v1

Physics

Condensed Matter

Disordered Systems and Neural Networks

19 pages

Scientific paper

10.1142/S0129183106009916

In this article we intoduce a novel stochastic Hebb-like learning rule for neural networks that is neurobiologically motivated. This learning rule combines features of unsupervised (Hebbian) and supervised (reinforcement) learning and is stochastic with respect to the selection of the time points when a synapse is modified. Moreover, the learning rule does not only affect the synapse between pre- and postsynaptic neuron, which is called homosynaptic plasticity, but effects also further remote synapses of the pre- and postsynaptic neuron. This more complex form of synaptic plasticity has recently come under investigations in neurobiology and is called heterosynaptic plasticity. We demonstrate that this learning rule is useful in training neural networks by learning parity functions including the exclusive-or (XOR) mapping in a multilayer feed-forward network. We find, that our stochastic learning rule works well, even in the presence of noise. Importantly, the mean learning time increases with the number of patterns to be learned polynomially, indicating efficient learning.

Affiliated with

Also associated with

No associations

Rating

A Heterosynaptic Learning Rule for Neural Networks does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with A Heterosynaptic Learning Rule for Neural Networks, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and A Heterosynaptic Learning Rule for Neural Networks will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-111334