Shannon Information Capacity of Discrete Synapses

Details Shannon Information Capacity of Discrete Synapses Shannon Information Capacity of Discrete Synapses

2008-03-13

arxiv.org/abs/0803.1923v1

Biology

Quantitative Biology

Neurons and Cognition

5 pages, 2 figures

Scientific paper

There is evidence that biological synapses have only a fixed number of discrete weight states. Memory storage with such synapses behaves quite differently from synapses with unbounded, continuous weights as old memories are automatically overwritten by new memories. We calculate the storage capacity of discrete, bounded synapses in terms of Shannon information. For optimal learning rules, we investigate how information storage depends on the number of synapses, the number of synaptic states and the coding sparseness.

Affiliated with

Also associated with

No associations

Rating

Shannon Information Capacity of Discrete Synapses does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Shannon Information Capacity of Discrete Synapses, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Shannon Information Capacity of Discrete Synapses will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-69764