Physics – Condensed Matter – Statistical Mechanics
Scientific paper
2001-01-11
Physics
Condensed Matter
Statistical Mechanics
11 pages, 3 figures, accepted to PRL
Scientific paper
10.1103/PhysRevLett.86.4958
We studied the mutual information between a stimulus and a large system consisting of stochastic, statistically independent elements that respond to a stimulus. The Mutual Information (MI) of the system saturates exponentially with system size. A theory of the rate of saturation of the MI is developed. We show that this rate is controlled by a distance function between the response probabilities induced by different stimuli. This function, which we term the {\it Confusion Distance} between two probabilities, is related to the Renyi $\alpha$-Information.
Kang Kukjin
Sompolinsky Haim
No associations
LandOfFree
Mutual Information of Population Codes and Distance Measures in Probability Space does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Mutual Information of Population Codes and Distance Measures in Probability Space, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Mutual Information of Population Codes and Distance Measures in Probability Space will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-564466