Biology – Quantitative Biology – Neurons and Cognition
Scientific paper
2007-12-31
Biology
Quantitative Biology
Neurons and Cognition
Scientific paper
We consider words as a network of interacting letters, and approximate the probability distribution of states taken on by this network. Despite the intuition that the rules of English spelling are highly combinatorial (and arbitrary), we find that maximum entropy models consistent with pairwise correlations among letters provide a surprisingly good approximation to the full statistics of four letter words, capturing ~92% of the multi-information among letters and even "discovering" real words that were not represented in the data from which the pairwise correlations were estimated. The maximum entropy model defines an energy landscape on the space of possible words, and local minima in this landscape account for nearly two-thirds of words used in written English.
Bialek William
Stephens Greg J.
No associations
LandOfFree
Toward a statistical mechanics of four letter words does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Toward a statistical mechanics of four letter words, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Toward a statistical mechanics of four letter words will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-29604