A New Look at the Classical Entropy of Written English

Details A New Look at the Classical Entropy of Written English A New Look at the Classical Entropy of Written English

2009-11-12

arxiv.org/abs/0911.2284v2

Computer Science

Computation and Language

Submitted to the IEEE Transactions on Information Theory. Reference on page 5 corrected. Weighted average of HL on page 12 cor

Scientific paper

A simple method for finding the entropy and redundancy of a reasonable long sample of English text by direct computer processing and from first principles according to Shannon theory is presented. As an example, results on the entropy of the English language have been obtained based on a total of 20.3 million characters of written English, considering symbols from one to five hundred characters in length. Besides a more realistic value of the entropy of English, a new perspective on some classic entropy-related concepts is presented. This method can also be extended to other Latin languages. Some implications for practical applications such as plagiarism-detection software, and the minimum number of words that should be used in social Internet network messaging, are discussed.

Affiliated with

Also associated with

No associations

Rating

A New Look at the Classical Entropy of Written English does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with A New Look at the Classical Entropy of Written English, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and A New Look at the Classical Entropy of Written English will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-150068