Symmetry in Shannon's Noiseless Coding Theorem

Details Symmetry in Shannon's Noiseless Coding Theorem Symmetry in Shannon's Noiseless Coding Theorem

2010-10-29

arxiv.org/abs/1010.6247v1

Computer Science

Information Theory

7 pages

Scientific paper

Statements of Shannon's Noiseless Coding Theorem by various authors, including the original, are reviewed and clarified. Traditional statements of the theorem are often unclear as to when it applies. A new notation is introduced and the domain of application is clarified. An examination of the bounds of the Theorem leads to a new symmetric restatement. It is shown that the extended upper bound is an acheivable upper bound, giving symmetry to the theorem.The relation of information entropy to the physical entropy of Gibbs and Boltmann is illustrated. Consequently, the study of Shannon Entropy is strongly related to physics and there is a physical theory of information. This paper is the beginning of of an attempt to clarify these relationships.

Affiliated with

Also associated with

No associations

Rating

Symmetry in Shannon's Noiseless Coding Theorem does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Symmetry in Shannon's Noiseless Coding Theorem, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Symmetry in Shannon's Noiseless Coding Theorem will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-616032