Physics – Quantum Physics
Scientific paper
2003-03-25
Physics
Quantum Physics
51 pages (files: 1 .tex, 2 .sty, 10 .eps)
Scientific paper
We apply Renormalization Group (RG) techniques to Classical Information Theory, in the limit of large codeword size $n$. In particular, we apply RG techniques to (1) noiseless coding (i.e., a coding used for compression) and (2) noisy coding (i.e., a coding used for channel transmission). Shannon's "first" and "second" theorems refer to (1) and (2), respectively. Our RG technique uses composition class (CC) ideas, so we call our technique Composition Class Renormalization Group (CCRG). Often, CC's are called "types" instead of CC's, and their theory is referred to as the "Method of Types". For (1) and (2), we find that the probability of error can be expressed as an Error Function whose argument contains variables that obey renormalization group equations. We describe a computer program called WimpyRG-C1.0 that implements the ideas of this paper. C++ source code for WimpyRG-C1.0 is publicly available.
No associations
LandOfFree
An Application of Renormalization Group Techniques to Classical Information Theory does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with An Application of Renormalization Group Techniques to Classical Information Theory, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and An Application of Renormalization Group Techniques to Classical Information Theory will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-76011