Computer Science – Information Theory
Scientific paper
2007-11-16
Computer Science
Information Theory
19 pages
Scientific paper
Suppose a string $X_1^n=(X_1,X_2,...,X_n)$ generated by a memoryless source $(X_n)_{n\geq 1}$ with distribution $P$ is to be compressed with distortion no greater than $D\geq 0$, using a memoryless random codebook with distribution $Q$. The compression performance is determined by the ``generalized asymptotic equipartition property'' (AEP), which states that the probability of finding a $D$-close match between $X_1^n$ and any given codeword $Y_1^n$, is approximately $2^{-n R(P,Q,D)}$, where the rate function $R(P,Q,D)$ can be expressed as an infimum of relative entropies. The main purpose here is to remove various restrictive assumptions on the validity of this result that have appeared in the recent literature. Necessary and sufficient conditions for the generalized AEP are provided in the general setting of abstract alphabets and unbounded distortion measures. All possible distortion levels $D\geq 0$ are considered; the source $(X_n)_{n\geq 1}$ can be stationary and ergodic; and the codebook distribution can have memory. Moreover, the behavior of the matching probability is precisely characterized, even when the generalized AEP is not valid. Natural characterizations of the rate function $R(P,Q,D)$ are established under equally general conditions.
No associations
LandOfFree
The Generalized Asymptotic Equipartition Property: Necessary and Sufficient Conditions does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with The Generalized Asymptotic Equipartition Property: Necessary and Sufficient Conditions, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and The Generalized Asymptotic Equipartition Property: Necessary and Sufficient Conditions will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-4140