Computer Science – Information Theory
Scientific paper
2010-04-29
Computer Science
Information Theory
11 pages, 1 figure, submitted for publication.
Scientific paper
We derive a simple general parametric representation of the rate-distortion function of a memoryless source, where both the rate and the distortion are given by integrals whose integrands include the minimum mean square error (MMSE) of the distortion $\Delta=d(X,Y)$ based on the source symbol $X$, with respect to a certain joint distribution of these two random variables. At first glance, these relations may seem somewhat similar to the I-MMSE relations due to Guo, Shamai and Verd\'u, but they are, in fact, quite different. The new relations among rate, distortion, and MMSE are discussed from several aspects, and more importantly, it is demonstrated that they can sometimes be rather useful for obtaining non-trivial upper and lower bounds on the rate-distortion function, as well as for determining the exact asymptotic behavior for very low and for very large distortion. Analogous MMSE relations hold for channel capacity as well.
No associations
LandOfFree
Rate-distortion function via minimum mean square error estimation does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Rate-distortion function via minimum mean square error estimation, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Rate-distortion function via minimum mean square error estimation will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-284495