Computer Science – Information Theory
Scientific paper
2009-11-17
Computer Science
Information Theory
21 pages; submitted to the IEEE Transactions on Information Theory
Scientific paper
In continuation to a recent work on the statistical--mechanical analysis of minimum mean square error (MMSE) estimation in Gaussian noise via its relation to the mutual information (the I-MMSE relation), here we propose a simple and more direct relationship between optimum estimation and certain information measures (e.g., the information density and the Fisher information), which can be viewed as partition functions and hence are amenable to analysis using statistical--mechanical techniques. The proposed approach has several advantages, most notably, its applicability to general sources and channels, as opposed to the I-MMSE relation and its variants which hold only for certain classes of channels (e.g., additive white Gaussian noise channels). We then demonstrate the derivation of the conditional mean estimator and the MMSE in a few examples. Two of these examples turn out to be generalizable to a fairly wide class of sources and channels. For this class, the proposed approach is shown to yield an approximate conditional mean estimator and an MMSE formula that has the flavor of a single-letter expression. We also show how our approach can easily be generalized to situations of mismatched estimation.
No associations
LandOfFree
Optimum estimation via gradients of partition functions and information measures: a statistical-mechanical perspective does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Optimum estimation via gradients of partition functions and information measures: a statistical-mechanical perspective, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Optimum estimation via gradients of partition functions and information measures: a statistical-mechanical perspective will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-649942