Gelfand-Yaglom-Perez Theorem for Generalized Relative Entropies

Details Gelfand-Yaglom-Perez Theorem for Generalized Relative Entropies Gelfand-Yaglom-Perez Theorem for Generalized Relative Entropies

2006-01-18

arxiv.org/abs/math-ph/0601035v1

Physics

Mathematical Physics

Scientific paper

The measure-theoretic definition of Kullback-Leibler relative-entropy (KL-entropy) plays a basic role in the definitions of classical information measures. Entropy, mutual information and conditional forms of entropy can be expressed in terms of KL-entropy and hence properties of their measure-theoretic analogs will follow from those of measure-theoretic KL-entropy. These measure-theoretic definitions are key to extending the ergodic theorems of information theory to non-discrete cases. A fundamental theorem in this respect is the Gelfand-Yaglom-Perez (GYP) Theorem (Pinsker, 1960, Theorem. 2.4.2) which states that measure-theoretic relative-entropy equals the supremum of relative-entropies over all measurable partitions. This paper states and proves the GYP-theorem for Renyi relative-entropy of order greater than one. Consequently, the result can be easily extended to Tsallis relative-entropy.

Affiliated with

Also associated with

No associations

Rating

Gelfand-Yaglom-Perez Theorem for Generalized Relative Entropies does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Gelfand-Yaglom-Perez Theorem for Generalized Relative Entropies, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Gelfand-Yaglom-Perez Theorem for Generalized Relative Entropies will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-449630