Computer Science – Information Theory
Scientific paper
2010-07-20
Computer Science
Information Theory
13 pages , 2 figures
Scientific paper
The entropy of an ergodic source is the limit of properly rescaled 1-block entropies of sources obtained applying successive non-sequential recursive pairs substitutions (see P. Grassberger 2002 ArXiv:physics/0207023 and D. Benedetto, E. Caglioti and D. Gabrielli 2006 Jour. Stat. Mech. Theo. Exp. 09 doi:10.1088/1742.-5468/2006/09/P09011). In this paper we prove that the cross entropy and the Kullback-Leibler divergence can be obtained in a similar way.
Benedetto Dario
Caglioti Emanuele
Cristadoro Giampaolo
Esposti Mirko Degli
No associations
LandOfFree
Relative entropy via non-sequential recursive pair substitutions does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Relative entropy via non-sequential recursive pair substitutions, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Relative entropy via non-sequential recursive pair substitutions will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-125695