On Shore and Johnson properties for a Special Case of Csiszár f-divergences

Details On Shore and Johnson properties for a Special Case of Csiszár f-divergences On Shore and Johnson properties for a Special Case of Csiszár f-divergences

2012-01-20

arxiv.org/abs/1201.4285v1

Computer Science

Information Theory

Scientific paper

The importance of power-law distributions is attributed to the fact that most of the naturally occurring phenomenon exhibit this distribution. While exponential distributions can be derived by minimizing KL-divergence w.r.t some moment constraints, some power law distributions can be derived by minimizing some generalizations of KL-divergence (more specifically some special cases of Csisz\'ar f-divergences). Divergence minimization is very well studied in information theoretical approaches to statistics. In this work we study properties of minimization of Tsallis divergence, which is a special case of Csisz\'ar f-divergence. In line with the work by Shore and Johnson (IEEE Trans. IT, 1981), we examine the properties exhibited by these minimization methods including the Pythagorean property.

Affiliated with

Also associated with

No associations

Rating

On Shore and Johnson properties for a Special Case of Csiszár f-divergences does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with On Shore and Johnson properties for a Special Case of Csiszár f-divergences, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and On Shore and Johnson properties for a Special Case of Csiszár f-divergences will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-320910