A class of Rényi information estimators for multidimensional densities

Details A class of Rényi information estimators for multidimensional densities A class of Rényi information estimators for multidimensional densities

2008-10-29

arxiv.org/abs/0810.5302v1

Annals of Statistics 2008, Vol. 36, No. 5, 2153-2182

Mathematics

Statistics Theory

Published in at http://dx.doi.org/10.1214/07-AOS539 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of

Scientific paper

10.1214/07-AOS539

A class of estimators of the R\'{e}nyi and Tsallis entropies of an unknown distribution $f$ in $\mathbb{R}^m$ is presented. These estimators are based on the $k$th nearest-neighbor distances computed from a sample of $N$ i.i.d. vectors with distribution $f$. We show that entropies of any order $q$, including Shannon's entropy, can be estimated consistently with minimal assumptions on $f$. Moreover, we show that it is straightforward to extend the nearest-neighbor method to estimate the statistical distance between two distributions using one i.i.d. sample from each.

Affiliated with

Also associated with

No associations

Rating

A class of Rényi information estimators for multidimensional densities does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with A class of Rényi information estimators for multidimensional densities, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and A class of Rényi information estimators for multidimensional densities will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-72433