Entropy Estimates from Insufficient Samplings

Details Entropy Estimates from Insufficient Samplings Entropy Estimates from Insufficient Samplings

2003-07-29

arxiv.org/abs/physics/0307138v2

Physics

Data Analysis, Statistics and Probability

5 pages, including 2 figures; revised version with corrected figures

Scientific paper

We present a detailed derivation of some estimators of Shannon entropy for discrete distributions. They hold for finite samples of N points distributed into M "boxes", with N and M -> oo, but N/M < oo. In the high sampling regime (<< 1 points in each box) they have exponentially small biases. In the low sampling regime the errors increase but are still much smaller than for most other estimators. One advantage is that our main estimators are given analytically, with explicitly known analytical formulas for the biases.

Affiliated with

Also associated with

No associations

Rating

Entropy Estimates from Insufficient Samplings does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Entropy Estimates from Insufficient Samplings, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Entropy Estimates from Insufficient Samplings will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-656