Mathematics – Statistics Theory
Scientific paper
2011-11-02
Mathematics
Statistics Theory
17 pages
Scientific paper
This article studies exponential families $\mathcal{E}$ on finite sets such that the information divergence $D(P\|\mathcal{E})$ of an arbitrary probability distribution from $\mathcal{E}$ is bounded by some constant $D>0$. A particular class of low-dimensional exponential families that have low values of $D$ can be obtained from partitions of the state space. The main results concern optimality properties of these partition exponential families. Exponential families where $D=\log(2)$ are studied in detail. This case is special, because if $D<\log(2)$, then $\mathcal{E}$ contains all probability measures with full support.
No associations
LandOfFree
Optimally approximating exponential families does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Optimally approximating exponential families, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Optimally approximating exponential families will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-328206