Mathematics – Probability
Scientific paper
2003-06-23
In: Bayesian inference and Maximum Entropy methods in Science and Engineering, Ch. Williams (ed.), AIP (Melville), 67-72, 2003
Mathematics
Probability
M. Grendar, Jr. and M. Grendar, ``Chernoff's bound forms,'' in Bayesian inference and Maximum Entropy methods in Science and E
Scientific paper
10.1063/1.1570535
Chernoff's bound binds a tail probability (ie. $Pr(X \ge a)$, where $a \ge EX$). Assuming that the distribution of $X$ is $Q$, the logarithm of the bound is known to be equal to the value of relative entropy (or minus Kullback-Leibler distance) for $I$-projection $\hat P$ of $Q$ on a set $\mathcal{H} \triangleq \{P: E_PX = a\}$. Here, Chernoff's bound is related to Maximum Likelihood on exponential form and consequently implications for the notion of complementarity are discussed. Moreover, a novel form of the bound is proposed, which expresses the value of the Chernoff's bound directly in terms of the $I$-projection (or generalized $I$-projection).
Jr.
Grendar Marian
No associations
LandOfFree
Chernoff's bound forms does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Chernoff's bound forms, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Chernoff's bound forms will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-513743