Entropic Priors for Discrete Probabilistic Networks and for Mixtures of Gaussians Models

Details Entropic Priors for Discrete Probabilistic Networks and for Mixtures of Gaussians Models Entropic Priors for Discrete Probabilistic Networks and for Mixtures of Gaussians Models

2002-01-09

arxiv.org/abs/physics/0201016v1

Physics

Data Analysis, Statistics and Probability

24 pages, 3 figures, Presented at MaxEnt2001, APL Johns Hopkins University, August 4-9 2001. See also http://omega.albany.edu:

Scientific paper

10.1063/1.1477063

The ongoing unprecedented exponential explosion of available computing power, has radically transformed the methods of statistical inference. What used to be a small minority of statisticians advocating for the use of priors and a strict adherence to bayes theorem, it is now becoming the norm across disciplines. The evolutionary direction is now clear. The trend is towards more realistic, flexible and complex likelihoods characterized by an ever increasing number of parameters. This makes the old question of: What should the prior be? to acquire a new central importance in the modern bayesian theory of inference. Entropic priors provide one answer to the problem of prior selection. The general definition of an entropic prior has existed since 1988, but it was not until 1998 that it was found that they provide a new notion of complete ignorance. This paper re-introduces the family of entropic priors as minimizers of mutual information between the data and the parameters, as in [rodriguez98b], but with a small change and a correction. The general formalism is then applied to two large classes of models: Discrete probabilistic networks and univariate finite mixtures of gaussians. It is also shown how to perform inference by efficiently sampling the corresponding posterior distributions.

Affiliated with

Also associated with

No associations

Rating

Entropic Priors for Discrete Probabilistic Networks and for Mixtures of Gaussians Models does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Entropic Priors for Discrete Probabilistic Networks and for Mixtures of Gaussians Models, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Entropic Priors for Discrete Probabilistic Networks and for Mixtures of Gaussians Models will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-124338