Bayes factors and the geometry of discrete hierarchical loglinear models

Details Bayes factors and the geometry of discrete hierarchical loglinear models Bayes factors and the geometry of discrete hierarchical loglinear models

2011-03-28

arxiv.org/abs/1103.5381v3

Mathematics

Statistics Theory

37 pages

Scientific paper

A standard tool for model selection in a Bayesian framework is the Bayes factor which compares the marginal likelihood of the data under two given different models. In this paper, we consider the class of hierarchical loglinear models for discrete data given under the form of a contingency table with multinomial sampling. We assume that the Diaconis-Ylvisaker conjugate prior is the prior distribution on the loglinear parameters and the uniform is the prior distribution on the space of models. Under these conditions, the Bayes factor between two models is a function of their prior and posterior normalizing constants. These constants are functions of the hyperparameters $(m,\alpha)$ which can be interpreted respectively as marginal counts and the total count of a fictive contingency table. We study the behaviour of the Bayes factor when $\alpha$ tends to zero. In this study two mathematical objects play a most important role. They are, first, the interior $C$ of the convex hull $\bar{C}$ of the support of the multinomial distribution for a given hierarchical loglinear model together with its faces and second, the characteristic function $\mathbb{J}_C$ of this convex set $C$. We show that, when $\alpha$ tends to 0, if the data lies on a face $F_i$ of $\bar{C_i},i=1,2$ of dimension $k_i$, the Bayes factor behaves like $\alpha^{k_1-k_2}$. This implies in particular that when the data is in $C_1$ and in $C_2$, i.e. when $k_i$ equals the dimension of model $J_i$, the sparser model is favored, thus confirming the idea of Bayesian regularization.

Affiliated with

Also associated with

No associations

Rating

Bayes factors and the geometry of discrete hierarchical loglinear models does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Bayes factors and the geometry of discrete hierarchical loglinear models, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Bayes factors and the geometry of discrete hierarchical loglinear models will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-707606