Bayesian model choice and information criteria in sparse generalized linear models

Details Bayesian model choice and information criteria in sparse generalized linear models Bayesian model choice and information criteria in sparse generalized linear models

2011-12-23

arxiv.org/abs/1112.5635v1

Mathematics

Statistics Theory

Scientific paper

We consider Bayesian model selection in generalized linear models that are high-dimensional, with the number of covariates p being large relative to the sample size n, but sparse in that the number of active covariates is small compared to p. Treating the covariates as random and adopting an asymptotic scenario in which p increases with n, we show that Bayesian model selection using certain priors on the set of models is asymptotically equivalent to selecting a model using an extended Bayesian information criterion. Moreover, we prove that the smallest true model is selected by either of these methods with probability tending to one. Having addressed random covariates, we are also able to give a consistency result for pseudo-likelihood approaches to high-dimensional sparse graphical modeling. Experiments on real data demonstrate good performance of the extended Bayesian information criterion for regression and for graphical models.

Affiliated with

Also associated with

No associations

Rating

Bayesian model choice and information criteria in sparse generalized linear models does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Bayesian model choice and information criteria in sparse generalized linear models, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Bayesian model choice and information criteria in sparse generalized linear models will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-193119