Parameter expansion in local-shrinkage models

Details Parameter expansion in local-shrinkage models Parameter expansion in local-shrinkage models

2010-10-25

arxiv.org/abs/1010.5265v1

Statistics

Computation

Scientific paper

This paper considers the problem of using MCMC to fit sparse Bayesian models based on normal scale-mixture priors. Examples of this framework include the Bayesian LASSO and the horseshoe prior. We study the usefulness of parameter expansion (PX) for improving convergence in such models, which is notoriously slow when the global variance component is near zero. Our conclusion is that parameter expansion does improve matters in LASSO-type models, but only modestly. In most cases this improvement, while noticeable, is less than what might be expected, especially compared to the improvements that PX makes possible for models very similar to those considered here. We give some examples, and we attempt to provide some intuition as to why this is so. We also describe how slice sampling may be used to update the global variance component. In practice, this approach seems to perform almost as well as parameter expansion. As a practical matter, however, it is perhaps best viewed not as a replacement for PX, but as a tool for expanding the class of models to which PX is applicable.

Affiliated with

Also associated with

No associations

Rating

Parameter expansion in local-shrinkage models does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Parameter expansion in local-shrinkage models, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Parameter expansion in local-shrinkage models will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-158788