Mathematics – Probability
Scientific paper
2006-07-03
Annals of Applied Probability 2006, Vol. 16, No. 2, 475-515
Mathematics
Probability
Published at http://dx.doi.org/10.1214/105051605000000791 in the Annals of Applied Probability (http://www.imstat.org/aap/) by
Scientific paper
10.1214/105051605000000791
In this paper we shall consider optimal scaling problems for high-dimensional Metropolis--Hastings algorithms where updates can be chosen to be lower dimensional than the target density itself. We find that the optimal scaling rule for the Metropolis algorithm, which tunes the overall algorithm acceptance rate to be 0.234, holds for the so-called Metropolis-within-Gibbs algorithm as well. Furthermore, the optimal efficiency obtainable is independent of the dimensionality of the update rule. This has important implications for the MCMC practitioner since high-dimensional updates are generally computationally more demanding, so that lower-dimensional updates are therefore to be preferred. Similar results with rather different conclusions are given for so-called Langevin updates. In this case, it is found that high-dimensional updates are frequently most efficient, even taking into account computing costs.
Neal Peter
Roberts Gareth
No associations
LandOfFree
Optimal scaling for partially updating MCMC algorithms does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Optimal scaling for partially updating MCMC algorithms, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Optimal scaling for partially updating MCMC algorithms will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-416232