A spectral analytic comparison of trace-class data augmentation algorithms and their sandwich variants

Details A spectral analytic comparison of trace-class data augmentation algorithms and their sandwich variants A spectral analytic comparison of trace-class data augmentation algorithms and their sandwich variants

2012-02-23

arxiv.org/abs/1202.5205v1

Annals of Statistics 2011, Vol. 39, No. 5, 2585-2606

Mathematics

Statistics Theory

Published in at http://dx.doi.org/10.1214/11-AOS916 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of

Scientific paper

10.1214/11-AOS916

The data augmentation (DA) algorithm is a widely used Markov chain Monte Carlo algorithm that is easy to implement but often suffers from slow convergence. The sandwich algorithm is an alternative that can converge much faster while requiring roughly the same computational effort per iteration. Theoretically, the sandwich algorithm always converges at least as fast as the corresponding DA algorithm in the sense that $\Vert {K^*}\Vert \le \Vert {K}\Vert$, where $K$ and $K^*$ are the Markov operators associated with the DA and sandwich algorithms, respectively, and $\Vert\cdot\Vert$ denotes operator norm. In this paper, a substantial refinement of this operator norm inequality is developed. In particular, under regularity conditions implying that $K$ is a trace-class operator, it is shown that $K^*$ is also a positive, trace-class operator, and that the spectrum of $K^*$ dominates that of $K$ in the sense that the ordered elements of the former are all less than or equal to the corresponding elements of the latter. Furthermore, if the sandwich algorithm is constructed using a group action, as described by Liu and Wu [J. Amer. Statist. Assoc. 94 (1999) 1264--1274] and Hobert and Marchev [Ann. Statist. 36 (2008) 532--554], then there is strict inequality between at least one pair of eigenvalues. These results are applied to a new DA algorithm for Bayesian quantile regression introduced by Kozumi and Kobayashi [J. Stat. Comput. Simul. 81 (2011) 1565--1578].

Affiliated with

Also associated with

No associations

Rating

A spectral analytic comparison of trace-class data augmentation algorithms and their sandwich variants does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with A spectral analytic comparison of trace-class data augmentation algorithms and their sandwich variants, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and A spectral analytic comparison of trace-class data augmentation algorithms and their sandwich variants will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-660410