Mathematics – Probability
Scientific paper
2006-07-31
Annals of Applied Probability 18, 2 (2008) 664-707
Mathematics
Probability
Published in at http://dx.doi.org/10.1214/07-AAP471 the Annals of Applied Probability (http://www.imstat.org/aap/) by the Inst
Scientific paper
10.1214/07-AAP471
Fluid limit techniques have become a central tool to analyze queueing networks over the last decade, with applications to performance analysis, simulation and optimization. In this paper, some of these techniques are extended to a general class of skip-free Markov chains. As in the case of queueing models, a fluid approximation is obtained by scaling time, space and the initial condition by a large constant. The resulting fluid limit is the solution of an ordinary differential equation (ODE) in ``most'' of the state space. Stability and finer ergodic properties for the stochastic model then follow from stability of the set of fluid limits. Moreover, similarly to the queueing context where fluid models are routinely used to design control policies, the structure of the limiting ODE in this general setting provides an understanding of the dynamics of the Markov chain. These results are illustrated through application to Markov chain Monte Carlo methods.
Fort Gersende
Meyn Sean
Moulines Eric
Priouret Pierre
No associations
LandOfFree
The ODE method for stability of skip-free Markov chains with applications to MCMC does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with The ODE method for stability of skip-free Markov chains with applications to MCMC, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and The ODE method for stability of skip-free Markov chains with applications to MCMC will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-34001