The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo

Statistics – Computation

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

30 pages, 7 figures

Scientific paper

Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo (MCMC) algorithm that avoids the random walk behavior and sensitivity to correlated parameters that plague many MCMC methods by taking a series of steps informed by first-order gradient information. These features allow it to converge to high-dimensional target distributions much more quickly than simpler methods such as random walk Metropolis or Gibbs sampling. However, HMC's performance is highly sensitive to two user-specified parameters: a step size {\epsilon} and a desired number of steps L. In particular, if L is too small then the algorithm exhibits undesirable random walk behavior, while if L is too large the algorithm wastes computation. We introduce the No-U-Turn Sampler (NUTS), an extension to HMC that eliminates the need to set a number of steps L. NUTS uses a recursive algorithm to build a set of likely candidate points that spans a wide swath of the target distribution, stopping automatically when it starts to double back and retrace its steps. Empirically, NUTS perform at least as efficiently as and sometimes more efficiently than a well tuned standard HMC method, without requiring user intervention or costly tuning runs. We also derive a method for adapting the step size parameter {\epsilon} on the fly based on primal-dual averaging. NUTS can thus be used with no hand-tuning at all. NUTS is also suitable for applications such as BUGS-style automatic inference engines that require efficient "turnkey" sampling algorithms.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-548311

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.