Efficient Inference in Markov Control Problems

Details Efficient Inference in Markov Control Problems Efficient Inference in Markov Control Problems

2012-02-14

arxiv.org/abs/1202.3720v1

Computer Science

Systems and Control

Scientific paper

Markov control algorithms that perform smooth, non-greedy updates of the policy have been shown to be very general and versatile, with policy gradient and Expectation Maximisation algorithms being particularly popular. For these algorithms, marginal inference of the reward weighted trajectory distribution is required to perform policy updates. We discuss a new exact inference algorithm for these marginals in the finite horizon case that is more efficient than the standard approach based on classical forward-backward recursions. We also provide a principled extension to infinite horizon Markov Decision Problems that explicitly accounts for an infinite horizon. This extension provides a novel algorithm for both policy gradients and Expectation Maximisation in infinite horizon problems.

Affiliated with

Also associated with

No associations

Rating

Efficient Inference in Markov Control Problems does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Efficient Inference in Markov Control Problems, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Efficient Inference in Markov Control Problems will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-90436