A Short Note on Stationary Distributions of Unichain Markov Decision Processes

Details A Short Note on Stationary Distributions of Unichain Markov Decision Processes A Short Note on Stationary Distributions of Unichain Markov Decision Processes

2006-04-20

arxiv.org/abs/math/0604452v1

Mathematics

Probability

Scientific paper

Dealing with unichain MDPs, we consider stationary distributions of policies
that coincide in all but $n$ states. In these states each policy chooses one of
two possible actions. We show that the stationary distributions of n+1 such
policies uniquely determine the stationary distributions of all other such
policies. An explicit formula for calculation is given.

Affiliated with

Also associated with

No associations

Rating

A Short Note on Stationary Distributions of Unichain Markov Decision Processes does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with A Short Note on Stationary Distributions of Unichain Markov Decision Processes, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and A Short Note on Stationary Distributions of Unichain Markov Decision Processes will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-67119