Average-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities

Details Average-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities Average-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities

2012-02-19

arxiv.org/abs/1202.4122v1

Mathematics

Optimization and Control

26 pages

Scientific paper

This paper presents sufficient conditions for the existence of stationary optimal policies for average-cost Markov Decision Processes with Borel state and action sets and with weakly continuous transition probabilities. The one-step cost functions may be unbounded, and action sets may be noncompact. The main contributions of this paper are: (i) general sufficient conditions for the existence of stationary discount-optimal and average-cost optimal policies and descriptions of properties of value functions and sets of optimal actions, (ii) a sufficient condition for the average-cost optimality of a stationary policy in the form of optimality inequalities, and (iii) approximations of average-cost optimal actions by discount-optimal actions.

Affiliated with

Also associated with

No associations

Rating

Average-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Average-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Average-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-419138