A Unified Framework for Risk-sensitive Markov Decision Processes with Finite State and Action Spaces

Details A Unified Framework for Risk-sensitive Markov Decision Processes with Finite State and Action Spaces A Unified Framework for Risk-sensitive Markov Decision Processes with Finite State and Action Spaces

2011-10-28

arxiv.org/abs/1110.6317v2

Mathematics

Optimization and Control

18 pages, 2 figures

Scientific paper

We introduce a unified framework to incorporate risk in Markov decision processes (MDPs), via prospect maps, which generalize the idea of coherent/convex risk measures in mathematical finance. Most of the existing risk-sensitive approaches in various literature concerning with decision-making problems are contained in the framework as special instances. Within the framework, we solve the optimal control problems according to two criteria, the newly invented temporal discounted criterion, which generalizes the conventional discount scheme, and the average criterion, by value iteration algorithms under different assumptions. Two online algorithms are proposed to solve the optimal controls problem when the exact MDP is unknown and has to be estimated during optimization.

Affiliated with

Also associated with

No associations

Rating

A Unified Framework for Risk-sensitive Markov Decision Processes with Finite State and Action Spaces does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with A Unified Framework for Risk-sensitive Markov Decision Processes with Finite State and Action Spaces, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and A Unified Framework for Risk-sensitive Markov Decision Processes with Finite State and Action Spaces will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-686152