Finite Optimal Control for Time-Bounded Reachability in CTMDPs and Continuous-Time Markov Games

Details Finite Optimal Control for Time-Bounded Reachability in CTMDPs and Continuous-Time Markov Games Finite Optimal Control for Time-Bounded Reachability in CTMDPs and Continuous-Time Markov Games

2010-04-22

arxiv.org/abs/1004.4005v2

Computer Science

Formal Languages and Automata Theory

Scientific paper

We establish the existence of optimal scheduling strategies for time-bounded reachability in continuous-time Markov decision processes, and of co-optimal strategies for continuous-time Markov games. Furthermore, we show that optimal control does not only exist, but has a surprisingly simple structure: The optimal schedulers from our proofs are deterministic and timed-positional, and the bounded time can be divided into a finite number of intervals, in which the optimal strategies are positional. That is, we demonstrate the existence of finite optimal control. Finally, we show that these pleasant properties of Markov decision processes extend to the more general class of continuous-time Markov games, and that both early and late schedulers show this behaviour.

Affiliated with

Also associated with

No associations

Rating

Finite Optimal Control for Time-Bounded Reachability in CTMDPs and Continuous-Time Markov Games does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Finite Optimal Control for Time-Bounded Reachability in CTMDPs and Continuous-Time Markov Games, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Finite Optimal Control for Time-Bounded Reachability in CTMDPs and Continuous-Time Markov Games will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-693553