Mathematics – Optimization and Control
Scientific paper
2009-04-27
Mathematics
Optimization and Control
22 pages, 1 figure. Revised
Scientific paper
10.1016/j.nahs.2010.12.003
We present a dynamic programming-based solution to the problem of maximizing the probability of attaining a target set before hitting a cemetery set for a discrete-time Markov control process. Under mild hypotheses we establish that there exists a deterministic stationary policy that achieves the maximum value of this probability. We demonstrate how the maximization of this probability can be computed through the maximization of an expected total reward until the first hitting time to either the target or the cemetery set. Martingale characterizations of thrifty, equalizing, and optimal policies in the context of our problem are also established.
Chatterjee Debasish
Cinquemani Eugenio
Lygeros John
No associations
LandOfFree
Maximizing the probability of attaining a target prior to extinction does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Maximizing the probability of attaining a target prior to extinction, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Maximizing the probability of attaining a target prior to extinction will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-322718