Mathematics – Optimization and Control
Scientific paper
2012-02-20
Mathematics
Optimization and Control
Scientific paper
We develop a novel framework for formulating a class of stochastic reachability problems with state constraints as a stochastic optimal control problem. Previous approaches to solving these problems are either confined to the deterministic setting or address almost-sure stochastic notions. In contrast, we propose a new methodology to tackle probabilistic specifications that are less specific than almost sure requirements. To this end, we first establish a connection between two stochastic reach-avoid problems and classes of different stochastic optimal control problems for diffusions with discontinuous payoff functions. In the sequel, we shall focus on one of the class of stochastic optimal control problem, exit-time problem, which indeed addresses both reachability type questions. We derive a weak version of dynamic programming principle (DPP) for the value functions. Moreover, based on our DPP, we give an alternative characterization of the value function as the solution to a partial differential equation in the sense of discontinuous viscosity solutions along with Dirichlet type boundary conditions. Finally we validate the performance of the proposed framework on the stochastic Zermelo navigation problem.
Chatterjee Debasish
Esfahani Peyman Mohajerin
Lygeros John
No associations
LandOfFree
On Stochastic Reach-Avoid Problem and Set Characterization for Diffusions does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with On Stochastic Reach-Avoid Problem and Set Characterization for Diffusions, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and On Stochastic Reach-Avoid Problem and Set Characterization for Diffusions will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-565404