A Relative Value Iteration Algorithm for Non-degenerate Controlled Diffusions

Details A Relative Value Iteration Algorithm for Non-degenerate Controlled Diffusions A Relative Value Iteration Algorithm for Non-degenerate Controlled Diffusions

2011-10-06

arxiv.org/abs/1110.1273v1

Mathematics

Optimization and Control

17 pages

Scientific paper

The ergodic control problem for a non-degenerate controlled diffusion controlled through its drift is considered under a uniform stability condition that ensures the well-posedness of the associated Hamilton-Jacobi-Bellman (HJB) equation. A nonlinear parabolic evolution equation is then proposed as a continuous time continuous state space analog of White's `relative value iteration' algorithm for solving the ergodic dynamic programming equation for the finite state finite action case. Its convergence to the solution of the HJB equation is established using the theory of monotone dynamical systems and also, alternatively, by using the theory of reverse martingales.

Affiliated with

Also associated with

No associations

Rating

A Relative Value Iteration Algorithm for Non-degenerate Controlled Diffusions does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with A Relative Value Iteration Algorithm for Non-degenerate Controlled Diffusions, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and A Relative Value Iteration Algorithm for Non-degenerate Controlled Diffusions will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-181691