Reinforcement Learning by Value Gradients

Details Reinforcement Learning by Value Gradients Reinforcement Learning by Value Gradients

2008-03-25

arxiv.org/abs/0803.3539v1

Computer Science

Neural and Evolutionary Computing

Scientific paper

The concept of the value-gradient is introduced and developed in the context of reinforcement learning. It is shown that by learning the value-gradients exploration or stochastic behaviour is no longer needed to find locally optimal trajectories. This is the main motivation for using value-gradients, and it is argued that learning value-gradients is the actual objective of any value-function learning algorithm for control problems. It is also argued that learning value-gradients is significantly more efficient than learning just the values, and this argument is supported in experiments by efficiency gains of several orders of magnitude, in several problem domains. Once value-gradients are introduced into learning, several analyses become possible. For example, a surprising equivalence between a value-gradient learning algorithm and a policy-gradient learning algorithm is proven, and this provides a robust convergence proof for control problems using a value function with a general function approximator.

Affiliated with

Also associated with

No associations

Rating

Reinforcement Learning by Value Gradients does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Reinforcement Learning by Value Gradients, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Reinforcement Learning by Value Gradients will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-349100