A Real-Time Model-Based Reinforcement Learning Architecture for Robot Control

Details A Real-Time Model-Based Reinforcement Learning Architecture for Robot Control A Real-Time Model-Based Reinforcement Learning Architecture for Robot Control

2011-05-09

arxiv.org/abs/1105.1749v2

Computer Science

Artificial Intelligence

Added a reference Presents a real-time parallel architecture for model-based reinforcement learning methods

Scientific paper

Reinforcement Learning (RL) is a method for learning decision-making tasks that could enable robots to learn and adapt to their situation on-line. For an RL algorithm to be practical for robotic control tasks, it must learn in very few actions, while continually taking those actions in real-time. Existing model-based RL methods learn in relatively few actions, but typically take too much time between each action for practical on-line learning. In this paper, we present a novel parallel architecture for model-based RL that runs in real-time by 1) taking advantage of sample-based approximate planning methods and 2) parallelizing the acting, model learning, and planning processes such that the acting process is sufficiently fast for typical robot control cycles. We demonstrate that algorithms using this architecture perform nearly as well as methods using the typical sequential architecture when both are given unlimited time, and greatly out-perform these methods on tasks that require real-time actions such as controlling an autonomous vehicle.

Affiliated with

Also associated with

No associations

Rating

A Real-Time Model-Based Reinforcement Learning Architecture for Robot Control does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with A Real-Time Model-Based Reinforcement Learning Architecture for Robot Control, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and A Real-Time Model-Based Reinforcement Learning Architecture for Robot Control will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-334606