Learning in embodied action-perception loops through exploration

Details Learning in embodied action-perception loops through exploration Learning in embodied action-perception loops through exploration

2011-12-06

arxiv.org/abs/1112.1125v2

Computer Science

Learning

Scientific paper

Although exploratory behaviors are ubiquitous in the animal kingdom, their computational underpinnings are still largely unknown. Behavioral Psychology has identified learning as a primary drive underlying many exploratory behaviors. Exploration is seen as a means for an animal to gather sensory data useful for reducing its ignorance about the environment. While related problems have been addressed in Data Mining and Reinforcement Learning, the computational modeling of learning-driven exploration by embodied agents is largely unrepresented. Here, we propose a computational theory for learning-driven exploration based on the concept of missing information that allows an agent to identify informative actions using Bayesian inference. We demonstrate that when embodiment constraints are high, agents must actively coordinate their actions to learn efficiently. Compared to earlier approaches, our exploration policy yields more efficient learning across a range of worlds with diverse structures. The improved learning in turn affords greater success in general tasks including navigation and reward gathering. We conclude by discussing how the proposed theory relates to previous information-theoretic objectives of behavior, such as predictive information and the free energy principle, and how it might contribute to a general theory of exploratory behavior.

Affiliated with

Also associated with

No associations

Rating

Learning in embodied action-perception loops through exploration does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Learning in embodied action-perception loops through exploration, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Learning in embodied action-perception loops through exploration will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-380046