Computer Science – Artificial Intelligence
Scientific paper
2009-11-26
AGI-2010
Computer Science
Artificial Intelligence
AGI-2010. 6 pages, 2 figures
Scientific paper
Explaining adaptive behavior is a central problem in artificial intelligence research. Here we formalize adaptive agents as mixture distributions over sequences of inputs and outputs (I/O). Each distribution of the mixture constitutes a `possible world', but the agent does not know which of the possible worlds it is actually facing. The problem is to adapt the I/O stream in a way that is compatible with the true world. A natural measure of adaptation can be obtained by the Kullback-Leibler (KL) divergence between the I/O distribution of the true world and the I/O distribution expected by the agent that is uncertain about possible worlds. In the case of pure input streams, the Bayesian mixture provides a well-known solution for this problem. We show, however, that in the case of I/O streams this solution breaks down, because outputs are issued by the agent itself and require a different probabilistic syntax as provided by intervention calculus. Based on this calculus, we obtain a Bayesian control rule that allows modeling adaptive behavior with mixture distributions over I/O streams. This rule might allow for a novel approach to adaptive control based on a minimum KL-principle.
Braun Daniel A.
Ortega Pedro A.
No associations
LandOfFree
A Bayesian Rule for Adaptive Control based on Causal Interventions does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with A Bayesian Rule for Adaptive Control based on Causal Interventions, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and A Bayesian Rule for Adaptive Control based on Causal Interventions will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-116858