Divergence-based characterization of fundamental limitations of adaptive dynamical systems

Details Divergence-based characterization of fundamental limitations of adaptive dynamical systems Divergence-based characterization of fundamental limitations of adaptive dynamical systems

2010-10-12

arxiv.org/abs/1010.2286v1

Computer Science

Information Theory

8 pages, uses ieeeconf.cls; to appear in Proc. 48th Annual Allerton Conf. on Communication, Control and Computing (2010)

Scientific paper

Adaptive dynamical systems arise in a multitude of contexts, e.g., optimization, control, communications, signal processing, and machine learning. A precise characterization of their fundamental limitations is therefore of paramount importance. In this paper, we consider the general problem of adaptively controlling and/or identifying a stochastic dynamical system, where our {\em a priori} knowledge allows us to place the system in a subset of a metric space (the uncertainty set). We present an information-theoretic meta-theorem that captures the trade-off between the metric complexity (or richness) of the uncertainty set, the amount of information acquired online in the process of controlling and observing the system, and the residual uncertainty remaining after the observations have been collected. Following the approach of Zames, we quantify {\em a priori} information by the Kolmogorov (metric) entropy of the uncertainty set, while the information acquired online is expressed as a sum of information divergences. The general theory is used to derive new minimax lower bounds on the metric identification error, as well as to give a simple derivation of the minimum time needed to stabilize an uncertain stochastic linear system.

Affiliated with

Also associated with

No associations

Rating

Divergence-based characterization of fundamental limitations of adaptive dynamical systems does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Divergence-based characterization of fundamental limitations of adaptive dynamical systems, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Divergence-based characterization of fundamental limitations of adaptive dynamical systems will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-607538