Computer Science – Information Theory
Scientific paper
2005-09-08
Computer Science
Information Theory
Scientific paper
Biological and machine pattern recognition systems face a common challenge: Given sensory data about an unknown object, classify the object by comparing the sensory data with a library of internal representations stored in memory. In many cases of interest, the number of patterns to be discriminated and the richness of the raw data force recognition systems to internally represent memory and sensory information in a compressed format. However, these representations must preserve enough information to accommodate the variability and complexity of the environment, or else recognition will be unreliable. Thus, there is an intrinsic tradeoff between the amount of resources devoted to data representation and the complexity of the environment in which a recognition system may reliably operate. In this paper we describe a general mathematical model for pattern recognition systems subject to resource constraints, and show how the aforementioned resource-complexity tradeoff can be characterized in terms of three rates related to number of bits available for representing memory and sensory data, and the number of patterns populating a given statistical environment. We prove single-letter information theoretic bounds governing the achievable rates, and illustrate the theory by analyzing the elementary cases where the pattern data is either binary or Gaussian.
O'Sullivan Joseph A.
Westover Brandon M.
No associations
LandOfFree
Achievable Rates for Pattern Recognition does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Achievable Rates for Pattern Recognition, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Achievable Rates for Pattern Recognition will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-1616