Computer Science – Information Theory
Scientific paper
May 2001
adsabs.harvard.edu/cgi-bin/nph-data_query?bibcode=2001aipc..568..159w&link_type=abstract
BAYESIAN INFERENCE AND MAXIMUM ENTROPY METHODS IN SCIENCE AND ENGINEERING: 20th International Workshop. AIP Conference Proceedi
Computer Science
Information Theory
Measurement And Error Theory, Information Theory And Communication Theory
Scientific paper
Bayes experimental design using entropy, or equivalently negative information, as a criterion is fairly well developed. The present work applies this model but at a primitive level in statistical sampling. It is assumed that the observer/experimentor is allowed to place a window over the support of a sampling distribution and only ``pay for'' observations that fall in this window. The window can be modeled with an ``attention function,'' simply the indicator function of the window. The understanding is that the cost of the experiment is only the number of paid for observations: n. For fixed n and under the information model it turns out that for standard problems the optimal structure for the window, in the limit amongst all types of window including disjoint regions, is discrete. That is to say it is optimal to observe the world (in this sense) through discrete slits. It also shows that in this case Bayesians with different priors will receive different samples because typically the optimal attention windows will be disjoint. This property we refer to as the quantization of the attention function. .
Sebastiani P.
Wynn Henry P.
No associations
LandOfFree
The quantization of the attention function under a Bayes information theoretic model does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with The quantization of the attention function under a Bayes information theoretic model, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and The quantization of the attention function under a Bayes information theoretic model will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-924021