Statistics – Machine Learning
Scientific paper
2010-08-29
Statistics
Machine Learning
8 pages, 3 figures. To appear in the proceedings of MaxEnt 2010, held in Chamonix, France
Scientific paper
The scientific method relies on the iterated processes of inference and inquiry. The inference phase consists of selecting the most probable models based on the available data; whereas the inquiry phase consists of using what is known about the models to select the most relevant experiment. Optimizing inquiry involves searching the parameterized space of experiments to select the experiment that promises, on average, to be maximally informative. In the case where it is important to learn about each of the model parameters, the relevance of an experiment is quantified by Shannon entropy of the distribution of experimental outcomes predicted by a probable set of models. If the set of potential experiments is described by many parameters, we must search this high-dimensional entropy space. Brute force search methods will be slow and computationally expensive. We present an entropy-based search algorithm, called nested entropy sampling, to select the most informative experiment for efficient experimental design. This algorithm is inspired by Skilling's nested sampling algorithm used in inference and borrows the concept of a rising threshold while a set of experiment samples are maintained. We demonstrate that this algorithm not only selects highly relevant experiments, but also is more efficient than brute force search. Such entropic search techniques promise to greatly benefit autonomous experimental design.
Knuth Kevin H.
Malakar N. K.
No associations
LandOfFree
Entropy-Based Search Algorithm for Experimental Design does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Entropy-Based Search Algorithm for Experimental Design, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Entropy-Based Search Algorithm for Experimental Design will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-399762