Statistics – Machine Learning
Scientific paper
2011-11-15
Statistics
Machine Learning
8 pages, 1 figure, to appear in the proceedings of MaxEnt 2011 held in Waterloo, Canada
Scientific paper
We are working to develop automated intelligent agents, which can act and react as learning machines with minimal human intervention. To accomplish this, an intelligent agent is viewed as a question-asking machine, which is designed by coupling the processes of inference and inquiry to form a model-based learning unit. In order to select maximally-informative queries, the intelligent agent needs to be able to compute the relevance of a question. This is accomplished by employing the inquiry calculus, which is dual to the probability calculus, and extends information theory by explicitly requiring context. Here, we consider the interaction between two question-asking intelligent agents, and note that there is a potential information redundancy with respect to the two questions that the agents may choose to pose. We show that the information redundancy is minimized by maximizing the joint entropy of the questions, which simultaneously maximizes the relevance of each question while minimizing the mutual information between them. Maximum joint entropy is therefore an important principle of information-based collaboration, which enables intelligent agents to efficiently learn together.
Knuth Kevin H.
Lary D. J.
Malakar N. K.
No associations
LandOfFree
Maximum Joint Entropy and Information-Based Collaboration of Automated Learning Machines does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Maximum Joint Entropy and Information-Based Collaboration of Automated Learning Machines, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Maximum Joint Entropy and Information-Based Collaboration of Automated Learning Machines will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-708135