Maximum Joint Entropy and Information-Based Collaboration of Automated Learning Machines

Details Maximum Joint Entropy and Information-Based Collaboration of Automated Learning Machines Maximum Joint Entropy and Information-Based Collaboration of Automated Learning Machines

2011-11-15

arxiv.org/abs/1111.3421v1

Statistics

Machine Learning

8 pages, 1 figure, to appear in the proceedings of MaxEnt 2011 held in Waterloo, Canada

Scientific paper

We are working to develop automated intelligent agents, which can act and react as learning machines with minimal human intervention. To accomplish this, an intelligent agent is viewed as a question-asking machine, which is designed by coupling the processes of inference and inquiry to form a model-based learning unit. In order to select maximally-informative queries, the intelligent agent needs to be able to compute the relevance of a question. This is accomplished by employing the inquiry calculus, which is dual to the probability calculus, and extends information theory by explicitly requiring context. Here, we consider the interaction between two question-asking intelligent agents, and note that there is a potential information redundancy with respect to the two questions that the agents may choose to pose. We show that the information redundancy is minimized by maximizing the joint entropy of the questions, which simultaneously maximizes the relevance of each question while minimizing the mutual information between them. Maximum joint entropy is therefore an important principle of information-based collaboration, which enables intelligent agents to efficiently learn together.

Affiliated with

Also associated with

No associations

Rating

Maximum Joint Entropy and Information-Based Collaboration of Automated Learning Machines does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Maximum Joint Entropy and Information-Based Collaboration of Automated Learning Machines, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Maximum Joint Entropy and Information-Based Collaboration of Automated Learning Machines will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-708135