Computer Science – Artificial Intelligence
Scientific paper
2003-12-20
Computer Science
Artificial Intelligence
A preliminary version of the is paper appears in IJCAI, 1995. This version will appear in the Journal of AI Research
Scientific paper
Non-deductive reasoning systems are often {\em representation dependent}: representing the same situation in two different ways may cause such a system to return two different answers. Some have viewed this as a significant problem. For example, the principle of maximum entropy has been subjected to much criticism due to its representation dependence. There has, however, been almost no work investigating representation dependence. In this paper, we formalize this notion and show that it is not a problem specific to maximum entropy. In fact, we show that any representation-independent probabilistic inference procedure that ignores irrelevant information is essentially entailment, in a precise sense. Moreover, we show that representation independence is incompatible with even a weak default assumption of independence. We then show that invariance under a restricted class of representation changes can form a reasonable compromise between representation independence and other desiderata, and provide a construction of a family of inference procedures that provides such restricted representation independence, using relative entropy.
Halpern Joseph Y.
Koller Daphne
No associations
LandOfFree
Representation Dependence in Probabilistic Inference does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Representation Dependence in Probabilistic Inference, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Representation Dependence in Probabilistic Inference will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-656723