Information Forests

Details Information Forests Information Forests

2012-02-07

arxiv.org/abs/1202.1523v1

Computer Science

Learning

Proceedings of the Information Theory and Applications (ITA) Workshop, 2/7/2012

Scientific paper

We describe Information Forests, an approach to classification that generalizes Random Forests by replacing the splitting criterion of non-leaf nodes from a discriminative one -- based on the entropy of the label distribution -- to a generative one -- based on maximizing the information divergence between the class-conditional distributions in the resulting partitions. The basic idea consists of deferring classification until a measure of "classification confidence" is sufficiently high, and instead breaking down the data so as to maximize this measure. In an alternative interpretation, Information Forests attempt to partition the data into subsets that are "as informative as possible" for the purpose of the task, which is to classify the data. Classification confidence, or informative content of the subsets, is quantified by the Information Divergence. Our approach relates to active learning, semi-supervised learning, mixed generative/discriminative learning.

Affiliated with

Also associated with

No associations

Rating

Information Forests does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Information Forests, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Information Forests will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-580230