The Feature Importance Ranking Measure

Details The Feature Importance Ranking Measure The Feature Importance Ranking Measure

2009-06-23

arxiv.org/abs/0906.4258v1

Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (EC

Statistics

Machine Learning

15 pages, 3 figures. to appear in the Proceedings of the European Conference on Machine Learning and Principles and Practice o

Scientific paper

Most accurate predictions are typically obtained by learning machines with complex feature spaces (as e.g. induced by kernels). Unfortunately, such decision rules are hardly accessible to humans and cannot easily be used to gain insights about the application domain. Therefore, one often resorts to linear models in combination with variable selection, thereby sacrificing some predictive power for presumptive interpretability. Here, we introduce the Feature Importance Ranking Measure (FIRM), which by retrospective analysis of arbitrary learning machines allows to achieve both excellent predictive performance and superior interpretation. In contrast to standard raw feature weighting, FIRM takes the underlying correlation structure of the features into account. Thereby, it is able to discover the most relevant features, even if their appearance in the training data is entirely prevented by noise. The desirable properties of FIRM are investigated analytically and illustrated in simulations.

Affiliated with

Also associated with

No associations

Rating

The Feature Importance Ranking Measure does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with The Feature Importance Ranking Measure, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and The Feature Importance Ranking Measure will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-708460