Feature-Weighted Linear Stacking

Details Feature-Weighted Linear Stacking Feature-Weighted Linear Stacking

2009-11-03

arxiv.org/abs/0911.0460v2

Computer Science

Learning

17 pages, 1 figure, 2 tables

Scientific paper

Ensemble methods, such as stacking, are designed to boost predictive accuracy by blending the predictions of multiple machine learning models. Recent work has shown that the use of meta-features, additional inputs describing each example in a dataset, can boost the performance of ensemble methods, but the greatest reported gains have come from nonlinear procedures requiring significant tuning and training time. Here, we present a linear technique, Feature-Weighted Linear Stacking (FWLS), that incorporates meta-features for improved accuracy while retaining the well-known virtues of linear regression regarding speed, stability, and interpretability. FWLS combines model predictions linearly using coefficients that are themselves linear functions of meta-features. This technique was a key facet of the solution of the second place team in the recently concluded Netflix Prize competition. Significant increases in accuracy over standard linear stacking are demonstrated on the Netflix Prize collaborative filtering dataset.

Affiliated with

Also associated with

No associations

Rating

Feature-Weighted Linear Stacking does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Feature-Weighted Linear Stacking, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Feature-Weighted Linear Stacking will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-255845