Ensemble Risk Modeling Method for Robust Learning on Scarce Data

Details Ensemble Risk Modeling Method for Robust Learning on Scarce Data Ensemble Risk Modeling Method for Robust Learning on Scarce Data

2011-08-13

arxiv.org/abs/1108.2820v2

Computer Science

Learning

Scientific paper

In medical risk modeling, typical data are "scarce": they have relatively small number of training instances (N), censoring, and high dimensionality (M). We show that the problem may be effectively simplified by reducing it to bipartite ranking, and introduce new bipartite ranking algorithm, Smooth Rank, for robust learning on scarce data. The algorithm is based on ensemble learning with unsupervised aggregation of predictors. The advantage of our approach is confirmed in comparison with two "gold standard" risk modeling methods on 10 real life survival analysis datasets, where the new approach has the best results on all but two datasets with the largest ratio N/M. For systematic study of the effects of data scarcity on modeling by all three methods, we conducted two types of computational experiments: on real life data with randomly drawn training sets of different sizes, and on artificial data with increasing number of features. Both experiments demonstrated that Smooth Rank has critical advantage over the popular methods on the scarce data; it does not suffer from overfitting where other methods do.

Affiliated with

Also associated with

No associations

Rating

Ensemble Risk Modeling Method for Robust Learning on Scarce Data does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Ensemble Risk Modeling Method for Robust Learning on Scarce Data, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Ensemble Risk Modeling Method for Robust Learning on Scarce Data will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-711771