Feature Selection with Conjunctions of Decision Stumps and Learning from Microarray Data

Details Feature Selection with Conjunctions of Decision Stumps and Learning from Microarray Data Feature Selection with Conjunctions of Decision Stumps and Learning from Microarray Data

2010-05-04

arxiv.org/abs/1005.0530v1

Computer Science

Learning

Scientific paper

One of the objectives of designing feature selection learning algorithms is to obtain classifiers that depend on a small number of attributes and have verifiable future performance guarantees. There are few, if any, approaches that successfully address the two goals simultaneously. Performance guarantees become crucial for tasks such as microarray data analysis due to very small sample sizes resulting in limited empirical evaluation. To the best of our knowledge, such algorithms that give theoretical bounds on the future performance have not been proposed so far in the context of the classification of gene expression data. In this work, we investigate the premise of learning a conjunction (or disjunction) of decision stumps in Occam's Razor, Sample Compression, and PAC-Bayes learning settings for identifying a small subset of attributes that can be used to perform reliable classification tasks. We apply the proposed approaches for gene identification from DNA microarray data and compare our results to those of well known successful approaches proposed for the task. We show that our algorithm not only finds hypotheses with much smaller number of genes while giving competitive classification accuracy but also have tight risk guarantees on future performance unlike other approaches. The proposed approaches are general and extensible in terms of both designing novel algorithms and application to other domains.

Affiliated with

Also associated with

No associations

Rating

Feature Selection with Conjunctions of Decision Stumps and Learning from Microarray Data does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Feature Selection with Conjunctions of Decision Stumps and Learning from Microarray Data, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Feature Selection with Conjunctions of Decision Stumps and Learning from Microarray Data will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-532264