Discriminant Analysis with Adaptively Pooled Covariance

Details Discriminant Analysis with Adaptively Pooled Covariance Discriminant Analysis with Adaptively Pooled Covariance

2011-11-07

arxiv.org/abs/1111.1687v2

Statistics

Machine Learning

Scientific paper

Linear and Quadratic Discriminant analysis (LDA/QDA) are common tools for classification problems. For these methods we assume observations are normally distributed within group. We estimate a mean and covariance matrix for each group and classify using Bayes theorem. With LDA, we estimate a single, pooled covariance matrix, while for QDA we estimate a separate covariance matrix for each group. Rarely do we believe in a homogeneous covariance structure between groups, but often there is insufficient data to separately estimate covariance matrices. We propose L1- PDA, a regularized model which adaptively pools elements of the precision matrices. Adaptively pooling these matrices decreases the variance of our estimates (as in LDA), without overly biasing them. In this paper, we propose and discuss this method, give an efficient algorithm to fit it for moderate sized problems, and show its efficacy on real and simulated datasets.

Affiliated with

Also associated with

No associations

Rating

Discriminant Analysis with Adaptively Pooled Covariance does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Discriminant Analysis with Adaptively Pooled Covariance, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Discriminant Analysis with Adaptively Pooled Covariance will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-693218