MedLDA: A General Framework of Maximum Margin Supervised Topic Models

Details MedLDA: A General Framework of Maximum Margin Supervised Topic Models MedLDA: A General Framework of Maximum Margin Supervised Topic Models

2009-12-30

arxiv.org/abs/0912.5507v1

Statistics

Machine Learning

27 Pages

Scientific paper

Supervised topic models utilize document's side information for discovering predictive low dimensional representations of documents. Existing models apply the likelihood-based estimation. In this paper, we present a general framework of max-margin supervised topic models for both continuous and categorical response variables. Our approach, the maximum entropy discrimination latent Dirichlet allocation (MedLDA), utilizes the max-margin principle to train supervised topic models and estimate predictive topic representations that are arguably more suitable for prediction tasks. The general principle of MedLDA can be applied to perform joint max-margin learning and maximum likelihood estimation for arbitrary topic models, directed or undirected, and supervised or unsupervised, when the supervised side information is available. We develop efficient variational methods for posterior inference and parameter estimation, and demonstrate qualitatively and quantitatively the advantages of MedLDA over likelihood-based topic models on movie review and 20 Newsgroups data sets.

Affiliated with

Also associated with

No associations

Rating

MedLDA: A General Framework of Maximum Margin Supervised Topic Models does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with MedLDA: A General Framework of Maximum Margin Supervised Topic Models, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and MedLDA: A General Framework of Maximum Margin Supervised Topic Models will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-34343