The Discrete Infinite Logistic Normal Distribution

Details The Discrete Infinite Logistic Normal Distribution The Discrete Infinite Logistic Normal Distribution

2011-03-24

arxiv.org/abs/1103.4789v3

Statistics

Machine Learning

This paper will appear in Bayesian Analysis. A shorter version of this paper appeared at AISTATS 2011, Fort Lauderdale, FL, US

Scientific paper

We present the discrete infinite logistic normal distribution (DILN), a Bayesian nonparametric prior for mixed membership models. DILN is a generalization of the hierarchical Dirichlet process (HDP) that models correlation structure between the weights of the atoms at the group level. We derive a representation of DILN as a normalized collection of gamma-distributed random variables, and study its statistical properties. We consider applications to topic modeling and derive a variational inference algorithm for approximate posterior inference. We study the empirical performance of the DILN topic model on four corpora, comparing performance with the HDP and the correlated topic model (CTM). To deal with large-scale data sets, we also develop an online inference algorithm for DILN and compare with online HDP and online LDA on the Nature magazine, which contains approximately 350,000 articles.

Affiliated with

Also associated with

No associations

Rating

The Discrete Infinite Logistic Normal Distribution does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with The Discrete Infinite Logistic Normal Distribution, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and The Discrete Infinite Logistic Normal Distribution will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-47867