Using Variational Inference and MapReduce to Scale Topic Modeling

Details Using Variational Inference and MapReduce to Scale Topic Modeling Using Variational Inference and MapReduce to Scale Topic Modeling

2011-07-19

arxiv.org/abs/1107.3765v1

Computer Science

Artificial Intelligence

Scientific paper

Latent Dirichlet Allocation (LDA) is a popular topic modeling technique for exploring document collections. Because of the increasing prevalence of large datasets, there is a need to improve the scalability of inference of LDA. In this paper, we propose a technique called ~\emph{MapReduce LDA} (Mr. LDA) to accommodate very large corpus collections in the MapReduce framework. In contrast to other techniques to scale inference for LDA, which use Gibbs sampling, we use variational inference. Our solution efficiently distributes computation and is relatively simple to implement. More importantly, this variational implementation, unlike highly tuned and specialized implementations, is easily extensible. We demonstrate two extensions of the model possible with this scalable framework: informed priors to guide topic discovery and modeling topics from a multilingual corpus.

Affiliated with

Also associated with

No associations

Rating

Using Variational Inference and MapReduce to Scale Topic Modeling does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Using Variational Inference and MapReduce to Scale Topic Modeling, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Using Variational Inference and MapReduce to Scale Topic Modeling will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-515013