Visualizing Topics with Multi-Word Expressions

Details Visualizing Topics with Multi-Word Expressions Visualizing Topics with Multi-Word Expressions

2009-07-06

arxiv.org/abs/0907.1013v1

Statistics

Machine Learning

Scientific paper

We describe a new method for visualizing topics, the distributions over terms that are automatically extracted from large text corpora using latent variable models. Our method finds significant $n$-grams related to a topic, which are then used to help understand and interpret the underlying distribution. Compared with the usual visualization, which simply lists the most probable topical terms, the multi-word expressions provide a better intuitive impression for what a topic is "about." Our approach is based on a language model of arbitrary length expressions, for which we develop a new methodology based on nested permutation tests to find significant phrases. We show that this method outperforms the more standard use of $\chi^2$ and likelihood ratio tests. We illustrate the topic presentations on corpora of scientific abstracts and news articles.

Affiliated with

Also associated with

No associations

Rating

Visualizing Topics with Multi-Word Expressions does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Visualizing Topics with Multi-Word Expressions, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Visualizing Topics with Multi-Word Expressions will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-27988