Computer Science – Information Retrieval
Scientific paper
2012-02-14
Computer Science
Information Retrieval
Scientific paper
Models of bags of words typically assume topic mixing so that the words in a single bag come from a limited number of topics. We show here that many sets of bag of words exhibit a very different pattern of variation than the patterns that are efficiently captured by topic mixing. In many cases, from one bag of words to the next, the words disappear and new ones appear as if the theme slowly and smoothly shifted across documents (providing that the documents are somehow ordered). Examples of latent structure that describe such ordering are easily imagined. For example, the advancement of the date of the news stories is reflected in a smooth change over the theme of the day as certain evolving news stories fall out of favor and new events create new stories. Overlaps among the stories of consecutive days can be modeled by using windows over linearly arranged tight distributions over words. We show here that such strategy can be extended to multiple dimensions and cases where the ordering of data is not readily obvious. We demonstrate that this way of modeling covariation in word occurrences outperforms standard topic models in classification and prediction tasks in applications in biology, text modeling and computer vision.
Jojic Nebojsa
Perina Alessandro
No associations
LandOfFree
Multidimensional counting grids: Inferring word order from disordered bags of words does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Multidimensional counting grids: Inferring word order from disordered bags of words, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Multidimensional counting grids: Inferring word order from disordered bags of words will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-90634