Clustered Language Models with Context-Equivalent States

Details Clustered Language Models with Context-Equivalent States Clustered Language Models with Context-Equivalent States

1996-06-04

arxiv.org/abs/cmp-lg/9606002v1

Computer Science

Computation and Language

3 pages, latex

Scientific paper

In this paper, a hierarchical context definition is added to an existing clustering algorithm in order to increase its robustness. The resulting algorithm, which clusters contexts and events separately, is used to experiment with different ways of defining the context a language model takes into account. The contexts range from standard bigram and trigram contexts to part of speech five-grams. Although none of the models can compete directly with a backoff trigram, they give up to 9\% improvement in perplexity when interpolated with a trigram. Moreover, the modified version of the algorithm leads to a performance increase over the original version of up to 12\%.

Affiliated with

Also associated with

No associations

Rating

Clustered Language Models with Context-Equivalent States does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Clustered Language Models with Context-Equivalent States, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Clustered Language Models with Context-Equivalent States will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-409170