Corpus structure, language models, and ad hoc information retrieval

Details Corpus structure, language models, and ad hoc information retrieval Corpus structure, language models, and ad hoc information retrieval

2004-05-12

arxiv.org/abs/cs/0405044v1

Computer Science

Information Retrieval

To appear, SIGIR 2004

Scientific paper

Most previous work on the recently developed language-modeling approach to information retrieval focuses on document-specific characteristics, and therefore does not take into account the structure of the surrounding corpus. We propose a novel algorithmic framework in which information provided by document-based language models is enhanced by the incorporation of information drawn from clusters of similar documents. Using this framework, we develop a suite of new algorithms. Even the simplest typically outperforms the standard language-modeling approach in precision and recall, and our new interpolation algorithm posts statistically significant improvements for both metrics over all three corpora tested.

Affiliated with

Also associated with

No associations

Rating

Corpus structure, language models, and ad hoc information retrieval does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Corpus structure, language models, and ad hoc information retrieval, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Corpus structure, language models, and ad hoc information retrieval will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-618377