Using Context to Improve the Evaluation of Information Retrieval Systems

Computer Science – Information Retrieval

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

18 pages

Scientific paper

10.5121/ijdms.2011.3202

The crucial role of the evaluation in the development of the information retrieval tools is useful evidence to improve the performance of these tools and the quality of results that they return. However, the classic evaluation approaches have limitations and shortcomings especially regarding to the user consideration, the measure of the adequacy between the query and the returned documents and the consideration of characteristics, specifications and behaviors of the search tool. Therefore, we believe that the exploitation of contextual elements could be a very good way to evaluate the search tools. So, this paper presents a new approach that takes into account the context during the evaluation process at three complementary levels. The experiments gives at the end of this article has shown the applicability of the proposed approach to real research tools. The tests were performed with the most popular searching engine (i.e. Google, Bing and Yahoo) selected in particular for their high selectivity. The obtained results revealed that the ability of these engines to rejecting dead links, redundant results and parasites pages depends strongly to how queries are formulated, and to the political of sites offering this information to present their content. The relevance evaluation of results provided by these engines, using the user's judgments, then using an automatic manner to take into account the query context has also shown a general decline in the perceived relevance according to the number of the considered results.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

Using Context to Improve the Evaluation of Information Retrieval Systems does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Using Context to Improve the Evaluation of Information Retrieval Systems, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Using Context to Improve the Evaluation of Information Retrieval Systems will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-337844

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.