Minimally Invasive Randomization for Collecting Unbiased Preferences from Clickthrough Logs

Details Minimally Invasive Randomization for Collecting Unbiased Preferences from Clickthrough Logs Minimally Invasive Randomization for Collecting Unbiased Preferences from Clickthrough Logs

2006-05-09

arxiv.org/abs/cs/0605037v1

Computer Science

Information Retrieval

7 pages. Proceedings of the 21st National Conference on Artificial Intelligence (AAAI), 2006

Scientific paper

Clickthrough data is a particularly inexpensive and plentiful resource to obtain implicit relevance feedback for improving and personalizing search engines. However, it is well known that the probability of a user clicking on a result is strongly biased toward documents presented higher in the result set irrespective of relevance. We introduce a simple method to modify the presentation of search results that provably gives relevance judgments that are unaffected by presentation bias under reasonable assumptions. We validate this property of the training data in interactive real world experiments. Finally, we show that using these unbiased relevance judgments learning methods can be guaranteed to converge to an ideal ranking given sufficient data.

Affiliated with

Also associated with

No associations

Rating

Minimally Invasive Randomization for Collecting Unbiased Preferences from Clickthrough Logs does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Minimally Invasive Randomization for Collecting Unbiased Preferences from Clickthrough Logs, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Minimally Invasive Randomization for Collecting Unbiased Preferences from Clickthrough Logs will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-675162