Online Learning with Preference Feedback

Details Online Learning with Preference Feedback Online Learning with Preference Feedback

2011-11-03

arxiv.org/abs/1111.0712v1

Computer Science

Learning

Scientific paper

We propose a new online learning model for learning with preference feedback. The model is especially suited for applications like web search and recommender systems, where preference data is readily available from implicit user feedback (e.g. clicks). In particular, at each time step a potentially structured object (e.g. a ranking) is presented to the user in response to a context (e.g. query), providing him or her with some unobserved amount of utility. As feedback the algorithm receives an improved object that would have provided higher utility. We propose a learning algorithm with provable regret bounds for this online learning setting and demonstrate its effectiveness on a web-search application. The new learning model also applies to many other interactive learning problems and admits several interesting extensions.

Affiliated with

Also associated with

No associations

Rating

Online Learning with Preference Feedback does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Online Learning with Preference Feedback, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Online Learning with Preference Feedback will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-700822