Yandex Personalized Web Search Challenge
The challenge ask participants to re-rank URLs of each SERP returned by the search engine according to the personal preferences of the users - personalize search using the long-term (user history based) and short-term (session-based) user context.
We are pleased to announce the launch of the Yandex Personalized Web Search Challenge, which is a part of the WSDM 2014 Web Search Click Data (WSCD) workshop. The Challenge is hosted by Kaggle and provides a unique opportunity to consolidate and scrutinize the work from industrial labs on personalizing web search using user-logged search behavior context. It also provides a fully anonymized dataset shared by Yandex, which has anonymized user ids, queries, query terms, urls, url domains and clicks. This Challenge and the shared dataset will enable a whole new set of researchers to study the problem of personalizing web search experience.
The Challenge is intended as a logical follow-up to the previous two challenges. We ask participants to re-rank URLs of each SERP returned by the search engine according to the personal preferences of the users. In other words, participants need to personalize search using the long-term (user history based) and short-term (session-based) user context.
The evaluation relies on a variant of a dwell-time based model of personal relevance and is data-driven, as it is presently accepted in the state-of the-art research on personalized search.
The Challenge is a part of the Web Search Click Data workshop (WSCD 2014) and the reports of the best teams are welcome to be presented at this workshop, to be held at WSDM 2014 conference, on 28 Feb 2013, New York City, USA. The workshop is organized by Pavel Serdyukov (Yandex), Georges Dupret (Yahoo!) and Nick Craswell (Microsoft Research/Bing).
Contestants can participate as individuals, or as teams. You will find a detailed description of the task, data sets and result evaluation methodology at:
- Oct 11, 2013 - Challenge opened
- Dec 20, 2013 - Registration of new participants stops
- Jan 10, 2014 - End of challenge (23:59 UTC)
- Jan 14, 2014 - Preliminary winners notified
- Jan 30, 2014 - Reports deadline
- Feb 28, 2014 - WSCD workshop at WSDM 2014 and Winners announcement
The top three competitors will receive the following cash prizes:
- 1st place: $5,000
- 2nd place: $3,000
- 3rd place: $1,000
Pavel Serdyukov, Eugene Kharitonov (Yandex)