WSDM Yandex Relevance Prediction Challenge

The challenge provides a fully anonymized dataset from Yandex, with user queries, clicks on URLs and their relevance labels.

---

As it was already announced, the Relevance Prediction Challenge, which is a part of the WSDM 2012 Web Search Click Data (WSCD) workshop, is under way. The Challenge represents a unique opportunity to consolidate and scrutinize the work from industrial labs on predicting the relevance of URLs using user search behavior.

This workshop provides a fully anonymized dataset shared by Yandex, which has user queries, clicks on URLs and their relevance labels. There is also a forum for presenting new results and analysis in the area. The dataset includes user sessions extracted from Yandex logs, with queries, URL rankings and clicks.

Unlike previous click datasets, it also includes relevance judgments for the ranked URLs, for the purposes of training relevance prediction models. The queries are grouped only by sessions and no user IDs are provided.

There are over 250 participants already and there is still about 6 weeks to go. Feel free to participate at: imat-relpred.yandex.ru/en