KDnuggets : News : 2009 : n09 : item5 < PREVIOUS | NEXT >

Features

From: Ronny Kohavi
Date: Tue, 5 May 2009
Subject: Analyzing Controlled Experiments on the Web tutorials at CIKM-08 and KDD-09

My talk at CIKM a few months ago was just published on videolectures.net

It's a great example of how hard it is to assess ideas. The people in the room do worse than random at guessing the winning treatment in real experiments we ran at Microsoft.

See http://videolectures.net/cikm08_kohavi_pgtce/

I will also be presenting a tutorial at KDD 2009

http://www.kdd.org/kdd/2009/tutorials.html#t4

T4 - Planning, Running, and Analyzing Controlled Experiments on the Web
Ronny Kohavi, Roger Longbotham, John Quarto-vonTivadar

The web provides an unprecedented opportunity to evaluate ideas quickly using controlled experiments, also called randomized experiments, A/B tests (and their generalizations), split tests, and MultiVariable Tests (MVT). Controlled experiments embody the best scientific design for establishing a causal relationship between changes and their influence on user-observable behavior. Data Mining and Knowledge Discovery techniques can then be used to analyze the data from such experiments. The tutorial will provide a survey and practical guide to running controlled experiments based on the recently published survey article in the Data Mining and Knowledge Discovery Journal, co-authored with the two of the tutorial co-presenters


KDnuggets : News : 2009 : n09 : item5 < PREVIOUS | NEXT >

Copyright © 2009 KDnuggets.   Subscribe to KDnuggets News!