Interview: Cliff Lyon, Stubhub on Mastering Recommendation & Personalization Analytics Part 2
We discuss current trends, future vision, interesting correlations, privacy concerns, and advice for Data Science practitioners.

First part of interview.
Here is second part and last part of my interview with him:
Anmol Rajpurohit: Q4. Over the last few years, what major trends have you observed in the area of recommendation and personalization? What is your vision for near future?

On the presentation side, given the huge growth of mobile, and the much smaller viewport, I think recommendation and search together can really help users make the most use of the small screen – the more quickly catalogs can cull low-utility suggestions, the better.
AR: Q5. Are there any examples of interesting correlations that you observed (in the pursuit of building recommendations) recently? May be, similar to the famous diapers-and-beers case.
CL: I spend a lot of time looking at recommendations I don’t understand, and trying to decide whether I just don’t have the context, or if it might be a bug. I have seen some surprising similarities for sure, but none that had the sort of explanatory power of the beer-and-diapers case. At StubHub, we sell tickets for concerts, music, and theater. As you might imagine, most often, the correlations stay in category – sports for sports, concerts for concerts, etc. But I did find it interesting that some artists cross over to sports audiences – Jay-Z correlates with the Nets, as he has connections to that organization, for example. And strangely, Jay-Z also shows up for WWE fans. Not exactly beer and diapers, but we do find cross-category correlations.
AR: Q6. What are your thoughts on the privacy concerns of online shoppers? How can the privacy concerns be properly addressed while designing recommendation and personalization systems?

AR: Q7. What motivated you to work in Data Science? What is the best advice you have got in your career in Data Science?
CL: Like any data geek, I suppose, when I first encountered the power of machine learning as a way of extracting information from data, I was completely hooked. I’d worked with data for years to that point, doing

Best advice – I feel lucky in that I had a lot of good teachers and counselors, too many to count.
One thing I learned from a teacher early on -- and this sounds simple but can be difficult for many reasons -- is to follow the data wherever it leads, which may or may not be to certainty. Often, we explore data only to find an outcome or result that challenges our basic assumptions. We need to question those assumptions, and find another model.
AR: Q8. What key qualities do you look for when interviewing for Data Science related positions on your team?
CL: I look for depth in one or maybe two areas depending on the level of the position, and passion. It is such a broad discipline, chances are you are going to be out of your comfort zone, learning new things, and you need passion to get you through that.

AR: Q9. What was the last book that you read and liked?
CL: I really liked Ted Dunning’s Practical Machine Learning; a quick read, and a really great take on the growing trend of deploying recommendation via search.
Related: