How would you build and test a metric to compare two user's ranked lists of movie/tv show preferences?

Question

Anonymous · Accepted Answer

Probably incorrectly.

Anonymous · Answer

1) Develop a list of shows/movies that are representative of different taste categries (more on this later)
2) Obtain ranking of the items in the list from 2 users
3) Use Spearman's rho (or other test that works with rankings) to assess dependence/conguence between the 2 people's rankings.

* To find shows/movies to include in the measurement instrument, maybe do cluster analysis on large number of viewer's viewing habits.

Anonymous · Answer

Look at the mean average precision of the movies that the users watch out of the rankings. So if out of 10 recommended movies one user prefers the third and the other user prefers the sixth, the recommendation engine of the user who preferred the third would be better.

InterviewQuery.com has it more in depth of an answer.

Anonymous · Answer

It's essential to demonstrate that you can really go deep... there are plenty of followup questions and (sometimes tangential) angles to explore.


There's a lot of  Senior Data Scientist experts who've worked at Netflix, who provide this sort of practice through mock interviews. There's a whole list of them curated on Prepfully.


prepfully.com/practice-interviews

Netflix

Netflix interview question

Interview Answers

Want the inside scoop on your own company?

Bowls

Followed companies

Job searches