Wikimedia Engineering/WMF Tech Days 2013/Product and Data Workshop

Product & Data workshop

 * see the brainstorming page


 * Leads
 * Dario Taraborelli, Aaron Halfaker, Toby Negrin


 * Schedule
 * 1:30 pm - 60 minutes - 6th floor collab space


 * Audience
 * PMs and analysts: how do we incorporate data into product decisions?
 * Engineers wanting to collect data on new features or platform changes


 * Outcomes
 * how we use data at the WMF (more broadly)
 * how we plan tests and define metrics
 * how we incorporate data into product decisions


 * Things to discuss
 * Evaluating new features/products
 * Product lifecycle
 * Using data to inform product design vs product optimization
 * Types of request: counting things vs testing hypotheses
 * Controlled tests and hypothesis testing
 * When is it appropriate to run a controlled test?
 * A/B testing state of the art: what can we do with the existing infrastructure?
 * A/B testing: low hanging fruits
 * What are the costs associated with a controlled test?
 * Descriptive usage data
 * I want to use EventLogging to collect usage data, where do I start? How do I set up a dashboard?
 * Cohort analysis: Wikimetrics
 * Other product evaluation methods
 * Usability testing
 * Qualitative analysis