Analytics/Archive/Editor Engagement Vital Signs

= Goals =

The Editor Engagement program is a top strategic priority for the foundation and has many individual initiatives. However we do not have a dashboard that provides consistent, explorable, timely data on this program which makes it difficult and time-consuming for implementors to understand the impact of their changes. A consistent dashboard would also help normalize results across products and other aspects of the program which are difficult to compare at this time.

The goal of this project is implementing such a dashboard. Note that Research and Data has volunteered to provide the definitions and SQL queries for the actual metrics.

= Detailed Tracking Links =

Development (Mingle)

Research (Trello)

= Users =

= Prioritized Use Cases =

High Probablity

 * 1) As a Product Manager I want a well designed dashboard that I can use to explore key Editor Engagement Metrics
 * 2) The high priority metrics are active users and number of edits
 * 3) As a Product Manager, Researcher and Analytics Developer (and just about everybody else) I need documentation about the how these metrics are calculated

Need Confirmation

 * 1) As a Product Manager I want to be able to compare arbitrary data series in a graph
 * 2) As a Product Manager and Researcher, I want historical data to be maintained in a format that can be queried easily.
 * 3) As a Manager I want some graphs to be available to WMF only

Non functional requirements

 * 1) All dashboards should be updated daily.
 * 2) Once we have signoff on the basic issues described below, all issues with dashboards should be addressed within 2 "business" days of the problem reports.
 * 3) Data be retained indefinitely

= Metrics =

A note on mobile v. desktop. We don't want a straight breakdown of every metric on mobile v. desktop because sometimes the metric won't make sense. For example, active editors isn't something that we want to differentiate mobile v. desktop at this time.

Granularity

 * Daily
 * Monthly

Acquisition

 * Newly registered users
 * by source: Mobile, Desktop
 * by campaign

Activation

 * Live users
 * First-time editors
 * by threshold: 1 edit, 5 edits per time period
 * by number of edit sessions per time period

Productivity

 * Productive new users

Retention

 * Surviving new users
 * by survival period: 1, 3, 7, 14, 30, 60, 90, 120, 365 days

Community

 * Active editors
 * by threshold: 1+, 5+, 100+ edits per time period
 * Bots
 * by threshold: 1+, 5+, 100+ edits per time period

Contributions

 * Edits
 * by source: Mobile, Desktop
 * Uploads
 * by source: Mobile, Desktop

Curation

 * Reverts
 * Deletions

Content

 * New Pages
 * Total Pages

= Implementation Details =

Research and Data will provide definitions of of these metrics as well as SQL queries that we can plug use.