Analytics/Archive/Editor Engagement Vital Signs

= Goals =

The Editor Engagement program is a top strategic priority for the foundation and has many individual initiatives. However we do not have a dashboard that provides consistent, explorable, timely data on this program which makes it difficult and time-consuming for implementors to understand the impact of their changes. A consistent dashboard would also help normalize results across products and other aspects of the program which are difficult to compare at this time.

The goal of this project is implementing such a dashboard. Note that Research and Data has volunteered to provide the definitions and SQL queries for the actual metrics.

TODO: Dario has a list of his high priority dashboards. I need to incorporate this list into this document.

= Users =

= Prioritized Use Cases =

HIgh Probablity

 * 1) As a Product Manager I want a well designed dashboard that I can use to explore key Editor Engagement Metrics
 * 2) As a Product Manager, Researcher and Analytics Developer (and just about everybody else) I need documentation about the how these metrics are calculated

Need Confirmation

 * 1) As a Product Manager I want to be able to compare arbitrary data series in a graph
 * 2) As a Product Manager and Researcher, I want historical data to be maintained in a format that can be queried easily.
 * 3) As a Manager I want some graphs to be available to WMF only

Non functional requirements

 * 1) All dashboards should be updated daily.
 * 2) Once we have signoff on the basic issues described below, all issues with dashboards should be addressed within 2 "business" days of the problem reports.
 * 3) Data be retained indefinitely

= Metrics =

A note on mobile v. desktop. We don't want a straight breakdown of every metric on mobile v. desktop because sometimes the metric won't make sense. For example, active editors isn't something that we want to differentiate mobile v. desktop at this time.

Granularity

 * Daily
 * Monthly

New Users

 * Registrations
 * Mobile
 * Desktop

Activation

 * Live accounts (?)
 * First time editors
 * 5+ Edits
 * Sessions
 * Number
 * Average Length

Community

 * Active Users
 * 1+ Edits
 * 5+ Edits
 * 100+ Edits
 * Bots
 * 1+ Edits
 * 5+ Edits
 * 100+ Edits

Contributions

 * Edits
 * Mobile
 * Desktop
 * Uploads
 * Mobile
 * Desktop

Curation

 * Reverts
 * Deletions

Content

 * New Pages
 * Total Pages

= Implementation Details =

Research and Data will provide definitions of of these metrics as well as SQL queries that we can plug use.