Product Analytics/Movement metrics

From mediawiki.org

The Product Analytics team is responsible for defining and calculating a set of metrics for the overall health of the movement.

For current definitions, see Wikimedia Audiences/Data dictionary#Core metrics. For our most recent movement metrics report, see Wikimedia Audiences#Metrics.

We report these metrics monthly by the 15th of the following month (or the next business day if the 15th falls on a weekend or holiday).

Our reports are used in the following ways:

  • Reviewed in the People Product Manager meeting every month.
  • Posted on Wikimedia Product for public access
  • Compiled on a quarterly basis for presentation to the Board of Trustees

Calculation[edit]

Contributors[edit]

The contributors metrics are calculated on JupyterHub using the wikimedia-research/Editing-movement-metrics repo from GitHub. The repo's readme contains full instructions.

Readers[edit]

The readers metrics are calculated on JupyterHub using the wikimedia-research/Readers-core-metrics from GitHub. The repo's readme contains full instructions.

Platform evolution and structured data[edit]

The platform evolution and structured data metrics are calculated on JupyterHub using the wikimedia-research/Platform-metrics from GitHub.

Reporting[edit]

  1. Briefly identify any key trends (the "what") and one key story to focus on each month.
  2. Draft Executive Summary and create highlights slides for Key Product Metrics: deck.
  3. Once the slides are completed,
    1. upload the month's slides to Commons as a PDF (you can use the May 2020 report as a guide), and add “WMF Product Analytics” category when uploading.
    2. update Wikimedia Audiences#Metrics and Product_Analytics page to include the PDF you just uploaded.
    3. Add the highlights to the Executive Team Weekly Report (example from 29 March, 2022)
  4. The metrics numbers will be available for WMF staff to use in the Google spreadsheets : editors and readers