Product Analytics/Movement metrics

The Product Analytics team is responsible for defining and calculating a set of metrics for the overall health of the movement.

For current definitions, see Wikimedia Audiences/Data dictionary.

For our most recent movement metrics report, see Wikimedia Audiences.

Contributors metric calculation process

 * 1) Clone the wikimedia-research/Editing-movement-metrics repo from GitHub onto one of the SWAP hosts.
 * 2) In any order, run the three notebooks numbered
 * 3) 01a-editor-month-table.ipynb: creates or updates an intermediate editor-month table in the   Hive database.
 * 4) 01b-new-editor-table.ipynb: creates or updates an intermediate table of new editors in the   Hive database.
 * 5) 01c-diversity-metrics.ipynb: just calculates Global South new editor retention. This needs to integrated into 02-calculation and past numbers backfilled into metrics/metrics.tsv.
 * 6) Run the notebook 02-calculation.ipynb, which actually calculates the metrics (some of them using the editor month and new editor tables calculated in the previous step) and inserts them into metrics.tsv.
 * 7) Run the notebook 03-report.ipynb, which does a few simple transformations on the metrics and produces the table of values needed for the final report, as well as a graph of each metric.
 * 8) Add the numbers from the table into the movement metrics tables preparation spreadsheet, which has exactly the format used in the final report. When you paste the new numbers in, make sure to "paste values only" so the formatting is preserved.
 * 9) Add or update the slides for the new month in the key product metrics: board slide deck. Copy the tables from the preparation spreadsheet into the slides in the appropriate places. If asked, paste them unlinked so we can keep changing the preparation slides without fear of changing the slides for past months.
 * 10) Do any analysis you need to understand major trends (drawing on the analysis notes in past months' slides if needed). The analysis folder in the metrics repo has a variety of notebook you could reuse; if you do new analysis, considering keeping it in an existing or new notebook in this folder, so it can be reused in the future.
 * 11) Write the analysis notes.
 * 12) If your addition of metrics and notes has completed the month's report:
 * 13) write an email to the reports key consumers letting them know it's finished. As of May 2019, these are Kate Zimmerman, Jon Katz, and Toby Negrin.
 * 14) upload the month's slides to Commons as a PDF (using the March 2019 report as a guide).
 * 15) update Wikimedia Audiences to include the PDF you just uploaded.
 * 16) Celebrate! 📊 🎉