Wikimedia Product/Data dictionary

This page collects definitions of core metrics and quantitative annual plan goals of the Wikimedia Product department which are tracked by the Product Analytics team.

Core metrics

A set of key metrics designed to give a high-level picture of the movement's health. These are reported monthly to the Wikimedia Foundation board and at Wikimedia_Product#Metrics, with further analysis in the quarterly metrics & insights presentations.

Contributors

The code that calculates these metrics can be found in the wikimedia-research/Editing-movement-metrics repository on Github.

Contributors

metric	definition	remarks
Total content pages	The total number of existing (non-deleted) pages in content namespaces across all wikis	Produced by summing up the net new content pages metric for provided by the Analytics Query Service over all time.
—Wikipedia articles	The total number of existing (non-deleted) pages in content names across all Wikipedias.	A subset of total content pages. Produced by summing up the net new content pages metric for all Wikipedias.
—Media files	The total number of existing (non-deleted) pages in content namespaces on Wikimedia Commons. The large majority of these are file pages, but a small number are gallery pages.	A subset of total content pages. Produced by summing up the net new content pages metric for Wikimedia Commons.
—Wikidata entities	The number of existing (non-deleted) Wikidata entities.	A subset of total content pages. Produced by summing up the net new content pages metric for Wikidata.
Net new content	The number of content pages added since the previous month minus the ones deleted since the previous month.	Produced by subtracting last month's total content pages metric from this month's.
—Wikipedia articles	The number of Wikipedia articles added since the previous month minus the ones deleted since the previous month.	A subset of net new content. Produced by subtracting last month's total Wikipedia articles metric from this month's.
—Media files	The number of Wikimedia Commons content pages added since the previous month minus the ones deleted since the previous month.	A subset of net new content. Produced by subtracting last month's total media files metric from this month's.
—Wikidata entities	The number of Wikidata entities added since the previous month minus the ones deleted since the previous month.	A subset of net new content. Produced by subtracting last month's total Wikipedia entities metric from this month's.
Active editors	The number of registered users who made at least 5 content edits across all projects in the given month. See meta:Research:Active editor for the full definition.
—New	Active editors who registered during the given month.
—Returning	Active editors who registered before the given month.
New editor retention	Out of the users who registered in the month before the previous and made at least one edit in their first 30 days, the proportion who also edited during their second 30 days.
Global revert rate	The proportion of non-bot edits made during the given month which were reverted at any point before the snapshot.	Reverted edits are identified using the revision_is_identity_reverted field in the mediawiki_history dataset.
Total edits	The total number of edits made across all wikis during the given month. Edits that have been reverted or deleted are included among total edits.	Total edits has a "missing" fifth component in addition to the four components included below: the number of other bot edits.
—Mobile edits	The number of edits tagged as having been made using the mobile website (which can be used by desktop computers) or the mobile apps.
—Data edits	The number of edits to Wikidata, including bot edits.
—File uploads	The number of edits, including any bot edits, which uploaded a new file on any project.
—Other non-bot edits	The number of non-bot edits which were not on Wikidata and did not upload a new file, minus the number of mobile edits.	The current calculation assumes that bot edits made using the mobile site, mobile Wikidata edits, and mobile uploads are negligible.

Readers

Readers

Metric	definition	remarks
Pageviews	Full definition: m:R:Page view Monthly pageviews based on calendar month Corrected for spurious IE views from some countries	Data source: pageview_hourly
...Desktop	Same limited to the desktop domains (e.g. en.wikipedia.org)	(ditto)
...Mobile Web	Same limited to the mobile web domains (e.g. en.m.wikipedia.org, does not include apps)	(ditto)
Desktop previews	Seen page previews, defined as previews popups that remain visible for at least one second.	Data source: virtualpageview_hourly
Page interactions	Pageviews (all platforms) + seen previews (desktop)
Unique Devices	Full definition: m:R:Unique Devices Monthly unique devices for all Wikipedias (includes desktop and mobile web), based on calendar month.	Data source: unique_devices_per_project_family_monthly
Android Uniques	Monthly unique users of the Android Wikipedia app. See Android core metrics
Android Installs	Installs per day of the Android Wikipedia app, monthly average. See Android core metrics
iOS Downloads	First-time downloads of the iOS Wikipedia app from the app store Does not include updates or installs on an additional device using the same account. May contain Volume Purchase Program downloads and possibly some artifacts on rare occasions.	Data source: App Annie

Diversity (beta)

A set of contributors and readers metrics (defined above), restricted to:

• Global South countries: definition
• Mobile-heavy wikis: definition

Annual plan metrics and targets

Team-level and department-level goals derived from the 2018/19 Audiences annual plan.

Web team

Objective: Advanced mobile contributions (AMC) (cf. annual plan)

• Mobile web edit rate on target wikis: 10% increase
  • List of target wikis
  • Mobile web edits are defined using the existing edit tag (example)
  • Increase is measured using new AMC edit tag (example)
• Retention rate for opt-in advanced mobile mode amongst medium and high-volume editors (100+ edits previous month): At least 60% retention
  • via instrumenting opt-in/opt-out button (data recorded in the PrefUpdate schema)
  • Retention period TBD
• Moderation actions on mobile web on target wikis: 10% increase
  • Definition of "moderation action": phab:T213461
  • Definition of target wikis: see above

For more links to implementation tasks and technical details, see this overview task.

iOS team

• Total iOS app edit count: 10% increase
• Editor retention (exact definition TBD as of March 2019): 10% increase

See Wikimedia_Apps/Team/iOS/Editing_program#Primary_metrics for details.

Android team

• Total Android app edit count (mirroring iOS definition): 10% increase
• Android Contributor Retention Rate (exact definition TBD as of March 2019): 10% increase
• New Editor Acquisitions, defined as first-time edits on the Android app: 10% increase

Anti-Harassment Tools team

The AHT team is part of the cross-department Community health initiative.

Selection of annual plan metrics is being revisited as of March 2019 (for the original draft version, see m:Community_health_initiative/Annual_plan_FY18-19#CDP_Targets, Outcome 1)

Language team

Objective: Content translation (cf. annual plan):

• Surviving translations by newcomers: metric defined in phab:T194650, target TBD as of April 2019
• Newcomers using Content Translation: metric defined in phab:T194641, target TBD as of April 2019
• Success and failure rates for newcomers using Content Translation: metric defined in phab:T194647, target TBD as of April 2019
• Newcomer retention after their first translation: metric defined in phab:T195949, target TBD as of April 2019

Objective: Improve Translate extension & translatewiki.net process (cf. annual plan)

Growth team

Objective: Human-to-human help (cf. annual plan)

• Main metric: Second-month(?) new contributor retention in Czech and Korean Wikipedias (see phab:T201656). Target: 10% increase (as in original annual plan), measured using A/B tests

Editing Team

Objective: Simpler editing on mobile web + apps (cf. annual plan)

• Mobile visual editing edit completion rate: 10% increase
  • Metric definition: phab:T202134
• Number of mobile visual edits: 10% increase
  • Metric definition: number of saved edits tagged with visual editand mobile web edit
• Number of editors using the mobile visual editor: 10% increase
  • Metric definition: number of distinct editors making mobile web visual edits in a month.

See this overview task for more details.

See also

• Wikimedia Audiences/New Content Program Metrics Reports (draft)