Wikimedia Product/Data dictionary

From MediaWiki.org
Jump to navigation Jump to search

This page collects definitions of core metrics and quantitative annual plan goals of the Wikimedia Product department which are tracked by the Product Analytics team.

Core metrics[edit]

A set of key metrics designed to give a high-level picture of the movement's health. These are reported monthly to the Wikimedia Foundation board and at Wikimedia_Product#Metrics, with further analysis in the quarterly metrics & insights presentations.

Contributors[edit]

The code that calculates these metrics can be found in the wikimedia-research/Editing-movement-metrics repository on Github.

Contributors
metric definition remarks
Total content pages The total number of existing (non-deleted) pages in content namespaces across all wikis Produced by summing up the net new content pages metric for provided by the Analytics Query Service over all time.
—Wikipedia articles The total number of existing (non-deleted) pages in content names across all Wikipedias. A subset of total content pages. Produced by summing up the net new content pages metric for all Wikipedias.
—Media files The total number of existing (non-deleted) pages in content namespaces on Wikimedia Commons. The large majority of these are file pages, but a small number are gallery pages. A subset of total content pages. Produced by summing up the net new content pages metric for Wikimedia Commons.
—Wikidata entities The number of existing (non-deleted) Wikidata entities. A subset of total content pages. Produced by summing up the net new content pages metric for Wikidata.
Net new content The number of content pages added since the previous month minus the ones deleted since the previous month. Produced by subtracting last month's total content pages metric from this month's.
—Wikipedia articles The number of Wikipedia articles added since the previous month minus the ones deleted since the previous month. A subset of net new content. Produced by subtracting last month's total Wikipedia articles metric from this month's.
—Media files The number of Wikimedia Commons content pages added since the previous month minus the ones deleted since the previous month. A subset of net new content. Produced by subtracting last month's total media files metric from this month's.
—Wikidata entities The number of Wikidata entities added since the previous month minus the ones deleted since the previous month. A subset of net new content. Produced by subtracting last month's total Wikipedia entities metric from this month's.
Active editors The number of registered users who made at least 5 content edits across all projects in the given month. See meta:Research:Active editor for the full definition.
—New Active editors who registered during the given month.
—Returning Active editors who registered before the given month.
New editor retention Out of the users who registered in the month before the previous and made at least one edit in their first 30 days, the proportion who also edited during their second 30 days.
Global revert rate The proportion of non-bot edits made during the given month which were reverted at any point before the snapshot. Reverted edits are identified using the revision_is_identity_reverted field in the mediawiki_history dataset.
Total edits The total number of edits made across all wikis during the given month. Edits that have been reverted or deleted are included among total edits. Total edits has a "missing" fifth component in addition to the four components included below: the number of other bot edits.
—Mobile edits The number of edits tagged as having been made using the mobile website (which can be used by desktop computers) or the mobile apps.
—Data edits The number of edits to Wikidata, including bot edits.
—File uploads The number of edits, including any bot edits, which uploaded a new file on any project.
—Other non-bot edits The number of non-bot edits which were not on Wikidata and did not upload a new file, minus the number of mobile edits. The current calculation assumes that bot edits made using the mobile site, mobile Wikidata edits, and mobile uploads are negligible.


Readers[edit]

Readers
Metric definition remarks
Pageviews Full definition: m:R:Page view

Monthly pageviews based on calendar month

Corrected for spurious IE views from some countries

Data source: pageview_hourly
...Desktop Same limited to the desktop domains (e.g. en.wikipedia.org) (ditto)
...Mobile Web Same limited to the mobile web domains (e.g. en.m.wikipedia.org, does not include apps) (ditto)
Desktop previews Seen page previews, defined as previews popups that remain visible for at least one second. Data source: virtualpageview_hourly
Page interactions Pageviews (all platforms) + seen previews (desktop)
Unique Devices Full definition: m:R:Unique Devices

Monthly unique devices for all Wikipedias (includes desktop and mobile web), based on calendar month.

Data source: unique_devices_per_project_family_monthly
Android Uniques Monthly unique users of the Android Wikipedia app. See Android core metrics
Android Installs Installs per day of the Android Wikipedia app, monthly average. See Android core metrics
iOS Downloads First-time downloads of the iOS Wikipedia app from the app store

Does not include updates or installs on an additional device using the same account.

May contain Volume Purchase Program downloads and possibly some artifacts on rare occasions.

Data source: App Annie


Diversity (beta)[edit]

A set of contributors and readers metrics (defined above), restricted to:

Annual plan metrics and targets[edit]

Team-level and department-level goals derived from the 2018/19 Audiences annual plan.

Web team[edit]

Objective: Advanced mobile contributions (AMC) (cf. annual plan)

  • Mobile web edit rate on target wikis: 10% increase
  • Retention rate for opt-in advanced mobile mode amongst medium and high-volume editors (100+ edits previous month): At least 60% retention
    • via instrumenting opt-in/opt-out button (data recorded in the PrefUpdate schema)
    • Retention period TBD
  • Moderation actions on mobile web on target wikis: 10% increase
    • Definition of "moderation action": phab:T213461
    • Definition of target wikis: see above

For more links to implementation tasks and technical details, see this overview task.

iOS team[edit]

  • Total iOS app edit count: 10% increase
  • Editor retention (exact definition TBD as of March 2019): 10% increase

See Wikimedia_Apps/Team/iOS/Editing_program#Primary_metrics for details.

Android team[edit]

  • Total Android app edit count (mirroring iOS definition): 10% increase
  • Android Contributor Retention Rate (exact definition TBD as of March 2019): 10% increase
  • New Editor Acquisitions, defined as first-time edits on the Android app: 10% increase

Anti-Harassment Tools team[edit]

The AHT team is part of the cross-department Community health initiative.

Selection of annual plan metrics is being revisited as of March 2019 (for the original draft version, see m:Community_health_initiative/Annual_plan_FY18-19#CDP_Targets, Outcome 1)

Language team[edit]

Objective: Content translation (cf. annual plan):

  • Surviving translations by newcomers: metric defined in phab:T194650, target TBD as of April 2019
  • Newcomers using Content Translation: metric defined in phab:T194641, target TBD as of April 2019
  • Success and failure rates for newcomers using Content Translation: metric defined in phab:T194647, target TBD as of April 2019
  • Newcomer retention after their first translation: metric defined in phab:T195949, target TBD as of April 2019

Objective: Improve Translate extension & translatewiki.net process (cf. annual plan)

Growth team[edit]

Objective: Human-to-human help (cf. annual plan)

  • Main metric: Second-month(?) new contributor retention in Czech and Korean Wikipedias (see phab:T201656). Target: 10% increase (as in original annual plan), measured using A/B tests

Editing Team[edit]

Objective: Simpler editing on mobile web + apps (cf. annual plan)

  • Mobile visual editing edit completion rate: 10% increase
  • Number of mobile visual edits: 10% increase
    • Metric definition: number of saved edits tagged with visual editand mobile web edit
  • Number of editors using the mobile visual editor: 10% increase
    • Metric definition: number of distinct editors making mobile web visual edits in a month.

See this overview task for more details.

See also[edit]