User:NRodriguez (WMF)/Draft/Health Metrics for Inclusive Product Development

Background
The following set of metrics allow the Product teams and the Inclusive Product Development Working Group at the WMF to both measure and benchmark the health of the product development processes.

How were these metrics selected?
We started by thinking about the goals of the playbook as well as the processes in place across Teams. These metrics were discussed by the Inclusive Product Development Working Group and shared for input at an internal Product Salon with Staff.

Measuring how we interact and build with communities:

 * Total number of user tests run across teams that influenced the outcome of what was built
 * Total pilot wiki teams partnered with Product and Tech teams
 * Total number of product research, artifacts, design mocks, project page updates, and any other findings shared publicly
 * Average comments on project Talk pages
 * Average number of test cases taken into account during architectural decisions

Establishing benchmarks for the accessibility of our websites:
Measuring how we strategize around inclusion:
 * Accessibility score by accessibility accreditation website


 * Total number of DEI-specific OKRs (Objective Key Results) across Product teams

These metrics are upstream, they influence what and how we build which is in relationship to the health of the movement. These metrics impact the user engagement and behaviors we observe in the tools and platforms of the ecosystem.

Measuring user impact via:


 * Closing the quantitative gap between the contributors active on WMF platforms versus the diversity of global internet users