Edit check/ja

2022–2023予算年度、当編集機能チームはの改善点として、新人ボランティアの皆さんがウィキメディアのプロジェクト群で建設的な編集を貢献できるようにするため、方針とガイドラインの理解を補佐して守りやすくすることを目指しました.

以下の情報ではこのプロジェクトの目標を述べ、それを決めた背景や、ウィキメディア財団の製品部門がこれを優先する根拠をご説明します.

当プロジェクト関連のミーティング予定は をご参照ください.

目的

 * 1) 編集初学者およびジュニア投稿者で活動地域がアフリカ大陸のサハラ以南地域の人たちは、自分の編集した箇所が経験を積んだボランティアに有益な編集だと認知されたと分かると、（次から）編集に自信が持てるし、変更箇所を安心して保存できるようになります.
 * 2) ウィキペディアの英語版とフランス語には新規参加者を見つめるモデレーター（調整役）がいて、その人たちの編集の質が改善したと気づくと、編集チェックでウィキペディアの編集の方針をどう提示したら良いか、考えるきっかけになっています.

Last Wednesday (11 October 2023), Edit Check became available within the desktop and mobile visual editor at an initial set of wikis: dag.wiki, ee.wiki, fat.wiki, gur.wiki, gpe.wiki, ha.wiki, kg.wiki, ln.wiki, tw.wiki.

You can review the edits Edit Check was activated within by filtering Special:RecentChanges using the  tag.

Reporting False Positives

Ahead of the first iteration of Edit check being offered at an initial set of partner wikis, there is a new page to report false positives: Edit check/False positives.

The page draws inspiration from Wikipedia:Edit_filter/False positives. It is designed to be an easy for people to:


 * 1) Report an edit they think Edit Check should NOT have been activated within and
 * 2) Propose changes to how Edit Check is configured

We are curious to know what – if any – questions, concerns, and/or ideas this new page brings to mind.

Trying Edit Check in production

As of today, anyone can try Edit Check by editing any Wikipedia page in the main namespace using VisualEditor.

To try Edit Check, append the following parameter to the URL of the page you would like to edit:. E.g. https://en.wikipedia.org/wiki/Jollof_rice?veaction=edit&ecenable=1 .

Baseline metrics Two of the metrics the Editing Team is planning to use to evaluate the impact of the initial reference check are:


 * 1) A decrease in the proportion of new content edits that are reverted
 * 2) An increase in the proportion of new content edits that include references

To help set targets for the two metrics named above, we recently completed a baseline analysis. Here's some of what we learned:


 * Across all Wikipedias, new content edits that include a reference are ~2x less likely to be reverted (6.2%) than edits that do not include a reference (11.5%)


 * Across all Wikipedias, newcomers and junior editors are less likely to include a new reference with new content edits compared to more senior editors.
 * Of all the new content edits newcomers make across Wikipedias, 12% of these edits include a reference.
 * Of all the new content edits people who have made >500 cumulative edits across Wikipedias, 26% of these edits edit include a reference

You can see per wiki breakdowns in the full report here.

Storing and show decline responses

In March, we shared plans to present people who decline to add a source when Edit Check prompts them to do so with a way to share why they made this decision.

This past week, we converged on how Edit Check will initially make these responses available to experienced volunteers...

To start, the reason someone selects for declining to add a reference when Edit Check invites them to do so will get logged as an edit tag that is "appended" to that edit. Note: the definitions for these yet-to-be defined tags will eventually be stored here: Edit check/Tags.

Two new change tags

This week, two new Edit Check-related change tags became available that you can use to filter Special:RecentChanges.

These tags will help us collectively evaluate the extent to which the reference Edit Check increases the likelihood that people accompany the new content they're adding with a reference. Note: the logic that determine when the two tags get applied is the same logic that is used to decide whether people should be presented with the reference Edit Check.

Edit Check Prototype (mobile) ready

A prototype for the first Edit Check is ready! Now, we need your help identifying how it might need to be fixed and improved before being enabled in production as a beta feature.

You can find instructions for trying out the Edit Check prototype and sharing feedback about on the talk page: Seeking Feedback: Edit Check Prototype.

For context, this first Edit Check that will prompt newcomers who are contributing new content without including a corresponding reference to consider doing so.

First version

The first version of Edit Check is almost ready for you all to try!

Within the next week, you can expect us to share a link to a test wiki where you can try the Edit Check prototype.

This first iteration will invite people who add more than 50 new characters to an article in the main namespace to include a reference in the edit they're making, IF they have not already done so themselves.

In the meantime, you can see the kinds of edits EditCheck currently thinks warrant a reference, by filtering Recent changes using the newly-introduced  tag. View the tag on en.wiki and fr.wiki.

Informed by community conversations (still ongoing)   and a series of technical and design investigations  , during February the Editing Team became clear about the first version of Edit Check on mobile...


 * User Experience: the first version of Edit Check will introduce a new step within the mobile visual editor's publishing workflow that people will see if/when they add new content without a reference. Design for the desktop user experience is still underway. See T329579.
 * Usability Testing: to learn whether people understand and can intuitively navigate the mobile Edit Check workflow, we will soon begin a series of usability tests. See T327356.
 * Technical Investigation: Edit Check will use a "transaction-based" approach for determining what new content is added within a given edit session. Work on developing a way to detect individual sentences is ongoing in T324363.
 * Initial Heuristic: To start, the initial Edit Check heuristic will be relatively straightforward in so far as it will prompt people to decide whether the change they are making warrants a reference if/when they are adding a new paragraph and that paragraph does not already contain a reference. See T324730 and T329988#8654867.

Next up: the Editing Team will be implementing the initial Edit Check heuristic (T324730) and a corresponding hidden change tag (T324733) so that we – volunteers and members of the Editing Team – can evaluate the extent to which the reference check heuristic is getting initiated in expected cases.

Work on Edit Check is underway! Below you will find an overview of what the Editing Team is actively working on…


 * Community conversations: Between October 2022 and January 2023, the Editing Team hosted seven community conversations to learn what contributing to Wikipedia has been like for people living in and from Sub-Saharan Africa. Next week, you can expect the team to publish the findings from these conversations and how they will inform the work we do on this project.
 * Initial Focus: The first feature the team will be introducing is one that checks whether the new content people are attempting to add includes a reference. Learn more in the Strategy and Approach section below.
 * Design: The team is actively working on a proposal for what the mobile user experience for the first reference check could be like. In the coming weeks, we will be inviting volunteers to help us revise and refine these designs. In the meantime, you can follow along with this work in Phabricator.
 * Talking with experienced volunteers: for the "reference check" to be useful to inexperienced and experienced volunteers alike, it will need to guide people to cite references in ways that projects expect. In the coming weeks, we'll begin conversations with experienced volunteers to learn what these expectations are so that we can ensure Edit Check is configured in ways that align with them.
 * Technical investigations: For the "reference check" to work, the software will need to know when people are attempting to add new content, whether that new content warrants a reference, and whether it currently contains a reference. The Editing Engineering team is currently doing a series of technical investigations to decide how we will approach building this functionality.



戦略とアプローチ
To equip newcomers and Junior Contributors from Sub-Saharan Africa with the know-how and tools to publish changes they are proud of and that experienced volunteers consider useful, the Editing Team will be introducing new functionality within the visual editor (desktop and mobile) that will check the changes people are attempting to make and present them with actions they can take to improve these changes in ways that will align with established Wikipedia policies and guidelines.

The first "check" the Editing Team will be introducing is one that will detect when people are attempting to add new content to an existing article without a corresponding reference and prompt them to do so. The functionality will be accompanied by a complimentary set of features that will enable moderators to configure the user experience newcomers and Junior Contributors will see to ensure the software is guiding them to take actions that align with project policies and conventions.

問題点
The visual editor's growing popularity among people who are new to editing Wikipedia leads us to think that the editing experience has been reasonably successful at helping inexperienced volunteers learn the technical skills necessary to publish changes to Wikipedia.

The trouble is that the visual editor and other editing interfaces do not make people aware of the Wikipedia policies and guidelines they are expected to follow.

As a result, the changes inexperienced volunteers publish often break established best practices and lead to undesirable outcomes for inexperienced volunteers, experienced volunteers, and Wikipedia projects as a whole:


 * 1) Inexperienced volunteers become disappointed and frustrated when the good-faith change(s) they arrived to the wiki seeking to make are undone (read: reverted), deleted, and/or scrutinized in inequitable ways. These poor interactions are demotivating and drive these could-be volunteers and community members, and the knowledge that are uniquely positioned to offer, away.
 * 2) Experienced volunteers/moderators need to do more work reverting low-quality edits and posting messages on inexperienced volunteers' talk pages to make them aware of the policies and/or guidelines they are likely to have unknowingly broken. Continually needing to educate inexperienced volunteers and undo their changes can lead to experienced volunteers becoming skeptical of inexperienced volunteers and impatient with them.
 * 3) Wikipedia projects struggle to grow and diversify their volunteer populations and shrink the knowledge gaps present within Wikimedia wikis.

This project seeks to address the challenges above by:


 * 1) Offering inexperienced volunteers relevant and actionable feedback about Wikipedia policies in the precious moments when they are in the midst of making a change using the visual editor.
 * 2) Equipping moderators with a new ability to specify the feedback inexperienced volunteers are presented with while they are editing



変化の理論
This project is built on the belief that by surfacing relevant guidance in the precious moments when inexperienced volunteers are in the midst of making a change to Wikipedia and equipping them with the know-how and tools necessary to apply this guidance, they will make changes they are proud of and that experienced volunteers value.

In the longer term, the Editing Team thinks that people who are new, particularly people who have historically been excluded from and harmed by established power structures, will feel safe and motivated making changes to Wikipedia if they can accurately predict whether the changes they are attempting to make are aligned with existing Wikipedia policies, guidelines, and/or cultural conventions.

More broadly, the Editing Team thinks that to evolve towards a future where wikis' policies and cultural norms – and ultimately, content – reflect the diverse experiences of the people these projects are intended to serve, we first need to make the norms and standards that are currently in place legible and actionable to people while they are editing. This way, volunteers can develop shared awareness of cases where these norms and standards are not having the impacts they were intended to have and decide what – if any – changes they think are worth making to them in response.



第一の観衆
編集機能チームではこの作業の主な対象として、以下の人々のニーズに着目します.
 * 1) 体験： ウィキペディア投稿入門編を学ぶ
 * 2) * 当プロジェクトの範囲では、「入門段階の人」を、言語版1件もしくは複数言語版のウィキペディアで編集回数の累計が100回未満の人と考えています. これには、生まれて初めてウィキペディアの編集をしてみた人も含まれます. 
 * 3) 場所： 生活の場はアフリカ・サハラ以南
 * 4) プロジェクト： 投稿先は英語とフランス語ウィキペディア
 * 5) 動機： ウィキペディアにある落差を埋めたいから

上記の重点基準4件は、次の作業に立脚しました.


 * 新規参加者の半数は、アフリカもしくはアジア在住の可能性が大です.
 * ウィキメディア運動ではヨーロッパや北アメリカの圏外で暮らす編集者集めに苦心
 * サハラ以南アフリカ在住の人々は、ウィキメディア運動できちんと代表されていません. サハラ以南の人々は世界人口の15%、インターネット世界人口の7%を占めているのに、ウィキメディアの個別編集者全体の1%に過ぎないのです.
 * サハラ以南アフリカのアカウント登録済み編集者は、80%がウィキペディアの英語版またはフランス語版に投稿しています.

設計


出典の検出
まず最初に、編集チェック機能の取り組みにおいて編集チームが目指すところとは、偽陽性の疑いを低減すること、プロジェクト単位で に沿って実施することでボランティアを支援、やがては進化によって自己改革 をより強固にしていこうとしています.

この戦略を進めると、編集チェックを有効にするタイミングと前提は、以下の条件全てを満たかどうかになります.

上記の条件は実施と管理を書いたコードはこちら：editcheck/init.js.
 * 1) 誰かが編集中の記事に、新たに追加された段落が1件以上ある場合
 * 2) 「新たに追加された段落」には、脚注は含みません
 * 3) 条件「1.」と「2.」の変更は記事名前空間（メイン空間）のページで実施した場合 (NS:0)

当編集機能チームが達した結論とは、手始めに点数を絞り込み複雑ではないルールの組み合わせで開始 してみることにして、次の目的を目指しました.
 * 1) 編集初学者とジュニア投稿者が編集チェックを使ってガイダンスに気づくこと、編集という体験をもっと広い目で見ることができるようになること、編集ヘックが直感的でわかりやすく、もう一度、編集しようと戻ってくるように導くこと.
 * 2) 編集チェックが原因で、経験を積んだボランティアの作業を増やしてしまわないように、無用な箇所なのに編集初学者やジュニア投稿者に出典を追加するように促さないこと.

You can learn more about the assumptions that informed the thinking above in T329988.



設定が可能なこと
当編集機能チームでは調整役の皆さんに設定権限を預かってもらい、編集チェック機能を有効にするタイミングと対象を決めてもらうことを重視しています. この方法でなら、このソフトウェアが調整役の皆さんから見て、生産的と認める動作を促していると確信してもらい、そうでなかった場合にはソフトウェアを改変できます.

上述との整合性を保ち、また編集フィルタ機能やGrowthチームとコミュニティによる設定作業ではボランティアの皆さんがどのようにしてウィキ上でそれぞれの機能の動作確認と構成変更ができたか発想を借りており、編集チェックの場合は、システム導入によりボランティアはプロジェクト単位で、次のことが可能になります.


 * 編集チェックがいつ発動するか決定するロジックを監査および編集し、
 * 編集チェックが表示されている利用者がどんな内容の編集をしているか評価する

これらを実施するため、作業をT327959で進めています.



モバイル版
編集チェック機能の初版では、モバイル版 のビジュアル編集機能の公開ワークフローに新しい手順を導入、新しいコンテンツを加筆して出典を添付しなかった場合 に発動させます.

デスクトップ版
''デスクトップ版の利用者体験の設計はまだ進行中です. T329579 を参照してください. ''

Evaluating impact
The viability of the features introduced as part of the Edit Check project depends on the impacts it causes and averts.

This section describes the:


 * 1) Impacts the features introduced as part of the Edit Check are intended to cause and avert
 * 2) Data we will use to help determine the extent to which a feature has/has not caused a particular impact
 * 3) Evaluation methods we will use to gather the data necessary to determine the impact of a given feature

Deployment sequence
Before volunteers and staff can consider whether a featured introduced as part of the Edit Check project is fit for being made available at all projects, we need evidence that confirms:


 * 1) Experienced volunteers are optimistic the check will be activated within edits when they would expect it to
 * 2) Members of the Editing Team are optimistic newcomers and Junior Contributors are finding the user experience intuitive and helpful
 * 3) Staff and volunteers agree the feature has net positive impact on projects and the volunteers who build and maintain them

To gather the evidence needed to confirm the above, the Editing Team will follow a deployment sequence made up of phases listed below.

背景
ウィキメディア運動の各所で活動するボランティアの皆さんは、長い間、次の作業に骨を折ってこられました.

いくつかの先行例から当編集機能チームならびにこのプロジェクトはインスピレーションを得ており、その一部を以下に述べます. もし皆さんから、目を配っておくと良いプロジェクトあるいは情報源のおすすめがありましたら、トークページで発言をお願いします.
 * 積極的に編集初学者を教え、ウィキペディアを改善する変更を指導し、本人にとってやりがいのある変更になるようにすること
 * 予防として利用者が破壊的な変更を後悔しないようにすること、それに加えて
 * 対応および仲裁としてウィキペディアの記事の変更点に介入すること.