ORES/Get support

ORES supports a limited set of Wikis, but support is growing all of the time. This page describes how to get ORES support for your favorite wiki. Make sure to double-check the support table as we may already support your wiki. There are several different types of support that we can provide. It really comes down to which class of model and the tier of support we are aiming for. If you need help figuring out how to make a request, post on the talk page.

Basic language support
In order to set up basic support for your wiki, the first thing we'll need to do is set up the language assets that ORES will need to operate in your wiki. Check if your language is listed in our code or check phabricator for open tasks. If you don't find your language listed, use the link below to request support!

 Request language support ([//phabricator.wikimedia.org/T131450 example])

At the very basic level, we provide a  model that attempts to predict whether or not an edit will need to be reverted. This model is "trained" using a sample of past reverted edits that happened in a particular wiki. Once we have basic language support ready, we'll set up a  model for your wiki.

Advanced edit quality support
While the  model is useful and can be trained based on the history of article, it is slightly problematic. It's much better if we can train our prediction models on more nuanced judgements of the quality of an edit. Many of the tools that use ORES to support reviewing recent changes require this level of support. The  model predicts whether an edit causes damage and the   model predicts whether an edit was saved with good intentions. To gather the data needed to train these models, we can set up a Wiki labels campaign with a random sample of edits for evaluation.

 [//phabricator.wikimedia.org/maniphest/task/create/?projects=Scoring-platform-team-backlog,wikilabels,rsaas-editquality&title=Edit%20quality%20campaign%20for%20...&description=%5B%20%5D%20Confirm%20translations%20are%20ready%0A%5B%20%5D%20List%20of%20trusted%20user%20groups%0A%5B%20%5D%20Translate%20%22Edit%20quality%20(20k%20sample)%22%0A%5B%20%5D%20Run%20prelabeling%20script%0A%5B%20%5D%20Load%20revisions%20into%20labels.wmflabs.org Request an labeling campaign] ([//phabricator.wikimedia.org/T114509 example])

Article quality support
We train article quality models based on quality assessments (like en:WP:1.0 in English Wikipedia) if they are available. If not, we'll need to set up a Wiki labels campaign and have editors assess a sample of articles (usually ~5000) in order to train ORES how to make assessments.

 [//phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=Scoring-platform-team-backlog,wikilabels,rsaas-articlequality&title=Build%20article%20quality%20model%20for%20...&description=How%20do%20Wikipedians%20label%20articles%20by%20their%20quality%20level%3F%20%0A%0AWhat%20levels%20are%20there%20and%20what%20processes%20do%20they%20follow%20when%20labeling%20articles%20for%20quality%3F%20%0A%0AHow%20do%20InfoBoxes%20work%3F%20%20Are%20they%20used%20like%20on%20English%20Wikipedia%3F%0A%0AAre%20there%20%22citation%20needed%22%20templates%3F%20%20How%20do%20they%20work%3F Request article quality model] ([//phabricator.wikimedia.org/T131635 example])

Draft quality support
We train draft quality models based on deletion reasons that are recorded in the deletion log. In order to start work on the model, we'll need to ask for some help identifying what types comments are present in deletion reasons that we might flag as deeply problematic.

 [//phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=Scoring-platform-team-backlog,wikilabels,rsaas-editquality&title=Build%20draft%20quality%20model%20for%20...&description=What%20tools%20do%20editors%20use%20to%20find%20and%20delete%20the%20worst%20types%20of%20new%20pages%20%28spam%2C%20vandalism%2C%20and%20personal%20attacks%29%3F%20%20%0D%0A%0D%0AIs%20there%20a%20common%20way%20that%20deletion%20reasons%20are%20recorded%20in%20the%20log%3F%20%20For%20example%2C%20in%20English%20Wikipedia%2C%20they%20include%20names%20for%20each%20deletion%20reason%20in%20the%20log%20%28e.g%20%22WP%3ACSD%23G11%22%20means%20the%20article%20was%20deleted%20as%20%22spam%22%29. Request draft quality model]