ORES/FAQ

= Beginner Questions =

What does ORES stand for?
ORES Stands for Objective Revision Evaluation Service

Predicting edit and article quality
ORES is an artificial intelligence service, which helps human editors improve the quality of edits and articles on Wikipedia. ORES uses a combination of open data and open source machine learning algorithms to train models and create scores that help predict the quality of edits as they are made. Learn more about the background and basics of ORES.

Tools and services that use ORES scores
Many tools use ORES scores. These tools automate time consuming workflows that would otherwise be done manually by human editors.

ORES tools have been used to predict the quality of new edits and articles, quickly identify and address damaging edits (sometimes called "vandalism"), check for copyright violations, and patrol recent changes to articles.

What's an ORES score?
An ORES score is a score assigned to individual edits to articles on (Wikipedia). ORES scores help humans and machines describe the quality of an edit.

ORES scores allow humans and machines to generate better article content and to improve existing content.

ORES generates 2 types of scores “article” and “edit” “quality.

The “edit” ORES score helps to determine which edits are damaging to an article and which edits were made in good faith. This makes it easier to identify well intended folks who might need extra support to make better edits to articles. It can also help identify and revert clear incidents of vandalism.

What is a patroller?
ORES patrollers use specific filters to determine if new edits may be damaging. Potentially damaging edits are flagged and brought to the attention of human editors to make a final determination.

What are damaging edits (sometimes called "vandalism")?
The word "vandalism" implies an edit was made to create damage on purpose.

Sometimes folks make edits that have damaging effects, even if they make them with the best intentions. A patroller's job is to look for "damaging" edits, whether the damage was intended or not.

Additional information on ORES review tools page.

How do I get support for my wiki in ORES?
https://www.mediawiki.org/wiki/ORES/Get_support

= Intermediate Questions =

What tools are available that make use of ORES?
A number of tools are available that make use of ORES.

What does ORES' architecture look like?
Architecture diagram (conceptual)

= Expert Questions =

What installations of ORES are there (WMFLabs & Production) and what's the difference between them?

 * ORES in WMFLabs: https://ores.wmflabs.org
 * ORES in Production: https://ores.wikimedia.org

The difference between WMFLabs and Product comes down to new features and stability. You can expect ORES in Production to be stable, highly available, and performant. ORES in WMFLabs is our experimental installation. It should be mostly stable, mostly available, and relatively performant. We will deploy new models and new features to ORES in WMFLabs first. We suggest you use the WMFLabs installation for testing out new models, or for running large batch processing jobs (up to 4 parallel requests per second) without affecting Production. Production should be able to handle moderate batch processing jobs (up to 2 parallel requests per second), but it more suited for real-time usage (i.e. requesting scores for changes as they happen).

Who should I contact about ORES stuff?
ORES swagger: https://ores.wikimedia.org/v2/ or https://ores.wmflabs.org/v2/ (Audience: Tool devs)

Where should I set my thresholds for filtering/highlighting
Requires: https://phabricator.wikimedia.org/T140364

Defined at https://github.com/wiki-ai/ores/blob/master/ores/wsgi/routes/v2/swagger.yaml

Link to sources in the swagger template, if it's not already.
ORES repo: https://github.com/wiki-ai/ores (Audience: Contributors)

Where do I get more information about what ORES is and how it is used?
ORES on MediaWiki

ORES MediaWiki Extension

PythonHosted: https://pythonhosted.org (Uses python's sphinx doc framework) (Audience: Developers / contributors)