Talk:ORES/FAQ

Jump to navigation Jump to search

About this board

FAQ discussion page for ORES.

Explanation of ArticleQuality.js script

1
Sage (Wiki Ed) (talkcontribs)

I just talked through the ArticleQuality script and how to interpret it, with another Wiki Education staffer, and we thought something similar would be good to include in the FAQ.


We were looking at the result for https://en.wikipedia.org/wiki/Rachel_Carson: FA (4.7), and the question was, what does the 4.7 mean? (47% likely to be an FA? 4.7% likely to be a FA?)


The answer I gave is that it's based on the probabilities that ORES gives for the possible quality levels: ps://ores.wmflabs.org/v3/scores/enwiki/?models=wp10&revids=877812769


So it says FA because FA is the most likely result (at 42%), but 4.7 means the weighted average prediction is actually closer to GA, with the scale going from 1 (definitely a stub) to 6 (definitely an FA).

Reply to "Explanation of ArticleQuality.js script"

Help answer ORES expert level questions...

6
SRodlund (WMF) (talkcontribs)

Here are some questions we would still like to answer! Feel free to share answers or ask something that hasn't been covered in the FAQ!

What hosts are used for ORES and where do they fit in the architecture?

Where are the deployment repositories? ===

How do I install the ORES package? 

How do I develop ORES? 

How to start a dev instance? 

How to submit a PR to this repository?

How do I use ORES' API client? 

What's a ScoringSystem and how does it work? 

Sage (Wiki Ed) (talkcontribs)

In what sense does ORES WP10 model measure the "quality" of an article? Does it differentiate between high and low quality sources? Good and bad writing? Can I use it for grading Wikipedia editing assignments?

We're incorporating more WP10-based info into the Wiki Education Dashboard these days... I actually just deployed a new feature that links to this very FAQ for background... and these are the types of questions that academics are likely to ask. More explanation of what features do and do not go into the models would be most welcome.

Halfak (WMF) (talkcontribs)

Ooh. Good Q. I'm happy to have a more substantial writeup about the wp10 model.

EpochFail (talkcontribs)

Sage, it's not much, but check out what I've added to ORES#Assessment_scale_support. What do you think? I think we could write a whole page about what the model directly and indirectly accounts for. But I figured this was a good start.

Sage (Wiki Ed) (talkcontribs)

Yeah, good start!

Adamw (talkcontribs)

Another question TODO answer:

  • Which models are used by each known consumer? For example, what is using wp10 predictions?
Reply to "Help answer ORES expert level questions..."
Julle (talkcontribs)

The page asked that people contact the team through said email address, but attempting to do so gives "550 Address scoring-internal@wikimedia.org does not exist". I've removed the address from the page for the time being.

Adamw (talkcontribs)

Thanks for noticing—I'm replacing with the correct address, scoring-internallists.wikimedia.org

Reply to "scoring-internal@wikimedia.org"
There are no older topics