Reading/Web/Projects/Related pages/Draft RFC

RFC: Related Pages extension
This is an RFC relating to the Related Pages extension. It is currently enabled on beta, for mobile version of Wikipedia. Editors may test it on desktop by activating it in the Beta section of Special:Preferences. The Wikimedia Foundation Reading team wants to know, given the feature performance in beta, what would be the best path to move forward, in the following aspects: What need to further improve or change in the feature? What would be the best way move forward with the feature? What is the best way to plan a partial roll out on some Wikipedias to continue testing the feature and measuring its performance, given that beta, so far is only allowed for logged in users on desktop?

Background
The Related Pages extension (also known as the Read more feature) is an experiment carried out by the Reading team in order to further engage readers and increase their browsing time. A user reaching the bottom of an article is shown the title and lead image for three articles that relate to the article they just finished. The related articles are selected by software based on textual similarity to the current article, with a preference for articles with many inbound links, and a preference for articles carrying the templates for Featured article, Featured picture, Featured sound, Featured list, or Good article. (More details at Related_pages#FAQ.) Editors may override these software selections by adding up to three to the page.

Read more aims to drive page views by engaging users by directing them to related content. If a reader has reached to the bottom of the article, they might be looking to read more about the topic and surfacing articles that are similar might be exactly what they are looking for. This has been released on apps and saw a 16% click-through (for users who saw it). The desktop numbers are much lower at 3.4%.

Rationale: If readers are offered suggestions that are similar to the topic they are reading about, this will further engage their reading session time, it will further educate them about the topic they are looking for, and supports a richer reading experience for those who are just randomly browsing topics.

Early Announcements: Related pages extension had a documentation published on mediawiki since mid October 2015. It was also announced in Reading team updates, published in early November 2015. It was announced on Wiktech-l. In addition, there was a post made on the English Wikipedia Village pump in mid November 2015, announcing the work on the feature in beta.


 * A brief summary of some of the initial feedback at the project talk page
 * The community was not consulted first and we would have helped you avoid major pitfalls.
 * Reading Team Response: There was consultation in ideation phase, because we don't yet have clear mechanisms for doing so, however, there was an update around the team's thinking to start working on a "Read More" feature, similar to the one on the web, this was published in Reading team updates, published in early November 2015. In addition, there was a post made on the English Wikipedia Village pump in mid November 2015, in order to update the community about the work happening on the extension. We thought since this worked on apps it was a no-brainer, but we clearly misjudged. Given that we obviously made a mistake here, and are making an attempt to improve moving forward both with this feature and others, we hope that you can help us move forward together.


 * Some language Wikipedias, notably German and Russian, have policies prohibiting collections of related links unless it is an objective and complete set.
 * The Reading Team does not want to push the feature on wikis that don't want it.  The reading team is not looking forward to break any community policies, however, it is essential to understand how exactly does Related Pages conflict with Thermenringe policy on German Wikipedia. It also is important to understand the different angles of the discussion on Russian Wikipedia, if there was a discussion.


 * English Wikipedia policy on non-free images does not allow their reuse for decorative or navigational purposes.
 * Non-free images will be excluded.


 * This is the same as see-also and does not add additional value.
 * See also doesn't exist on all articles. The section has less presence on smaller Wikipedias. At this is a point of the discussion, and one aspects which this RFC can hep define, is how a feature that helps readers further learn about a specific topic by offering more articles related to the topic that they are reading about, can also help the editing community better shape our content in articles.  The Reading Team believes the sustained high click through rate on mobile suggests that users are finding it valuable enough to justify the feature.


 * Wikipedia, unlike many commercial websites, is not about generating as many clicks as possible.
 * Many Read more suggestions are redundant to links in the article, and other suggestions can range from suboptimal to bizarre or even damaging. Generic products tend to be given links to arbitrary brands, for example Read more at the Hard disk drive article suggests Seagate Technology and at Car it suggests Mercedes-Benz. Potentially offensive articles and images can show up unexpectedly, such as images of penises and maggot infested wounds. At Korur language it suggests Anus, Anal and Poop. At List of serial killers before 1900 it suggests Peru national football team. At Murder of Kelly Anne Bates it suggests Batman.
 * Reading Team Response: For 'damaging' results, which are rare, editors can over-ride results. For 'suboptimal results', for now I think we should live with it because the readers seem to be deriving value.


 * The software returns particularly poor results for Disambiguation pages, for example at Holocaust (disambiguation) it suggests Batman.
 * The Reading Team sees little utility for the feature on Disambiguation pages. The feature is being disabled on those pages.