Wikipedia.org Portal Project

The Wikipedia.org Portal is a project within the Discovery Department to update and change the wikipedia.org portal page to better serve Wikipedia visitors.

Our early efforts in this project are to measure how visitors use the portal page, learning about user expectations, and determining how we can serve up better and more relevant content. Once the Discovery Portal team has gathered data from test and have analyzed it in-depth for success, we'll promote updates to the portal page in production.

Rationale
The Wikimedia Discovery Portal Team wants to improve the experience of visitors to the wikipedia.org portal page and help them get to the information they are looking for as fast as possible. The portal page gets around 14 million daily page views daily, which is (very roughly) 3% of our total pageviews.

To better serve this large audience, we want to make sure that this page is easy to understand and use. We want to increase the usability of the search text box, so more people will run a search query and get to their preferred article faster. We want to decrease the number of people who leave the page without taking any action. We also want to better understand what people expect from this page so we can address their needs. In the future, we want to serve language, location and time specific content on this page too.

Goals

 * Decrease bounce rate on the wikipedia.org portal page
 * Increase amount of searches and clickthroughs on the search results
 * Increase clickthrough to the top 10 language wikis
 * Enhance and promote discovery of languages that are not in the top 10
 * Increase clickthrough to sister (other) Wikimedia projects

Current Quarter Goals

 * See Wikimedia Engineering's current quarter goals for the team (for 2016-17 Q1):

Current quarter goals:

 * make the wikipedia.org portal a site for exploring new and open content on Wikimedia sites.

Upcoming quarter goals (2016-17 Q2):

 * for the next few months, the Portal team will take a hiatus to focus on other projects within the Discovery department. We will continue to update the wikipedia.org page with article stats and translations along with small bug fixes and minor enhancements. If there is something that needs to be addressed, please add it to our backlog on our sprint board. We're planning on resuming work on the portal in late Q3 and Q4 (March - July 2017).

Upcoming A/B Testing
Wikipedia.org Portal A/B Testing Page.

We have several upcoming A/B tests planned for the near future. They are documented at Wikipedia.org Portal A/B testing. "Note: The text and mocks that were previously displayed on this page have been moved and updated in the page linked above. This is to avoid any confusion of having mocks in several places and not knowing which is more correct or up-to-date."

A/B Testing: January - March 2016
The Discovery Portal team performed a test En:A/B testing on Wikipedia.org between January 13 - 20, 2016 to measure if the proposed improvements are beneficial to our users (Phabricator ticket). The findings of these tests. This was an A/B test to determine the impact of various user experience improvements to the Wikipedia portal (www.wikipedia.org) aimed at increasing the rate at which users click-through to our other Wiki projects. Specifically, we looked at increasing the size and prominence of the search box while pairing images and Wikidata metadata with each search result (see the fourth visual mockup below). We found evidence that the combination of these elements results in a 1.7% to 5.5% higher clickthrough rate. Put another way, that's roughly an increase of 300,000 to 1.3 million pageviews a day into our projects - a solid improvement. Absent non-JavaScript support (which we are working on), we recommend the improvement be deployed to the production Wikimedia.org portal, tentatively scheduled for March 2016. (Update: this was released to production on March 10, 2016)

Another test was run to detect and re-arrange the language links around the globe, based on detection of the user's browser's preferred language setting while adding a localized "The Free Encyclopedia" phrase under the Wikipedia wordmark (Phabricator ticket). This test started on March 22, 2016 and will run until approximately April 5, 2016 when we will start analyzing the results.

Analysis of A/B Testing: 2016
For more information about how our data analysis team is working on this project please refer to: Research: Portal experiments.
 * Meeting: Rethinking portal planning 2016-02-03
 * Analysis: Results of removing inline JavaScript on wikipedia.org portal page
 * Meeting: Wikipedia Portal and JavaScript Usage - review meeting notes 2016-02-11


 * Presentation of Analysis: Browsers Geography and JavaScript Support on Wikipedia Portal (PDF)
 * Analysis: Referrers of the10% of traffic to Wikipedia Portal that is referred by something other than a search engine
 * Analysis: Quick, one page report comparing page views and traffic to wikimedia.org vs wikipedia.org
 * Analysis: Assessment of Portal update and its impact on search rate post-deployment
 * Analysis: Clickthrough rates, section usage, and language preferences of Portal visitors
 * Analysis: Descriptive text added to sister project links
 * Presentation of Analysis: Wikipedia.org Portal Survey - 'How did you arrive at Wikipedia.org?' May 2016
 * Analysis: Wikipedia Portal AB Test of Collapsing links to Wikipedia in other languages
 * Analysis: Retrospective of the Portal work done to date (Dec 2015 - Aug 2016)

Portal Updates: January - March 2016

 * Disabling inline JavaScript (JS is now a separate file that most browsers will use, but not all)
 * Missing scroll bar in Chrome bug fix
 * Set up an archive of previous A/B tests
 * Update links on Portal to be the same blue color
 * Replace portal images with sprites for ease of fast loading
 * Create a script to sync and purge varnish cache during deployments
 * Update Portal stats for articles
 * Search icon screen flash bug fix
 * Update Portal stats for articles
 * Prominent search box with type-ahead and meta data in results
 * Disable the 'find a language' search box and arrow button
 * Display a magnifying glass without the word 'search'
 * Language selector to use native selector on mobile
 * Support a non-JavaScript version of the language picker

Portal Updates: April - August 2016

 * Tabbing through new Portal input has no visual feedback on language switcher
 * new searchbox: round becomes square (corners) on wikipedia.org
 * Build A/B test for language detection on the Portal to reorder and resort the primary links on the page to suit the user better
 * Wikipedia portal shouldn't use fake language codes
 * Remove references to external images that are actually 404s
 * Redirects produce non-obvious search results
 * Typeahead suggestions sometimes freeze on results for incomplete search query
 * Update A/B test archive page
 * Wikipedia.org A/B Test (Egg): add descriptive text to sister project links
 * Portal Production release: bug fixes and small updates
 * Search suggestions sometimes show 2 descriptions
 * Portal search suggestions mouse/keyboard highlight behaviour is jumpy
 * Clean up old search-box & A/B test code
 * Create method of versioning the Wikipedia.org portal page
 * Portal Production release: bug fixes and small updates
 * Portal Event Logging: determine which data to update
 * Refactor code for (Egg): adding descriptive text to sister project links
 * Release to production (Egg): adding descriptive text to sister project links
 * Create Survey to find out why some visitors don't interact with the Wikipedia.org Portal
 * Update Wikipedia.org Portal and sister Wiki's statistics
 * Add license information for page code
 * Wikimedia/portals repo should have a LICENSE file
 * Wikimedia/portals repo should have a README file
 * Wikimedia/portals repo should have a CONTRIBUTING file
 * A/B Test (Caterpiller): Implement the languages by article count test
 * Wikipedia.org Portal: check ordering of languages
 * Wikipedia.org Portal Survey: revisit for more participants
 * Wikipedia.org A/B Test (Caterpiller): languages by article count
 * Wikipedia.org (Elephant): translate sister wiki projects descriptive text
 * Article counts under 1000 showing as 0
 * Search input has dark background
 * Switch Portal EL & survey sampling algorithm to use seeded RNG
 * Refined the sister project descriptive text wording
 * Released the new portal page layout into production

Browsers Supported
We will be following the guidelines listed on MediaWiki for Compatibility. For example, this will mean that the JavaScript that we have on the Portal page will be targeted for IE9 and newer, while IE8 and below would have a basic CSS experience.

Ideas for the future of the Portal

 * Read about our April 20, 2016 brainstorming session here.
 * Add mobile app badge icons (community feedback conducted: June 13 through August 12, 2016)
 * Update portal page design to use a dropdown for all languages beyond the default top ten  (community feedback conducted: July 4 through August 12, 2016)