Cross-wiki Search Result Improvements/Testing

From MediaWiki.org
Jump to: navigation, search

The Discovery department is developing the ability to provide search results from other Wikimedia projects within the same language (commonly called cross-wiki or inter-wiki searches).

For example, if you were on the French Wikivoyage and searched for milk you would be presented with the expected matching articles from the French Wikipedia and results from other French Wikimedia projects (i.e.: fr.wiktionary and fr.wikiquote).

This page is an attempt to outline upcoming A/B tests that the search team would like to run and, as always, we invite all contributors to openly discuss these tests on the talk page.

After a conversation with the community, we have decided to run tests on Persian, Catalan, Italian and Polish Wikipedias; testing will begin in mid to late January 2017.

A/B test: Add cross-wiki search results in a right hand sidebar[edit]

This is a draft mock of a new A/B test for cross-wiki (project) search results that adds relevant search results in a sidebar

Rationale[edit]

"Why this test?" We want to find out if adding relevant search results from other wiki's (or projects) would help users discovery additional relevant information and data for the query that they typed in.

Description[edit]

"What is this test?" This A/B test will have a test group that will be shown a new right sidebar that will contain relevant search results that were found from cross-wiki searching. A control group will see the currently existing search results page.

Test group users will see:

  • additional search results from sister wikis in a right sidebar
  • each result for the sister wiki(s) will display:
    • the top ranked result from any wiki that contain relative search results
    • an icon that denotes which wiki the result is from
    • article name of the search result
    • description of the search result
    • typical bolding of the search result term(s)
  • link below the search result that is labeled 'more results'
    • this link will open a new browser tab and display a search results page for the original search term on that sister project
  • separate section for multimedia results above the other sister wiki results
    • up to 3 images will be displayed that are relevant to the original search term
    • display a link that will open a new browser tab and display a search results page of multimedia for the original search term from the native wikipedia that the user is on
      • for example, if a user searched for 'rainbow' on English Wikipedia, and clicked on the more multimedia link, the user will be displayed search results for multimedia for 'rainbow' on English Wikipedia in a new tab.

Timeline[edit]

This test is expected to start February 9, 2017 and run for a week. There is a beta version available (as this link shows) for viewing, but is not entirely reflective of the actual test results that will be displayed.

Results[edit]

TBD

Archive[edit]

TBD

A/B test: Add 'explore similar' pages and categories for search results[edit]

This is a draft mock of a new A/B test for cross-wiki (project) search results that adds a link to "explore similar"

Rationale[edit]

"Why this test?" We want to find out if adding related articles and categories provides users additional rich data that is more useful than what we currently have.

Description[edit]

"What is this test?" This A/B test will have a test group that will be shown additional information that will be relevant to individual results on the existing search results page. This additional information will be links and metadata of related pages and links to related categories that are similar to the individual search results. A control group will see the currently existing search results page.

Test group users will see for each search result returned:

  • 'explore similar' link and dropdown icon
  • when the user clicks on the link and/or icon, we will roll down a display below the result:
  • a label 'related pages' and
    • up to 3 related page links containing metadata (as available):
      • thumbnail image
      • name of related page
      • metadata description
  • a label 'related categories' and
    • a 3 column listing of links
      • up to 3 links of related categories per column (for a maximum total display of 9 related categories)
  • when the user clicks again on the link and/or icon for 'explore similar', the related pages and categories will roll back up and not be displayed

Timeline[edit]

TBD

Results[edit]

TBD

Archive[edit]

TBD

A/B test: Add thumbnail icons to search results[edit]

This is a draft mock of a new A/B test for cross-wiki (project) search results that adds thumbnail icons to the search results

Rationale[edit]

"Why this test?" We want to find out if adding thumbnail images to the results provides users additional rich data that is more useful than what we currently have.

Description[edit]

"What is this test?" This A/B test will have a test group that will be shown thumbnails for the search query results and updated metadata for each search result. A control group will see the currently existing search results page.

Test group users will see for the search results returned:

  • thumbnail (as available) image for the search result

Test group users will see for all search results returned:

  • word count
  • number of revisions
  • last updated date
    • this could be shown as Month Day, Year or 2 years, 4 months and 3 days ago

Timeline[edit]

TBD

Results[edit]

TBD

Archive[edit]

TBD