Page Previews/DraftPage

The Hovercards beta feature solves the core problem of users needing to open multiple tabs to gain an understanding of a word or concept within the context of the subject they are reading. With Hovercards, whenever a reader hovers over a link to another article, a short summary of the subject and an image (if available) is displayed. The user can then decide whether they wish to visit that subject more thoroughly before continuing with the current article.

There have been many requests over the years for a similar feature; there are browser extensions (see list) and one heavily used gadget (the more editor-focused Navigation popups) that also exist to solve this problem.

The Hovercards settings panel enables logged-out users to enable and disable the feature based on their preferences. Logged-in users can currently enable and disable the feature from their beta settings. If Navigation Popups and Hovercards are enabled at the same time (typically, for logged in users who have opted in via the beta feature), Navigation popups takes precedence. To enable hovercards, navigation popups must be disabled.

Introduction
Hovercards are designed to reduce the cost of exploration of a link, as well as to promote learning by allowing readers to gain context on the article they are reading or to define an unfamiliar term, object, event, or idea without navigating away from their original topic. For casual readers, hovercards will make it easier for users to get an overview of an article before deciding whether or not to browse to it. Users interested in reading an entire article in its totality will not be distracted or discouraged by viewing unfamiliar concepts - they can simply preview the concept without navigating to a new page. Consequently, the smoothness of the user experience for these users will be increased.



Design
For the current iteration of hovercards, each hovercard will contain the following:
 * A portion of the first paragraph from the article
 * An image (if available) from the article. Images will appear horizontal of vertical depending on the location of the link within the article.
 * A settings cog which will allow users to turn hovercards on an off

Key differences to Navigation Popups
Hovercards is styled to enable easy reading. Currently, Navpopups' type-size is small and the margins are tight.
 * Hovercards will be available to all users, not just logged-in users
 * Create a consistent visual style with the article type treatment.
 * Emphasize the lead images, so a user gets an idea of a term using both text and image.
 * The action set in the gadget feels out of context, hence we need to validate which of those actions are useful for readers and editors.
 * Include the last edited timestamp that we have tested on Wikipedia mobile web.

Logged Out Users
Logged out users may turn Hovercards off via the cog-icon displayed at the bottom of each hovercard. If a user wishes to turn hovercards back on, they can be enabled via the "Enable Previews" link available at the bottom of any wikipage.

Logged-In Users
Currently, logged in users may enable or disable Hovercards from the beta features page. Upon promotion of the feature, our of beta, users will be able to enable and disable it from their user preferences page, under the "Appearance" setting

Open/Close delay timing
Logged-in users can change the timing of how fast Hovercards appear and disappear (open/close delay); see Extension:Popups for instructions.

Success Metrics and Feature Evaluation
A number of qualitative and quantitative tests were performed to evaluate the performance of the hovercards feature. These tests were focused on the following questions:
 * Do users enjoy Hovercards and find them useful?
 * How do hovercards change reading behavior and do they help users be more accurate when selecting the articles they wish to read
 * Would launching the hovercards feature have effects on fundraising

2016 A/B tests
To determine changes in reading behavior and evaluate the success of the hovercards beta feature, three A/B tests were launched on Hungarian, Italian, and Russian wikipedias. The A/B test on Hungarian was launched June 7, 2016, the A/B tests on Italian and Russian were launched Sept 23, 2016.

From the results of these tests, we can conclude that hovercards facilitate positive changes in reading behavior by increasing the precision with which users select the pages they read, reducing the cost of exploration of other pages, and allowing users to selectively focus on a single topic by providing context within a page.

For the full results and analysis of these tests, HERE

2015 Greek and Catalan Wikipedia test
WRITE A SUMMARY AND PULL OUT INTO A DIFFERENT PAGE

''We ran a test where hovercards were turned on by default for Greek and Catalan Wikipedia for a period of 4 months. We have both quantitative and qualitative data for this experiment.''

Here is a list of major bugs reported.

Known & documented issues:

 * Cutting sentences randomly
 * Info in parenthesis ignored (https://phabricator.wikimedia.org/T91344 )
 * Period problem with TextExtracts  (send email to Gergo and Prateek)
 * Hovercards not going away

Unknown and need more information:

 * Text alignment issue in certain scripts
 * Disambiguation text showing in some cases - this is when a page is just using plain indented/italic text instead of a template (e.g.). Or, if the hatnote template doesn't include.
 * Half sentences are annoying, people want more text
 * People are unhappy with animation speed, some want it faster, some slower (replicating the existing Reference Tooltips options, would be best.

Known and hard to solve for
 * Issues with PageImages (…)
 * Map shown without dot (This should be fixed once Max and Yuri are done with the tile server)
 * Reference hovercards (user and special pages too) (Prateek and Bene* are working on a restructure)
 * Sub-section links (TextExtracts)
 * Make it work with Wikidata (https://phabricator.wikimedia.org/T69434 )

Qualtrics Survey Results
In April of 2015, hovercards were rolled out to all users on Catalan and Greek Wikipedias. They also continued to be a beta feature on english and other wikipedias. During this time, a survey was shown to all hovercards users using a banner recruitment. There were over 1,700 responses, heavily dominated by non-logged in users on Catalan and Greek and logged in users (probably mostly editors) on English. Below are the aggregated results

Questions 2-6 are the qualitative text answers to whatever the user chose for open feedback. We cannot share these answers on wiki, as they have not been vetted to remove potentially personally identifiable information.

Here are some random, contiguous sample rows from those answers:
 * bug:
 * other problem:
 * positive feedback:
 * suggestion for improvement:

Future Iterations
Design mockups for:
 * Article titles
 * Reference Tooltips (T67114)
 * Cross-wiki Hovercards (T67117), and subsection links (T65792), particularly for Wiktionary
 * User names
 * Integrate with Navigation Popups

FAQ
This is a feature intended to improve the experience for any reader who normally would have clicked on a blue-link in wikipedia because they needed an overview (definition) of that entity.
 * Why Hovercards?

The theory of impact for hovercards is that they lower the cost of exploring a link. This should mean that users are less inhibited and more focused when exploring links. We should see that the overall links clicked + (non-accidental) hovers exceed the number of links clicked without hovercards. This is what success looks like. There are also some indications of failure that we will look for: If you have Navpops enabled, hovercards are automatically disabled. You will have to disable Navpops in order to experience hovercards. This is an intentional decision to ensure that Navpop users' do not have their preferences interrupted. Note: for certain browsers, you might have to clear your browser cache first for the change to take place. Right now, hovercards will either be turned on or off by a user. The option to turn them off lives in each hover event. So at each hover event, a user can decide that they are no longer interested. For logged-in users, hovercards may be re-enabled from user settings. For logged-out users, hovercards may be enabled by selecting the "Enable Previews" link at the bottom of the page.
 * How do we measure Hovercards performance?
 * hovers can be accidental-we need to measure normal dwell time in a controlled condition to ensure that the likely rate of accidental hovers is not too high. To give an example, if a user must dwell on a link for 250 msecs before a hover shows, then we would want to make sure that there are not a large number of users who tend to dwell on a link for more than 250 msecs without clicking it.
 * hovercards could lead to fewer pageviews, because the user gets the information that they need from the preview- this is not a problem, but we want to make sure that the decrease (if any) does not result in significantly less editing or fundraising.
 * the % of hovers that result in a user continuing to the page is high - this would suggest that most people wanted to go to the page anyway. If this is the case, then the hover is likely just adding an unnecessary step.  We expect some significant % of click throughs for hovers.  It is ~60% on Android for a similar feature, but we expect it to be lower on desktop.
 * the percentage of users who disable hovercards is low (given that users are aware on how to disable the feature) - this suggests that users enjoy the feature
 * What if I have Navpops enabled by default?
 * How many options do I have in Hovercards preferences?

At the project level, administrators can determine how long a user should dwell on a link before a hover is triggered. If a project wants to be conservative, the lag can be longer. WMF will have a recommendation as to optimum dwell time that provides the best user experience while minimizing accidental hovers. Unfortunately, there is no good way to tell users about a new feature. Central notice banners have been suggested, but running them for 2 weeks would not solve the needs of future users and we do not want to run them continuously. Notifying a user of a new feature is best done using a...hover-over. So that is why we are planning to show an initial hover on the users first hover event, followed by an explanation of what the user has seen. They can choose to turn them off in that dialogue. Please go to the hovercards discussion page, here: Talk:Beta Features/Hovercards
 * Why can't users just turn on hovercards if they want them?
 * Why can't users just turn on hovercards if they want them?
 * If I have hovercards feedback or if I have a suggestion for making them better, where should I go?
 * If I have hovercards feedback or if I have a suggestion for making them better, where should I go?

Code

 * Analytics and instrumentation
 * Hovercards are currently instrumented to measure various aspects of usage. Please see  the popups extension page for details and feel free to ask any clarifying questions

Project-level rollout discussions
Here is where the potential rollout of hovercards is being discussed:

English Wikipedia: https://en.wikipedia.org/wiki/Wikipedia:Village_pump_(proposals)/Archive_131#Proposal:_Enable_Hovercards_by_default