Account Creation Improvement Project

This page provides information about the technical needs of the Account Creation Improvement Project, a Wikimedia Foundation initiative, aiming at increasing the number of people who create a user account and actually start editing.

Objectives
Our goal is to increase the number of people who successfully create a user account and make at least 5 edits after account creation.

Metrics

 * 1) Whether we can increase the % of users who edit by showing various treatments upon successfully completing the Account Creation flow
 * 2) Whether we can increase the % of users who make it through the Account Creation flow

Current account creation flow
Here is the current flow on the English Wikipedia:



Current steps for account creation:
 * 0: User clicks on the Log in/ create account link in the navigation
 * 1: User is taken to the Login page, which asks the user to either log in or to create an account
 * 2: User is taken to the Account Creation pages, which asks the user to create an account by filling in a form
 * 3: User is taken to a Confirmation page

Overview of the elements that will be A/B tested
The following diagram shows the elements which will be A/B tested:



Each of the three main steps within the flow will have multiple versions. Examples of each of these versions are included.

Requirements for A/B

 * 1) Ability to implement different pages for each step in the flow
 * 2) Ability to set percentages for each of the pages  (% of users that see a given page)
 * 3) Ability to track fallout of each flow

Analytics Requirements

 * Impact on editing: The first priority is to understand whether different versions of Page 3 result in different editing behavior. We need to be able to track which version users see so that we can run editing histories against users which have seen different versions of the page.
 * We do not need to analyze the effects of different combinations of login-account creation-confirmation on editing. Simply measuring the effect of different versions of the Confirmation page is sufficient
 * Funnel analysis: In order to understand the effectiveness of each point in the flow, we would ideally have funnel analysis (% of users that see 1a, 2a, 3a, etc.).
 * An approximation for this is to be able to report the click-through-rates for each page

Technical specification for A/B-testing
Use of the function "UserLoginComplete" in "Specialuserlogin.php": the developer needs to deploy an extension that provides a random switcher in the function "successfulCreation". This switcher will send people either to the existing page "MediaWiki:Welcomecreation" or to a new page "MediaWiki:WelcomecreationAlternative". MediaWiki:Welcomecreation is the existing page that is shown to all users who create an account. Every admin on a local Wikipedia should be able to change it. For the bigger language versions of Wikipedia it will be sufficient if 20% of the new users will be directed to the new page MediaWiki:WelcomecreationAlternative that we use for our testing purposes. The other 80% will see the existing MediaWiki:Welcomecreation. This ratio needs to be adjustable, as smaller language versions will need a higher percentage of users to be directed to our new testing page. So, the percentage of users going to MediaWiki:WelcomecreationAlternative needs to be customizable on a project level.