Growth/Personalized first day/Newcomer tasks/cs

Tato stránka popisuje práci týmu Growth na projektu "Úkoly nováčka", což je podprojekt větší iniciativy "Personalizovaný první den". Tato stránka obsahuje nejdůležitější informace a rozhodnutí. Více postupných aktualizací týkající se průběhu projektu bude k dispozici na všeobecné stránce s aktualitami, s většími a detailními informacemi vloženými zde.

Plánování a design tohoto projektu začal 24. července 2019.

Současný stav

 * 2019-07-24: první schůzka týmu k prodiskutování projektu
 * 2019-08-27: team meeting to go over design concepts.
 * 2019-09-09: Phabricator tasks created for engineering work.
 * Další: druhé setkání týmu - diskuse možných přístupů k projektu

Shrnutí
Myslíme si, že nováčci by měli mít příležitost uspět v okamžiku, kdy poprvé na projekt dorazí. Velmi často se ale nováčci pokusí splnit úkol, který je pro ně příliš náročný, nebo žádný vhodný úkol najít nemohou, anebo nemohou přijít na to, co by mohli dělat po své první editaci. To vše vede k tomu, že mnoho z nováčků odchází a již se nevrací. V minulosti proběhlo několik úspěšných pokusů o doporučování úkolů nováčkům, a my věříme, že Domovská stránka je vhodným místem pro doporučování relevantních úkolů nováčkům.

Budeme muset myslet na několik věcí:
 * Nováčci často mají specifické cíle, které se snaží naplnit, například přidání určitého obrázku do určitého článku. Nechceme je od plnění tohoto předsevzatého úkolu odradit.
 * Nováčci své dovednosti tvoří postupně, od jednodušších editací k těm složitějším.
 * Pokud jsou nováčci ve svých začátcích úspěšní, jsou více motivovaní v editaci pokračovat.

Po vzetí těchto věcí v úvahu, rádi bychom nováčkům doporučovali...

Důležitým nástrojem pro zajištění relevantnosti úkolů je uvítací dotazník, který byl původně vybudován právě z tohoto důvodu - personalizovat rozhraní nováčků. Plánujeme použít informace, které nám nováčci dobrovolně o svých zájmech či cílech sdělují k tomu, abychom vybrali ty nejvhodnější úkoly.

Jednou z největších výzev bude samotné získávání úkolů, které by se daly doporučit. Existuje mnoho zdrojů pro úkoly, kupř. údržbové šablony, doporučení v nástroji Překlad obsahu nebo návrhy z nástrojů, jako je Citation Hunt. Otázkou je, která z těchto možností nováčkům nejlépe pomůže dosáhnout jejich cílů.

Nejprve budeme pro doporučování úkolů používat Domovskou stránku nováčka, ale v dlouhodobějším horizontu si dovedeme představit vytvoření funkcí, které budou doporučovat úkoly a pomáhat v jejich splnění přímo jako součást editačního rozhraní.

V dlouhodobějším horizontu budeme přemýšlet o způsobech, jak doporučení úkolů zakomponovat do ostatních prvků zážitku nováčka, jako je např. modul Dosah na Domovské stránce, nebo Panel Potřebuji pomoc.

Why this idea is prioritized
We know from research and experience that many newcomers fail early in their editing journey for one of these reasons:
 * They arrive with a very challenging edit in mind, such as writing a new article or adding an image. Those tasks are difficult enough that they likely fail and don't return.
 * They arrive without knowing what to edit, and can't find any edits to make.

We also know that on the newcomer homepage, the most frequently clicked-on module is the "user page" module -- the only thing on the page that encourages users to start editing. This makes us think that many users are looking for a clear way to get started with editing.

And from past Wikimedia endeavors, we've seen that task recommendations can be valuable. SuggestBot is a project that sends personalized recommendations to experienced users, and is a well-received service. The Content Translation tool also serves personalized recommendations based on past translations, and has been shown to increase the volume of editing.

For all these reasons, we think that recommending specific editing tasks for newcomers will give them a clear way to get started. For those newcomers that have an edit in mind that we want to do, we'll encourage them to try some easy edits first to build up their skills. For those newcomers who do not have a specific preference on what to edit, they'll hopefully find some good edits from this feature.

Glossary
''There are many terms that sound similar and can be confusing. This section defines each of them.''


 * "Task recommendations" or "Task suggestions"
 * Lists of articles that need editing work, suggested automatically to users.


 * "Personalized"
 * Software that adapts automatically to each user to fit their needs.


 * "Customized"
 * Software that the user adapts to fit their needs.


 * "Topic"
 * A content subject, such as "Art", "Music", or "Economics".


 * "Maintenance template"
 * Templates that are put on articles indicating that work needs to be done on them.

Recommending tasks
The core challenge to this project is: Where will the tasks come from and how will we give the right ones to the right newcomers?

The graphic below shows our priorities when recommending tasks to newcomers.

As shown in the graphic above, we would give newcomers tasks that...


 * ...arrive at the right time and place for a newcomer's journey.
 * ...teach relevant conceptual and technical skills.
 * ...gradually guide users to build up their editing abilities.
 * ...be personalized to their interests.
 * ...show them the value and impact of editing.
 * ...motivate them to participate continually.

For instance, we do not want to give newcomers tasks that are irrelevant to what they hope to accomplish. If a newcomer wants to write a new article, then asking them to add a title description will not teach them skills they need to be successful.

We're splitting this challenge into two parts: the sourcing the tasks and topic matching.

Sourcing the tasks
There are many different places we could find tasks for newcomers to do. Our team listed as many as we could think of and evaluated them for whether they seem to be achievable for the first version of the feature. Written below is our determination on the task type we'll be starting with, followed by a a table listing many of the task sources that we evaluated.

Maintenance templates
We're going to be starting by using maintenance templates and categories to identify articles that need work. All of our target wikis use some set of maintenance templates or categories on thousands of articles, tagging them as needing copyediting, references, images, links, or expanded sections. And previous task recommendations software, such as SuggestBot, have used them successfully. These are some examples of maintenance categories:


 * Articles needing links in Arabic Wikipedia
 * Articles needing copyediting in Korean Wikipedia
 * Articles needing references in Czech Wikipedia



In this Phabricator task, we investigated exactly which templates are present and in what quantities, to get a sense of whether there will be enough tasks for newcomers. There seem to be sufficient numbers for the initial version of this project. We are likely to incorporate other task sources from the table below in future versions.

It's also worth noting that it could be possible to supplement many of these maintenance templates with automation. For instance, it is possible to automatically identify articles that have no internal links, or articles that have no references. This is an area for future exploration.

Full evaluation of task types
Below is a table showing the many sources of tasks that we evaluated in coming to the decision to start by using maintenance templates.

Topic matching
Past research and development shows that users are more likely to do recommended tasks if the tasks match their topical interests. SuggestBot uses an editor's past editing history to find similar articles, and those intelligent results are shown in this paper to be executed on more often than random results. The Content Translation tool also recommends articles based on a user's previous translation history, and those recommendations have increased the translation volume.

Our challenge with newcomers is a "cold start problem", in that newcomers do not have any edit history to use when trying to find relevant articles for them to edit. We have several ideas for how to allow users to indicate topics of interest in a list, or to type topics of interest into a search. Those ideas are being investigated in this Phabricator task.

Comparative review
Our team's designer reviewed the way that other platforms (e.g. TripAdvisor, Foursquare, Amazon Mechanical Turk, Google Crowdsource, Reddit) offer task recommendations to newcomers. We also reviewed Wikimedia projects that incorporate task recommendations, such as the Wikipedia Android app and SuggestBot. We think there are best practices we can learn from other software, especially when we see the same patterns across many different types of software. Even as we incorporate ideas from other software, we will still make sure to preserve Wikipedia's unique values of openness, clarity, and transparency. The main takeaways are below, and the full set of takeaways is on this page:


 * Task types – bucket into 4 types: Rating content, Creating content, Moderating/Verifying content, Translating content
 * Incentives – Most products offered intangible incentives mainly bucketed into the form of: Awards and ranking (badges), Personal pride and gratification (stats), or Unlocking features (access rights)
 * Reward incentives – promote badges or attainments of specific milestones (e.g., a badge for adding 50 citations)
 * Personalization/Customization – Most have at least one facet of personalization/customization. Most common customization is user input on surveys upon account creation or before a task, most common system-based personalization type is geolocalization
 * Visual design & layout – incentivizing features (stats, leaderboards, etc) and onboarding is visually rich compared to pared back, simple forms to complete short edits.
 * Guidance – Almost all products reviewed had at least basic guidance prior to task completion, most commonly introductory ‘tours’. In-context help was also provided in the form of instructional copy, tooltips, step-by-step flows,  as well as offering feedback mechanisms (ask questions, submit feedback)

User flow
The user journey for newcomer tasks is broken into several parts:


 * 1) Gathering information from the newcomer: learning what we need in order to recommend relevant tasks.
 * 2) Feature discovery: the way the newcomer first encounters task recommendations.
 * 3) Task recommendations: the interface for filtering and choosing tasks.
 * 4) Guidance during editing: once the newcomer is doing a task, the guidance that helps them understand what to do.
 * 5) User feedback: ways in which the newcomer can indicate that they are not satisfied with the recommended task.
 * 6) Next edit: how we continue the user's momentum after the save an edit.

Below are some of the current draft design concepts as the team continues to refine our approach.

User testing
To be written

Measurement and results
To be written