Draft namespace/Usability testing

The following document describes resources, questions, and a usability testing scenario for enhancements to the Draft namepsace.

Materials

 * Initial designs
 * Blog post, to start circulating the participants form.
 * Prototype from redlink
 * Prototype from search

Goals
In these sessions, we want to test...


 * Understandability of draft concept. Is the concept of draft (and how it relates to an article) understood by users?
 * Discoverability of entry points. Are users able to start a new draft?
 * Awareness of draft mode. Is it clear when users are in draft mode (and how that is different from an article)?
 * Understanding of draft creation process. Are users able to create a draft and publish/abandon it?
 * Understanding of aids. Do users understand the purpose of the different tools provided?
 * Learn about collaboration patterns for editing. How are users collaborating to each other when editing and how they expect to be able to do so?

Pre-test questions

 * 1) How was your experience editing Wikipedia (if you ever did)?
 * 2) Have you tried to create a new article?
 * 3) * Yes: Can you describe the process you followed for creating a new article?
 * 4) ** Pay attention to entry points used (search, direct URL, red links).
 * 5) ** Have you experienced a deletion?
 * 6) * No: Is there any reason you think it prevents you to create a new article about any of your topics of interest?
 * 7) ** Hypotheses: Not knowing you can edit, no ideas of what to contribute to, perceived lack of valuable knowledge, lack of confidence, lack of technical knowledge, lack of time to invest on that.
 * 8) Can you check if there is an article about “Driving in Germany” in Wikipedia and try to start a new one? There is no need to add any real content, we are not going to save it.
 * 9) When creating a Wikipedia article (or any other kind of document such as a presentation or a report for you work), do you collaborate with other users or you share your work with other users?
 * 10) When you are editing, how do you identify the important aspects that need improvement?

Test scenarios
The following are our testing steps:

Intro. In this scenario, you are reading the wikipedia article about traffic lights to check if their color code is universal or changes from country to country.

Show the prototype where there is a red link that allows users to start a draft: Imagine that you are also interested in “pedestrian crossings” which are mentioned in the article. Would you be able to add some information about this topic?

[The user gets to the draft page]


 * Could you tell us which is the purpose of this?
 * Can you add some content and make it available as a wikipedia article?

Show the prototype with the search entry point (this leads to the same draft but has some comments from users): Some months later, you got a notification telling you that your article was not ready for publishing. Could you search for the “Pedestrian crossing” article to add some more information?


 * [The user access the draft.]
 * Do you have an idea on what to change to make it ready to be published?
 * How would you ask other editors to help you with this?
 * In case you have a friend which is an expert on the topic, how would you share this with him to let him participate?
 * If you wanted to add a link [or make some text bold] what would you do? [Not supported in prototype, but allows to check if toolbar become disconnected from content]
 * [For advanced users] Could you revert to the regular Article creation if you don’t want to go through the draft process?

Post-test questions

 * 1) You have created a draft before the content become a real article. In which situations you think you would use drafts?
 * 2) Was it clear when articles were lacking, and how to create new drafts?
 * 3) Was it clear at anytime when you were working on a draft and when you were in a published article?
 * 4) Do you have any issue saving, publishing, and requesting help on drafts?
 * 5) In which scenarios would that be useful?
 * 6) After your initial impression of the tool, do you think you’ll be more likely to create (more) new articles?