Extension:WikiGrok/Version A Guerrilla Testing

Guerrilla Testing for Wikigrok Version A
The goal of this research was to observe people interact with the wikigrok version a micro-contributions beta feature and determine:
 * Goal
 * 1) do users notice the call to action
 * 2) how do users respond to the call to action
 * 3) how do users’ expectations of what is being prompted match up to our intentions for this feature
 * 4) did users understand the overall purpose of the feature and also the contents/purpose of the ‘tell me more’ link

To get started, we asked people a few basic questions first:
 * Questions
 * 1) What kind of phone do you use/what OS?
 * 2) Do you use a tablet, and if so, what model/OS?
 * 3) Do you use a computer, and if so, what model/OS?
 * 4) Do you ever use Wikipedia? (Goal of this question is to find out if they know you can edit wikipedia or not. If they answer, "Yes, I use Wikipedia", we ask "how do you use it?" If they describe that they read, mostly and don't mention editing, then we ask "Do you know that you can edit Wikipedia?”

We presented users with either an iPod Touch (for iOS users) or a Nexus (for Android/other users). They were then prompted to interact with the wikigrok beta feature on the Anne Dallas Dudley page on mobile web.
 * Task

Monday, September 22, 2014: We went to Yerba Buena.
 * When/Where

Findings: Patterns Observed

 * 1) When asked to describe the page, users do not actively describe or mention the wikigrok feature.
 * 2) A few users seemed to think that this was either a new way of editing, or that agreeing to help would take them to the edit page.
 * 3)  Users did not have issues interacting with the feature.
 * 4) A few users indicated that the task was quicker/easier than they had anticipated.

Bugs and/or Suggestions

 * 1) Users’ responses in the aggregate seemed positive, but seemed to indicate that testing would be more indicative if users were allowed to encounter this feature on pages of their own choosing (topic on which they had prior knowledge or interest)
 * 2) May be helpful to add an option after the first inquiry is completed for user to answer more questions, if they’re on a page that they know a lot about and they'd like to continue the wikigame
 * 3) It may be helpful to inform potential interactions how long answering a 'tag' question might take on the front end (e.g., take five seconds to help improve this page)
 * 4) Users tended to tap multiple times on ‘Okay!’ even though mifi was effective, and then end up tapping/registering an answer that they didn’t mean. They seem to be a bit confused about what happened when they suddenly jump from initially engaging with the feature to being done
 * 5) Make the answer buttons vertical or some other workaround. Tapping ‘Okay’ more than once can trigger an accidental tap of ‘Not sure’ or ‘No’ on the next page.
 * 6) In future, how will we reconcile incorrect data provided through this feature? Perhaps add some information in the tell me more section to address this issue.

Test A

 * Female (26-35)
 * iPhone, ? tablet, ? computer
 * Reads Wikipedia

Task:
 * User thinks that they’re being asked to tag information
 * User tapped on ‘no thanks’ button in response to the inquiry
 * User noticed the ‘tell me more’ link
 * User is not interested in the feature

Test B

 * Female (15-25)
 * iPhone, ? tablet, ? computer
 * Reads Wikipedia

Task:
 * User asked, 'is it a quiz?’
 * User didn’t know how to answer the question prompted because she didn’t read the article
 * User noticed the call to action without prompting

Test C

 * Female (15-25)
 * iPhone, no tablet, Mac
 * Reads Wikipedia, knows about editing but hasn’t because she feels she doesn’t know enough about any particular topic

Task:
 * User skipped over feature initially, reviewed and described the article sections. After prompting, notices and explains it
 * User thinks that this feature is meant to have user edit and add more information to the page
 * User believes that if she hits no thanks, the box will disappear and let user continue reviewing the page. If okay, then it will take user to another page where user can add information. After seeing what okay actually does, she says that it is not what she expected
 * User did not take much time to read the question and answer not sure, because she didn’t know the answer
 * User did not notice the tell me more link, guesses that it explains how people can edit and add information. Similar to what she thought what it would be
 * User had a positive impression of the feature

Test D

 * Female (46-56)
 * iPhone, iPad, PC
 * ‘sometimes’ reads Wikipedia, knows about editing. Uses wiki to look for info, doesn’t think she has enough know-how to edit

Task:
 * User scrolls down and describes page attributes, but skips over mentioning wikigrok. After prompting, notices and describes
 * User thinks this is a way of providing users the ability to add more information
 * User believes that answering no thanks will just let user move forward with reviewing the article. Answering okay will take user somewhere where he/she can suggest more information
 * User answers the question, doesn’t take much time. Tester had to reset because user tapped ‘Okay’ button too many times and accidentally hit an answer
 * User notices the ‘tell me more’ link, but thinks this is a mechanism to allow the user more space to type or edit, not a place where WMF provides info on this feature
 * User had a positive experience, said would answer more questions if she knew the answers

Test E

 * Female (26-35)
 * iPhone, no tablet, Mac
 * Reads Wikipedia, knows about editing. Tried to edit her company info box/description section a long time ago, but wasn’t successful. Had to create a page back in the day, felt it was a lot more work-intensive than anticipated, and gave up

Task:
 * User scrolls down and describes page attributes, but skips over mentioning wikigrok. After prompting, notices and describes
 * User thinks this is a way of letting users provide feedback/information on how to make the page more user-friendly (or to generally make the page more user-friendly through the inclusion of feature, unclear)
 * User believes that answering no thanks will just disappear the box. Answering okay will take user somewhere where he/she can add tags to the article
 * User answers the question quickly. Said, “I made wiki better!” :)
 * User notices the ‘tell me more’ link, but thinks this will tell users how to tag and more about the tagging feature
 * User had a positive experience, said this was a lot easier and quicker than she thought it would be

Test F

 * Male (15-25)
 * Windows phone, no tablet, PCs at library
 * Reads Wikipedia, didn’t know about editing

Task:
 * User scrolls down and describes page attributes, but skips over mentioning wikigrok. After prompting, notices and describes
 * User thinks this is a way of getting more opinions on the topic from users
 * User believes that answering no thanks will prompt another follow-up by the feature, instead of leaving the user alone (didn’t expect the feature to go away). Answering okay will take the user somewhere where he/she can contribute/edit ‘ask me to exercise my brain'
 * User answers the question, doesn’t take much time. Said ‘this is like a quiz’. Pressed ‘not sure’, said he’d have to read about her more
 * User notices the ‘tell me more’ link, thinks this will tell user more about the questions the feature will ask. similar to user’s expectation.
 * User had a positive experience. Asked, ‘is [this feature] new?’ Likes that it’s not time-intensive, but still contributes something. People like to get in and out, and this is a good way to get feedback or information

Test G

 * Male (36-45)
 * Android, Android, PC
 * Reads Wikipedia, knows about editing. Uses wiki to look for info. Not sure why he doesn’t edit, but said he usually goes to wiki to check something he doesn’t already know

Task:
 * User scrolls down and describes page attributes, but skips over mentioning wikigrok. After prompting, notices and describes
 * User thinks this is a way of asking for information, and letting users add something or improve the page
 * User believes that answering no thanks will just let user move forward with reviewing the article. Answering okay will take user to highlighted sections on the page where improvements or additions can be made
 * User answers the question, doesn’t take much time. Hit ‘not sure’ because he said he didn’t know about her
 * User did not notice the ‘tell me more’ link, assumes that it would describe the feature/task
 * User had a positive experience. Asked if feature is new. Said that this feature is good because generally users don’t know what to add, and that it’s good to have suggestions. Said that this would also put users in a more contributory mindset