Wikimedia Research/Design Research/Microcontributions on Android Depicts

Microcontributions on Android Phase 3 (Depicts/Image tagging)

Daisy Chen

= Abstract/Background = Microcontributions and related user retention are essential goals for the Suggested Edits (SE) feed on Android. Depicts/image-tagging is an upcoming feature; we need to make sure users understand what this feature does and what it means to accept and reject machine-generated tag suggestions.

= Research Questions =
 * File page: Do participants expect more information about an image to add tags? Is the information that’s provided sufficient? Goal: find out if quick access to file page is needed.
 * Zoom: How would participants zoom an image? Find out which gesture to zoom images to incorporate: Tap to zoom, double tap to zoom, pinch to zoom.
 * Publish process: Do users realize that they can tap on multiple tags? Do users realize that their tags have been published?
 * New left/right arrows: Observe how users go back and forth between images that need tags. Do they understand the arrows?
 * Language and onboarding: Is the language that we’re using understood? Are users reading the onboarding dialog? Do they comment on it? Could be incorporated as a follow up question too.

= Methodology =
 * Usertesting.com
 * Test environments
 * Mobile web on Android, using this test prototype link
 * Alternate view of the same feature

= Participants = Screener elements Demographic breakdown
 * primarily Android and Chrome browser user
 * Wikipedia user
 * Non-editor on mobile Wikipedia media
 * 3 US/UK/AUS/CAN
 * 7 India and rest of the world
 * 5 women, 5 men

= Protocol =

Screener
* 		iPhone [Reject] * 		Android phone [Accept] * 		Other [Reject] * 		Yes [Accept] * 		No [Reject] * 		Yes [Reject] * 		No [Accept]
 * What is your primary mobile device?
 * Do you use Wikipedia?
 * Have you ever edited Wikipedia on your mobile device?

Protocol
For the purposes of this test session:
 * imagine that your name is Sharvani and you’re encountering the following screens on the Wikipedia app on your Android phone
 * keep in mind that this is a prototype shown on mobile browser (some scrolling may be needed)


 * 1) Take a minute or two to describe some of the things you can do on this screen.


 * 1) If you haven’t already, take a closer look at the section ‘Image Tags’. What do you think this section represents, without tapping on it quite yet?
 * 2) Show us how you would begin adding an image tag. Comment on the screen you see next.
 * 3) Tap on ‘Get Started’ if you haven’t already.
 * 4) Now, go ahead and complete the task presented on this screen. Talk us through the process. Prior to tapping ‘Publish’, first explain a bit what you expect to happen or to see next.
 * 5) Tap ‘Publish’. What do you think of what you see next? Then, tap the continue button.
 * 6) And what are you seeing now? From this screen, tell us what you think would happen if you tapped on the left arrow next to the ‘Publish’ button. What if you tapped on the right arrow instead? No need to tap on anything, feel free to move to the next task.
 * 7) This time, take a second to review this screen. What do you think of it? How do you feel about the amount of information provided, about the image, anything else?
 * 8) Is there anything you would change or add/remove to make your experience on this screen better?
 * 9) If you didn’t mention this already, how do you feel about the images provided so far in this feature?
 * 10) Do you think you’d have a need to zoom in to the image or no? Either way, try zooming in. Did it work? If not, describe what gesture you would want to use to zoom into this image (e.g. tapping, double-tapping, pinching, or other).
 * 11) This is an alternative view of this same feature. How do you feel about this look? Let us know how you’d compare the two; which you prefer and why.
 * 12) Now, let’s go back to the first link (we left off on a screen with a photo of the Matterhorn). Show us what you would do next if you were on the Wikipedia app. Feel free to explore for another minute or so and voice any thoughts you have on what you see and experience.

Post-test Questionnaire

 * 1) How did you feel about completing the tagging task?
 * 2) Briefly explain your understanding of the feature of adding image tags.
 * 3) What do you think adding image tags is for? How are your contributions through this feature used?
 * 4) Why might tagging images be helpful for Wikipedia users like you? Why might it be useful to do?

= Findings =

= Recommendations =