Wikimedia Apps/Team/Android/Image Recommendations

Background
In May 2021 the Android team built an minimum viable product of Image recommendations. The goal of the MVP was to determine if it would be a good task for newcomers, especially on mobile. The results were generally positive resulting in the Growth team introducing the feature on Web (Desktop and Mobile) on select language wikis. The Structured Data team also released a version of an image suggesting tool targeted at experienced users across all Wikis on web via notifications. Due to both tools having generally positive results, and to meet requests of bringing the feature back to the app, we are re-releasing Image Recommendations. Instead of the tool validating the accuracy of the suggestion like the original MVP, this version will enable experienced editors to place suggested images into Wikipedia articles.

Essentials for Version 1
The entry point for users should be located both on the 'Suggested Edits' screen and within an article.


 * 'Image Recommendations' task should be positioned immediately below 'Article Descriptions'.
 * A new task indicator should be available for users who have already completed at least one suggested edit. This indicator should disappear upon their second visit.
 * Users should be able to add captions and alt text
 * Users must have an accessible avenue to report feature-related issues, which will lead them to our support email.
 * A link to the FAQ page should be included within the task.
 * Measures should be in place to prevent users from repeatedly confirming edits within short intervals (less than 5 seconds) to guard against misuse.
 * The first time a user opens the task they will be guided through an onboarding process for the feature.
 * Users should have the ability to access the full article and image metadata.
 * Users cannot skip tasks without providing some form of feedback (Yes, No, Not Sure).
 * Users must be able to zoom/pinch on the image
 * Provisions need to be made for scenarios when images run out of tasks or tasks are unavailable in certain languages.
 * Suggested Edit should not be available to users with less than 50 edits

Nice to Haves

 * Enabling users to filter tasks by topics. Incorporation of subtle positive reinforcement messages (displayed in dark mode).

Out of scope

 * Addition of section images.

Target Wikis
While we welcome feedback from everyone, we are especially interested in hearing from:


 * 1) Spanish and Portuguese Wikipedia editors within Latin American and Caribbean countries.
 * 2) Hindi Wikipedia editors residing in India.
 * 3) Persian Wikipedia editors distributed across the diaspora.

In our study, we are committed to fostering a balanced and diverse group of testers. To that end, we aim for a broad spectrum of gender and age representation, ensuring that all perspectives are well-captured and accounted for.

User Stories

 * As a Wikipedia Android app user with a small screen and inconsistent internet, I would like to evaluate images and determine if they should go into an article, to contribute to Wikipedia articles that are in need of more content.
 * When I am using the Android app, I want to be able to add images with one hand to many articles on my mobile device, so that I can be productive while riding the bus in Bogotà, and listening to music.
 * When I am reading an article about Allameh Jafari Bridge, I want to learn that I can add an image to the Persian language article, so that I can enhance articles that I find interesting.
 * When I try to add an image to an article and fail, I want to learn how to do this task, so that I can build my confidence before going on to adding image that I want as my intended edit.
 * BONUS: When I am recommended an image for an article in Bengali and I don’t believe the image is a good fit and I am physically next to the subject of the article, I want to be made aware there is a Commons app, so I can upload the appropriate image using the Commons App

Validation

 * KR 1.1: 2000 articles have images in a 30 day period
 * KR 1.2: Average at least 8 edits per session per unique user
 * KR 1.3: 15% of Suggested Editors try image recommendations task
 * KR 1.4: 70% of those users complete the task again on a separate day in a 15 day period
 * KR 1.5: Reject and Accept rate does not deviate from Mobile Web or MVP by more than 10%
 * KR 1.6: DAU of Suggested Edits increase overall

Guardrails

 * KR 1.1: Feature does not worsen gender or geographic bias
 * KR 1.2: Less than 5% of users report NSFW or offensive content
 * KR 1.3: Users spend at least 10s evaluating a task before publishing it
 * KR 1.4: Bounce rate does not exceed 50%
 * KR 1.5: At least a 35% task completion rate
 * KR 1.6: Revert rate does not exceed 18%

Curiosities

 * KR 1.1: Do these numbers differ by language or user tenure
 * KR 1.2: If this is a user’s first suggested edit, do they go on to try others?
 * KR 1.3: Feature perception by geographically underrepresented groups on large language wiki
 * KR 1.4 At what point in workflow are most frequent dropoff events?

Designs
Below are initial designs for the feature: Next suggestion

Image Recommendations on Android is available in the Beta version of the app for users that over 50 edits. The feature can be accessed by experienced logged-in users by going to the edits tab in the main navigation bar.

We expect this feature to be released by the end of September. We are currently code complete, however there are a few bugs that other teams need to work out before we can release.

API Underpinnings and modifications to the Growth extension to enable the feature in the app was made available. We also completed the designs found in the section above.