Edit Review Improvements/New filters for edit review/Research

Amandio Tulumba, Born in 1989, he holds a bachelor degree of Business Management and one MBA in Oil and Gas Management.

From the south province of Angola, Humabo, Amandio Tulumba has successfuly created a very sucessful Business in Tanzania the today he is a board Member of the CEO African Leadership comission. he plans to get in to politics when he gets to 35 years old.
 * in 2014, Amandio Tulumba Published a Oil and Gas Article with a title: The relacionship Between oil domestic consumption and economic growth in Angola, it was published in Malaysia where he finished he´s MBA.
 * In 2015, Amandio Tulumba, Was invited to be a speaker in the oil and gas conference in Italy, and he then decided to erroll himself for a PHD program under the WTI Institute in Swd where he plans to start he´s career in Energy trading Policy.
 * How it informed the project decisions: Due to the positive feedback, we tested additional filters and functionalities, and made iterative tweaks on existing edit review elements based on user feedback.
 * Question 2: To what extent did participants discover, understand, and intend to use the new filters/functionalities on Recent Changes?
 * What we learned: Each round of testing yielded different results, but at each stage there was feedback to evaluate and improvements to be made to facilitate discoverability, understanding, and, as a direct correlation to that, how much participants intended to try the beta in their normal workflows on the wikis.
 * How it informed the project decisions: At each stage in the research process, we were constantly adding, removing, and editing both new and existing elements of the Recent Changes page based on our evaluation of the participant sessions and also their direct feedback/recommendations.
 * Question 3: How did the success of the filters/functionalities translate to the Watchlist page?
 * What we learned: The participant cohort did not express much interest in bringing these functionalities to Watchlist and indicated that they would not find utility in this notion.
 * How it informed the project decisions: For the moment, this is not moving forward, but further investigation is warranted as the participant cohort were primarily users of Recent Changes, not Watchlist. The new filters on the Watchlist will not be exposed by default, remaining as a beta feature as more feedback is collected.

Challenges
We need more participants in general! If you're interested in the Contributors space and would like to participate in upcoming research studies, please contact DChen>User:Dchen (WMF)|Daisy Chen with your areas of interest and we will keep you in the loop!
 * Our macro level goal is to make the wikis and its tools more intuitive and useful for everyone, but for these sessions, we limited our participants list to those who were (relatively heavier) users of edit review pages. It ended up that *most* of our participants worked primarily on English Wikipedia, but we did have representation from other languages, other language wikipedias and Wikiversity.
 * Change can be difficult, regardless of utility, intention, or results. Though any particular change won't always make everyone delighted, we generally aim to make as many product decisions as possible based on our users' feedback and what will help the most users.
 * Usability on a relatively wide scope is a large undertaking, especially when generative research elements are mixed in as well. Our goal is to keep both details and overall look, feel and utility in mind as we make product decisions.

What’s next
Are you interested in the Contributors space? Would you like to participate in upcoming research studies and provide your feedback? If so, please contact DChen>User:Dchen (WMF) |Daisy Chen with your areas of interest and we will keep you in the loop!
 * Although the results have been encouraging, our wikis support many different usecases and we want to hear from you how the new filters work for your activities. Feel free to share your experience on the [https://www.mediawiki.org/wiki/Talk:Edit_Review_Improvements/New_filters_for_edit_review project talk page].

Research Questions

 * Concept and Intent
 * Do users understand what the filter categories represent, specifically the Quality, Intent, and Experience filters?
 * Do subjects understand what the different ORES (Objective Revision Evaluation Service) levels mean?
 * Do users understand the difference between filtering and highlighting, and how they might use these singly or in combination?


 * Usability
 * Do users notice and/or understand the default filters?
 * Are users able to find the correct filters and use them in combination effectively?
 * Do users find and learn to effectively use the highlighting to isolate targets?
 * Can they manage and interpret the highlight colors?
 * Do they find the “ignore highlights” button and understand its use?


 * Effectiveness
 * How do users feel the new tools will affect their work and workflows?
 * What are users’ reactions regarding the new interface and its functionalities?
 * Do users feel any differently about the new interface as compared to the current Recent changes page?
 * Do they see that the new interface as being functionally neutral, inferior or superior?

Curious about the more nitty-gritty details on the research set-up? Take a look Round1>Wikimedia_Research/Design_Research/Contributors_Team_UX_Research/2016.09-11_Recent_Changes_Filters,_Round_1|here.

Findings
Overall, the new Recent Changes filters features were well-received. Users generally find that the prototype Recent Changes are improvements over the current and a majority think they would incorporate these features into their work.

Though features can still use some clarification, refinement, and ongoing iteration/improvement, using them is pretty intuitive overall and even when there are user hesitations, is a learnable process.

Over the course of this first round of usability testing, two prototypes were used with the second prototype building on findings from the first prototype.

Next Steps
Discuss existing issues and corresponding recommendations for improvement. Prototype 2 is recommended to go to beta for further user feedback and iteration.

Research Questions
After introducing the new filters for edit review to positive feedback, the Collaboration team’s next iteration aimed to include support for advanced functions.

In these sessions, we utilized a prototype testing environment and lead users through a series of tasks. Through completing said tasks, we are able to evaluate if research participants were aware of the functionalities, found them intuitive to use, and whether they found utility in them.

If they find them, are they easy to understand and use?
 * What elements of the extended filters are most and least useful for users?
 * Do users notice the new capabilities?

New page elements/functionalities Navigating and updating results
 * Namespaces, tag, users, and categories filters
 * Filter set bookmarking
 * Display options (size and pagination of results)

Read more details on the research planning and protocol testing>Wikimedia_Research/Design_Research/Contributors_Team_UX_Research/2017.05_Recent_Changes_Extended_Filters_(Round_2)_Usability/Generative_Testing|here.

Findings
Generally, participants had positive responses to the new filters and functionalities. To different degrees/varying use cases, most of these new features have audiences ready to wield these tools.

However, there are some areas in the prototype that can benefit from additional clarifications, UI tweaks, and workflow considerations. The details on user recommendations can be found in the research report.

Next Steps
Discuss existing issues and corresponding recommendations for improvement.

If possible, integrate changes into beta feature to allow time for users to experience them. After period of use, users of the beta should be prompted for information on how much the feature was utilized day-to-day, what specific elements/functionalities they used, and their feedback and recommendations for how the beta has worked for them and where areas for improvement remain.

Research Questions
The new filters for edit review have been out as a beta feature on various wikis. Our goal is to learn from users directly how the experience of using the new filters over a period of time has been for them.

Since the initial rounds of generative and usability testing, the team made some tweaks from past usability testing and feature requests that were then applied to a new prototype, named ‘integrated’ filters, along with a set of filters made specifically for the functionality on watchlist. In this round of testing, we evaluated the usability of the latest iteration, the applicability of its watchlist mirror, and the live updates feature in conjunction with the beta satisfaction testing.

Next Steps [ [/w/index.php%3Ftitle%3DEdit%20Review%20Improvements/New%20filters%20for%20edit%20review/Research%26action%3Dedit%26section%3D1 edit] ]
Discuss existing issues and corresponding recommendations for improvement (this will always be a recurring element of our work).

Discuss the utility of further examining the idea of bringing the edit review filters to pages like watchlist, but with more seasoned/heavier users of watchlist pages specifically.

=== Research Report [ [/w/index.php%3Ftitle%3DEdit%20Review%20Improvements/New%20filters%20for%20edit%20review/Research%26action%3Dedit%26section%3D2 edit] ]  ===