Reading/Web/Projects/Mobile Page Issues/Research Results

Starting on April 6th 2018 we conducted qualitative user testing in an attempt to answer our two main research questions:


 * 1) Does the new treatment for page issues increase the awareness among readers of page issues?
 * 2) How do users feel about being informed of page issues? How does awareness of page issues affect their perception of Wikipedia?

We were additionally able to glean some information regarding some of our our additional research questions:


 * 1) How do readers form opinions about the quality and reliability of Wikipedia pages in general?
 * 2) Do readers care more about issues considered by Wikipedia to be of higher severity than issues considered to be of lower severity?

Methodology & participants

 * Remote, unmoderated user tests conducted through usertesting.com
 * Users will be looking at an Invision prototype
 * Users are non-experts
 * 4 test groups



Findings
Top level findings are listed here. For more detail please see PDF below.

Does the new treatment for page issues increase the awareness among readers of page issues?
✓ Yes, the new treatment increases awareness of page issues among participants (particularly when they are in a more evaluative/critical mode)

✓ Surprisingly, treatment B did not perform better than treatment A

How do users feel about being informed of page issues? How does awareness of page issues affect their perception of Wikipedia?
✓ Page issues make sense to readers and they understand how they work

✓ Readers care about page issues and consider them important

✓ Positive sentiments towards Wikipedia associated with readers learning about page issues