Article feedback/Public Policy Pilot

This page lists the Functional Requirements for the Public Policy Pilot of the Article Assessment feature. This is a work in progress.

Feedback from the Public Policy Initiative has been and will continue to be incorporated into this feature. The Public Policy Initiative will decide whether to use the data as part of their project evaluation.

Objective
[draft] To provide a way for readers to easily assess the quality of an article.

Timeline
We aim to have this feature in production by September 15, 2010.

Use Cases
(To be completed)

Feature Requirements
General requirements
 * This feature will exist only on a subset of pages designated by the Public Policy Initiative
 * This feature will be available to all users

Reader Feedback: Input and Display
 * THere will be 1 "overall" rating with a five category rating
 * There will be 3-4 categories, each with a five-star rating
 * There will be tooltips to describe each category of rating
 * There will be an open comment field. What happens with the information entered in the comments field is TBD. Options are:
 * The comment goes into some database, but not published anywhere (I think this is where we are leaning)
 * The comments go a special page which is linked from somewhere either on the article page or rating control
 * We'll likely see spam quickly. Restricting addition of URLs would help. Note that WP also has a fair share of aggressive trolls/vandals who may post inappropriate or personal information. If we don't want to implement a basic deletion mechanism, we will probably need to restrict views.


 * For a given user and article, there are the following states for review:
 * Haven't reviewed at all
 * Have reviewed current revision, let user change review
 * Haven't reviewed current revision, but reviewed previous revision, let user re-review, give message that their review is stale


 * TBD: whether the input will be the same as the display (e.g., Netflix) or separate (e.g., Yelp)
 * Requirements for display/input (Brandon to mock up)
 * Upload page load, users should be able to see average ratings
 * User should be able to enter their own ratings
 * There is clear distinction between the two
 * Users should be able to see what they've just done (both immediately and when they visit the page later)
 * Open issue: how to manage distortion of seeing existing ratings

Ratings Display: Other users' ratings:
 * We will have the following two categories of information to display:
 * The total number of ratings to date
 * average of last x ratings of the each of the categories of ratings, both in graphical form and in text form
 * these graphs need to be updated


 * TBD: Which information will display on page load vs. upon click/other user action

Analytics
 * Ideally, we would have page views per article so that we know the ratings rate = (number of ratings) / (total views of page)
 * We also need some measurement of ratings completion = (users that complete the rating process) / (users that start the rating process)
 * Ways of analyzing ratings distributions in aggregate (vs. one article at a time).

Known Issues
 * Re-rating current revisions should be allowed. This is a bug in the existing software.