User:BDavis (WMF)/Projects/Review tool

Review tool is a placeholder name for a system for managing the process of having a group of users evaluate grant/scholarship/whatever proposals and collecting the evaluations to use in making final decisions.

Problem
The Wikimania Scholarships app is a one-off solution to this problem. IEG would like something similar. Internal discussions at the WMF indicate that if a more general self-serve solution could be found there would be additional programs interested in using it.

Simplifying assumptions

 * For an MVP, there is no need to collect information from applicants
 * For an MVP, administrators can be responsible for populating list of proposals

User stories

 * As an administrator of the grant review system
 * I want to create new grant campaigns (defining reviewers, review criteria, data to be reviewed, and data grouping)
 * So that reviewers can provide feedback on the applications in the campaign.


 * As a grant administrator or reviewer
 * I want to mark grant applications as eligible or ineligible
 * So that ineligible grant applications can be excluded from further review.


 * As a grant reviewer
 * I want to score a grant application on multiple dimensions (defined by the admin)
 * So that the quality of the grant application can be compared to others in the same campaign.


 * As a grant provider or administrator
 * I want to view reports on the aggregate reviewer scores for grant applications in a campaign
 * So I can share results with others outside of the review system and select applications to fund.