Quality Assurance/Article Feedback Test Plan

OpenHatch Article Feedback Tool 9 June Test Plan

 * Objective


 * Test nearly-final version of Article Feedback Tool. Last chance to identify potential issues before final version


 * Validate appearance and behavior of AFT user interface to create feedback on articles.
 * Validate appearance, workflow, and display of existing feedback for articles
 * Validate workflow that leads to editing WikiPedia
 * Validate filtering of feedback


 * Platforms/Browsers of Interest


 * IE7 and IE8/IE9 in "compatibility mode"
 * IE8
 * IE9
 * IE10
 * Firefox with and without "HTTPS-Everywhere" extension
 * Chrome
 * All browsers with and without "privacy/incognito" mode set


 * Test Environments (Note: we are testing in production environments, please be respectful)


 * For experiments with inappropriate feedback use the Golden-crowned Sparrow page: http://en.wikipedia.org/wiki/Golden-crowned_Sparrow?aftv5_form=1&aftv5_link=E and http://en.wikipedia.org/wiki/Special:ArticleFeedbackv5/Golden-crowned_Sparrow?aftv5_form=1 (This is something of a "throwaway" page, used for testing by the AFT team)


 * For experiments with high volume and/or controversy use the Barack Obama page: http://en.wikipedia.org/wiki/Barack_Obama?aftv5_form=1&aftv5_link=E and http://en.wikipedia.org/wiki/Special:ArticleFeedbackv5/Barack_Obama


 * For a non-controversial article see http://en.wikipedia.org/wiki/Drew_Barrymore?aftv5_form=1&aftv5_link=E and http://en.wikipedia.org/wiki/Special:ArticleFeedbackv5/Drew_Barrymore


 * Some additional articles with AFTv5 enabled: https://en.wikipedia.org/wiki/Category:Article_Feedback_5_Additional_Articles


 * Setup


 * IMPORTANT: If possible, create an account on http://en.wikipedia.org/ no later than Tuesday 4 June and complete at least ten edits.  This will make your account "autoconfirmed" as of June 9.  Autoconfirmed accounts have access to more AFT features.  See http://www.mediawiki.org/wiki/Article_feedback/Version_5/Feature_Requirements#Access_and_permissions for details.  Create your User page and your User_talk page.  (Note: editing your user page and your User_talk page count as Wikipedia edits, but feel free to complete your ten edits by updating Wikipedia articles, for example about your home town, or about some subject of interest to you.)


 * For the AFT test, login on http://en.wikipedia.org/. This is not required, but it makes several things easier:
 * Any edits to pages preserves the identity of the editor.
 * Provides a User_talk page, which is a good place to take notes
 * Allows persistent setting of various user preferences relevant to testing


 * Create an account in Bugzilla https://bugzilla.wikimedia.org/
 * This is also not strictly required, but recommended strongly for reporting issues


 * Join the IRC channel #mediawiki on the freenode IRC server at 10AM Pacific time 9 June for introductions and discussion.
 * If you don't have an IRC client like Colloquy or pidgin, the Chatzilla add-on for Firefox is handy: https://addons.mozilla.org/en-US/firefox/addon/chatzilla/. Type "/server freenode" and "/join #mediawiki" to get started.


 * Procedures

For an explanation of Exploratory Testing, see http://en.wikipedia.org/wiki/Exploratory_testing and http://en.wikipedia.org/wiki/Session-based_test


 * For tracking purposes, use "AFT " when appropriate when creating data.


 * Some general testing charters:
 * Create feedback
 * Use unusual characters, capitalization, punctuation, etc.
 * Display feedback
 * Check links on page
 * Check 'Show more..'
 * Check display of long text, unusual characters, etc.


 * Workflow
 * Check paths through AFT features, back button, etc.
 * Check ultimate ability to edit Wikipedia


 * Negative tests
 * Check that AFT does *not* appear where it should not: User pages, Talk pages, Main Page, Featured, etc.


 * Some specific areas of interest for testing:


 * As a reader, consider testing in these areas:
 * use filters to find helpful or featured feedback
 * use sort tools to sort the lists by relevance, date, etc.
 * look for inappropriate feedback and flag it as abuse
 * look for useful feedback and mark it as helpful
 * check to see that the filter counters match the number of list items


 * If you are an Editor consider testing in these areas:
 * feature an exceptional post
 * if you see a featured post that has been addressed, mark as resolved
 * check the permalink page to confirm that the relevance and helpfulness scores work


 * Reporting issues:


 * When creating a bugzilla ticket, make the title "OH-AFT " for help in triage later (Bugzilla: https://bugzilla.wikimedia.org/)
 * Product: MediaWiki extensions
 * Component: 'ArticleFeedbackv5'
 * Keywords: 'aftv5-1.5'
 * Discuss issues in IRC channel freenode#mediawiki
 * optional: Edit http://www.mediawiki.org/wiki/User_talk:Cmcmahon with description of the issue
 * optional: Email cmcmahon at wikimedia dot org


 * Technical Resources
 * Exploratory Testing heuristics cheat sheet (PDF): http://testobsessed.com/wp-content/uploads/2011/04/testheuristicscheatsheetv1.pdf
 * Help/FAQ: http://en.wikipedia.org/wiki/Wikipedia:Article_Feedback/Help
 * for Article Feedback: http://www.mediawiki.org/wiki/Article_feedback/Version_5
 * for new editors of Wikipedia: http://en.wikipedia.org/wiki/Wikipedia:Teahouse