Selenium/Ruby/Workshops/WTA Test Plan

Weekend Testing Americas May 5 Test Plan
WTA May 5 Test Plan


 * Objectives


 * Test MediaWiki version 1.20wmf02 using version 1.20wmf01 as an oracle
 * Regression testing for 1.20wmf01
 * General Exploratory Testing in various browsers


 * Platforms/Browsers of Interest


 * IE7 and IE8/IE9 in "compatibility mode"
 * IE8
 * IE9
 * IE10
 * Firefox with and without "HTTPS-Everywhere" extension
 * Chrome
 * All browsers with and without "privacy/incognito" mode set


 * Test Environments (Note: we are testing in production environments, please be respectful, see Recommended Procedures below)


 * 1.20wmf01: All Wikipedia sites, e.g. http://en.wikipedia.org/
 * 1.20wmf02: All non-Wikipedia sites (Wiktionary, Wikisource, Wikinews, Wikibooks, Wikiquote, Wikiversity, and other sites)
 * http://en.wikisource.org/ is of interest because ProofreadPage has many moving parts. A ProofreadPage sandbox is available here: http://en.wikisource.org/wiki/Page:The_book_of_try_and_learn.djvu/1
 * http://commons.wikimedia.org/ is also of interest, particularly http://commons.wikimedia.org/wiki/Special:UploadWizard. Again, please be respectful when uploading files.


 * Setup


 * Create a global account on any wiki and login. This is not required, but it makes several things easier:
 * Any edits to pages preserves the identity of the editor. This is of particular interest for the Sandbox page
 * Provides a User_talk page, which is a good place to do testing
 * Allows persistent setting of various user preferences relevant to testing


 * Create an account in Bugzilla https://bugzilla.wikimedia.org/
 * This is also not strictly required, but recommended strongly for reporting issues


 * Test Charters and Features to be Tested


 * Top priorities for 1.20wmf02 testing:
 * Editing
 * ProofreadPage
 * UploadWizard


 * 1.20wmf02 test charters: http://www.mediawiki.org/wiki/Mediawiki_1.20wmf2_Feature_Test_Charters
 * 1.20wmf02 Features: http://www.mediawiki.org/wiki/MediaWiki_1.20/wmf2


 * 1.20wmf01 test charters: http://www.mediawiki.org/wiki/Mediawiki_1.20_Feature_Test_Charters
 * 1.20wmf01 Features: http://www.mediawiki.org/wiki/MediaWiki_1.20/wmf1/overview
 * 1.20wmf01 Release Notes: https://gerrit.wikimedia.org/r/gitweb?p=mediawiki/core.git;a=blob;f=RELEASE-NOTES-1.20;h=0e8cdc09e6163154a6182e301a37aebdb244cc41;hb=refs/heads/master


 * Recommended Procedures


 * New feature testing


 * Choose a test charter or feature from the 1.20wmf02 list
 * Perform ET for that charter or feature on a non-Wikipedia site
 * Optional follow up: Do ET for similar actions on a Wikipedia site with 1.20wmf01 installed


 * Regression testing


 * Choose a test charter from 1.20wmf01 list
 * Investigate both Wikipedia and non-Wikipedia sites for proper function of that feature


 * Note: if you are unsure of what version of MediaWiki is installed in your environment, most wikis have the page Special:Version in place, for example http://en.wikipedia.org/wiki/Special:Version


 * Note: instructions to use Sandbox pages are here: http://en.wikipedia.org/wiki/Wikipedia:Sandbox . An example of a User talk page is here: http://en.wikipedia.org/wiki/User_talk:Cmcmahon


 * Reporting issues


 * When creating a bugzilla ticket, make the title "WTA " for help in triage later
 * Discuss issues in WTA Skype channel and/or IRC channel freenode#wikimedia-dev
 * optional: Edit http://www.mediawiki.org/wiki/User_talk:Cmcmahon with description of the issue
 * optional: Email cmcmahon at wikimedia dot org