Selenium/Ruby/Workshops/WTA ACUX Test Plan Apr 6

Weekend Testing Americas Apr 6 2013 Test Plan
WTA April 6 2013 Test Plan

Objectives

 * Test Account Creation User Experience
 * Test Login User Experience
 * General Exploratory Testing in various browsers

Platforms/Browsers of Interest

 * IE7 and IE8/IE9 in "compatibility mode"
 * IE8
 * IE9
 * IE10
 * Firefox with and without "HTTPS-Everywhere" extension
 * Chrome
 * All browsers with and without "privacy/incognito" mode set
 * Also of interest: earlier versions of Firefox; Opera; also Safari

Test Environments

 * http://piramido.wmflabs.org/wiki/Special:UserLogin?useAgora=1
 * http://toro.wmflabs.org/wiki/Special:UserLogin?useAgora=1
 * also try targets for returnto e.g. http://toro.wmflabs.org/w/index.php?title=Special:UserLogin&returnto=Main+Page&useAgora=1


 * Compare to existing login/account creation experience at http://test2.wikipedia.org/w/index.php?title=Special:UserLogin

Setup

 * Be prepared to clear cache and appropriate cookies in browsers used for testing
 * Be prepared to use incognito/private mode in browsers used for testing
 * Create an account in Bugzilla https://bugzilla.wikimedia.org/ if you don't already have one
 * This is not strictly required, but recommended strongly for reporting issues

Test Charters and Features to be Tested

 * Account Creation: manually append   to all URLs used for testing
 * Navigate to Account Creation page:
 * Use the link in the top right menu
 * Visit from Special:Search
 * Visit from the Main Page
 * Visit from a random content page
 * Visit from other namespaces like User: or Special:
 * Create account after invoking editor as anonymous user
 * New User login: manually append   to all URLs used for testing
 * Navigate to Login page:
 * Use the link in the top right menu
 * Visit from Special:Search
 * Visit from the Main Page
 * Visit from a random content page
 * Visit from other namespaces like User: or Special:
 * Login after invoking editor as anonymous user
 * Behavior when cookies and cache are possibly polluted
 * Features documented in https://gerrit.wikimedia.org/r/#/c/55847 and https://bugzilla.wikimedia.org/show_bug.cgi?id=44628 (note the discussion on both issues)
 * Displays a "secure login" link if HTTPS is available.
 * Loads additional CSS for its form features (e.g. more attractive errorbox, "Join wiki" messaging).
 * Defines new "userlogin-xx" messages; many are the same as existing messages but without ':' on the end.
 * Uses a distinct title for Login instead of generic "Log in / Create account".
 * Outputs checkboxes using UserloginTemplateAgora::labelledCheck
 * Removes the [mailmypassword] code branch from its login template as it is never executed.

Out of scope

 * Mobile browsers
 * Tablet browsers that default to the desktop view and support javascript are in scope.

Recommended Procedures

 * A secondary goal of this exercise is to improve the actual Wikipedia articles about software testing as a new user would.
 * As a software tester and a new Wikipedia editor, I want to improve the Wikipedia articles on software testing so that others may benefit from my knowledge
 * Some example pages to edit:
 * http://en.wikipedia.org/wiki/Software_testing
 * http://en.wikipedia.org/wiki/Black-box_testing
 * http://en.wikipedia.org/wiki/Exploratory_testing
 * http://en.wikipedia.org/wiki/Session-based_test


 * Note: edits from this exercise will likely incur feedback and criticism, just as any edits from new users would. Significant support for new editors of Wikipedia is available at The Teahouse.  http://en.wikipedia.org/wiki/Wikipedia:Teahouse

Background and related information

 * Documentation and design information: https://www.mediawiki.org/wiki/Account_creation_user_experience


 * Note: We will be using information gathered from this exercise to inform our next community browser testing event, writing Cucumber scenarios for these features.  Feel free to join us! http://www.mediawiki.org/wiki/QA/Weekly_goals


 * Features testing at Wikipedia: http://www.mediawiki.org/wiki/QA/Features_testing


 * Features testing group for interested people: http://www.mediawiki.org/wiki/Groups/Proposals/Features_testing


 * Ongoing questions and support in the IRC channel on Freenode: look for users ,.

Reporting issues

 * Use this link to file a report in Bugzilla https://bugzilla.wikimedia.org/enter_bug.cgi?product=MediaWiki&component=User%20login
 * Product: MediaWiki
 * Component: User login
 * When creating a bugzilla ticket, make the title "WTA " for help in triage later
 * Discuss issues in WTA Skype channel and/or IRC channel freenode#wikimedia-dev