Selenium/Ruby/Workshops/WTA ACUX Test Plan Apr 6

ping weekendtestersamericas on skype to join

Test plan for Weekend Testing Americas session on the new Account creation user experience: Saturday, April 6, 2013 5pm UTC - 1pm EDT - 10am PDT.

Weekend Testing Americas is a group of volunteers who are also very experienced software QA testers. We're going to be hunting for bugs in the new design of login and account creation on a testing environment setup in Wikimedia Labs.

The next step, after that testing and any relevant bug fixing, is to enable the new look on an opt-in basis via a URL parameter, across the Wikimedia projects, including Wikipedia. This will mean that editors will have the opportunity to test the new design on their home wiki and ensure there are no further bugs or problems with the localization, before we enable the changes as defaults.

This activity is also part of Wikimedia's QA weekly goals. You are invited to our upcoming activities!



Objectives

 * Test the new Account creation user experience.
 * Test the new Login user experience.
 * General exploratory testing in various browsers

Platforms/Browsers of Interest

 * IE7 and IE8/IE9 in "compatibility mode"
 * IE8
 * IE9
 * IE10
 * Firefox with and without "HTTPS-Everywhere" extension
 * Chrome
 * All browsers with and without "privacy/incognito" mode set
 * Also of interest: earlier versions of Firefox; Opera; also Safari

Test environments
All the work will be done in testing environments. You can experiment at will.


 * Default environment: http://toro.wmflabs.org/wiki/Special:UserLogin?useAgora=1
 * Fallback: http://piramido.wmflabs.org/wiki/Special:UserLogin?useAgora=1
 * also try targets for returnto e.g. http://toro.wmflabs.org/w/index.php?title=Special:UserLogin&returnto=Main+Page&useAgora=1


 * Compare to existing login/account creation experience at http://test2.wikipedia.org/w/index.php?title=Special:UserLogin

Setup

 * Be prepared to clear cache and appropriate cookies in browsers used for testing
 * Be prepared to use incognito/private mode in browsers used for testing
 * Create an account in Bugzilla https://bugzilla.wikimedia.org/ if you don't already have one
 * This is not strictly required, but recommended strongly for reporting issues

Test Charters and Features to be Tested
In essence we are testing the new Login/Account Creation experience at http://toro.wmflabs.org/wiki/Special:UserLogin?useAgora=1 against the old experience at http://toro.wmflabs.org/wiki/Special:UserLogin


 * Account Creation: manually append   to all URLs used for testing
 * Navigate to Account Creation page:
 * Use the link in the top right menu
 * Visit from Special:Search
 * Visit from the Main Page
 * Visit from a random content page
 * Visit from other namespaces like User: or Special:
 * Create account after invoking editor as anonymous user
 * New User login: manually append   to all URLs used for testing
 * Navigate to Login page:
 * Use the link in the top right menu
 * Visit from Special:Search
 * Visit from the Main Page
 * Visit from a random content page
 * Visit from other namespaces like User: or Special:
 * Login after invoking editor as anonymous user
 * Behavior when cookies and cache are possibly polluted
 * Features documented in https://gerrit.wikimedia.org/r/#/c/55847 and https://bugzilla.wikimedia.org/show_bug.cgi?id=44628 (note the discussion on both issues)
 * Displays a "secure login" link if HTTPS is available.
 * Loads additional CSS for its form features (e.g. more attractive errorbox, "Join wiki" messaging).
 * Defines new "userlogin-xx" messages; many are the same as existing messages but without ':' on the end.
 * Uses a distinct title for Login instead of generic "Log in / Create account".
 * Outputs checkboxes using UserloginTemplateAgora::labelledCheck
 * Removes the [mailmypassword] code branch from its login template as it is never executed.

Out of scope

 * Mobile browsers
 * Tablet browsers that default to the desktop view and support javascript are in scope.

Recommended Procedures

 * A secondary goal of this exercise is to improve the actual Wikipedia articles about software testing as a new user would.
 * As a software tester and a new Wikipedia editor, I want to improve the Wikipedia articles on software testing so that others may benefit from my knowledge
 * Some example pages to edit:
 * http://en.wikipedia.org/wiki/Software_testing
 * http://en.wikipedia.org/wiki/Black-box_testing
 * http://en.wikipedia.org/wiki/Exploratory_testing
 * http://en.wikipedia.org/wiki/Session-based_test


 * Note: edits from this exercise will likely incur feedback and criticism, just as any edits from new users would. Significant support for new editors of Wikipedia is available at The Teahouse.  http://en.wikipedia.org/wiki/Wikipedia:Teahouse

Background and related information

 * Documentation and design information: https://www.mediawiki.org/wiki/Account_creation_user_experience


 * Note: We will be using information gathered from this exercise to inform our next community browser testing event, writing Cucumber scenarios for these features.  Feel free to join us! http://www.mediawiki.org/wiki/QA/Weekly_goals


 * Features testing at Wikipedia: http://www.mediawiki.org/wiki/QA/Features_testing


 * Features testing group for interested people: http://www.mediawiki.org/wiki/Groups/Proposals/Features_testing


 * Ongoing questions and support in the IRC channel on Freenode: look for users ,.

Reporting issues

 * Use this link to file a report in Bugzilla []
 * Product: MediaWiki
 * Component: User login
 * When creating a bugzilla ticket, make the title "WTA " for help in triage later
 * Discuss issues in WTA Skype channel and/or IRC channel freenode#wikimedia-dev

Evaluation

 * PENDING. For an example, see QA/Browser testing/Search features.

★★★☆☆


 * Summary:
 * Results:
 * Participation: WMF? Wikimedia? Other?
 * New:
 * Repeating:
 * Mood:
 * Documentation:
 * Promotion:
 * Developer team:
 * Organizers:
 * Lessons learned: