Quality Assurance/Status 2012-2014

Last update on: 2012-04-17

2012-04-17


Vision: Create a a rational, valuable, integrated QA/test process based on risk and requirements. Use labs cluster wikis for world-shareable feature testing both manual/exploratory and via automated UI testing. Use existing shared Windows VMs on WMF VPN for WMF-shareable cross-browser testing, both manual/exploratory and via automated UI testing.

Ongoing projects:

MediaWiki core/Wikimedia deployment testing

 * Status: 1.20wmf1 deployed to mediawiki/commons
 * Test charters in place in and in use
 * One stranger volunteer tester from IRC!
 * May 5 strategy for Weekend Testing Americas in place, under review

TimedMediaHandling testing

 * Status: labs commons is provisioned and testing underway. Reported https://bugzilla.wikimedia.org/show_bug.cgi?id=35698
 * Brought Tauhida up to speed on current TMH/Labs Commons status, need to follow up with her.

Mobile testing

 * Status: Chris shadowed Yuvi and Tomasz April 6 (after slight delay) to see community mobile testing in action firsthand.
 * Chris helped test Wiktionary nightly build, found some issues.

Documentation improvement (installation, etc.)

 * Status: updated installation docs on Mediawiki for missing dependency php5-mysql

AFT test services

 * Status: augmenting AFTv5 testing projects as required

UI Test automation

 * -Status: attended Test Automation Bazaar for feedback from experts-
 * -Status: created prototype selenium-webdriver test project on github, soliciting comments-
 * -Status: presented prototype to Rob, Antoine, Tomasz, Ian for feedback-
 * -Pending: refinements to prototype and call for comments on wikitech-l-
 * Pending: proof of concept to run selenium tests on remote (Windows) hosts via Jenkins
 * Pending: conference in March then going to SF to work out details of test environment.

Editor Engagement story acceptance testing

 * Status: at Ian and EE team's discretion, will help with creating acceptance criteria for particular stories early on, and testing/checking particular stories when they are ready for test.

QA hiring strategy

 * status: ongoing discussion with Rob, Erik

Localization/i18n testing

 * status: asked for conversation with Alolita and/or Siebrand to discuss specific testing activities/requirements

Involve global testing community

 * Pending: more improvements to labs cluster, including automated deployment of latest version via Jenkins
 * Pending: publicly available UI test automation
 * Pending: reviewing test case tool from Mozilla with Erik



2012-04-17
Attended Test Automation Bazaar Mar 23/24, returned with ideas for browser testing