Quality Assurance/Status 2012-2014

Last update on: 2012-03-19

2012-04-04


Vision: Create a a rational, valuable, integrated QA/test process based on risk and requirements. Use labs cluster wikis for world-shareable feature testing both manual/exploratory and via automated UI testing. Use existing shared Windows VMs on WMF VPN for WMF-shareable cross-browser testing, both manual/exploratory and via automated UI testing.

Ongoing projects:

MediaWiki core/Wikimedia deployment testing

 * Status: preparing for 1.20 deployment

TimedMediaHandling testing

 * Status: labs commons is provisioned and testing underway. Reported https://bugzilla.wikimedia.org/show_bug.cgi?id=35698

Mobile testing

 * Status: Chris to shadow Yuvi and Tomasz April 6 to see community mobile testing in action firsthand.

Documentation improvement (installation, etc.)

 * Status: updated installation docs on Mediawiki for missing dependency php5-mysql

AFT test services

 * Status: augmenting AFTv5 testing projects as required

UI Test automation

 * Status: attended Test Automation Bazaar for feedback from experts
 * Status: created prototype selenium-webdriver test project on github, soliciting comments
 * Status: presented prototype to Rob, Antoine, Tomasz, Ian for feedback
 * Pending: refinements to prototype and call for comments on wikitech-l
 * Pending: proof of concept to run selenium tests on remote (Windows) hosts via Jenkins

Editor Engagement story acceptance testing

 * Status: at Ian and EE team's discretion, will help with creating acceptance criteria for particular stories early on, and testing/checking particular stories when they are ready for test.

QA hiring strategy

 * status: ongoing discussion with Rob, Erik

Localization/i18n testing

 * status: asked for conversation with Alolita and/or Siebrand to discuss specific testing activities/requirements

Involve global testing community

 * Pending: more improvements to labs cluster, including automated deployment of latest version via Jenkins
 * Pending: publicly available UI test automation
 * Pending: reviewing test case tool from Mozilla with Erik



2012-03-26
Attended Test Automation Bazaar Mar 23/24, returned with ideas for browser testing