Quality Assurance/Status 2012-2014

Last update on: 2012-04-23

2012-04-30


Vision: Create a a rational, valuable, integrated QA/test process based on risk and requirements. Use labs cluster wikis for world-shareable feature testing both manual/exploratory and via automated UI testing. Use existing shared Windows VMs on WMF VPN for WMF-shareable cross-browser testing, both manual/exploratory and via automated UI testing.

Ongoing projects:

MediaWiki core/Wikimedia deployment testing

 * Status: 1.20wmf1 deployment complete
 * Waiting for 1.20wmf2 branch Apr 30 to complete test plans for immediate work and for Weekend Testing community testing project May 5
 * Test charters in place in and in use

TimedMediaHandling testing

 * Status: labs commons fairly well broken as of Apr. 21. Current status: 36135 Maintenance ongoing.
 * Skyped with Tauhida about activities and priorities for TMH testing

Mobile testing

 * Recruited a just-in-time tester for iOS5.1 scrolling issue

Documentation improvement (installation, etc.)

 * Weekend Testing Test Plan is now thorough
 * QA Engineer hiring doc is complete, awaiting deployment

AFT test services

 * Status: augmenting AFTv5 testing projects as required
 * Possible community testing project for AFT early June

UI Test automation

 * Tentative approval to keep going from wikitech-l. Foresee clash with Ubuntu maintenance, but will find workarounds
 * Began creating valuable/non-trivial test for wikisource ProofreadPage features
 * Pending: proof of concept to run selenium tests on remote (Windows) hosts via Jenkins
 * Pending: conference in May then going to SF to work out details of test environment. Antoine has begun joining Petr in beta labs maintenance.

Editor Engagement story acceptance testing

 * Status: at Ian and EE team's discretion, will help with creating acceptance criteria for particular stories early on, and testing/checking particular stories when they are ready for test.

QA hiring strategy

 * status: Job ad awaiting deployment

Localization/i18n testing

 * status: asked for conversation with Alolita and/or Siebrand to discuss specific testing activities/requirements

Involve global testing community

 * Pending: more improvements to labs cluster, including automated deployment of latest version via Jenkins
 * Pending: publicly available UI test automation
 * Pending: reviewing test case tool from Mozilla with Erik



2012-04-17
Attended Test Automation Bazaar Mar 23/24, returned with ideas for browser testing