Quality Assurance/Status 2012-2014

Last update on: 2012-04-17

2012-04-23


Vision: Create a a rational, valuable, integrated QA/test process based on risk and requirements. Use labs cluster wikis for world-shareable feature testing both manual/exploratory and via automated UI testing. Use existing shared Windows VMs on WMF VPN for WMF-shareable cross-browser testing, both manual/exploratory and via automated UI testing.

Ongoing projects:

MediaWiki core/Wikimedia deployment testing

 * Status: 1.20wmf1 deployment ongoing
 * Test charters in place in and in use
 * May 5 Test Plan for Weekend Testing Americas in place, under review, nearly final

TimedMediaHandling testing

 * Status: labs commons fairly well broken as of Apr. 21. Current status: https://bugzilla.wikimedia.org/show_bug.cgi?id=36135
 * Skyped with Tauhida about activities and priorities for TMH testing

Mobile testing

 * Recruited a just-in-time tester for iOS5.1 scrolling issue

Documentation improvement (installation, etc.)

 * Weekend Testing Test Plan is now thorough
 * QA Engineer hiring doc is essentially complete, awaiting review

AFT test services

 * Status: augmenting AFTv5 testing projects as required

UI Test automation

 * Tentative approval to keep going from wikitech-l. Foresee clash with Ubuntu maintenance, but will find workarounds
 * Began creating valuable/non-trivial test for wikisource ProofreadPage features, working with page-object community on enhancements.
 * Pending: proof of concept to run selenium tests on remote (Windows) hosts via Jenkins
 * Pending: conference in March then going to SF to work out details of test environment. Antoine has begun joining Petr in beta labs maintenance.

Editor Engagement story acceptance testing

 * Status: at Ian and EE team's discretion, will help with creating acceptance criteria for particular stories early on, and testing/checking particular stories when they are ready for test.

QA hiring strategy

 * status: Job ad awaiting final review and release date.

Localization/i18n testing

 * status: asked for conversation with Alolita and/or Siebrand to discuss specific testing activities/requirements

Involve global testing community

 * Pending: more improvements to labs cluster, including automated deployment of latest version via Jenkins
 * Pending: publicly available UI test automation
 * Pending: reviewing test case tool from Mozilla with Erik



2012-04-17
Attended Test Automation Bazaar Mar 23/24, returned with ideas for browser testing