Quality Assurance/Status 2012-2014

Last update on: 2012-03-19

2012-03-19


Vision: Create a a rational, valuable, integrated QA/test process based on risk and requirements. Use labs cluster wikis for world-shareable feature testing both manual/exploratory and via automated UI testing. Use existing shared Windows VMs on WMF VPN for WMF-shareable cross-browser testing, both manual/exploratory and via automated UI testing.

TL;DR:
 * much is waiting on the git migration
 * would very much like to have labs' "beta" project run on mediawiki-core "master" branch (or a specific branch). That is automatically updated by Jenkins to the latest revision that passes unit tests. Chris is working with Antoine on this (see also Thread:Talk:Continuous integration/also deploy from Jenkins to beta cluster? -Cmcmahon (talk) 14:58, 19 March 2012‎

I only have access to 1 (ie7) of 6 WMF VMs (ie6, ie7X2, ie8, ie9, ubuntu). working with Andrew on this

MediaWiki core/Wikimedia deployment testing


 * pending: git migration
 * pending: automated updates to labs cluster (preferably via Jenkins)
 * pending: 1.20 branch
 * status: Antoine on board with Jenkins aspect

Editor Engagement story acceptance testing
 * status: first pass: Chris to spend approximately 20% of available time helping with creating acceptance criteria for particular stories early on, and testing/checking particular stories when they are ready for test.  Ian and team to discuss Chris' role further in retrospective Mar 20.

AFT test services
 * status: improve communication with OmniTI and stakeholders

TimedMediaHandling testing pending: swift upgrade to labs cluster

Mobile testing
 * status: Tomasz filling current RFP for Mobile tester, Chris to support that role

Documentation improvement (installation, etc.)
 * status: ongoing

UI Test automation
 * pending: git migration
 * pending: access to all WMF Windows VMs (ongoing conversation with Andrew)
 * status: attending Test Automation Bazaar conference to discuss potential architectures with other experts

QA hiring strategy
 * status: ongoing discussion with Rob

Localization/i18n testing
 * status: asked for conversation with Alolita to discuss specific testing activities/requirements

Involve global testing community
 * pending: automated updates to labs cluster
 * pending: publicly available UI test automation

