Wikimedia Quality and Test Engineering Team/Office Hours/2022

2022-11-07
Attendees: Dom, Elena

Topics:
 * Good test data for testing diffs?

2022-10-31
Attendees: Zeljko, Dom, Stef, Elena, George, Vaughn

Testing Computer Software by Kaner et al meeting

2022-10-24
Attendees: Elena, Vaughn - (Vaughn time-zone testing ( an insightful dissertation - https://phabricator.wikimedia.org/T316688#8336443 ) - (Elena) wikifunctions testing for (Abstract Wikipedia) - https://wikifunctions.beta.wmflabs.org/wiki/Special:CreateZObject?view=zobject-editor

2022-10-17
Attendees: Elena, Dom, George, Zeljko, Vaughn


 * https://www.mediawiki.org/wiki/Extension:FileImporter
 * https://phabricator.wikimedia.org/diffusion/
 * https://doc.wikimedia.org/cover-extensions/GrowthExperiments/includes/index.html
 * https://gerrit.wikimedia.org/r/c/mediawiki/core/+/842391/
 * https://gerrit.wikimedia.org/g/fresh

2022-10-10
Attendees: Jackeline, Zeljko, Dom, Peter, Vaughn


 * https://phabricator.wikimedia.org/T318599 Developers/Maintainers graph automation

2022-10-03
Attendees: Dom, George, Zeljko, Peter, Vaughn

2022-09-26
Attendees: Zeljko, Dom, Elena Topics: - Book Club (Monthly on the last Monday) - We are reading Testing Computer Software (Cem Kaner, Jack Falk, Hung Q. Nguyen) - https://phabricator.wikimedia.org/T311842

2022-09-19
Attendees: George, Zeljko, Vaughn

2022-09-12
Attendees: Elena, George, Zeljko, Vaughn

2022-09-05
Attendees: Dom, Zeljko, Vaughn Topics: * New watercooler? * Thursday at around 1400UTC * Selenium on test2wiki * Need to get a test user setup (Dom will try to sort that out) * Discuss with k8s team about running when they deploy * Support for George while Dom is away * It would be useful to get his local docker environment working (he is on Windows) * Book Club * Discussed new times to hold the meeting

2022-08-29
Attendees: Elena, George, Vaughn, Željko Topics: - Book Club (Monthly on the last Monday) - We are reading Testing Computer Software (Cem Kaner, Jack Falk, Hung Q. Nguyen) - https://phabricator.wikimedia.org/T311842

2022-08-22
Attendees: Dom, Elena, Zeljko, George Topics:
 * Getting Selenium and API tests running on test2wiki (for the test2wiki k8s migration project)
 * VisualEditor watchlist accessibility - use-case for accessibility playbook (the accessibility playbook link is here, in case people did not see it: https://docs.google.com/document/d/1QUw-ClLIDxzY3ShDHMGuewn7NR4Z3a4pP2XlUhitr0g/edit)
 * I wrote it up, see: https://docs.google.com/document/d/1QUw-ClLIDxzY3ShDHMGuewn7NR4Z3a4pP2XlUhitr0g/edit#heading=h.e9cd5glhzv6p

2022-08-15
Attendees: Elena, Dom - (ET) QA Abstract Wikipedia Testing Playbook https://docs.google.com/document/d/1mtOoJ0pyYxnDAUiLzkEGfoMguLAmFXa3Z0VW2UK0DS4/edit#heading=h.ldf8bwrxezwh - Prototype for testing thumbor: https://gitlab.wikimedia.org/dwalden/thumbor-testing/-/blob/main/comparison_prototype.sh

2022-08-08
Attendees: Dom, Elena, Vaughn

2022-08-01
Attendees: Dom, Elena

2022-07-25
Attendees: Dom

2022-07-18
Attendees: Elena, Dom, Vaughn


 * ET: mediawiki update on docker
 * Do the "git pull", etc. to update the repositories
 * docker-compose up -d && docker-compose exec mediawiki composer update && docker-compose exec mediawiki php maintenance/update.php --quick

2022-06-27
Attendees: Dom, Elena, Zeljko, Vaughn, Derrick


 * Presentation on OWASP ZAP (if people still want this)
 * https://survey.stackoverflow.co/2022

2022-06-13
Attendees: Dom, Željko


 * How do I run logstash locally?

2022-06-06
Attendees: Elena, Dom, Zeljko, Vaughn, Peter, Derrick


 * BackstopJS Report
 * https://pixel.wmcloud.org/desktop/index.html
 * https://github.com/nicholasray/pixel
 * [betalabs] Non-responsive sticky header appears on Special and Talk pages https://phabricator.wikimedia.org/T309370
 * [GOAL] Leverage Automated Visual Regression Testing https://phabricator.wikimedia.org/T302246
 * How to setup a wiki farm with CentralAuth locally

2022-05-23
Attendees: Dom, Elena, Zeljko, Vaughn, Peter


 * Draft: Crowd-sourced list of proposed engineering priorities in Wikimedia Foundation engineering https://docs.google.com/document/d/1XY291UC-PJbUWHUEG_lVKM3-lIaT_x2U1bwE4Mr8-s0/edit#
 * https://versions.toolforge.org/
 * Beta Cluster’s Future https://docs.google.com/document/d/10JwPxx-6AUgLZ46LTCZvLOl4faPAtxrnEI5ZxnsVQ14/edit?usp=sharing
 * ET: QA handoff? - thx, Vaughn!
 * Please complete your respective team's readiness review for k8s migration https://www.mediawiki.org/wiki/User:DWalden_(WMF)/Test2wiki_k8s_migration#Team_testing_readiness (you should have a slack message from me, if not, you can ignore this)
 * Professional development https://office.wikimedia.org/wiki/Staff_handbook/Benefits#Growth

2022-05-16

 * https://phabricator.wikimedia.org/T302246 - QTE involvment?

2022-05-09
Attendees: Zeljko, Dom, Elena, Vaughn, Peter Topics:
 * Intro to Mediawiki Testing for Ghana Technical Community
 * only automation testing?
 * do we have some ready to do QA tasks to give Ghana Technical Community to work on?
 * Selenium Tests for VisualEditor https://phabricator.wikimedia.org/T296187
 * https://www.mediawiki.org/wiki/Technical_contributor_onboarding
 * Introductions (new people)
 * Meetings (advice to new people)

2022-05-02
Attendees: Jackeline, Elena, Vaughn, Ezekiel, Željko Topics:
 * Accessibility

2022-04-11
Attendees: Dom, Elena, Zeljko, Vaughn, Derrick, Esther, Jackeline

Topics:
 * QTE pairing https://phabricator.wikimedia.org/T300290
 * Explore It! https://phabricator.wikimedia.org/T301379


 * local development environment
 * https://www.mediawiki.org/wiki/MediaWiki-Docker
 * https://www.mediawiki.org/wiki/Cli
 * https://www.mediawiki.org/wiki/MediaWiki-Vagrant


 * shared testing environment
 * https://www.mediawiki.org/wiki/Beta_Cluster
 * https://patchdemo.wmflabs.org/
 * https://github.com/MatmaRex/patchdemo

2022-04-04
Attendees: Elena, Dom, Željko

Topics:
 * Data³ https://www.mediawiki.org/wiki/Data%C2%B3
 * a good overview of Selenium tests by extension:  https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php72-docker/143365/console with the performance checks.
 * I experimented with a "low-tech test dashboard" (from Lessons Learned) for IPInfo testwiki deployment testing https://www.mediawiki.org/wiki/User:DWalden_(WMF)/IPInfo/Testwiki_Deployment_Testing_Matrix
 * Book club https://phabricator.wikimedia.org/T247665
 * Selecting the next book https://app.slack.com/client/T024KLHS4/C01935QKL3S/thread/C01935QKL3S-1648564519.851039
 * Should we open it for the entire wmf?
 * Office hours
 * Should we open it for the entire wmf?
 * Any feedback on QTE pairing? https://phabricator.wikimedia.org/T300290

2022-03-28
Attendees: Željko, Dom, Ezekiel, Derrick, Jackeline

Topics:
 * Vagrant: this has been "replaced" by MediaWiki Docker so if there is a problem with following the Get Started guide (https://www.mediawiki.org/wiki/MediaWiki-Vagrant), skip it.


 * Ezekiel has come across a few pages on Media Wiki with links to other pages and was wondering why they do not open up in a new browser tab by default.


 * Explore It https://phabricator.wikimedia.org/T301379
 * QTE reading club https://phabricator.wikimedia.org/T247665
 * QTE pairing https://phabricator.wikimedia.org/T300290
 * Investigate why Selenium tests are being skipped and get delete page tests running on Beta https://phabricator.wikimedia.org/T303737
 * Switch to spec reporter https://phabricator.wikimedia.org/T280331

2022-03-21
Attendees: Elena, Dom, Esther, Zeljko, Emeka Topics: ET: SonarClouds provides coverage for unit testing? - https://doc.wikimedia.org/cover/ - https://sonarcloud.io/organizations/wmftest/projects ET: Test documentation? https://www.mediawiki.org/wiki/User:Etonkovidova/GrowthExperiments

2022-03-14
Attendees: Elena, Dom, Zeljko Topics: Elena: - https://github.com/wikimedia/operations-mediawiki-config/blob/master/wmf-config/InitialiseSettings.php - the automation tests were (are) run on test2wiki? 'qa_automation' => [ // For browser tests, T60375 and T63799

2022-03-07
Attendees: Dom, Elena Topics: Dom:
 * Should we increase Selenium testing coverage?
 * e.g. testing deleting pages, looking at revision history
 * catch bugs like https://phabricator.wikimedia.org/T303033, https://phabricator.wikimedia.org/T302887
 * Or, would it be better via API tests?
 * Do we have tools for reliability testing?
 * E.g. to simulate multiple users performing the same action at the same time (to catch race-conditions, etc.)
 * I wrote my own using python multiprocessing module (https://docs.python.org/3/library/multiprocessing.html ), but not sure if such a thing already exists - https://gitlab.wikimedia.org/dwalden/misc/-/blob/main/delete_page_concurrent.py
 * Beta has been unreliable the last few days - https://phabricator.wikimedia.org/T302699

2022-02-28
Attendees: Dom, Elena, Željko
 * Elena: https://phabricator.wikimedia.org/T302489 - the discussion/evaluation of Cypress testing framework for Lang team

2022-02-21
Attendies: Elena, Željko, Dom


 * Dom
 * adding this meeting (office hours) to the staff calendar: https://office.wikimedia.org/wiki/ITS/Calendars


 * Željko
 * T301379 Explore It! -- Reduce Risk and Increase Confidence with Exploratory Testing
 * T300290 QTE pairing
 * T301697 Investigate synthetic testing
 * T280652 Delete tests disabled for more than 1 year


 * Elena
 * Best Practices Playbook

2022-02-14
Attendies: Elena, Dom, Ima, Željko


 * ET: can we take a look at https://phabricator.wikimedia.org/T301463 ?
 * ET: I was really impressed with Chapter 5: Automating Testing (Lessons learned). Especially Lesson 113: "Capture replay fails" - I did not know that the ability to compare the screenshots taken at the certain checkpoints (without programmin) existed 20 years ago.


 * QTE pairing https://phabricator.wikimedia.org/T300290

2022-02-07
Attendees: Elena, Dom, Zeljko


 * QTE pairing https://phabricator.wikimedia.org/T300290
 * QTE reading club https://phabricator.wikimedia.org/T247665

2022-01-31
Attendees: Dom, Zeljko, Osama


 * Book club today! Lessons Learned in Software Testing https://phabricator.wikimedia.org/T293880

2022-01-24
Attendees: Elena, Dom, Zeljko, Osama

Dom:
 * https://en.wikipedia.org/wiki/Responsibility_assignment_matrix
 * Please add your lessons learned to https://www.mediawiki.org/wiki/Wikimedia_Quality_and_Test_Engineering_Team/Lessons_learned_testing_MediaWiki_and_associated_software
 * Any mistakes you have made and learned from, or anything you just think is good advice

2022-01-17
Attendees: Dom, Zeljko, Osama

Dom: Osama
 * Please add your lessons learned to https://www.mediawiki.org/wiki/Wikimedia_Quality_and_Test_Engineering_Team/Lessons_learned_testing_MediaWiki_and_associated_software
 * Any mistakes you have made and learned from, or anything you just think is good advice
 * https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Echo/+/754115
 * https://phabricator.wikimedia.org/T274579

2022-01-10
Attendees: Dom, Esther, Zeljko, Osama, Soham


 * Selenium Tests failing for CLI on Mac https://phabricator.wikimedia.org/T298882
 * Outreachy feedback for Osama Tahir https://phabricator.wikimedia.org/T297488
 * Refactor MediaWiki Core WebdriverIO tests from sync to async mode https://phabricator.wikimedia.org/T293071