Wikimedia Quality and Test Engineering Team/Office Hours/2022

2022-11-07

Attendees: Dom, Elena

Topics:

• Good test data for testing diffs?

2022-10-31

Attendees: Zeljko, Dom, Stef, Elena, George, Vaughn

Testing Computer Software by Kaner et al meeting

2022-10-24

Attendees: Elena, Vaughn - (Vaughn time-zone testing ( an insightful dissertation - https://phabricator.wikimedia.org/T316688#8336443 ) - (Elena) wikifunctions testing for (Abstract Wikipedia) - https://wikifunctions.beta.wmflabs.org/wiki/Special:CreateZObject?view=zobject-editor

2022-10-17

Attendees: Elena, Dom, George, Zeljko, Vaughn

• https://www.mediawiki.org/wiki/Extension:FileImporter
• https://phabricator.wikimedia.org/diffusion/
• https://doc.wikimedia.org/cover-extensions/GrowthExperiments/includes/index.html
• https://gerrit.wikimedia.org/r/c/mediawiki/core/+/842391/
• https://gerrit.wikimedia.org/g/fresh

2022-10-10

Attendees: Jackeline, Zeljko, Dom, Peter, Vaughn

• https://phabricator.wikimedia.org/T318599 Developers/Maintainers graph automation

2022-10-03

Attendees: Dom, George, Zeljko, Peter, Vaughn

2022-09-26

Attendees: Zeljko, Dom, Elena Topics: - Book Club (Monthly on the last Monday) - We are reading Testing Computer Software (Cem Kaner, Jack Falk, Hung Q. Nguyen) - https://phabricator.wikimedia.org/T311842

2022-09-19

Attendees: George, Zeljko, Vaughn

2022-09-12

Attendees: Elena, George, Zeljko, Vaughn

2022-09-05

Attendees: Dom, Zeljko, Vaughn Topics:

   * New watercooler?
   * Thursday at around 1400UTC
   * Selenium on test2wiki
   * Need to get a test user setup (Dom will try to sort that out)
   * Discuss with k8s team about running when they deploy
   * Support for George while Dom is away
   * It would be useful to get his local docker environment working (he is on Windows)
   * Book Club
   * Discussed new times to hold the meeting

2022-08-29

Attendees: Elena, George, Vaughn, Željko Topics: - Book Club (Monthly on the last Monday) - We are reading Testing Computer Software (Cem Kaner, Jack Falk, Hung Q. Nguyen) - https://phabricator.wikimedia.org/T311842

2022-08-22

Attendees: Dom, Elena, Zeljko, George Topics:

• Getting Selenium and API tests running on test2wiki (for the test2wiki k8s migration project)
• VisualEditor watchlist accessibility - use-case for accessibility playbook (the accessibility playbook link is here, in case people did not see it: https://docs.google.com/document/d/1QUw-ClLIDxzY3ShDHMGuewn7NR4Z3a4pP2XlUhitr0g/edit)
  • I wrote it up, see: https://docs.google.com/document/d/1QUw-ClLIDxzY3ShDHMGuewn7NR4Z3a4pP2XlUhitr0g/edit#heading=h.e9cd5glhzv6p

2022-08-15

Attendees: Elena, Dom - (ET) QA Abstract Wikipedia Testing Playbook https://docs.google.com/document/d/1mtOoJ0pyYxnDAUiLzkEGfoMguLAmFXa3Z0VW2UK0DS4/edit#heading=h.ldf8bwrxezwh - Prototype for testing thumbor: https://gitlab.wikimedia.org/dwalden/thumbor-testing/-/blob/main/comparison_prototype.sh

2022-08-08

Attendees: Dom, Elena, Vaughn

2022-08-01

Attendees: Dom, Elena

2022-07-25

Attendees: Dom

2022-07-18

Attendees: Elena, Dom, Vaughn

• ET: mediawiki update on docker
  • Do the "git pull", etc. to update the repositories
  • docker-compose up -d && docker-compose exec mediawiki composer update && docker-compose exec mediawiki php maintenance/update.php --quick

2022-06-27

Attendees: Dom, Elena, Zeljko, Vaughn, Derrick

• Presentation on OWASP ZAP (if people still want this)
• https://survey.stackoverflow.co/2022

2022-06-13

Attendees: Dom, Željko

• How do I run logstash locally?

2022-06-06

Attendees: Elena, Dom, Zeljko, Vaughn, Peter, Derrick

• BackstopJS Report
  • https://pixel.wmcloud.org/desktop/index.html
  • https://github.com/nicholasray/pixel
  • [betalabs] Non-responsive sticky header appears on Special and Talk pages https://phabricator.wikimedia.org/T309370
  • [GOAL] Leverage Automated Visual Regression Testing https://phabricator.wikimedia.org/T302246
• How to setup a wiki farm with CentralAuth locally

2022-05-23

Attendees: Dom, Elena, Zeljko, Vaughn, Peter

• Draft: Crowd-sourced list of proposed engineering priorities in Wikimedia Foundation engineering https://docs.google.com/document/d/1XY291UC-PJbUWHUEG_lVKM3-lIaT_x2U1bwE4Mr8-s0/edit#
• https://versions.toolforge.org/
• Beta Cluster’s Future https://docs.google.com/document/d/10JwPxx-6AUgLZ46LTCZvLOl4faPAtxrnEI5ZxnsVQ14/edit?usp=sharing
• ET: QA handoff? - thx, Vaughn!
• Please complete your respective team's readiness review for k8s migration https://www.mediawiki.org/wiki/User:DWalden_(WMF)/Test2wiki_k8s_migration#Team_testing_readiness (you should have a slack message from me, if not, you can ignore this)
• Professional development https://office.wikimedia.org/wiki/Staff_handbook/Benefits#Growth

2022-05-16

• https://phabricator.wikimedia.org/T302246 - QTE involvment?

2022-05-09

Attendees: Zeljko, Dom, Elena, Vaughn, Peter Topics:

• Intro to Mediawiki Testing for Ghana Technical Community
  • only automation testing?
  • do we have some ready to do QA tasks to give Ghana Technical Community to work on?
  • Selenium Tests for VisualEditor https://phabricator.wikimedia.org/T296187
  • https://www.mediawiki.org/wiki/Technical_contributor_onboarding
• Introductions (new people)
• Meetings (advice to new people)

2022-05-02

Attendees: Jackeline, Elena, Vaughn, Ezekiel, Željko Topics:

• Accessibility

2022-04-11

Attendees: Dom, Elena, Zeljko, Vaughn, Derrick, Esther, Jackeline

Topics:

• QTE pairing https://phabricator.wikimedia.org/T300290
• Explore It! https://phabricator.wikimedia.org/T301379

• local development environment
  • https://www.mediawiki.org/wiki/MediaWiki-Docker
  • https://www.mediawiki.org/wiki/Cli
  • https://www.mediawiki.org/wiki/MediaWiki-Vagrant

• shared testing environment
  • https://www.mediawiki.org/wiki/Beta_Cluster
  • https://patchdemo.wmflabs.org/
    • https://github.com/MatmaRex/patchdemo

2022-04-04

Attendees: Elena, Dom, Željko

Topics:

• Data³ https://www.mediawiki.org/wiki/Data%C2%B3
• a good overview of Selenium tests by extension: https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php72-docker/143365/console with the performance checks.
• I experimented with a "low-tech test dashboard" (from Lessons Learned) for IPInfo testwiki deployment testing https://www.mediawiki.org/wiki/User:DWalden_(WMF)/IPInfo/Testwiki_Deployment_Testing_Matrix
• Book club https://phabricator.wikimedia.org/T247665
  • Selecting the next book https://app.slack.com/client/T024KLHS4/C01935QKL3S/thread/C01935QKL3S-1648564519.851039
  • Should we open it for the entire wmf?
• Office hours
  • Should we open it for the entire wmf?
• Any feedback on QTE pairing? https://phabricator.wikimedia.org/T300290

2022-03-28

Attendees: Željko, Dom, Ezekiel, Derrick, Jackeline

Topics:

• Vagrant: this has been "replaced" by MediaWiki Docker so if there is a problem with following the Get Started guide (https://www.mediawiki.org/wiki/MediaWiki-Vagrant), skip it.

• • Ezekiel has come across a few pages on Media Wiki with links to other pages and was wondering why they do not open up in a new browser tab by default.

• Explore It https://phabricator.wikimedia.org/T301379
• QTE reading club https://phabricator.wikimedia.org/T247665
• QTE pairing https://phabricator.wikimedia.org/T300290
• Investigate why Selenium tests are being skipped and get delete page tests running on Beta https://phabricator.wikimedia.org/T303737
• Switch to spec reporter https://phabricator.wikimedia.org/T280331

2022-03-21

Attendees: Elena, Dom, Esther, Zeljko, Emeka

Topics: ET: SonarClouds provides coverage for unit testing? - https://doc.wikimedia.org/cover/ - https://sonarcloud.io/organizations/wmftest/projects ET: Test documentation? https://www.mediawiki.org/wiki/User:Etonkovidova/GrowthExperiments

2022-03-14

Attendees: Elena, Dom, Zeljko

Topics:
Elena:

- https://github.com/wikimedia/operations-mediawiki-config/blob/master/wmf-config/InitialiseSettings.php - the automation tests were (are) run on test2wiki? 'qa_automation' => [ // For browser tests, T60375 and T63799

2022-03-07

Attendees: Dom, Elena

Topics: Dom:

• Should we increase Selenium testing coverage?
  • e.g. testing deleting pages, looking at revision history
  • catch bugs like https://phabricator.wikimedia.org/T303033, https://phabricator.wikimedia.org/T302887
  • Or, would it be better via API tests?
• Do we have tools for reliability testing?
  • E.g. to simulate multiple users performing the same action at the same time (to catch race-conditions, etc.)
  • I wrote my own using python multiprocessing module (https://docs.python.org/3/library/multiprocessing.html ), but not sure if such a thing already exists - https://gitlab.wikimedia.org/dwalden/misc/-/blob/main/delete_page_concurrent.py
• Beta has been unreliable the last few days - https://phabricator.wikimedia.org/T302699

2022-02-28

Attendees: Dom, Elena, Željko

• Elena: https://phabricator.wikimedia.org/T302489 - the discussion/evaluation of Cypress testing framework for Lang team

2022-02-21

Attendies: Elena, Željko, Dom

• Dom
  • adding this meeting (office hours) to the staff calendar: https://office.wikimedia.org/wiki/ITS/Calendars

• Željko
  • T301379 Explore It! -- Reduce Risk and Increase Confidence with Exploratory Testing
  • T300290 QTE pairing
  • T301697 Investigate synthetic testing
  • T280652 Delete tests disabled for more than 1 year

• Elena
  • Best Practices Playbook

2022-02-14

Attendies: Elena, Dom, Ima, Željko

• ET: can we take a look at https://phabricator.wikimedia.org/T301463 ?
• ET: I was really impressed with Chapter 5: Automating Testing (Lessons learned). Especially Lesson 113: "Capture replay fails" - I did not know that the ability to compare the screenshots taken at the certain checkpoints (without programmin) existed 20 years ago.

• QTE pairing https://phabricator.wikimedia.org/T300290

2022-02-07

Attendees: Elena, Dom, Zeljko

• QTE pairing https://phabricator.wikimedia.org/T300290
• QTE reading club https://phabricator.wikimedia.org/T247665

2022-01-31

Attendees: Dom, Zeljko, Osama

• Book club today! Lessons Learned in Software Testing https://phabricator.wikimedia.org/T293880

2022-01-24

Attendees: Elena, Dom, Zeljko, Osama

• https://en.wikipedia.org/wiki/Responsibility_assignment_matrix

Dom:

• Please add your lessons learned to https://www.mediawiki.org/wiki/Wikimedia_Quality_and_Test_Engineering_Team/Lessons_learned_testing_MediaWiki_and_associated_software
  • Any mistakes you have made and learned from, or anything you just think is good advice

2022-01-17

Attendees: Dom, Zeljko, Osama

Dom:

• Please add your lessons learned to https://www.mediawiki.org/wiki/Wikimedia_Quality_and_Test_Engineering_Team/Lessons_learned_testing_MediaWiki_and_associated_software
  • Any mistakes you have made and learned from, or anything you just think is good advice

Osama

• https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Echo/+/754115
• https://phabricator.wikimedia.org/T274579

2022-01-10

Attendees: Dom, Esther, Zeljko, Osama, Soham

• Selenium Tests failing for CLI on Mac https://phabricator.wikimedia.org/T298882
• Outreachy feedback for Osama Tahir https://phabricator.wikimedia.org/T297488
• Refactor MediaWiki Core WebdriverIO tests from sync to async mode https://phabricator.wikimedia.org/T293071