Wikimedia Quality and Test Engineering Team/Office Hours/2021

2021-12-20

Attendees: Soham, Osama, Ima, Željko

• https://www.mediawiki.org/wiki/Selenium/How-to/Set_environment_variables
• https://gerrit.wikimedia.org/r/c/mediawiki/core/+/730546

• unit testing with jest- https://gerrit.wikimedia.org/r/c/mediawiki/extensions/MediaSearch/+/741103/. Any insights on jest framework?

2021-12-13

Attendees: Elena, Zeljko, Osama

• Osama's blog: https://osamaahmedtahir.wordpress.com/
• Beta Cluster Logstash https://wikitech.wikimedia.org/wiki/Logstash#Beta_Cluster_Logstash
• Lessons Learned in Software Testing: A Context-Driven Approach https://phabricator.wikimedia.org/T293880

2021-12-06

Attendees: Dom, Elena, Zeljko, Osama, Esther

• Ž: First day of Osama's internship! (I'll announce it today.) https://phabricator.wikimedia.org/T296426
• ET: discussion (with Dom) blocked users' access to editing & reverted edits tagging
• ET: Lang team Automation testing task https://phabricator.wikimedia.org/T296719

2021-11-29

Attendees: Elena, Dom, Željko, Esther, Ima

• Perfect Software -- And Other Illusions about Testing
  • https://phabricator.wikimedia.org/T293817
  • https://docs.google.com/document/d/1_yulyjZuTDJqiQW2KurP_9dV-OOb2VjFuQv_E9e8LiQ/edit

• ET:

** https://phabricator.wikimedia.org/T296508 - betalabs logs.

• • (for Ima) Lang team QA column

• Dom: Any advice for testing page and file deletion?

2021-11-22

Attendees: Zeljko, Dom, Elena, Osama

• Osama is our Outreachy intern!

2021-11-15

Attendees: Zeljko, Osama, Dom, Ima

• Create a task similar to "Create MediaWiki-Docker documentation for all repositories with Selenium tests" (https://phabricator.wikimedia.org/T256239 ), but instead of MediaWiki-Docker, the task should use

Cli (https://www.mediawiki.org/wiki/Cli )

• Create a task similar to "Refactor WebdriverIO tests from sync to async mode" (https://phabricator.wikimedia.org/T256626 ) but instead of

sync/async, the task is about updating webdriverio to the latest released version (7.16.8)

• • There is a similar task (Upgrade WebdriverIO to v7 in all repositories https://phabricator.wikimedia.org/T274579 ), but until recently (because of nodejs version we used, v10) we could only update to webdriverio v7.4. Now we use node v12 and v14, so we can update to the latest version.

2021-11-08

Attendees: Zeljko, Elena, Dom, Ima

• Create MediaWiki-Docker documentation for all repositories with Selenium tests https://phabricator.wikimedia.org/T256239

2021-11-01

Attendees: Dom, Elena

• Add image - the current project for Growth and SD team
• new betalabs logstash - https://beta-logs.wmcloud.org (https://wikitech.wikimedia.org/wiki/Logstash#Beta_Cluster_Logstash)

2021-10-25

Attendees: Elena, Ima, Željko, Mahfuza, Agha, Osama, Kelechi

• 730546: selenium: Refactor WebdriverIO tests from sync to async mode | https://gerrit.wikimedia.org/r/c/mediawiki/core/+/730546 https://gerrit.wikimedia.org/r/c/mediawiki/core/+/730546
• T293090 Fix MediaWiki-Docker/Extension/AbuseFilter

2021-10-18

Attendees: Zeljko, Elena, Dom, Osama, Esther, Ima, Lydia

• T247665 QTE reading club
• T265635 Schools of Software Testing
• gerrit/github discussion

2021-10-11

Attendees: Zeljko, Dom, Ima

2021-10-04

Attendees: Esther, Zeljko, Dom, Ima, Elena

• Željko: Q1 Individual Tuning Conversations https://phabricator.wikimedia.org/T286478
• ET: Book club https://phabricator.wikimedia.org/T247665

2021-09-27

Attendees: Elena, Zeljko, Esther

• Esther: VE Regression test Findings/Bugs and how to reproduce them
• Selenium tests for VisualEditor, Thursday, September 30, 16:00 UTC
• Elena: three great Growth team practices: weekly priorities, pre-recorded meetings materials, and Team Chores.

2021-09-20

Attendees: Elena, Zeljko, Ima, Dom

• Elena: https://phabricator.wikimedia.org/T290740 WikibaseMediaInfo Selenium tests not running anywhere - can we talk about how to move forward with it?

• Dom: remember to add any test artifacts you have to https://www.mediawiki.org/wiki/Category:Test_Artifact
  • Instructions for how to tag a page with a category:
    • On VisualEditor: https://www.mediawiki.org/wiki/Help:VisualEditor/User_guide#Editing_categories
    • On Source Editor: https://www.mediawiki.org/wiki/Help:Categories#Adding_a_page_to_a_category

Željko: https://github.com/zeljkofilipin/incident-documentation

2021-09-13

• Attendees: Elena, Derrick, Željko

• https://gerrit.wikimedia.org/r/c/mediawiki/extensions/GrowthExperiments/+/714547/
• https://phabricator.wikimedia.org/T290724 `CANCELED [mediawiki_cxserver internal] load metadata for docker.io/library/node:10-buster` when following instructions from MediaWiki-Docker/Extension/ContentTranslation
• https://phabricator.wikimedia.org/T256626 Investigate WebdriverIO async mode
• https://phabricator.wikimedia.org/T256239 Create MediaWiki-Docker documentation for all repositories with Selenium tests

2021-09-06

• Attendees: Esther, Željko

• Dual Boot macOS and Ubuntu Linux https://filipin.eu/dual-boot
• MediaWiki-Docker/Extension/VisualEditor https://www.mediawiki.org/wiki/MediaWiki-Docker/Extension/VisualEditor
• Create MediaWiki-Docker documentation for all repositories with Selenium tests https://phabricator.wikimedia.org/T256239
• If your Mac starts up to a question mark https://support.apple.com/en-us/HT204323

2021-08-30

• Attendees: Elena, Pita, Zeljko, Derrick, Ima

• Pita: GSoC https://github.com/wikimedia/wikipedia-preview/tree/main/cypress
• Željko:
  • GSoC https://phabricator.wikimedia.org/T274579 Upgrade WebdriverIO to the latest version 7 for all repositories
  • Outreachy https://phabricator.wikimedia.org/T256626 Investigate WebdriverIO async mode

2021-08-23

• Attendees: Elena, Pita, Zeljko, Dom, Ima, Derrick

2021-08-16

• Attendees: Elena, Dom, Derick, Ima, Esther

• • Dom: ssh config file (Esther ssh access to wnflabs)

Host *.wmflabs *.wikimedia.cloud

 User dwalden
 ProxyJump primary.bastion.wmflabs.org:22

• • Ima -checking ssh access (https://phabricator.wikimedia.org/T286584)
• If anyone wants to test the SecurePoll board elections:
  • https://en.wikipedia.org/wiki/Special:SecurePoll/vote/DWalden_STV_Election_Test_456
  • https://en.wikipedia.org/wiki/Special:SecurePoll/vote/DWalden_Test_Election_Foobar
  • https://en.wikipedia.org/wiki/Special:SecurePoll/vote/DWalden_Encrypted_All_Wiki_Test_Election_with_Eligibility_list (if you have a user with > 300 edits)
  • https://wikimania.wikimedia.org/wiki/2021:Program

2021-08-02

• Attendees: Esther, Elena, Ima, Dom, Derrick

• Ima
  • Would like a session on: Cypress as a preferred automation tool by Pita
  • Would like a step by step review of Prod and Beta deployment set up - Done
  • Is there a way to get email alerts when task moves into QA column on a scrum board other than subscribing to the tickets in development column.
• Phab has setting for filtering notifcations in Email https://phabricator.wikimedia.org/settings/user/Etonkovidova/page/emailpreferences/

• Elena
  • https://phabricator.wikimedia.org/phame/post/view/250/qa_support_for_deployment_train/

• Esther
  • Wikimania intro meeting

2021-07-26

• Attendees: Dom, Elena, Ima, Esther, Derrick

Agenda:

• • QTE Quarterly Planning https://docs.google.com/document/d/1sPjMKLqHT_dBQDG0OcwqWOEaEwMri3FRwbiiJX6sZOU/edit#heading=h.ibozl0causrh
  • Review Deployment train docs

2021-07-19

• Attendees: Dom, Esther, Elena, Derrick

• • Metrics document - https://docs.google.com/spreadsheets/d/10lvSkI703qz4sYxjDS5xtZwigxH9wUXKiDMpZEEHJR8/edit#gid=0

2021-07-12

• Attendees: Esther, Elena, Pita, Derrick, Zeljko, Dom, Ima

• Elena
  • Liked Cypress on Browserstack webinar
  • Pita: https://www.rainforestqa.com/blog/accessible-quality
  • Željko: http://blog.codepipes.com/testing/software-testing-antipatterns.html
  • https://patchdemo.wmflabs.org/
    • https://patchdemo.wmflabs.org/wikis/3b3765191f/wiki/Main_Page

2021-06-28

• Attendees: Derrick, Ima, Dom, Zeljko, Pita, Esther

• Dom
  • SecurePoll/STV: The number of possible vote distributions is potentially in the tens of trillions. I am trying to group them into "cases" (i.e. using domain analysis/equivalence-class partitioning)

• Željko
  • WMDE considering cypress https://phabricator.wikimedia.org/T180228#7178058

2021-06-21

• Attendees: Esther, Derrick, Ima, Elena, Dom, John, Pita

• Dom
  • Used principles of recursive optimisation/dynamic programming to generate test data
    • https://en.wikipedia.org/wiki/Dynamic_programming
    • https://github.com/dominic998/SecurePoll-Test-Data/blob/main/prototype_test_data_generator.R
  • Used an intercepting proxy (OWASP ZAP https://www.zaproxy.org ) to provoke error behaviour (for testing https://phabricator.wikimedia.org/T281767 ) and to simulate delays (for testing https://phabricator.wikimedia.org/T282050 )

• Elena
  • talked about setting up account access for onboarding
  • "The Phoenix project" for Lunch&Talk presentation?

2021-06-14

• Attendees: Dom, Elena, Esther, Derrick, Zeljko, Pita, Ima

• Dom
  • Creating test data for SecurePoll STV project:
    • https://github.com/dominic998/SecurePoll-Test-Data
    • Need to work out how to get the data in the database

• Esther
  • Onboarding https://office.wikimedia.org/wiki/Guide_for_new_hires

• Pita
  • https://github.com/hariclerry/mediawiki/blob/master/.github/workflows/node.js.yml
  • https://github.com/wikimedia/wikipedia-kaios/tree/main/cypress

• Željko
  • Remove debugging output when recording videos of Selenium test runs https://phabricator.wikimedia.org/T284335
  • Create the first VisualEditor Selenium test https://phabricator.wikimedia.org/T284165
  • Add selenium tests for GlobalWatchlist https://phabricator.wikimedia.org/T284521
  • Upgrade WebdriverIO to the latest version 7 for all repositories https://phabricator.wikimedia.org/T274579
  • Update wdio-mediawiki in all repositories https://phabricator.wikimedia.org/T283597

• Elena
  • Wow. So wikimedia. Such quality. Many testing. Very team. https://phabricator.wikimedia.org/phame/blog/view/21/

2021-06-07

• Attendees: Zeljko, Dom, Elena, Ima, Derrick

• Offsite reflections (ET)
• Daily Jenkins jobs: https://integration.wikimedia.org/ci/view/selenium-daily/
• MediaWiki-Docker https://www.mediawiki.org/wiki/MediaWiki-Docker

2021-05-24

• Attendees:

• Željko
  • T283363 Release wdio-mediawiki 1.1.0
  • T282237 Upgrade README.md for Selenium tests across all the repositories
  • T274579 Upgrade WebdriverIO to the latest version 7 for all repositories

• Dom
  • Helping Rummana out with regression testing VE. Fairly successful so far (at least from my perspective).

• Suggestions for VE regression testing:
  • QTE shares Rummana's burden (perhaps rotating QTE staff)
  • Talk with VE team to see if they can share some of Rummana's work
  • VE team helps with automation
  • QTE team helps with automation
  • Are there ways of analysing changes to VE and its dependencies so Rummana can focus her testing on the areas that are most likely to be broken by those changes?
  • Can we make VE more testable? (e.g. could we make it possible to run without Parsoid?)

2021-05-17

• Attendees: Elena, Pita, Dom, Željko

• Željko
  • https://filipin.eu/macos-vs-ubuntu

2021-05-10

• Attendees: Pita, Dom, Elena, Željko

• Željko
  • T281484 Add a basic wdio.conf.js to wdio-mediawiki

• Elena
  • The Phoenix Project - book club
  • Onboarding examples
    • https://www.mediawiki.org/wiki/Extension:GlobalUserrights
    • https://www.mediawiki.org/wiki/Help:VisualEditor/User_guide
    • https://www.mediawiki.org/wiki/User:DWalden_(WMF)/Watchlist_Expiry

2021-05-03

• Attendees: John, Željko

• John
  • T281547 TypeError: Cannot read property 'top' of undefined

• Željko
  • T281484 Add a basic wdio.conf.js to wdio-mediawiki - Almost there. 🚴‍♂️
  • T281505 selenium-daily-beta(commons)-MediaWiki fails with `Test report file (...)WDIO.xunit-(...).xml was length 0` - Fixed. 🤕
  • T214686 selenium-daily-beta Jenkins jobs should have junit publisher - Done. ✅
  • T281372 Add timestamp function to wdio-mediawiki - Done. ✅
  • T280334 remove @wdio/devtools-service NPM package. - Done. ✅

2021-04-26

• Attendees: Elena, Pita, Željko, Dom, John

• Elena
  • DONE - Rename the meeting to Quality and Test Office Hours
  • failed test: https://integration.wikimedia.org/ci/job/selenium-daily-beta-MediaWiki/
    • https://www.mediawiki.org/wiki/Selenium/How-to/Run_tests_using_selenium-daily_Jenkins_job
  • hiring
  • sql training

• John
  • New time for the meeting - not changing

• Željko
  • Working with Ed on T269051 Minerva selenium test "Wikitext Editor (Makes actual saves) Redirects" failing
    • T280975 Upgrade WebdriverIO to v7 in MinervaNeue

2021-04-19

• Attendees: Elena, Dom, Željko, Soham

• Elena
  • (it was suggested during QTE Apr 07 meeting) can we re-purpose the Test Automation Office Hours meeting into more general QTE Office hours . No changes in the format, only in the title. Thoughts?
    • Elena will ask at slack and/or mailing list
  • QTE blogs - should they have phab tags?
    • We are not sure if tags do anything at blog posts.

• Željko
  • Write missing Selenium documentation https://phabricator.wikimedia.org/T278827

New

• • • https://www.mediawiki.org/wiki/Selenium/How-to/Debug_a_flaky_test
    • https://www.mediawiki.org/wiki/Selenium/How-to/Debug_with_browser.debug()
    • https://www.mediawiki.org/wiki/Selenium/How-to/Debug_with_logLevel
    • https://www.mediawiki.org/wiki/Selenium/How-to/Run_a_subset_of_a_test_suite
    • https://www.mediawiki.org/wiki/Selenium/How-to/Set_Environment_Variables

Updated

• • • https://www.mediawiki.org/wiki/Selenium/How-to/Use_MediaWiki_API
    • https://www.mediawiki.org/wiki/Selenium/Reference/Running_tests
    • https://www.mediawiki.org/wiki/Selenium/Getting_Started/Run_tests_using_Fresh

• • Selenium framework cleanup https://phabricator.wikimedia.org/T210726
    • Screenshots for both passing and failing tests https://phabricator.wikimedia.org/T280355
    • Switch to spec reporter https://phabricator.wikimedia.org/T280331
      • https://gerrit.wikimedia.org/r/c/mediawiki/extensions/FileImporter/+/680377/
    • Remove `Screenshot location...` messages https://phabricator.wikimedia.org/T280343
    • Update mwbot to v2 https://phabricator.wikimedia.org/T280332
      • https://gerrit.wikimedia.org/r/c/mediawiki/core/+/680336/

2021-04-05

• Attendees: Elena, Leza Zaman (tech product manager for Vuejs team)
  • Discussion on
    • Deployment process
    • Team/QA processes

2021-03-29

• Attendees: Pita, Željko

• Pita
  • T277284 GSOC - Create cypress tests for wikipedia-preview

• Željko
  • T248221 Update Selenium documentation to work with WebdriverIO v6
    • Status: 18/27 (67%)
  • T277054 Selenium tests fail when using Fresh
  • T278700 selenium-daily-beta-* Jenkins jobs failing

2021-03-22

• Attendees: Dom, Jared, Elena, Pita, Željko

• Jared
  • "Create a generic NPM package for recording videos of test runs" -- pushed update with package to core
    • Phabricator: https://phabricator.wikimedia.org/T259341
    • Gerrit: https://gerrit.wikimedia.org/r/c/mediawiki/core/+/673828/
    • npm package: https://www.npmjs.com/package/test-video-recorder

• Dom
  • Got my ebooklib script working (also had to use the MW Action API)
  • My vagrant has stopped working and I don't know why :'(

• ET
  • why it fails - https://integration.wikimedia.org/ci/job/selenium-daily-beta-MediaWiki/971/console
  • "Engineering laptops" thread - do I need to know any specs when I ask IT people for a new computer?

2021-03-15

• Attendees: Elena, Dom, Soham, Jared, Željko

• Soham
  • Request to set up a discusson on WebdriverIO to v7 proposal (seems to work with Node 10)
  • Spoke to Pita about the Cypress project and we have that as a project this year

• Željko
  • T248221 Update Selenium documentation to work with WebdriverIO v6
    • 4 pages updated

• Jared
  • T277427 Update DEVELOPERS.md Selenium Test Instructions
    • https://gerrit.wikimedia.org/r/c/mediawiki/core/+/672172

• Pita
  • T277284 GSOC - Create cypress tests for wikipedia-preview

• Dom
  • Trying to use https://pypi.org/project/EbookLib/ in Python to test WS Export (anyone have any experience with this?)

2021-03-08

• Attendees: Dom, Elena, Jared, Željko

• Željko
  • T269566 Remove ChromeDriver dependency in all repositories with Selenium tests
    • mediawiki/core patch merged https://gerrit.wikimedia.org/r/c/mediawiki/core/+/666946
  • T276503 Make Echo browser tests record and save videos in CI
    • This should be easy to do, if anybody wants to try (otherwise I'll do it).
  • T248221 Update Selenium documentation to work with WebdriverIO v6
    • 2 pages updated so far, I'll continue with the updates this week. Let me know if any page is urgent.
  • T268756 Outreachy blog posts
    • I have to write my report of the internship
  • Testival Meetup #62 - Online Edition https://www.meetup.com/testival/events/276685626/
    • Vidhi and Soham will talk about their GSOC intership at my local (now online) testing meetup

• Jared
  • T259341 Create a generic NPM package for recording videos of test runs

• ET
  • https://phabricator.wikimedia.org/T276783 "Page should be undoable" selenium test is flaky -what needs to be done?
    • Željko will take a look
  • Updated https://docs.google.com/presentation/d/1XJgMxvWwU8SLps8h6_ge79CYNoR3z_beJrUyRT4FIOc/edit?usp=sharing - added `kafkacat` stuff
    • Elena will present the second part of the talk at the QTE meeting

• Pita
  • Idea for GSOC on Cypress
    • Pita might ask Vidhi and Soham for help

2021-03-01

• Attendees: Elena, Dom, Željko

• Željko
  • Harriet's report: https://github.com/hariclerry/mediawiki/blob/master/tests/playwright/Report.md
  • T269566 Remove ChromeDriver dependency for running Selenium tests
  • T246425 Selenium documentation is easy to use and up to date
    • T248221 Update Selenium documentation to work with WebdriverIO v6
    • T275850 Make it clear that running `npm ci` is not secure

• Elena
  • needs to update macos
  • Eventlogging journey https://phabricator.wikimedia.org/phame/post/view/230/eventlogging_journey/

2021-02-22

• Attendees: Pita, Dom, Elena, Željko

• Pita
  • talked with HR about QA job https://boards.greenhouse.io/wikimedia/jobs/2897861?gh_src=c96a38b91usp

• Elena
  • Logstash/Kibana presentation at QTE meeting https://phabricator.wikimedia.org/T274167
  • Scaling GrowthExperiments - Help panel tests https://phabricator.wikimedia.org/T274166

2021-02-15

• Attendees: Željko, Elena

• Željko
  • Scaling GrowthExperiments - Help panel tests https://phabricator.wikimedia.org/T274166

2021-02-08

• Attendees: Pita, Željko, John; Elena, Pablo, Harriet

• Elena
  • A script to check a new feature at tens or hundreds of wikis
    • Create a phab task for (Scaling GrowthExperiments) script https://phabricator.wikimedia.org/T274166
  • Logstash for eventlogging errors in production
    • Create a phab task for logstash presentation at QTE meeting https://phabricator.wikimedia.org/T274167

• Harriet
  • Intership progress report https://github.com/hariclerry/mediawiki
    • https://github.com/hariclerry/mediawiki/blob/b6f803b2260e00c9378217abd2b2cf70d5c9f753/tests/playwright/Report.md
    • Run Cypress tests in github actions https://github.com/hariclerry/mediawiki/issues/92

2021-01-25

• Attendees: Pita, Željko, Dom

• • Željko
    • Soham's Github account suspended and we don't know why https://twitter.com/und3fined_v01d/status/1353676770474512385
    • 2 (out of 3) milestones of Harriet's internships are completed, starting with the final milestone https://github.com/hariclerry/mediawiki/milestones

2021-01-18

• Attendees: Pita, Željko
  • Željko
    • selenium-daily-beta-CirrusSearch is failing https://phabricator.wikimedia.org/T271102
    • New repo with Selenium tests https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/extensions/CodeMirror/+/refs/heads/master/tests/selenium/
    • Learn Appium basics https://phabricator.wikimedia.org/T251508
  • Jared
    • Error running Selenium tests in fresh-node in mediawiki core https://phabricator.wikimedia.org/T271772

2021-01-11

• Attendees: Elena, Pita, Dom, Željko
  • Željko
    • Playwright tests running in Github Actions https://github.com/hariclerry/mediawiki/milestones
    • Appium: https://phabricator.wikimedia.org/T251508

2021-01-04

• Attendees: Elena, Pita, Dom, Željko
  • Željko:
    • Pita will help him with Appium https://appium.io/
      • https://github.com/jpita/workshopValencia
    • https://github.com/hariclerry/mediawiki
      • https://github.com/hariclerry/mediawiki/pull/32
  • https://github.com/jaredblumer/test-video-recorder
  • Elena: no logs at deployment-eventlog05.eqiad.wmflabs