Wikimedia Release Engineering Team/Checkin archive/2023-03-20

From mediawiki.org

2023-03-20[edit]

πŸ† Wins/winterrogation[edit]

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
Mar 2024
  • Nightly security patch failures updating phabricator tasks merged, ready to release
  • Merged deploys-in-progress reset script
  • Two repos have patches for git-fat β†’ git-lfs
  • scap: replaced canary swagger checks with test server httpbb checks
  • Phorge integration with GitLab in its third round of review
  • GitLab webhooks also still going, looks like it'll go through
  • People like scap backport - more patches, fewer things typed into terminals.
  • Security patch notification now working!
  • GitLab webhooks have a more accurate regex for "Bug: TXX"
  • Foreachwiki in beta
  • Getting rid of the /srv/mediawiki/php symlink
  • Upgraded GitLab k8s/cloud cluster to new k8s version and documented the process
  • Andre has returned to us \o/
  • Phab deploy is out (but stuff is broken (not terribly (probably)))
  • scap backport now works for non-extension submodules
  • gitlab cloud runner dependencies
  • scap backport -2 fix merged, need to release

Stuff from last time[edit]

πŸ“… Vacations/Important dates[edit]

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List#2024
https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar
https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off (page needs updating for Dayforce)

Mar 2024[edit]

  • 29 Feb, 1st Mar, 4th Mar - 8th Mar - Antoine
  • 14 Mar–14 May: Dan
  • 29 Mar: Brennen, Jeena, Andre

Apr 2024[edit]

  • Mon 01 Apr: Andre
  • Fri 05 Apr: Brennen
  • Fri 05 Apr–Fri 12 Apr -- Tyler, eclipse viewing
  • Mon 22 Apr: Global holiday, all staff
  • 26 Apr: Brennen (tentative)
  • Apr 29 - May 02: Andre less available

May 2024[edit]

  • Mon 27 May: Memorial Day (US staff with reqs)

Future[edit]

  • A few days around July 4: Brennen
  • 25 Aug - 03 Sep: Brennen

πŸ”₯πŸš‚ Train[edit]

https://tools.wmflabs.org/versions/
https://train-blockers.toolforge.org/
https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar

Rotation[edit]

  • 3 Dec – 1.42.0-wmf.8 – No Train offsite
  • 11 Dec – 1.42.0-wmf.9 – Brennen + Antoine (Jaime out)
  • 18 Dec – 1.42.0-wmf.10 – Ahmon + Brennen (Jaime out)
  • 25 Dec – 1.42.0-wmf.11 – No Train
  • 1 Jan – 1.42.0-wmf.12 – Dan + Ahmon (Jaime out)
  • 8 Jan – 1.42.0-wmf.13 – Jeena + Dan (Jaime out)
  • 15 Jan – 1.42.0-wmf.14 – Jaime + Jeena
  • 22 Jan – 1.42.0-wmf.15 – Antoine + Jaime
  • 29 Jan – 1.42.0-wmf.16 – Ahmon + Antoine(Brennen out Wed–Fri)
  • 05 Feb – 1.42.0-wmf.17 – Brennen + Ahmon
  • 12 Feb – 1.42.0-wmf.18 – Brennen+Antoine (Friday)
  • 19 Feb – 1.42.0-wmf.19 – Jeena+Brennnen
  • 26 Feb – 1.42.0-wmf.20 – Dan + Jeena
  • 04 Mar – 1.42.0-wmf.21 – Jaime + Dan (Antoine out)
  • 11 Mar – 1.42.0-wmf.22 – Antoine + Jaime (Dan out)
People for train: Ahmon, Antoine, Brennen, Jeena, Jaime
  • 18 Mar – 1.42.0-wmf.23 – Ahmon + Antoine
  • 25 Mar – 1.42.0-wmf.24 – Jeena + Ahmon
  • 1 Apr – 1.42.0-wmf.25 – Jaime + Jeena
  • 8 Apri – 1.42.0-wmf.26 – Antoine + Jaime
  • 15 Apr – 1.42.0-wmf.27 – Ahmon + Antoine
  • 22 Apr – 1.42.0-wmf.28 – Brennen + Ahmon (Global holiday Monday; Brennen out Friday)

Team Discussions[edit]

Annual planning[edit]

WE6.2:

  • If we make single version MediaWiki containers for production and remove configuration from the container, we reap the benefit of Kubernetes by getting individual changes to production faster on a per-deploy basis
  • If we make our existing deployment UI safer and more user-friendly, we reduce the toil of deployers as measured by the number of users of the deployment tool.

Things we care about:

  • We care about moving routing to k8s to ensure fast train rollback
  • ramp up one version, ramp down other version

Things mentioned today in IC meeting:

  • Wikitech, votewiki, videoscaling
  • Issue with beta clusterβ€”how do we have pre-production testing?
  • Worries about db corruption
  • * *

Let's do some inbox triage: https://phabricator.wikimedia.org/maniphest/query/7vRDrcVnt8OI/#R