Wikimedia Release Engineering Team/Checkin archive/2023-09-20

= 2023-09-20 =


 * Last time

🏆 Wins

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
 * Sep '23 edition


 * Image published for Blubber that is native LLB, no dockerfile anymore
 * implications
 * dockerfile is unnecessary since no one sees the dockerfile—we can customize each llb instruction and what it displays to the users: a name that corresponds to the blubber.yaml config
 * now we have the ability to create our own instructions
 * dockerfile2llb gone! No more external helper images that haven't been maintained just to copy files around—no more cross-platform compatibility/emulation issues
 * llb gets new stuff first—ex: diffop/mergeop https://www.docker.com/blog/mergediff-building-dags-more-efficiently-and-elegantly/
 * Phorge working on the scap3∞ deployment environment
 * Landed 3 upstream phorge patches, 1 is one we've had for years the blocks some tasks rendering (T284397)
 * Patch for T&S could outputs the MediaWiki SUL account along with the phab username (T344303)
 * Wrote a plugin for tox to keep supporting [tox:jenkins] CI config with tox v4 https://gerrit.wikimedia.org/g/integration/tox-jenkins-override  unblocking part of the migration from tox v3.
 * Moved Civi CRM CI from Stretch to Bullseye and to php 7.4 (aligning with prod). Paired with Ejegg from FR-tech.


 * Ahmon refactoring GitLab nodepools, buildkitd persistent volume,  and containerd debugging
 * Dan deep debugging of source code for containerd
 * GerritLab uses the git credential helper
 * Trusted runners now not running untrusted jobs
 * Authentication working in phorge dev environment
 * Phabricator housekeeping for open tickets assigned for more than two years
 * Phabricator logstash dashboard with filters

Last week
The six questions I answer week-by-week about our work. This is pretty much all CTPO/VP/Director-types see for what we're doing. If there are specific things to call out here, let's do.

On track

Progress update on the hypothesis for the week T343035 – Sync ldap/ops users to group on GitLab – All members of SRE are now owners of the repos/sre subgroup on GitLab T346084 – Consulting with data engineering on memory-optimized runners on GitLab T346090 – Debian 12 support for python images in our image building tool T344747 – Mathoid migrated to GitLab Any new metrics related to the hypothesis Repositories on Gerrit decreased (2019 last week → 2012 this week) Any emerging blockers or risks Upcoming work to scope stacked testing will give us a better understanding of the risks of MediaWiki migration Any unresolved dependencies - do you depend on another team that hasn’t already given you what you need? Are you on the hook to give another team something you aren’t able to give right now? No Have there been any new learnings from the hypothesis? No Are you working on anything else outside of this hypothesis? If so, what? MediaWiki 1.41.0-wmf.26 298 Patches ▇█▂▁▂ in 69 repos by 75 authors 0 Rollbacks ▁▁▁█▁ 0 Days of delay █▁▁▁▁ 3 Blockers █▁▁▃▆ T346266 establishing a routine Phab deploy window with serviceops collab

This week
Progress update on the hypothesis for the week Any new metrics related to the hypothesis Any emerging blockers or risks Any unresolved dependencies - do you depend on another team that hasn’t already given you what you need? Are you on the hook to give another team something you aren’t able to give right now? Have there been any new learnings from the hypothesis? Are you working on anything else outside of this hypothesis? If so, what?
 * we should report the number of repos in gitlab too

🌻 Open source/Upstream contributions

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Upstream


 * https://github.com/yaoyuannnn/gerritlab/pulls?q=is%3Apr+is%3Aclosed
 * https://github.com/tox-dev/tox/issues/3115
 * https://github.com/moby/buildkit/pull/4264
 * https://gitlab.com/gitlab-org/omnibus-gitlab/-/merge_requests/7101 (we'll see)

Code review

 * +1'd gerrit changes
 * (filed as: https://phabricator.wikimedia.org/T344361 )

Gerrit Access requests

 * Gerrit access requests

Private repo requests
https://phabricator.wikimedia.org/search/query/E7t2_WXX01bB/#R

Gerrit repo requests

 * https://www.mediawiki.org/wiki/Gerrit/New_repositories/Requests

GitLab Access requests

 * Account Approval
 * Accounts and auth
 * GitLab access requests
 * Look up username in LDAP ( https://ldap.toolforge.org/ )
 * Look for contributions on Gerrit or Phab

High priority tasks

 * UBN! + High: https://phabricator.wikimedia.org/maniphest/query/PkxR1BXrbbU4/#R
 * Can we have this in project defaults? Protected branch: main; protected tags: *
 * New in inbox: https://phabricator.wikimedia.org/maniphest/query/7vRDrcVnt8OI/#R

📅 Vacations/Important dates

 * https://office.wikimedia.org/wiki/HR_Corner/Holiday_List#2023
 * https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar
 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off

September 2023

 * 04 Sep: Labor day (US Staff with reqs)
 * 08 Sep: Tyler
 * 15, 18 Sep: Tyler
 * 26 Aug–05 Sep: Brennen (🔥)
 * 13 Weds–17 Sun: Brennen → KS (approximate)
 * 29Fri Sep (moving state holiday from Thu28): Andre
 * a few days after December offsite: Andre

October 2023

 * 2-16 Oct: Jaime

Future

 * 15Jan - 15Mar: Andre

🔥🚂 Train

 * https://tools.wmflabs.org/versions/
 * https://train-blockers.toolforge.org/
 * https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar


 * 2 Jan - wmf.17 - Dan + Antoine (Jaime out)
 * 9 Jan - wmf.18 - Jeena + Dan (Jaime out)
 * 16 Jan - wmf.19 - Jaime + Jeena
 * 23 Jan - wmf.20 - Brennen + Jaime
 * 30 Jan - wmf.21 - Ahmon + Brennen
 * 6 Feb - wmf.22 - Chad + Ahmon
 * 13 Feb - wmf.23 – Dan + Chad
 * 20 Feb - wmf.24 – Antoine + Dan
 * 27 Feb - wmf.25 – Jaime + Antoine
 * 6 Mar – wmf.26 – Jeena + Jaime
 * 13 Mar – wmf.27 – Brennen + Jeena
 * 20 Mar – wmf.1 – Ahmon + Brennen
 * 27 Mar – wmf.2 – Chad Dan + Ahmon
 * 3 Apr – wmf.3 – Antoine + Dan
 * 10 Apr – wmf.4 – Chad + Antoine
 * 17 Apr – wmf.5 – Jaime + Chad
 * 24 Apr – wmf.6 – Jeena + Jaime
 * 1 May – wmf.7 – Brennen + Jeena
 * 8 May – wmf.8 – Antoine + Brennen (Ahmon out + Antoine Out 8th)
 * 15 May – wmf.9 – Ahmon + Antoine (Dan out + Chad out)
 * 22 May – wmf.10 – Chad + Ahmon (Dan out + Jeena out 26th)
 * 29 May – wmf.11 – Dan + Chad (Memorial Day 29th)
 * 5 Jun – wmf.12 – Jeena + Dan (Brennen out, Jaime out)
 * 12 Jun – wmf.13 – Jaime + Jeena
 * 19 Jun – wmf.15 – Cancelled for offsite
 * 26 Jun – wmf.16 – Brennen + Jaime (Jeena out)
 * 3 Jul – wmf.17 – Antoine + Brennen (3rd + 4th holidays)
 * 10 Jul – wmf.18 – Dan + Antoine (Ahmon out)
 * 17 Jul – wmf.19 – Ahmon+Dan (Brennen out Friday)
 * 24 Jul – wmf.20 – Jaime+Ahmon
 * 31 Jul – wmf.21 – Ahmon+Jaime (Jeena out, Antoine out) (Ahmon volunteered)
 * 7 Aug – wmf. 22 – No train
 * 14 Aug - wmf.23 – Ahmon+Jaime (Jeena out, Antoine out)
 * 21 Aug - wmf.24 – Dan(brennen out, Jeena out, Antoine out)
 * 28 Aug – wmf.25 – Jeena+Dan
 * 04 Sep – wmf.26 – Antoine+Jeena
 * 11 Sep – wmf.27 – Jaime+Antoine+Andre as lurker!


 * 18 Sep – wmf.28 – Brennen+Jaime
 * Logspam-watch needs some attention
 * Every deploy is rebuilding l10n
 * 25 Sep – 1.42.0-wmf.1 – Dan + Brennen
 * 2 Oct – 1.42.0-wmf.2 – Jeena + Dan (Jaime Out)
 * 9 Oct – 1.42.0-wmf.3 – Antoine + Jeena (Jaime Out)
 * 16 Oct – 1.42.0-wmf.4 – Brennen + Antoine
 * 23 Oct – 1.42.0-wmf.5 – Ahmon + Brennen
 * 30 Oct – 1.42.0-wmf.6 – Dan + Ahmon

GitLab meeting recap

 * the most important thing:  do what we feel we can support, sustain, and help us achieve our/the orgs goals
 * Lots of high-level questions, I think we have more shared understanding
 * Options I presented (in order):
 * All in one place: GitLab CE or Gerrit
 * Split: GitLab CE & Gerrit
 * Paid option
 * What now?
 * Design meeting on GitLab CE Merge Gating (biggest item on https://docs.google.com/document/d/1zczuL1S8A4E3zINdJAam5HwxxASaREUaN3ntfAASGok/edit#heading=h.7qtlock9hcb7 )
 * Gather and organize MUST/SHOULD/MAY (per https://www.ietf.org/rfc/rfc2119.txt )
 * Investigation Spike


 * Questions
 * SRE needs vs MediaWiki needs?
 * Covering Depends-On + Stacking should meet their needs
 * Gating
 * Couple things get bunched in: dependent pipelines (save time), setting up the tests, atomic function of performing the merge


 * Scope: Depends-on, Dependent pipeline, Merge atomicity
 * Pre-work: MUST, SHOULD, MAY
 * TODO: Meeting w/Ahmon, Dan, Jeena, Cindy

Offsite!

 * Brainstorming doc coming soon
 * Think about: Work activities, Discussion topics (information sharing/collective decision making), Fun activities