Wikimedia Release Engineering Team/Checkin archive/2023-09-27

= 2023-09-27 =


 * Last time

TODO: postmortem for scap patches, loop in security

🏆 Wins

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
 * Sep '23 edition


 * Image published for Blubber that is native LLB, no dockerfile anymore
 * implications
 * dockerfile is unnecessary since no one sees the dockerfile—we can customize each llb instruction and what it displays to the users: a name that corresponds to the blubber.yaml config
 * now we have the ability to create our own instructions
 * dockerfile2llb gone! No more external helper images that haven't been maintained just to copy files around—no more cross-platform compatibility/emulation issues
 * llb gets new stuff first—ex: diffop/mergeop https://www.docker.com/blog/mergediff-building-dags-more-efficiently-and-elegantly/
 * Phorge working on the scap3∞ deployment environment
 * Landed 3 upstream phorge patches, 1 is one we've had for years the blocks some tasks rendering (T284397)
 * Patch for T&S could outputs the MediaWiki SUL account along with the phab username (T344303)
 * Wrote a plugin for tox to keep supporting [tox:jenkins] CI config with tox v4 https://gerrit.wikimedia.org/g/integration/tox-jenkins-override unblocking part of the migration from tox v3.
 * Moved Civi CRM CI from Stretch to Bullseye and to php 7.4 (aligning with prod). Paired with Ejegg from FR-tech.
 * Ahmon refactoring GitLab nodepools, buildkitd persistent volume, and containerd debugging
 * Dan deep debugging of source code for containerd
 * GerritLab uses the git credential helper
 * Trusted runners now not running untrusted jobs
 * Authentication working in phorge dev environment
 * Phabricator housekeeping for open tickets assigned for more than two years
 * Phabricator logstash dashboard with filters


 * We've got a weekly Phorge deploy window, of sorts (and can ask for other things)
 * Workaround for security patches touching l10n—fixes bug!
 * Tox v4 migration in progress
 * Added phorge to the scap3 development environment!
 * Fixed a logspam-watch bug (SIGPIPE)

Last week
The six questions I answer week-by-week about our work. This is pretty much all CTPO/VP/Director-types see for what we're doing. If there are specific things to call out here, let's do.

On track

Progress update on the hypothesis for the week T344733 – Migrate metrics-platform repo to GitLab, Repo exists on GitLab, still figuring out some composer issues T347132 – Fix LDAP syncing for GitLab T346924 and T346937 – Migrating Wikimedia Stewards group/scripts from Phabricator to GitLab Any new metrics related to the hypothesis Repositories on Gerrit decreased (2012 last week → 2008 this week) Projects on GitLab increased (1364 Sept 1 → 1375 this week (+0.5 repos/day)) Any emerging blockers or risks Finding a path forward with MediaWiki testing while balancing migration fatigue. Any unresolved dependencies - do you depend on another team that hasn’t already given you what you need? Are you on the hook to give another team something you aren’t able to give right now? No Have there been any new learnings from the hypothesis? No Are you working on anything else outside of this hypothesis? If so, what? Now tracked as essential work: https://app.asana.com/0/1205533424276719/progress/1205561333945970 What was accomplished in this essential workstream this week? If nothing, why? Security/hardware/maintenance updates for Jenkins/Phab/Gerrit/GitLab Updated Releases and CI Jenkins to new LTS 2.414.2 security updates on Wednesday Train/Backport deployments 1.41.0-wmf.27 299 Patches █▂▁▂▂ in 68 repos by 70 authors 0 Rollbacks ▁▁█▁▁ 0 Days of delay ▄▄▄▄▄ 7 Blockers ▁▁▂▃█ Deployment training for Adam Basso! Does this essential workstream have any unresolved blockers or dependencies? If so, what? No

This week
Progress update on the hypothesis for the week Any new metrics related to the hypothesis Any emerging blockers or risks Any unresolved dependencies - do you depend on another team that hasn’t already given you what you need? Are you on the hook to give another team something you aren’t able to give right now? Have there been any new learnings from the hypothesis? Are you working on anything else outside of this hypothesis? If so, what?

🌻 Open source/Upstream contributions

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Upstream

Code review

 * +1'd gerrit changes
 * (filed as: https://phabricator.wikimedia.org/T344361 )

Gerrit Access requests

 * Gerrit access requests

Private repo requests
https://phabricator.wikimedia.org/search/query/E7t2_WXX01bB/#R

Gerrit repo requests

 * https://www.mediawiki.org/wiki/Gerrit/New_repositories/Requests

GitLab Access requests

 * Account Approval
 * Accounts and auth
 * GitLab access requests
 * Look up username in LDAP ( https://ldap.toolforge.org/ )
 * Look for contributions on Gerrit or Phab

High priority tasks

 * UBN! + High: https://phabricator.wikimedia.org/maniphest/query/PkxR1BXrbbU4/#R
 * Can we have this in project defaults? Protected branch: main; protected tags: *
 * New in inbox: https://phabricator.wikimedia.org/maniphest/query/7vRDrcVnt8OI/#R

📅 Vacations/Important dates

 * https://office.wikimedia.org/wiki/HR_Corner/Holiday_List#2023
 * https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar
 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off

September 2023

 * 04 Sep: Labor day (US Staff with reqs)
 * 08 Sep: Tyler
 * 15, 18 Sep: Tyler
 * 26 Aug–05 Sep: Brennen (🔥)
 * 13 Weds–17 Sun: Brennen → KS (approximate)
 * 29 Fri Sep (moving state holiday from Thu28): Andre


 * 02-03 Mon-Tue Oct: Dan

October 2023

 * 2-16 Oct: Jaime
 * 9 Oct: Indiginous people's day

Dec 2023

 * a few days after December offsite: Andre

Future

 * 15Jan - 15Mar: Andre

🔥🚂 Train

 * https://tools.wmflabs.org/versions/
 * https://train-blockers.toolforge.org/
 * https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar


 * 2 Jan - wmf.17 - Dan + Antoine (Jaime out)
 * 9 Jan - wmf.18 - Jeena + Dan (Jaime out)
 * 16 Jan - wmf.19 - Jaime + Jeena
 * 23 Jan - wmf.20 - Brennen + Jaime
 * 30 Jan - wmf.21 - Ahmon + Brennen
 * 6 Feb - wmf.22 - Chad + Ahmon
 * 13 Feb - wmf.23 – Dan + Chad
 * 20 Feb - wmf.24 – Antoine + Dan
 * 27 Feb - wmf.25 – Jaime + Antoine
 * 6 Mar – wmf.26 – Jeena + Jaime
 * 13 Mar – wmf.27 – Brennen + Jeena
 * 20 Mar – wmf.1 – Ahmon + Brennen
 * 27 Mar – wmf.2 – Chad Dan + Ahmon
 * 3 Apr – wmf.3 – Antoine + Dan
 * 10 Apr – wmf.4 – Chad + Antoine
 * 17 Apr – wmf.5 – Jaime + Chad
 * 24 Apr – wmf.6 – Jeena + Jaime
 * 1 May – wmf.7 – Brennen + Jeena
 * 8 May – wmf.8 – Antoine + Brennen (Ahmon out + Antoine Out 8th)
 * 15 May – wmf.9 – Ahmon + Antoine (Dan out + Chad out)
 * 22 May – wmf.10 – Chad + Ahmon (Dan out + Jeena out 26th)
 * 29 May – wmf.11 – Dan + Chad (Memorial Day 29th)
 * 5 Jun – wmf.12 – Jeena + Dan (Brennen out, Jaime out)
 * 12 Jun – wmf.13 – Jaime + Jeena
 * 19 Jun – wmf.15 – Cancelled for offsite
 * 26 Jun – wmf.16 – Brennen + Jaime (Jeena out)
 * 3 Jul – wmf.17 – Antoine + Brennen (3rd + 4th holidays)
 * 10 Jul – wmf.18 – Dan + Antoine (Ahmon out)
 * 17 Jul – wmf.19 – Ahmon+Dan (Brennen out Friday)
 * 24 Jul – wmf.20 – Jaime+Ahmon
 * 31 Jul – wmf.21 – Ahmon+Jaime (Jeena out, Antoine out) (Ahmon volunteered)
 * 7 Aug – wmf. 22 – No train
 * 14 Aug - wmf.23 – Ahmon+Jaime (Jeena out, Antoine out)
 * 21 Aug - wmf.24 – Dan(brennen out, Jeena out, Antoine out)
 * 28 Aug – wmf.25 – Jeena+Dan
 * 04 Sep – wmf.26 – Antoine+Jeena
 * 11 Sep – wmf.27 – Jaime+Antoine+Andre as lurker!
 * 18 Sep – wmf.28 – Brennen+Jaime
 * Logspam-watch needs some attention
 * Every deploy is rebuilding l10n


 * 25 Sep – 1.42.0-wmf.1 – Dan + Brennen
 * 2 Oct – 1.42.0-wmf.2 – Jeena + Dan (Jaime Out)
 * 9 Oct – 1.42.0-wmf.3 – Antoine + Jeena (Jaime Out)
 * 16 Oct – 1.42.0-wmf.4 – Brennen + Antoine
 * 23 Oct – 1.42.0-wmf.5 – Ahmon + Brennen
 * 30 Oct – 1.42.0-wmf.6 – Dan + Ahmon

Team discussions

 * Cancelling next week for WM connect
 * Note there's a GitLab datacenter / host switch coming on Thursday: https://phabricator.wikimedia.org/T345531 - downtime is expected
 * Let's confirm that people know this ;D

Offsite!

 * Brainstorming doc coming soon
 * Think about: Work activities, Discussion topics (information sharing/collective decision making), Fun activities