Jump to content

Wikimedia Release Engineering Team/Checkin archive/2023-09-20

From mediawiki.org

 

[edit]

🏆 Wins[edit]

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
Sep '23 edition
  • Image published for Blubber that is native LLB, no dockerfile anymore
    • implications
      • dockerfile is unnecessary since no one sees the dockerfile—we can customize each llb instruction and what it displays to the users: a name that corresponds to the blubber.yaml config
      • now we have the ability to create our own instructions
      • dockerfile2llb gone! No more external helper images that haven't been maintained just to copy files around—no more cross-platform compatibility/emulation issues
      • llb gets new stuff first—ex: diffop/mergeop https://www.docker.com/blog/mergediff-building-dags-more-efficiently-and-elegantly/
  • Phorge working on the scap3∞ deployment environment
  • Landed 3 upstream phorge patches, 1 is one we've had for years the blocks some tasks rendering (T284397)
  • Patch for T&S could outputs the MediaWiki SUL account along with the phab username (T344303)
  • Wrote a plugin for tox to keep supporting [tox:jenkins] CI config with tox v4 https://gerrit.wikimedia.org/g/integration/tox-jenkins-override  unblocking part of the migration from tox v3.
  • Moved Civi CRM CI from Stretch to Bullseye and to php 7.4 (aligning with prod). Paired with Ejegg from FR-tech.
  • Ahmon refactoring GitLab nodepools, buildkitd persistent volume,  and containerd debugging
  • Dan deep debugging of source code for containerd
  • GerritLab uses the git credential helper
  • Trusted runners now not running untrusted jobs
  • Authentication working in phorge dev environment
  • Phabricator housekeeping for open tickets assigned for more than two years
  • Phabricator logstash dashboard with filters

OKR update[edit]

Last week[edit]

The six questions I answer week-by-week about our work. This is pretty much all CTPO/VP/Director-types see for what we're doing. If there are specific things to call out here, let's do.

On track

Progress update on the hypothesis for the week T343035 – Sync ldap/ops users to group on GitLab – All members of SRE are now owners of the repos/sre subgroup on GitLab T346084 – Consulting with data engineering on memory-optimized runners on GitLab T346090 – Debian 12 support for python images in our image building tool T344747 – Mathoid migrated to GitLab Any new metrics related to the hypothesis Repositories on Gerrit decreased (2019 last week → 2012 this week) Any emerging blockers or risks Upcoming work to scope stacked testing will give us a better understanding of the risks of MediaWiki migration Any unresolved dependencies - do you depend on another team that hasn’t already given you what you need? Are you on the hook to give another team something you aren’t able to give right now? No Have there been any new learnings from the hypothesis? No Are you working on anything else outside of this hypothesis? If so, what? MediaWiki 1.41.0-wmf.26 298 Patches ▇█▂▁▂ in 69 repos by 75 authors 0 Rollbacks ▁▁▁█▁ 0 Days of delay █▁▁▁▁ 3 Blockers █▁▁▃▆ T346266 establishing a routine Phab deploy window with serviceops collab

This week[edit]

Progress update on the hypothesis for the week

  •  

Any new metrics related to the hypothesis

  • we should report the number of repos in gitlab too

Any emerging blockers or risks

  •  

Any unresolved dependencies - do you depend on another team that hasn’t already given you what you need?

  •  

Are you on the hook to give another team something you aren’t able to give right now?

  •  

Have there been any new learnings from the hypothesis?

  •  

Are you working on anything else outside of this hypothesis? If so, what?

  •  

🌻 Open source/Upstream contributions[edit]

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Upstream

😶 Let's keep these empty[edit]

Code review[edit]

Gerrit Access requests[edit]

Private repo requests[edit]

https://phabricator.wikimedia.org/search/query/E7t2_WXX01bB/#R

Gerrit repo requests[edit]

GitLab Access requests[edit]

High priority tasks[edit]

📅 Vacations/Important dates[edit]

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List#2023
https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar
https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off

September 2023[edit]

  • 04 Sep: Labor day (US Staff with reqs)
  • 08 Sep: Tyler
  • 15, 18 Sep: Tyler
  • 26 Aug–05 Sep: Brennen (🔥)
  • 13 Weds–17 Sun: Brennen → KS (approximate)
  • 29Fri Sep (moving state holiday from Thu28): Andre
  • a few days after December offsite: Andre

October 2023[edit]

  • 2-16 Oct: Jaime

Nov 2023[edit]

  •  

Dec 2023[edit]

  •  

Future[edit]

  • 15Jan - 15Mar: Andre


🔥🚂 Train[edit]

https://tools.wmflabs.org/versions/
https://train-blockers.toolforge.org/
https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar


  • 2 Jan - wmf.17 - Dan + Antoine (Jaime out)
  • 9 Jan - wmf.18 - Jeena + Dan (Jaime out)
  • 16 Jan - wmf.19 - Jaime + Jeena
  • 23 Jan - wmf.20 - Brennen + Jaime
  • 30 Jan - wmf.21 - Ahmon + Brennen
  • 6 Feb - wmf.22 - Chad + Ahmon
  • 13 Feb - wmf.23 – Dan + Chad
  • 20 Feb - wmf.24 – Antoine + Dan
  • 27 Feb - wmf.25 – Jaime + Antoine
  • 6 Mar – wmf.26 – Jeena + Jaime
  • 13 Mar – wmf.27 – Brennen + Jeena
  • 20 Mar – wmf.1 – Ahmon + Brennen
  • 27 Mar – wmf.2 – Chad Dan + Ahmon
  • 3 Apr – wmf.3 – Antoine + Dan
  • 10 Apr – wmf.4 – Chad + Antoine
  • 17 Apr – wmf.5 – Jaime + Chad
  • 24 Apr – wmf.6 – Jeena + Jaime
  • 1 May – wmf.7 – Brennen + Jeena
  • 8 May – wmf.8 – Antoine + Brennen (Ahmon out + Antoine Out 8th)
  • 15 May – wmf.9 – Ahmon + Antoine (Dan out + Chad out)
  • 22 May – wmf.10 – Chad + Ahmon (Dan out + Jeena out 26th)
  • 29 May – wmf.11 – Dan + Chad (Memorial Day 29th)
  • 5 Jun – wmf.12 – Jeena + Dan (Brennen out, Jaime out)
  • 12 Jun – wmf.13 – Jaime + Jeena
  • 19 Jun – wmf.15 – Cancelled for offsite
  • 26 Jun – wmf.16 – Brennen + Jaime (Jeena out)
  • 3 Jul – wmf.17 – Antoine + Brennen (3rd + 4th holidays)
  • 10 Jul – wmf.18 – Dan + Antoine (Ahmon out)
  • 17 Jul – wmf.19 – Ahmon+Dan (Brennen out Friday)
  • 24 Jul – wmf.20 – Jaime+Ahmon
  • 31 Jul – wmf.21 – Ahmon+Jaime (Jeena out, Antoine out) (Ahmon volunteered)
  • 7 Aug – wmf. 22 – No train
  • 14 Aug - wmf.23 – Ahmon+Jaime (Jeena out, Antoine out)
  • 21 Aug - wmf.24 – Dan(brennen out, Jeena out, Antoine out)
  • 28 Aug – wmf.25 – Jeena+Dan
  • 04 Sep – wmf.26 – Antoine+Jeena
  • 11 Sep – wmf.27 – Jaime+Antoine+Andre as lurker!
  • 18 Sep – wmf.28 – Brennen+Jaime
    • Logspam-watch needs some attention
    • Every deploy is rebuilding l10n
  • 25 Sep – 1.42.0-wmf.1 – Dan + Brennen
  • 2 Oct – 1.42.0-wmf.2 – Jeena + Dan (Jaime Out)
  • 9 Oct – 1.42.0-wmf.3 – Antoine + Jeena (Jaime Out)
  • 16 Oct – 1.42.0-wmf.4 – Brennen + Antoine
  • 23 Oct – 1.42.0-wmf.5 – Ahmon + Brennen
  • 30 Oct – 1.42.0-wmf.6 – Dan + Ahmon

Team discussions[edit]

GitLab meeting recap[edit]

  • Questions
    • SRE needs vs MediaWiki needs?
      • Covering Depends-On + Stacking should meet their needs
      • Gating
        • Couple things get bunched in: dependent pipelines (save time), setting up the tests, atomic function of performing the merge
  • Scope: Depends-on, Dependent pipeline, Merge atomicity
  • Pre-work: MUST, SHOULD, MAY
  • TODO: Meeting w/Ahmon, Dan, Jeena, Cindy

Offsite![edit]

  • Brainstorming doc coming soon
    • Think about: Work activities, Discussion topics (information sharing/collective decision making), Fun activities
Retrieved from "https://www.mediawiki.org/w/index.php?title=Wikimedia_Release_Engineering_Team/Checkin_archive/2023-09-20&oldid=6145534"