Wikimedia Release Engineering Team/Checkin archive/2021-02-10

= 2020-02-10 =

Vacations/Important dates

 * https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
 * How to do it


 * 15 Feb: Presidents' Day -- US staff with reqs


 * 29 Mar: US staff with reqs


 * 12 Apr: US staff with reqs
 * 22 Apr: Earth Day -- US staff with reqs


 * I made this: https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar
 * Am I missing anything?

Train

 * Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R
 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Important_dates


 * 16 Nov - wmf.18 - Ahmon + Antoine
 * 23 Nov - wmf.19 - No Train - Thanksgiving Thurs/Fri https://phabricator.wikimedia.org/T263185
 * 30 Nov - wmf.20 - Antoine + Mukunda
 * 7 Dec - wmf.21 - Mukunda + Dan
 * 14 Dec - wmf.22 - Dan + Jeena
 * 21 Dec - wmf.23 - No Train
 * 28 Dec - wmf.24 - No Train
 * 4 Jan - wmf.25 - Jeena + Lars Antoine
 * NB: Lars is only back from holiday on Thursday Jan 7
 * 11 Jan - wmf.26 - Lars + Jeena
 * 18 Jan - wmf.27 - Brennen + Lars (Monday is a holiday)
 * 25 Jan - wmf.28 - Ahmon + Brennen
 * 1 Feb - wmf.29 - Antoine + Ahmon
 * 8 Feb - wmf.30 - Mukunda + Antoine


 * 15 Feb - wmf.31 - Dan + Mukunda (Monday is a holiday)
 * 22 Feb - wmf.31 - Jeena + Dan
 * 1 Mar - wmf.31 - Lars + Jeena
 * 8 Mar - wmf.31 - Brennen + Lars

Status

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

SoS

 * 2019-08-14 onwards: Zeljko 🎸 🎷 \o/
 * 2020-08-26 onwards: Deb is in charge/SoS is async
 * 2020-11-25: Brennen
 * 2020-12-02: Ahmon
 * 2020-12-09: Tyler
 * 2020-12-16: Antoine
 * 2021-01-06: Tyler
 * 2021-01-13: Text only update
 * 2021-01-20: Mukunda
 * 2021-01-27: Text only update
 * 2021-02-03: Thcipriani
 * 2021-02-10: Thcipriani

Outgoing

 * Blocked by:
 * Serviceops: docker-pkg: "certificate verify failed: unable to get local issuer certificate" for docker-registry.discovery.wmnet when publishing dev-images from contint2001
 * Have checked the obvious stuff, but not really sure how to proceed.
 * Blocking:
 * Updates:
 * [All] Deployments/Covid-19 https://wikitech.wikimedia.org/wiki/Deployments/Covid-19
 * Train Health
 * Last week: 1.36.0-wmf.29 T271343
 * This week: 1.36.0-wmf.30 T271344
 * Next week: 1.36.0-wmf.31 T271345
 * Next week: 1.36.0-wmf.31 T271345

Callouts

 * RelEng: Trying to be a bit more strict about log messages, see Greg's email: https://lists.wikimedia.org/pipermail/wikitech-l/2021-February/094250.html

Incoming/Needs attention

 * 2021-02-10: Brennen demos logspam-watch!!!
 * Source: https://gerrit.wikimedia.org/r/plugins/gitiles/operations/puppet/+/refs/heads/production/modules/role/files/logging
 * Train handoff idea: https://gitlab.com/gitlab-com/gl-infra/on-call-handovers/-/issues?label_name=SRE%3AOn-Call
 * Feedback on: https://lists.wikimedia.org/pipermail/wikitech-l/2021-February/094250.html
 * "Cool"/"Can I join the triage meeting"
 * Triage meeting: needs documented
 * TODO: Tyler to document

Book club/Lunch and Learn

 * https://www.mediawiki.org/wiki/Wikimedia_Engineering_Productivity_Team/Book_club
 * https://www.mediawiki.org/wiki/Wikimedia_Engineering_Productivity_Team/Lunch_and_learn
 * https://www.mediawiki.org/wiki/Wikimedia_Engineering_Productivity_Team/Read_papers_and_talk
 * Feb 15th Mar 1st: Lars -- David Allen's Getting Things Done (GTD)

Monthly reflection on accomplishments - Feb '21 edition

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
 * Add as you have them!


 * PipelineLib fully working on releases-jenkins.wikimedia.org

Ahmon

 * Updates:
 * Working on packaging up multiversion mediawiki container image stuff so that others can try it out using minikube. Currently battling OOMKiller.
 * Blocked by:
 * N/A
 * Blocking:
 * Timo asked about T266055: Reading and making a decision on how to move forward
 * Need to get multiversion MW stuff to Joe to he can check it out.

Antoine

 * Blocked by:
 * Blocking:
 * doc.wikimedia.org upgrade to Buster. Gotta pair that with Liw for "synergetic knowledge engine" transfer
 * Updates:
 * Hoping to do the Quibble jobs upgrade to Buster next week
 * Got a new gpg key!
 * In progress doc for using Gerrit upstream war + build plugins
 * Next Jenkins Gearman plugin upgrade!
 * Next Jenkins Gearman plugin upgrade!

Brennen

 * Blocked by:
 * dev-images publishing issue
 * Blocking:
 * FR Tech on their dev-images changes
 * Updates:
 * Un-expired GPG key (hopefully)
 * GitLab and authentication:
 * Waiting on John Bond to (hopefully) set up CAS in wmcloud
 * Picking away at learning other stuff about how this works
 * Going to rewrite train docs drastically
 * Portal + sidebar nav pattern

Dan
can Jeena join too? (yes!)
 * Blocked by:
 * Blocking:
 * Updates:
 * PipelineLib fully working on releases-jenkins.wikimedia.org (w00t)
 * I need to brainstorm with someone about multiversion image (Ahmon has volunteered)
 * TL;DR how do we take an arbitrary number of single-version images to integrate. PipelineLib config is static with no function for looping over inputs. We can certainly do everything in a blubber variant (parse wikiversions.json, git clone each branch, ...) but then we're not reusing prebuilt single-version images (that have potentially already run a build step, etc.)
 * I need to brainstorm with someone about multiversion image (Ahmon has volunteered)
 * TL;DR how do we take an arbitrary number of single-version images to integrate. PipelineLib config is static with no function for looping over inputs. We can certainly do everything in a blubber variant (parse wikiversions.json, git clone each branch, ...) but then we're not reusing prebuilt single-version images (that have potentially already run a build step, etc.)

Jeena

 * Blocked by:
 * Blocking:
 * reviews
 * Updates:
 * Working on MW on k8s secrets
 * local dev stuff
 * event driven systems group
 * pipelinelib credentials
 * pipelinelib credentials

Lars

 * Blocked by:
 * nada
 * Blocking:
 * nada?
 * Updates:
 * Python 2 is fading away slowly, Python packages are dropping support for it
 * Scap is moving towards a position where we can do a controlled migration rather than an abrupt sudden one
 * Tuesday, Feb 17, at 17:00 UTC, a Rust introduction tutorial
 * tell me if you want to join, and I'll add you to the calendar invite
 * You all should sleep and not have a headache. Not enough sleep and headaches are not recommended.

Mukunda

 * Blocked by:
 * perl doesn't support utf8? 😡😞
 * Does, but the boilerplate can be a little tricky. How can I help? :D
 * Blocking:
 * Updates:
 * Played with logspam-watch, it's very cool and I've got some ideas for features ;)
 * phatality more difficult than it should be due to kibana breaking api in minor release
 * I have a working kibana 7 dev environment, however, it's moving more slowly than I'd like, largely due to the train currently
 * I have a working kibana 7 dev environment, however, it's moving more slowly than I'd like, largely due to the train currently

Tyler

 * Blocked by:
 * Nothing.
 * Blocking:
 * Everything.
 * Updates:
 * DeploymentCalendarBot: fighting tox
 * Have ~50 Résumés for SRE position -- tell your friends!
 * Got 5 responses to train practices survey -- check your email if you haven't filled it out
 * Gave an m8s update for senior leadership Tuesday
 * Highlights:
 * http://tyler.zone/the-previous-slide.png
 * http://tyler.zone/releng-deployment-future.png
 * Train communication becoming a bit fragmented
 * Element.io: what's happening?
 * Slack?