Wikimedia Release Engineering Team/Checkin archive/20191204

= 2019-12-04 =

Vacations/Important dates

 * https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
 * How to do it


 * December 1–2: Jeena


 * December 6: Lars (Finnish Independence Day)
 * December 23: James, Brennen, Greg (need to put it in Namely)
 * December 24–31 (Christmas): Staff with reqs (everyone? (yes))
 * December 25–26: Lars (Christmas)


 * 1 January (New Year's Day): Staff with reqs, Lars
 * 2–3 January: James
 * 20 January (Martin Luther King Jr. Day): Staff with reqs


 * 17 February (Presidents' Day): Staff with reqs


 * 9 March (DST+1 day): Staff with reqs


 * 24 April (Not-Easter): Staff with reqs


 * 25 May (Memorial Day): Staff with reqs

Train

 * Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R


 * 25 Nov - wmf.8 [Group0 on Tuesday] - Brennen + Mukunda (Thanksgiving)


 * 2 Dec - wmf.8 part 2 [Wednesday Group1 + Thursday Group2] - Brennen + Dan
 * 9 Dec - wmf.10 - Dan + James
 * 16 Dec - wmf.11 - James + Jeena
 * 23 Dec - wmf.12 - No Train or any other deploys (Winterval)
 * 30 Dec - wmf.13 - No Train or any other deploys (Still Winterval)
 * 6 Jan - wmf.14 - Jeena + Lars
 * 13 Jan - wmf.15 - Lars + Antoine

SoS

 * Aug 14 onward: Zeljko 🎸 🎷 \o/

Incoming/Needs attention

 * New skill matrix: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Skill_matrix
 * New workboard for December: https://phabricator.wikimedia.org/project/view/4401/ -- make sure your tasks look right
 * Enable API integration tests in CI for MediaWiki core https://phabricator.wikimedia.org/T236680
 * Antoine taking this task.
 * Add curl support to mwext-node10-rundoc-docker https://phabricator.wikimedia.org/T239246
 * Antoine to decide
 * Create and maintain somehow a list of repos mastered in GitHub (and in Differential) https://phabricator.wikimedia.org/T237470
 * Support MarcoAurelio and make it semi-automated? Halp.
 * mobileapps-periodic-test failing since 2019-12-04 01:00 UTC due to failing git fetches https://phabricator.wikimedia.org/T239815
 * Broken by phab 1003->1001 migration? Other things also are broken, apparently. :-(
 * There is _something_ broken about this repo but I can't make sense of what it is. Shallow clone fails but a normal clone works fine.


 * "integration" (CI) WMCS project: jessie usage needs replacing with buster/stretch https://phabricator.wikimedia.org/T236576
 * Antoine?
 * Antoine to write a doc about everything that has to be done (eg: portals build, wdqs gui build, debian glue, zuul package)
 * TODO assign to antoine and comment
 * See also https://phabricator.wikimedia.org/project/view/4080/ (continuous integration infrastructure > phase-out-jessie )

Offsite Actions

 * 🏂 [thcipriani] figure out what part of team meeting to move to phab
 * 🏂 [James + Antoine] draft runbooks listing
 * Very initial page at https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Runbooks; more coming today.
 * [dan + brennen] explore tools for pairing
 * Ž: stumbled upon this recently https://pragprog.com/book/jkrp/remote-pairing
 * ✅ ✅ [thcipriani] add James to train duty rotation
 * [Dan + Jeena] add blubber to local dev
 * -> Q3 goals?
 * [Mukunda] phab to local dev
 * -> Q3 goals?
 * [thcipriani] lunch and learns


 * 🏂 [thcipriani] SPOF Training program
 * Idea: assigned pairings for folks
 * Things in production that we intend to maintain over the next year + current owners:
 * Gerrit: Thcipriani -- two people needed
 * Scap: Thcipriani -- two people needed -- Dan + Lars
 * Phabricator: Mukunda + designated tribute (antoine: could use training for the basics) (brennen: well, I know PHP...)
 * Jenkins/Zuul/CI infra: Antoine + James
 * Production config architecture: James + designated tribute


 * [Mukunda] Monthly rotating blog post
 * [thcipriani/greg] Program/Project managers
 * [JDF] highlighted this to Grace, so she expects outreach to understand the role.

Q3 (Jan–Mar 2020) Goal Planning is upon us!

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals


 * Dan + Lars: Scap
 * For us from performance team -- scap work: https://phabricator.wikimedia.org/T99740
 * "We are happy to provide help on this task in an advisory role if needed."


 * Mukunda + James: Automate branchcut


 * Lars + Mukunda?: Something something security patches -- tentative
 * https://phabricator.wikimedia.org/T202356


 * Antoine: Jessie migration for integration project
 * Needs support for blubber. Overlap with Pipeline migrations goal below.
 * Needs support for Scap


 * Antoine + James: Quibble parsing extension.json for dependencies instead of hard-coded in CI.


 * DECISION: Let's not do wikimedia/production.git until we have more clarity on timeline for way forward from SRE.


 * Local dev
 * [Finish putting TMH in local-charts if not done by then.]
 * Land basic local dev into mw/core itself.


 * James: Pipeline migrations, cont'd -- supporting teams as they switch [Minimal work from RelEng side; depends on SRE & teams.] Overlap with Jessie migration for integration.


 * Pipeline documentation
 * Dan + Lars


 * [Pending discussion with SRE] New CI

Timespent spreadsheet

 * For the avoidance of doubt: fill out the sheet week number for the previous week


 * https://docs.google.com/spreadsheets/d/1YS_2eUQWUOnygshMfxgGPu93GKGCO5t00yjUREQ5B-I/edit#gid=1441822979
 * reminder: your time spent doesn't need to total to 100%

Book club

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club
 * Happening 2019-12-10
 * You should have an invite
 * https://google.github.io/eng-practices/review/reviewer/

Monthly reflection on accomplishments - December '19 edition

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
 * Add as you have them!


 * PHP 7.4 testing was available in CI the first "business day" after 7.4.0 was released.

Incoming from last week (aka this morning)

 * Blocked by:
 * None known.
 * Blocking:
 * Wikimedia Deutschland/Wikidata: Setting up Pipeline CI job for wikibase/vuejs-components repository: https://gerrit.wikimedia.org/r/c/integration/config/+/551829
 * Updates:
 * Train Health
 * Last week: 1.35.0-wmf.8 - T233856 - group0 only because of Thanksgiving
 * This week: 1.35.0-wmf.8 - T233856 - group1 + group2
 * Next week: 1.35.0-wmf.10 - T233858

Callouts

 * Release Engineering - unusual train schedule:
 * This week: 1.35.0-wmf.8 - group1 + group2
 * Next week: 1.35.0-wmf.10
 * December 23-January 3rd - No deploys (including train), Holiday break

Outgoing next week

 * Blocked by:
 * Blocking:
 * Updates:
 * Train Health
 * Last week: 1.35.0-wmf.8 - T233856 - group1 + group2
 * This week: 1.35.0-wmf.10 - T233858
 * Next week: 1.35.0-wmf.11 - T233859

Callouts

 * Release Engineering - December 23-January 3rd - No deploys (including train), Holiday break

Train status and happenings

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

Standup!

 * Make sure your tasks are correct on our kanban board!
 * https://phabricator.wikimedia.org/project/board/4105/

Last week

 * Best thing
 * Mukunda empowered Antoine as a Phabricator administrator. \o/
 * Started Doxygen Debian packaging backport to fix search
 * Jenkins job collapsible sections fixed. Learned more about Jenkins plugins / maven https://phabricator.wikimedia.org/T236222
 * Worst thing
 * CI debian-glue job does not support pristine-tar delta v3 due to running on Jessie grr
 * What I planned vs did
 * Did Quibble reviews
 * Unplannned

This week

 * What I plan to do
 * Blockers
 * Blockers

Last week

 * Best things
 * This Week in Logspam seems to have prompted action \o/
 * Got my backpack
 * Worst thing
 * Was still pretty fried after offsite
 * What I planned vs did
 * ✅ dev-images:
 * stretch-php72: Add PHP redis and mysql-client plus some utils to dependencies
 * Update stretch dependencies
 * ✅ Some learning effort for Tuesday's Rust study group meeting
 * https://code.p1k3.com/gitea/brennen/bpb-words
 * Unplannned
 * Some feedback for JR on WMF-provided equipment

This week

 * What I plan to do
 * Finish deploying 1.35.0-wmf.8
 * Update skill matrix
 * Read for book club
 * Fill out offsite survey
 * Keysigning!
 * Hack on T238224 Provide docker-compose based development enviornment in mediawiki core
 * Blockers

Last week

 * Best thing
 * Not working
 * Worst thing
 * Staying in a household where no one else drinks coffee, thus no coffee being readily available
 * 😱 Can we drop-ship you a portable coffee machine? Yes! Next time :) Or I can just buy myself an Aeropress
 * What I planned vs did
 * N/A
 * Unplannned
 * N/A

This week

 * What I plan to do
 * Come up with questions for SRE re: third-party vs. WMF K8s platform
 * Reaquaint myself with scap codebase and look at ways to support PHP-based l10n
 * Talk to Brennen about pairing tooling research and experimentation
 * PipelineLib user documentation
 * PipelineLib git clone improvements (depth and parallel clone support)
 * Tooling to simplify easier taskification of daily work
 * Taskify the above
 * Blockers
 * Argo CI platform work blocked on SRE

Last week

 * Best thing
 * vacation
 * left overs
 * Worst thing
 * rain
 * What I planned vs did
 * Unplannned
 * Unplannned

This week

 * What I plan to do
 * MTP/OKR metrics working group
 * leveling/job codes
 * review as much of techconf+offsite notes as possible
 * all hands team day (mostly done for now, but more coming)
 * Blockers
 * time
 * parents in town

Last week

 * Best thing
 * Finally got auto-built DBlists out of the door. \o/
 * [Also, Friendsgiving was nice: https://www.instagram.com/p/B5cLsL-JdW8/ ]
 * Worst thing
 * Got almost nothing done due to pesky holidays.
 * What I planned vs did
 * Not much.
 * Unplannned
 * A few things broke.

This week

 * What I plan to do
 * JDI for CI diff reports of changes, and then? static config in production
 * CI/CR metrics doc fiddles.
 * Runbooks documentation collation/writing.
 * Blockers
 * None known.

Last week

 * Best thing
 * Making Tea :D :D :D
 * Worst thing
 * Food Poisoning :(
 * What I planned vs did
 * Vacation
 * Unplannned

This week

 * What I plan to do
 * Catch up on emails
 * Catch up on things that got done while gone
 * Do Keysigning
 * register for all hands
 * Blockers

Last week

 * Best thing
 * Getting over jet lag, more or less.
 * Worst thing
 * The Darkness.
 * What I planned vs did
 * ✅Set up git repo for PGP public keys on Gerrit, for keysigning.
 * ❌ Read TechConf and offsite notes, extract any useful bits.
 * ❌ Ponder SRE input on new CI from TechConf. Discuss with Tyler, Dan.
 * ❌ Do an Argo test deployment.
 * ❌ Start work on documenting pipelinelib so it can be re-implemented for new CI.
 * Unplanned
 * Participated in email discussion about not dropping embargoed security patches.

This week

 * What I plan to do
 * Write and send out howto for signing PGP keys. T239829
 * Read TechConf and offsite notes, extract any useful bits.
 * Ponder SRE input on new CI from TechConf. Discuss with Tyler, Dan.
 * Do an Argo test deployment.
 * Start work on documenting pipelinelib so it can be re-implemented for new CI.
 * Blockers
 * Nope.

Other

 * SAD is kicking me in the head. Please make the Darkness go away.
 * Some shoulder and shoulder blade trouble. Not too bad.

Last week

 * Best thing
 * Phab migrated to phab1001
 * Worst thing
 * phab1001 has horrible disk i/o performance. The SATA controller is set to legacy ide mode in bios and it's going to require a reinstall to fix it.
 * What I planned vs did
 * ✅ phabricator migration
 * ❌ phabricator upgrade: still need to merge from upstream/stable && deploy.
 * Unplannned
 * Phabricator: debian reimage/reinstall tonight

This week

 * What I plan to do
 * Finish my phabricator redundancy OKRs
 * Finish reinstalling phab1001
 * Test some more failure scenarios.
 * Look into open-sourcing phabricator-antivandalism as I finally have the OK from our security team.
 * Blockers
 * Needing to sleep occasionally.

Last week

 * Best thing
 * Didn't horribly burn myself
 * Worst thing
 * Holidays/Blazey's family/being sick
 * What I planned vs did
 * ✅ Mandatory trainings
 * ✅ 177 résumés Hiring reviews
 * Offsite TODO amalgamation
 * Unplannned

This week

 * What I plan to do
 * Wrangle hiring loop
 * Build SPoF program
 * Q3 planning kickoff
 * Do keysigning!
 * Register for all-hands (everyone!)
 * Blockers

Other

 * Dog reajusting to 3 week schedule change
 * I am still sick :(

Last week

 * Best thing
 * caugh up on sleep 😴
 * Worst thing
 * safeguard contract 📜
 * What I planned vs did
 * catch up on gerrit/phabricator/mail ✅
 * Selenium documentation updates ❌
 * Unplannned
 * safeguard contract 📜
 * Harassment & Discrimination Prevention 👊

This week

 * What I plan to do
 * work on testing related questions for interviews with developers ❓
 * expense report (Coupa)
 * prepare to close my company: paperwork, meet with accountant... 👔
 * read article for book club (can not attend book club) 📖
 * prepare talk about software testing anti patterns for local tech meetup 🎤
 * use more emoji 🤠
 * Blockers

Other

 * my phone started behaving strangely recently, had to do factory reset over the weekend, it took a few hours to get back to being functional but looks like problems are solved