Wikimedia Release Engineering Team/Checkin archive/20191218

= 2019-12-18 =

Vacations/Important dates

 * https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
 * How to do it


 * December 1–2: Jeena
 * December 6: Lars (Finnish Independence Day)


 * December 20: Mukunda, Greg
 * December 23: Everyone except Jeena and Antoine (James, Brennen, Greg, Thcipriani, Dan, Mukunda, Lars)
 * December 24–31 (Winterval): Everyone


 * 1 January (New Year's Day): Staff with reqs, Lars
 * 2 January: Lars
 * 2–3 January: James, Thcipriani
 * 2-10 January: Dan
 * 6 January: probably Lars (public holiday because it's been N days since Xmas)
 * 20 January (Martin Luther King Jr. Day): Staff with reqs


 * 17 February (Presidents' Day): Staff with reqs


 * 9 March (DST+1 day): Staff with reqs


 * 24 April (Not-Easter): Staff with reqs


 * 25 May (Memorial Day): Staff with reqs

Train

 * Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R


 * 25 Nov - wmf.8 [Group0 on Tuesday] - Brennen + Mukunda (Thanksgiving)
 * 2 Dec - wmf.8 part 2 [Wednesday Group1 + Thursday Group2] - Brennen + Dan
 * 9 Dec - wmf.10 - Dan + James


 * 16 Dec - wmf.11 - James + Jeena
 * 23 Dec - wmf.12 - No Train or any other deploys (Winterval)
 * 30 Dec - wmf.13 - No Train or any other deploys (Still Winterval)
 * 6 Jan - wmf.14 - Jeena + Lars
 * 13 Jan - wmf.15 - Lars + Antoine

All Hands week starts Jan 27. Should we avoid deployments? and notify everyone of that? what about recovery from the trip? and fosdem?

SoS

 * Aug 14 onward: Zeljko 🎸 🎷 \o/

Incoming/Needs attention

 * New skill matrix: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Skill_matrix
 * Jeena ^
 * New workboard for December: https://phabricator.wikimedia.org/project/view/4401/ -- make sure your tasks look right
 * Modify Quibble to accept a LocalSettings.php file https://phabricator.wikimedia.org/T235865
 * MW RestAPI Integration tests help for quibble ^
 * New new workboard for January: https://phabricator.wikimedia.org/project/board/4434/ (don't use yet)

Q3 (Jan–Mar 2020) Goal Planning is upon us!

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals

Reduce Complexity of Platform Maintain and evolve developer tooling, testing infrastructure, validation environments, deployment infrastructure, and supporting processes


 * Localdev mw/core (Brennen + Jeena)
 * Gerrit 2.15 -> 2.16 (con't) (Thcipriani + Dan + Antoine)
 * Phabricator: eliminate elasticsearch for phabricator search (Mukunda + Brennen) https://phabricator.wikimedia.org/T230787

Maintain and improve the Continuous Integration and Testing services
 * Quibble extension.json parsing + migration (James + Antoine + Jeena)
 * Pipelinelib documentation (Dan + Lars)
 * Migrate zuul deployment to scap3 (Antoine + Mukunda)
 * "integration" Cloud VPS project jessie deprecation (Antoine + James + Jeena)
 * Unnamed "New CI work" TBD after meeting with SRE (Dan + Lars)

Developers have a consistent and dependable deployment service
 * Scap: Use static php array files for l10n cache instead of CDB (Dan + Lars)
 * Scap: Run Swagger checks in Scap before exposing to prod MW traffic https://phabricator.wikimedia.org/T239376
 * tl;dr: lots and lots of scap tasks if folks are interested :)
 * Pipeline migrations (con't) (Dan + Lars + James)

Timespent spreadsheet

 * For the avoidance of doubt: fill out the sheet week number for the previous week

https://docs.google.com/spreadsheets/d/1YS_2eUQWUOnygshMfxgGPu93GKGCO5t00yjUREQ5B-I/edit#gid=564813047
 * reminder: your time spent doesn't need to total to 100%

Book club

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club

Monthly reflection on accomplishments - December '19 edition

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
 * Add as you have them!


 * PHP 7.4 testing was available in CI the first "business day" after 7.4.0 was released.
 * Revived "This week in logspam" email
 * Auto DBLists
 * PGP Key repo
 * Production config now has pre-merge diff reports, e.g.: https://integration.wikimedia.org/ci/job/operations-mw-config-php72-composer-diffConfig-docker/86/console

Scrum of Scrums for next week
—

Incoming from last week (aka this morning)

 * Blocked by:
 * Blocking:
 * Updates:
 * Train Health
 * Last week: 1.35.0-wmf.10 - T233858
 * This week: 1.35.0-wmf.11 - T233859
 * Next week: No Train - 2 weeks!

Callouts

 * Release Engineering - December 23-January 3rd - No deploys (including train), Holiday break

Outgoing next week
No one's here.

Train status and happenings

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

Standup!

 * Make sure your tasks are correct on our kanban board!
 * https://phabricator.wikimedia.org/project/board/4105/

Last week

 * Best thing
 * Doxygen 1.8.16 packaged and migration fully completed.
 * Worst thing
 * It is complicated. not much :)
 * What I planned vs did
 * Polished a bit the Jessie migration doc.
 * To be completed this week and reflected on tasks of https://phabricator.wikimedia.org/project/board/4080/
 * Unplannned
 * Reviews ...

This week

 * What I plan to do
 * Finish tasks filling for #phase-out-jessie
 * Blockers

Last week

 * Best things
 * Not doing the train. 😃
 * Have learned some tiny fragments of Rust.
 * Worst thing
 * Sick, useless.
 * What I planned vs did
 * ❌ Keysigning
 * ✅ Skill matrix
 * ✅ Pair with Antoine on T239985 Upgrade Jenkins to 2.190.3
 * Give more useful input on:
 * 555750: Add missing runuser for Apache and make directory for php-fpm
 * 555914: Add php-fpm/apache image for use with MediaWiki Dev Env
 * 550708: (DNM) Proof-of-concept Docker development environment
 * ❌ Figure out phab pairing
 * ✅ Brief presentation to Rust study group
 * Unplannned
 * Miscellaneous housekeeping (harassment training, benefits enrollment).
 * Sleeping.

This week

 * What I plan to do
 * Expand on incident report from wmf.8
 * Something useful re: core dev environments
 * Started on: https://phabricator.wikimedia.org/T240625
 * Incremental improvements to logspam, per recent deployer feedback.
 * Experiment with personal workboard in Phabricator and taskify more things
 * Blockers
 * Sick.

Last week

 * Best thing
 * Corned-beef ruben at Wise Sons in SF
 * Worst thing
 * So many meetings this week
 * What I planned vs did
 * ✅ Interviewed candidates for Sr SWE position w/ Jeena
 * Working w/ Lars to improve Pipelinelib documentation
 * ✅ Met w/ Lars/SRE on CI threat modeling
 * ✅ Trying to get some outstanding Blubber reviews through
 * Unplannned

This week

 * What I plan to do
 * Write pipelinelib user guide
 * Write Pipelinelib tutorial
 * Blockers
 * Dysfunctional family dynamics around Christmas

Greg
(excused)

Last week

 * Best thing
 * Worst thing
 * What I planned vs did
 * Unplannned
 * What I planned vs did
 * Unplannned
 * Unplannned

This week

 * What I plan to do
 * Blockers
 * Blockers

Last week

 * Best thing
 * Train was fun.
 * Worst thing
 * Train was messy.
 * What I planned vs did
 * Train support & other UBNs.
 * CI metrics work.
 * ✅ Removal of Ruby daily selenium jobs, as part of contint1001 jessie->buster work.
 * ✅ Liaison between teams re. competing deployment thoughts.
 * ❌ More runbooks documentation.
 * Unplannned
 * Security and 1.34.0 release support.
 * Helping out with some CI stuff for Code Health/etc. work.
 * Complaining about `logspam` and trying out Brennen's fun alterations.

This week

 * What I plan to do
 * The final train. For the year.
 * UBNs as they arise.
 * More runbooks documentation.
 * Actually help get 1.34.0 out of the door.
 * Blockers

Last week

 * Best thing
 * Worst thing
 * sick
 * What I planned vs did
 * ✅ interviews
 * ❌ key signing
 * review Kosta's patch
 * train
 * ❌ make tasks for local dev
 * Unplannned
 * proposal for dev environment \o/
 * proposal for dev environment \o/

This week

 * What I plan to do
 * dev env proposal
 * train
 * skill matrix
 * time spent spreadsheet
 * keysigning
 * coordinate with Antoine on jessie deprecation
 * remind Joe about my deployment-charts patchset
 * Blockers

Last week

 * Best thing
 * CI threat modelling moving forward.
 * Worst thing
 * SAD.
 * What I planned vs did
 * ✅ Do a first draft of a threat model for CI
 * ❌ Read TechConf and offsite notes, extract any useful bits.
 * ❌ Do an Argo test deployment.
 * Unplanned
 * Did some keysiging.
 * Interview of candidate for Tyler's old job. Related discussions. Learning the process.
 * Learning about STRIDE for threat modelling.
 * Pipelinelib reference documentation fumbling.
 * Go study group.
 * Rust study group.
 * Wrote up how Argo was chosen. https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/CI_Futures_WG#Final_choice:_process,_Argo
 * SRE should be spammed about that, I guess? TODO thcipriani will spam folks :)

This week

 * What I plan to do
 * Read TechConf and offsite notes, extract any useful bits.
 * Do an Argo test deployment.
 * Blockers
 * Holidays until Jan 2.

Other

 * Threat modelling and STRIDE seems like it might be useful for others to learn about.

Last week

 * Best thing
 * A bunch of phabricator stuff got done
 * Worst thing
 * OKRs are fun
 * What I planned vs did
 * ❌ Talk to brennen about phabricator pairing
 * ❌ Work on code review working group stuff: patch triage / code review office hours
 * ✅ Task grooming
 * Unplannned
 * ✅ https://phabricator.wikimedia.org/T236507 Phlogiston dump is missing projects
 * ✅ https://phabricator.wikimedia.org/T239870 Provide field for Actual Story Points to be captured
 * Helped out with https://gerrit.wikimedia.org/r/c/mediawiki/tools/scap/+/558243/3

This week

 * What I plan to do
 * Deploy phabricator changes, including:
 * https://phabricator.wikimedia.org/T239162 Maniphest task: Add cc address to the "From email" field that replies to the task
 * Blockers

Last week

 * Best thing
 * Worst thing
 * What I planned vs did
 * ✅ benefits in namely
 * ❌ Q3 planning/SPoF/Changes to this meeting
 * Unplannned
 * ❌ Q3 planning/SPoF/Changes to this meeting
 * Unplannned

This week

 * What I plan to do
 * Book club email to ponder over break
 * ✅ Year end stats re:gerrit and phab
 * Hiring meetings
 * key signing!! this time I swear
 * Blockers

Last week

 * Best thing
 * found a lawyer 👔
 * Worst thing
 * still didn't sign my contract 😱
 * What I planned vs did
 * ❌ read article for book club 📖
 * ❌ follow up on various tasks from techconf 👨‍💻
 * Unplannned

This week

 * What I plan to do
 * sign my contract? 🤷‍♂️
 * Blockers

Other

 * is this up to date? https://wikitech.wikimedia.org/wiki/Help:SSH_Fingerprints/git-ssh.wikimedia.org
 * Cannot connect to vcs@git-ssh.wikimedia.org (since move from phab1001 to phab1003) https://phabricator.wikimedia.org/T224677#5738805