Wikimedia Release Engineering Team/Checkin archive/20191211

= 2019-12-11 =

Vacations/Important dates

 * https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
 * How to do it


 * December 1–2: Jeena
 * December 6: Lars (Finnish Independence Day)


 * December 23: James, Brennen, Greg (need to put it in Namely)
 * December 23–January 2: Lars
 * December 24–31 (Christmas): Staff with reqs (everyone? (yes))


 * 1 January (New Year's Day): Staff with reqs, Lars
 * 2–3 January: James
 * 20 January (Martin Luther King Jr. Day): Staff with reqs


 * 17 February (Presidents' Day): Staff with reqs


 * 9 March (DST+1 day): Staff with reqs


 * 24 April (Not-Easter): Staff with reqs


 * 25 May (Memorial Day): Staff with reqs

Train

 * Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R


 * 25 Nov - wmf.8 [Group0 on Tuesday] - Brennen + Mukunda (Thanksgiving)
 * 2 Dec - wmf.8 part 2 [Wednesday Group1 + Thursday Group2] - Brennen + Dan


 * 9 Dec - wmf.10 - Dan + James
 * 16 Dec - wmf.11 - James + Jeena
 * 23 Dec - wmf.12 - No Train or any other deploys (Winterval)
 * 30 Dec - wmf.13 - No Train or any other deploys (Still Winterval)
 * 6 Jan - wmf.14 - Jeena + Lars
 * 13 Jan - wmf.15 - Lars + Antoine

SoS

 * Aug 14 onward: Zeljko 🎸 🎷 \o/

Incoming/Needs attention

 * New skill matrix: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Skill_matrix
 * New workboard for December: https://phabricator.wikimedia.org/project/view/4401/ -- make sure your tasks look right
 * Create and maintain somehow a list of repos mastered in GitHub (and in Differential) https://phabricator.wikimedia.org/T237470
 * Support MarcoAurelio and make it semi-automated? Halp.
 * SoS: Site Reliability Engineering - Requesting follow-up from Releng team regarding Gerrit/Zuul Prometheus metrics 479139
 * TODO thcipriani: to reply/try to unstick

Offsite Actions

 * 🏂 [thcipriani] figure out what part of team meeting to move to phab


 * 🏂 (T240483) [James + Antoine] draft runbooks listing
 * Very initial page at https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Runbooks; more coming.
 * brennen+antoine: jenkins upgrade runbook
 * gerrit: runbook thcipriani


 * [dan + brennen] explore tools for pairing
 * https://phabricator.wikimedia.org/T240484
 * Ž: stumbled upon this recently https://pragprog.com/book/jkrp/remote-pairing


 * [Dan + Jeena] add Blubber to local dev
 * -> Q3 goals?


 * [Mukunda] Phab to local dev
 * -> Q3 goals?


 * [thcipriani] lunch and learns


 * [thcipriani/greg] Program/Project managers
 * [JDF] highlighted this to Grace, so she expects outreach to understand the role.

Q3 (Jan–Mar 2020) Goal Planning is upon us!

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals

Reduce Complexity of Platform Maintain and evolve developer tooling, testing infrastructure, validation environments, deployment infrastructure, and supporting processes


 * Localdev mw/core (Brennen + Jeena)
 * Gerrit 2.15 -> 2.16 (con't) (Thcipriani + Dan + Antoine)
 * Phabricator: eliminate elasticsearch for phabricator search (Mukunda + Brennen) https://phabricator.wikimedia.org/T230787

Maintain and improve the Continuous Integration and Testing services
 * Quibble extension.json parsing + migration (James + Antoine + Jeena)
 * Pipelinelib documentation (Dan + Lars)
 * Migrate zuul deployment to scap3 (Antoine + Mukunda)
 * "integration" Cloud VPS project jessie deprecation (Antoine + James + Jeena)
 * Unnamed "New CI work" TBD after meeting with SRE (Dan + Lars)

Developers have a consistent and dependable deployment service
 * Scap: Use static php array files for l10n cache instead of CDB (Dan + Lars)
 * Pipeline migrations (con't) (Dan + Lars + James)

thcipriani: bold future james: I prefer task heierarchy, things get ignored in a project workboard, project tags theoretically are for extended period rather than a 1-off project mukunda: we could use milestones instead antoine: I have been using subprojects for short-term projects -- I like looking at a workboard

Timespent spreadsheet

 * For the avoidance of doubt: fill out the sheet week number for the previous week

https://docs.google.com/spreadsheets/d/1YS_2eUQWUOnygshMfxgGPu93GKGCO5t00yjUREQ5B-I/edit#gid=244664871
 * reminder: your time spent doesn't need to total to 100%

Book club

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club
 * Tuesday notes: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club/How_to_do_a_code_review
 * Summary
 * generally liked the article
 * had some concerns
 * read the wikimedia page
 * Add suggestions/remove suggestions: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club#Future_Recommendations

Monthly reflection on accomplishments - December '19 edition

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
 * Add as you have them!


 * PHP 7.4 testing was available in CI the first "business day" after 7.4.0 was released.
 * Revived "This week in logspam" email
 * Auto DBLists
 * PGP Key repo
 * Production config now has pre-merge diff reports, e.g.: https://integration.wikimedia.org/ci/job/operations-mw-config-php72-composer-diffConfig-docker/86/console

Incoming from last week (aka this morning)

 * Blocked by:
 * Blocking:
 * Site Reliability Engineering - Requesting follow-up from Releng team regarding Gerrit/Zuul Prometheus metrics 479139
 * Updates:
 * Train Health
 * Last week: 1.35.0-wmf.8 - T233856 - group1 + group2
 * This week: 1.35.0-wmf.10 - T233858
 * Next week: 1.35.0-wmf.11 - T233859

Callouts

 * Release Engineering - December 23-January 3rd - No deploys (including train), Holiday break

Outgoing next week

 * Blocked by:
 * Blocking:
 * Updates:
 * Train Health
 * Last week: 1.35.0-wmf.10 - T233858
 * This week: 1.35.0-wmf.11 - T233859
 * Next week: No Train - 2 weeks!

Callouts

 * Release Engineering - December 23-January 3rd - No deploys (including train), Holiday break

Train status and happenings

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

Standup!

 * Make sure your tasks are correct on our kanban board!
 * https://phabricator.wikimedia.org/project/board/4105/

Last week

 * Best thing
 * Debian glue moved to Buster (less Jessie, newer versions of pristine-tar / git-buildpackage etc). \o/
 * Worst thing
 * Gotta get Doxygen 1.8.16 packaging reviewed and published to apt.wm.o.
 * What I planned vs did
 * Phase out Jessie draft doc
 * https://docs.google.com/document/d/1MgGKajDi93YTk_SxaoOv86jTEWPJC3m_mf8uGgR1O7c/edit
 * filed some tasks for its workboard https://phabricator.wikimedia.org/project/view/4080/
 * Unplannned
 * Github replication transiently broken! :-)
 * A bit of cleanup for Zuul package
 * Storybook for MobileFrontend https://phabricator.wikimedia.org/T239246
 * Brennen and I will upgrade Jenkins instances Monday 12/16 16:00UTC

This week

 * What I plan to do
 * Blockers
 * Blockers

Last week

 * Best things
 * https://squiggle.city/~brennen/tree_rex.mp4
 * (We won the marching division in the town holiday parade.)
 * Worst thing
 * https://www.youtube.com/watch?v=mX-OkFWpNBM
 * What I planned vs did
 * ✅ Finish deploying 1.35.0-wmf.8
 * https://wikitech.wikimedia.org/wiki/Incident_documentation/20191204-MediaWiki
 * https://wikitech.wikimedia.org/wiki/Incident_documentation/20191210-Cite
 * ❌ Update skill matrix
 * ✅ Read for book club
 * ✅ Fill out offsite survey
 * ❌ Keysigning!
 * ❌ Hack on T238224 Provide docker-compose based development enviornment in mediawiki core
 * Unplannned

This week

 * What I plan to do
 * Keysigning
 * Skill matrix
 * Pair with Antoine on T239985 Upgrade Jenkins to 2.190.3
 * Give more useful input on:
 * 555750: Add missing runuser for Apache and make directory for php-fpm
 * 555914: Add php-fpm/apache image for use with MediaWiki Dev Env
 * 550708: (DNM) Proof-of-concept Docker development environment
 * Pay attention to Mukunda's input in betterworks, figure out when to pair on phab
 * Deal with open enrollment
 * Blockers
 * T240382 Grant "contint-roots" and "releasers-mediawiki" to user brennen

Other

 * Shifting some time around this / next week for end-of-year medical appointments and such

Last week

 * Best thing
 * Learning how to document more effectively
 * https://www.divio.com/blog/documentation/
 * Used branch.py to cut the wmf branch yesterday \o/
 * Thanks to Mukunda for his work on that script!
 * Noemie (daughter) got to sleep on her own and slept for 12 hours straight last night
 * Worst thing
 * What I planned vs did
 * ✅ Come up with questions for SRE re: third-party vs. WMF K8s platform
 * Reaquaint myself with scap codebase and look at ways to support PHP-based l10n
 * ❌ Talk to Brennen about pairing tooling research and experimentation
 * PipelineLib/Blubber user documentation
 * ✅ (not needed) PipelineLib git clone improvements (depth and parallel clone support)
 * ❌ Tooling to simplify easier taskification of daily work
 * ❌ Taskify the above
 * Unplannned
 * Unplannned

This week

 * What I plan to do
 * Train
 * 1.35.0-wmf.10 deployment blockers
 * Continue improving Pipelinelib + Blubber documentation
 * Establish a collaborative RelEng/SRE process for refining Seakeeper proposal
 * Blockers

Last week

 * Best thing
 * Lost power for an hour, got to talk to some neighbors for a bit
 * Worst thing
 * I'm trying to be positive, yo
 * What I planned vs did
 * MTP/OKR metrics working group - going well
 * leveling/job codes - done for now
 * Unplannned
 * NewCI discussion with Erika

This week

 * What I plan to do
 * TechConf review, but that will most likely slip to next week, given my week is 4 days long in December
 * NewCI discussion with SRE (done)
 * MTP/OKR conversation with Birgit re renaming/titling the "Reduce Complexity" Key Deliverable
 * TechConf retro tomorrow morning with the ProgramCommittee
 * oh right, US Benefits confirmation
 * Blockers
 * time, self inflicted (taking off Fridays)
 * Rowan's 8th bday today

Last week

 * Best thing
 * MW Config has diffs now, e.g. https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/556422 -> https://integration.wikimedia.org/ci/job/operations-mw-config-php72-composer-diffConfig-docker/86/console
 * Worst thing
 * Oy veh, the future of the containerisation project.
 * What I planned vs did
 * ✅ JDI for CI diff reports of MW config changes.
 * ❌ ? static config in production.
 * CI/CR metrics doc fiddles.
 * Runbooks documentation collation/writing.
 * Unplannned
 * Train UBNs.

This week

 * What I plan to do
 * Train support & other UBNs.
 * CI metrics work.
 * Removal of Ruby daily selenium jobs, as part of contint1001 jessie->buster work.
 * Liaison between teams re. competing deployment thoughts.
 * More runbooks documentation.
 * Blockers

Other

 * Next week I'll be working from London, not San Francisco.

Last week

 * Best thing
 * judo :D :D :D
 * Worst thing
 * The dark days are here
 * sick again
 * What I planned vs did
 * ✅ Get caught up
 * ❌ key signing
 * Unplannned
 * Code Reviews
 * Updating patchsets
 * Book club
 * Reading
 * interview planning
 * all hands registration
 * benefits registration
 * local dev meeting

This week

 * What I plan to do
 * review kosta's parchset for local dev
 * train (https://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys#Pairing_on_the_Train )
 * make tasks for local dev
 * interview
 * keysigning
 * Blockers

Last week

 * Best thing
 * Saw the Sun one day, for a whole half hour.
 * Worst thing
 * Only saw the Sun for half an hour.
 * What I planned vs did
 * ✅ Write and send out howto for signing PGP keys. phab:T239829
 * Read TechConf and offsite notes, extract any useful bits.
 * ✅ Ponder SRE input on new CI from TechConf. Discuss with Tyler, Dan.
 * Do an Argo test deployment.
 * ✅ Start work on documenting pipelinelib so it can be re-implemented for new CI.
 * Book club.
 * Unplanned
 * n/a

This week

 * What I plan to do
 * Do a first draft of a threat model for CI
 * Read TechConf and offsite notes, extract any useful bits.
 * Do an Argo test deployment.
 * Meeting before this one remove my mental block and gave me hope
 * Blockers

Other

 * Less than two weeks until solstice! Days will be getting longer again!

Last week

 * Best thing
 * Phabricator is on phab1001, Debian 10, failover very is well tested (monthly accomplishment!)
 * Worst thing
 * Phabricator notification server is (still) broken and will likely remain that way until DZahn returns from vacation
 * What I planned vs did
 * ✅ Finish my phabricator redundancy OKRs
 * ❌ Look into open-sourcing phabricator-antivandalism as I finally have the OK from our security team.
 * Unplannned
 * Added a "Backup train conductor" custom field to Maniphest (monthly accomplishment! -- also, awesome!)

This week

 * What I plan to do
 * Talk to brennen about phabricator pairing
 * Work on code review working group stuff: patch triage / code review office hours
 * Task grooming
 * Blockers
 * Need DZahn to be back from travel / vacation.

Last week

 * Best thing
 * team is awesome
 * Worst thing
 * end of year brain dissolving
 * What I planned vs did
 * ✅ Wrangle hiring loop
 * ✅ ish Build SPoF program
 * ✅ ish Q3 planning kickoff
 * ❌ Do keysigning!
 * ✅ Register for all-hands (everyone!)
 * Unplannned

This week

 * What I plan to do
 * benefits in namely
 * Q3 planning/SPoF/Changes to this meeting
 * Blockers

Last week

 * Best thing
 * talked at a local tech meetup abot software testing anti-patterns 🎸
 * Worst thing
 * safeguard 🤦‍♂️
 * What I planned vs did
 * ❌ work on testing related questions for interviews with developers ❓
 * ✅ expense report (Coupa)
 * ✅ prepare to close my company: paperwork, meet with accountant... 👔
 * ❌ read article for book club (can not attend book club) 📖
 * ✅ prepare talk about software testing anti patterns for local tech meetup 🎤
 * ✅ use more emoji 🤠
 * Unplannned

This week

 * What I plan to do
 * read article for book club 📖
 * follow up on various tasks from techconf 👨‍💻
 * Blockers

Other

 * I'm buying a Synology NAS for months now, hopefully I'll actually buy it this week 💾