Wikimedia Release Engineering Team/Checkin archive/20180618

= 2018-06-18 =

Vacations/Important dates

 * https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
 * How to do it


 * June 19: WMF Monthly Holiday - https://en.wikipedia.org/wiki/Juneteenth
 * June 18-22: Dan – Vacation
 * July 2: Greg's BDay!!!
 * July 4: US Holiday
 * July 16: Mukunda's bday.....funtimes
 * August 15: WMF Monthly Holiday
 * August ~: Antoine
 * September a week or so - Antoine
 * Middle of August...a few days somewhere - thcipriani

Train

 * Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/?project=PHID-PROJ-fmcvjrkfvvzz3gxavs3a&statuses=open%28%29&group=none&order=newest#R


 * June 11 - wmf.8 - Dan (with Tyler doing Thursday)
 * June 18 - wmf.9 - Dan (no train, SRE summit) <
 * June 25 - wmf.10 - Dan
 * July 02 - wmf.11 - Zeljko - no train, Fourth of July
 * July 09 - wmf.12 - Zeljko
 * July 16 - wmf.13 - Zeljo
 * July 23 - wmf.14 - Antoine
 * July 30 - wmf.15 - Antoine

SoS

 * June 11 - Tyler
 * June 18 - Tyler <
 * June 25 - Tyler
 * July 02 - Dan
 * July 09 - Dan
 * July 16 - Dan
 * July 23 - Zeljko
 * July 30 - Zeljko
 * August 06 - Antoine
 * August 13 - Antoine

Updates

 * Train/SWAT changes
 * Greg emailed mark/faidon on Tuesday
 * email: https://etherpad.wikimedia.org/p/eu-train-swat


 * Skill matrix ready!
 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Skill_matrix
 * [X] Antoine - We should revisit it, ElasticSearch doesnt ring any bell to me
 * thcipriani: +1


 * Phabricator spam
 * TODO: Create an incident report
 * Last time: https://wikitech.wikimedia.org/wiki/Incident_documentation/20170617-Phabricator-spam
 * https://etherpad.wikimedia.org/p/phab-spam-20180615 basic timeline started


 * Gerrit duplicate account issue
 * tl;dr ugh, too cutting edge
 * tyler and mukunda pairing after meeting

Q1 Goals time!

 * https://office.wikimedia.org/wiki/Release_Engineering/FY1819-Planning/Continuous_Deployment_pipeline
 * https://office.wikimedia.org/wiki/Release_Engineering/FY1819-Planning/Code_Health
 * https://office.wikimedia.org/wiki/Release_Engineering/FY1819-Planning/Developer_productivity

TODO:
 * Per program determine attainable quarterly goals (duh)
 * NB: For the DevProd program I'm just going to put ~"Hire an engineer"
 * TODO: By monday have a list of goals per program.

Scrum of Scrums

 * Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums

Release Engineering

 * Blocking
 * Working on https://phabricator.wikimedia.org/T190710 for Readers
 * Blocked
 * Updates
 * wmf.999 is running on group0 wikis for testing MCR related changes, see https://phabricator.wikimedia.org/T196585
 * Quarterly cross-dependencies
 * Quarterly cross-dependencies

Release Engineering

 * Blocking
 * Blocked
 * Updates
 * Please take the Beta Cluster survey:
 * https://lists.wikimedia.org/pipermail/wikitech-l/2018-May/090049.html
 * https://docs.google.com/forms/d/e/1FAIpQLScw01fMHA9wNTUtp-_iIOdhmQpm0L38MHK-RS_MTvdnlro0lA/viewform
 * Heads up: There will be more people in the normal MW Train deployment rotation (namely: Antoine, Zeljko, and Dan to start) and we'll be doing some Train deployments during EU hours some weeks. Exact timing TBA (soon).
 * https://docs.google.com/forms/d/e/1FAIpQLScw01fMHA9wNTUtp-_iIOdhmQpm0L38MHK-RS_MTvdnlro0lA/viewform
 * Heads up: There will be more people in the normal MW Train deployment rotation (namely: Antoine, Zeljko, and Dan to start) and we'll be doing some Train deployments during EU hours some weeks. Exact timing TBA (soon).

Train status and happenings

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

Past week status updates

 * All of it in table form: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q4

Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure

 * Migrate away from Nodepool -
 * Migrate MediaWiki PHPUnit tests to Shipyard (docker-based CI) (~40% of Nodepool usage) -
 * Add Composer support to Blubber -
 * Add Python/Tox support to Blubber -
 * Add Ruby/Gem/Bundler/Rake support to Blubber -


 * Gated extensions work with Quibble - https://phabricator.wikimedia.org/T197469
 * Pass for extensions on master/wmf branch. Some edges cases. Should be done by end of week.
 * Nodepool leftover would be ~ 1% of what we used previously.

Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphans

 * Broad role out of Code Stewardship model.
 * Update Maintainers/Developers page with currently known Code Stewards.
 * Use Code Stewardship review process to address gaps.
 * Deploy dashboard of Code Stewardship Coverage


 * Q4 Stewardship review progress
 * Worked on Dashboard mock-up

Program 3: Outcome2: Objective 2: Define and implement a process to regularly address technical debt across the Foundation

 * Roll out of technical debt reduction approaches.
 * Identify early adopter engineering teams to test approaches.


 * Continued evaluation of Platform team Tech Debt and approach to managing.

Program 6: Outcome 2: Objective 2: Prove viability of testing staged service containers alongside MediaWiki extension containers

 * Add Composer support to Blubber -
 * Small, standalone, MediaWiki containers built using Blubber
 * Limited scope with: Debian Stretch, php7, composer dependencies, Mariadb, Apache (or last two with standalone containers)
 * Build MW base containers upon branch cut at master branch point from core
 * Build ext specific containers using MW image as base


 * In progress:
 * Base container image for mediawiki
 * Groovy library for pipeline
 * Got a CI namespace on the k8s cluster thanks to _Joe_!!!

Program 1: Outcome 1: Objective 1: Scap (Tech Debt Sprint FY201718-Q2)

 * workboard

Program 1: Outcome 6: Milestone 2: Maintain Phabricator

 * Streamline logspam workflows by adding some integration with phabricator
 * Store git-lfs (and other phab uploads) in swift:

Antoine

 * What I plan to do this week
 * Gated extensions work with Quibble - https://phabricator.wikimedia.org/T197469
 * MUST deal with paperwork for end of fiscal year
 * What I'm blocked on
 * Quibble need a slight change/hack for mediawiki/core + gated extensions
 * Other?
 * Left to migrate ~ 100 extensions + BlueSpice* ones. https://phabricator.wikimedia.org/T183512

Dan

 * What I plan to do this week
 * What I'm blocked on
 * Other?
 * Other?
 * Other?

Greg

 * What I plan to do this week
 * Comp changes
 * Annual Review reading/writing
 * What I'm blocked on
 * Other?
 * Other?

Jean-Rene

 * What I plan to do this week
 * Meet with RelatedSites code stewards to review sunsetting plans
 * Close out remaining Q4 Stewardship Review tasks.
 * Finish Code Stewardship coverage dashboard
 * Review and communicate Beta Cluster survey results
 * What I'm blocked on
 * Other?
 * Other?

Mukunda

 * What I plan to do this week
 * Deal with Phabricator and Gerrit issues
 * What I'm blocked on
 * Other?
 * Other?

Tyler

 * What I plan to do this week
 * Gerrit stuffs
 * MediaWiki base image for Q4 goal
 * Scap clean
 * Deploy notes
 * What I'm blocked on
 * Other?
 * Other?

Zeljko

 * What I plan to do this week
 * T190710 Minerva Ruby and Node.js browser tests running side by side
 * T194252 Configure the CI job that runs WikibaseLexeme's browser tests against beta wikidata
 * What I'm blocked on
 * Other?
 * Other?

Team Kanban Board Review and Triage

 * closed and touched in the 7 days
 * No update for 4 weeks
 * No update for 3 weeks
 * No update for 2 weeks
 * No update for 1 week
 * All Open
 * Review To Triage column of #releng
 * Assigned
 * Unassigned

Once / month-ish review of backlog(s)

 * releng Review To Triage column of #releng
 * releng-kanban Review unassigned in kanban
 * releng-kanban Review 'backlog' colum of -kanban
 * releng-next - Review for things we need to put on our kanban backlog
 * releng-backlog - oh my, the huge backlog of things...

Kanban stats

 * Burnup chart