Wikimedia Release Engineering Team/Checkin archive/20180430

= 2018-04-23 =

Vacations/Important dates

 * https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
 * How to do it


 * May 1: Željko (Holidays in Croatia - Labor Day / May Day), Antoine ditto
 * May 7-11: Antoine, too many holidays in France that week
 * May 7-14: Dan (Barcelona)
 * May 10-14: Chad (family time)
 * May 15-17: Team offsite in Barcelona
 * May 18-21: Wikimedia Hackathon in Barcelona
 * May 21 (Mon): Tech-Mgt F2F
 * May 28 (Mon): Memorial Day (US Holiday)
 * May 31: Željko (Holidays in Croatia - Corpus Christi)

Train

 * Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/?project=PHID-PROJ-fmcvjrkfvvzz3gxavs3a&statuses=open%28%29&group=none&order=newest#R


 * Apr 23 - 1.32.0-wmf.1 - Chad
 * Apr 30 - wmf.2 - Chad <
 * May 07 - wmf.3 - Mukunda
 * May 14 - wmf.4 - Mukunda
 * May 21 - wmf.5 - Mukunda
 * May 28 - wmf.6 - Tyler
 * June 04 - wmf.7 - Tyler
 * June 11 - wmf.8 - Chad
 * June 18 - wmf.9 - Chad
 * June 25 - wmf.10 - Mukunda
 * July 02 - wmf.11 - Mukunda

SoS

 * Apr 23 - Tyler
 * Apr 30 - Tyler <
 * May 07 - Chad
 * May 14 - Chad
 * May 21 - Chad
 * May 28 - Mukunda
 * June 04 - Mukunda
 * June 11 - Tyler
 * June 18 - Tyler
 * June 25 - Chad
 * July 02 - Chad

Updates

 * Q3 quarterly checkin slides: https://docs.google.com/presentation/d/1wZ10iUwquwQ93zUDF3DYoEcwKVG6GQ1A2sBWs0q6tng/edit#slide=id.g1651e065b0_0_555


 * I need a volunteer to be prepared for this in June:
 * rename wikimediafoundation.org wiki to foundation.wikimedia.org: https://phabricator.wikimedia.org/T188776


 * Activity in Barcelona!
 * https://docs.google.com/spreadsheets/d/1qVmJ47UYatbjpwOvCgLgBKsp3Ntv0gZv1-NuhiDnjFM/edit?ts=5ad72c5e&pli=1#gid=0
 * A cooking class and La Sagrada Familia are tied

Scrum of Scrums

 * Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums

Release Engineering

 * Blocking
 * Blocked
 * Updates
 * Announcing Quibble! https://phabricator.wikimedia.org/phame/post/view/99/introducing_quibble/
 * Updates
 * Announcing Quibble! https://phabricator.wikimedia.org/phame/post/view/99/introducing_quibble/

Release Engineering

 * Blocking
 * Blocked
 * Updates
 * HEADS UP: localization update rebuilds are taking a long time during full scaps. See: https://phabricator.wikimedia.org/T191921
 * Updates
 * HEADS UP: localization update rebuilds are taking a long time during full scaps. See: https://phabricator.wikimedia.org/T191921

Train status and happenings

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

Past week status updates

 * All of it in table form: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q4

Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure

 * Migrate away from Nodepool -
 * Migrate MediaWiki PHPUnit tests to Shipyard (docker-based CI) (~40% of Nodepool usage) -
 * Add Composer support to Blubber -
 * Add Python/Tox support to Blubber -
 * Add Ruby/Gem/Bundler/Rake support to Blubber -

Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphans

 * Broad role out of Code Stewardship model.
 * Update Maintainers/Developers page with currently known Code Stewards.
 * Use Code Stewardship review process to address gaps.
 * Deploy dashboard of Code Stewardship Coverage


 * Setup meetings for RelatedSites stewardship kickoff.
 * Reviewed Q4 candidates

Program 3: Outcome2: Objective 2: Define and implement a process to regularly address technical debt across the Foundation

 * Roll out of technical debt reduction approaches.
 * Identify early adopter engineering teams to test approaches.


 * Identified Search Platform and Platform as first two "early adopter" teams to engage with.

Program 6: Outcome 2: Objective 2: Prove viability of testing staged service containers alongside MediaWiki extension containers

 * Add Composer support to Blubber -
 * Small, standalone, MediaWiki containers built using Blubber
 * Limited scope with: Debian Stretch, php7, composer dependencies, Mariadb, Apache (or last two with standalone containers)
 * Build MW base containers upon branch cut at master branch point from core


 * Messing with Blubber/Composer and MediaWiki core but it's unclear how viable Composer-based dependency installation will be
 * Build ext specific containers using MW image as base

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Deployment_pipeline/2018-04-26

Program 1: Outcome 1: Objective 1: Scap (Tech Debt Sprint FY201718-Q2)

 * workboard

Program 1: Outcome 6: Milestone 2: Maintain Phabricator

 * Streamline logspam workflows by adding some integration with phabricator
 * Store git-lfs (and other phab uploads) in swift:

Other work
*** Incident report: https://wikitech.wikimedia.org/wiki/Incident_documentation/20180229-Train-1.31.0-wmf.27 *** Meeting notes: https://etherpad.wikimedia.org/p/Post_Mortem-20180329-Train-1.31.0-wmf.27-Blocker *** Action item: "Look into ways to identify risky commits that are part of the weekly branch cut, either manually or through automated process" - https://phabricator.wikimedia.org/T193258 *** This inspired chad to outline a two-branch model for mediawiki deployments: https://etherpad.wikimedia.org/p/two-branch-merge-model
 * Mukunda
 * Worked with Stas on wdqsguibuilder CI job - https://phabricator.wikimedia.org/T189811
 * Postmortem for 1.31.0-wmf.27:
 * JR
 * Post Mortem: 20180329-Train-1.31.0-wmf.27 Blocker
 * Staging/Beta Cliuster Survey

Antoine

 * Most MediaWiki skins moved to Quibble
 * What I plan to do this week
 * Left over skins and some extensions. Epic: https://phabricator.wikimedia.org/T183512
 * Doc with Zeljko
 * Analyze failures of mediawiki extensions
 * What I'm blocked on
 * Other?
 * Considering using utf8mb4 for MySQL, but lot of extensions schema fails (key too long)
 * Will add sql_mode=TRADITIONAL, get MySQL to report errors instead of silently truncating data
 * Will add sql_mode=TRADITIONAL, get MySQL to report errors instead of silently truncating data

Chad

 * What I plan to do this week
 * Train, MW 1.31.0 work
 * What I'm blocked on
 * Bugs for 1.31.0 :(
 * Other?
 * https://phabricator.wikimedia.org/T176871#4163240 irks me :\

Dan

 * What I plan to do this week
 * https://phabricator.wikimedia.org/T188935 modify service-pipeline to include helm install/helm test Normal  Open
 * https://phabricator.wikimedia.org/T186547 Blubber should support php/composer Normal  Open
 * What I'm blocked on
 * Futzing with Composer and MediaWiki core? Let's pair!
 * [Chad]: lets do it
 * Other?

Greg

 * What I plan to do this week
 * Q3 QCI slides
 * barecelona activity/other things with Megan, starting schedule
 * JD for Software Engineer (Dev Prod)
 * email SRE/Services survey text for Beta Cluster
 * What I'm blocked on
 * Other?
 * Other?

Jean-Rene

 * What I plan to do this week
 * Send out Q4 round of stewardship reviews + update of last quarter's review items.
 * Stewardship kickoff meeting for ReleatedSites
 * Q3 QCI Slides


 * What I'm blocked on
 * Other?
 * Staging Survey
 * Staging Survey

Mukunda

 * What I plan to do this week
 * Finish phabricator swift storage engine.
 * What I'm blocked on
 * Other?
 * Other?

Tyler

 * What I plan to do this week
 * Document CI pipeline
 * Document Blubber
 * Maybe scap release?
 * Want to look at skaffold
 * What I'm blocked on
 * Other?
 * if anyone has any thoughts: https://phabricator.wikimedia.org/T193311
 * if anyone has any thoughts: https://phabricator.wikimedia.org/T193311

Zeljko

 * What I plan to do this week
 * T179188 Video recording for Selenium tests in Node.js
 * T179190 Run Selenium Cucumber tests in CI
 * T193244 selenium-CirrusSearch-jessie does not run any tests
 * T191537 MediaWiki core's selenium tests flaky when run as part of mwext-mw-selenium-node-composer-jessie job
 * What I'm blocked on
 * T193164 document quibble cache / src reuse for local installation - see draft blog post for details https://phabricator.wikimedia.org/phame/post/view/100
 * Other?
 * Somebody I know applied for a job at WMF and pretty much crickets...
 * Helping with Bosnian, Croatian, and Serbo-Croatian Analyzer Analysis https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Bosnian,_Croatian,_and_Serbo-Croatian_Analyzer_Analysis
 * Reaching level 4 in Yousician for ukulele https://yousician.com/

Team Kanban Board Review and Triage

 * closed and touched in the 7 days
 * No update for 4 weeks
 * No update for 3 weeks
 * No update for 2 weeks
 * No update for 1 week
 * All Open
 * Review To Triage column of #releng
 * Assigned
 * Unassigned

Once / month-ish review of backlog(s)

 * releng Review To Triage column of #releng
 * releng-kanban Review unassigned in kanban
 * releng-kanban Review 'backlog' colum of -kanban
 * releng-next - Review for things we need to put on our kanban backlog
 * releng-backlog - oh my, the huge backlog of things...

Kanban stats

 * Burnup chart