Wikimedia Release Engineering Team/Checkin archive/20180730

= 2018-07-30 =

Vacations/Important dates

 * https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
 * How to do it


 * August 8-10th: thcipriani
 * August 15 (Wednesday): WMF Monthly Holiday
 * August 15 (Wednesday): Željko holiday (Assumption of Mary)
 * August 23-24 (Thursday-Friday): Željko vacation
 * August ~: Antoine
 * August 29-31: Dan vacation
 * September a week or so - Antoine

Train

 * Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/?project=PHID-PROJ-fmcvjrkfvvzz3gxavs3a&statuses=open%28%29&group=none&order=newest#R


 * July 02 - wmf.11 - Zeljko - no train, Fourth of July
 * July 09 - wmf.12 - Zeljko
 * July 16 - wmf.13 - Zeljko
 * July 23 - wmf.14 - Zeljko
 * July 30 - wmf.15 - Mukunda <
 * Aug 06 - wmf.16 - Mukunda
 * Aug 13 - wmf.17 - Mukunda (No train - Wednesday is a holiday)
 * Aug 20 - wmf.18 - Tyler
 * Aug 27 - wmf.19 - Tyler
 * Sep 03 - wmf.20 - Dan
 * Sep 10 - wmf.21 - Dan
 * Sep 17 - wmf.22 - Zeljko
 * Sep 24 - wmf.23 - Zeljko
 * Oct 01 - wmf.24 - Antoine
 * Oct 08 - wmf.25 - Antoine
 * Oct 15 - wmf.26 - Mukunda (last 1.32 wmf.XX release, 1.33 starts the next week)
 * Oct 22 - wmf.1 - Mukunda

SoS

 * July 04 - Dan
 * July 11 - Antoine
 * July 18 - Antoine
 * July 25 - Tyler
 * Aug 01 - Tyler <
 * Aug 08 - Dan
 * Aug 15 - Dan
 * Aug 22 - Mukunda
 * Aug 29 - Mukunda
 * Sep 05 - Tyler
 * Sep 12 - Tyler
 * Sep 19 - Dan
 * Sep 26 - Dan
 * Oct 03 - Zeljko
 * Oct 10 - Zeljko
 * Oct 17 - Antoine
 * Oct 24 - Antoine
 * Oct 31 - Mukunda

Jenkins plugin security release today

 * https://phabricator.wikimedia.org/T200575

First Offsite

 * Submitted google form to Travel on Friday with two options:
 * The week after Tech Conf (arriving Sun, working Mon-Wed, Activity on Thur, leaving Fri)
 * The week of Nov 5th (so a week break between Tech Conf and the offsite)

Needs attention

 * Create a production test wiki in group0 to parallel Wikimedia Commons - https://phabricator.wikimedia.org/T197616
 * Wikitech wiki page has a list of tasks
 * maintenance scripts
 * databases
 * dba to create the database
 * restbase + parsoid + tons of things
 * Chad and Sam were taking care of this in the past, but none of us know how to do it
 * We don't really have a lot of time :(
 * https://wikitech.wikimedia.org/wiki/Add_a_wiki
 * Is this worth it? without traffic does this tell you anymore than you can get with targeted tests in beta?
 * UPDATE: Conversation on task, still unclear use cases

Scrum of Scrums

 * Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums

Release Engineering

 * Blocked by:
 * Blocking:
 * Updates
 * Quarterly cross-dependencies
 * Updates
 * Quarterly cross-dependencies
 * Quarterly cross-dependencies

Last week

 * Blocked by:
 * Blocking:
 * Updates
 * Updates
 * Updates

Train status and happenings

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor


 * 1.32.0-wmf.14 everywhere, all good

Past week status updates

 * All of it in table form: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q4

Pipeline: Move verify stage from Minikube to CI k8s namespace in production context

 * tracking task

Code Health

 * T199253 - Investigate and propose record of origin (ROO) for deployed code (currently Developers/Maintainers page)
 * Perform existing Stewardship review process for Q1 cycle.
 * T199254 - Add test evaluation to post mortem review process.
 * Review existing e2e test coverage.
 * Define prioritization scheme.
 * Prioritize e2e testing gaps.
 * T199257 - make current unit testing coverage more visible by reporting out to Engineering Management.
 * T199259 - Platform and Search Platform teams are using TDM PoC
 * T199262 - Identify key Tech Debt areas
 * T199263 - Put in place Tech Debt management process for PEP
 * T199261 - Define base Code Health metric set.

Developer Productivity

 * Make a hire to create the capacity needed for this program.
 * Write and share a survey to measure developer satisfaction and areas for investment. -

Selenium

 * Q1 goals task: T198389 Q1 Selenium framework improvements
 * No progress in the last week because of train 🚂

Gerrit

 * Deployed new version: 2.15.3 \o/
 * Data center switchover work?...Is this a thing that has to move? We probably don't have time.
 * I don't know.... Ask... someone?
 * will double-check SRE goal list

Phabricator

 * Deployed improved Antivandalism algorithm and it appears to be working well
 * Almost done with revert tool though it's imperfect and will remain imperfect unfortunately
 * It may be time to consider disabling admin-approval soon.

Antoine

 * What I plan to do this week
 * Complete mw coverage switch to Docker - https://phabricator.wikimedia.org/T195918
 * Rest && exhausted
 * What I'm blocked on
 * Few edge cases on extensions
 * Need to overhaul the way we run tests and stop running everything. Antoine to summarize discussions.
 * Other?

Dan

 * What I plan to do this week
 * T196940 Establish shared library for pipeline code used in Jenkins
 * T200452 Move Blubber repo and CR to Gerrit (see blocked on)
 * What I'm blocked on
 * Merge of upstream change https://gerrit-review.googlesource.com/c/plugins/go-import/+/190630
 * Can we integrate it into our fork?
 * thcipriani: pair today on this
 * Other?

Greg

 * What I plan to do this week
 * Hiring (3 candidates getting recruiter screened today) and more reviews of incoming applications (94 applicants)
 * Alexandros agreed to be in on the interview loop
 * Travel/Offsite planning
 * trying to pin down personal travel plans for end of summer
 * What I'm blocked on
 * Other?
 * Other?

Jean-Rene

 * What I plan to do this week
 * Phab PM
 * CH:PEP Tech Debt
 * CH:Pull together sub team for core metrics
 * QA:Meeting to discuss QA in foundation
 * What I'm blocked on
 * Other?
 * Other?

Mukunda

 * What I plan to do this week
 * Train :-o
 * Phabricator, phabricator,  phabricator...
 * Finish work on the revert tool.
 * Phabricator post-mortem.
 * What I'm blocked on
 * Train may block progress on the rest of this stuff
 * Other?
 * Even more phabricator:
 * Figure out what to do about custom task types. https://phabricator.wikimedia.org/T93499
 * Figure out what to do about swift storage back-end & git-lfs.
 * Still need to finish ElasticSearch 6 support.
 * Gerrit database repair stuff happening upstream: https://gerrit-review.googlesource.com/c/plugins/wmf-fixshadowuser/+/190030
 * Pair with tyler on scap canary stuff

Tyler

 * What I plan to do this week
 * More work on helm test for CI namespace, reply to alexandros
 * Move deployment-tin -> deployment-deploy01
 * What I'm blocked on
 * Other?
 * Add some facility to scap for custom logstash canary checks
 * Had some good response, would like to see it move
 * Pair with Mukunda
 * gerrit upgraded with mukunda: we are now gerrit masters
 * gerrit plugin?
 * google group with gerrit contributors for CLA?
 * google group with gerrit contributors for CLA?

Zeljko

 * What I plan to do this week
 * T188742 Run tests daily targeting beta cluster for all repositories with Selenium tests
 * Incident reports
 * https://wikitech.wikimedia.org/wiki/Incident_documentation/20180717-Train
 * https://wikitech.wikimedia.org/wiki/Incident_documentation/20180724-Train
 * What I'm blocked on
 * I need help from teams involved in train problems to complete incidents reports
 * Other?
 * Thinking about taking a week off in the next few weeks, not sure when yet
 * In the last month I have run 81 k (50 miles) uphill (climbing 2.5 k = 1.5 miles) to get a digital badge https://www.strava.com/challenges/Strava-Climbing-Challenge-Run-July-2018

Team Kanban Board Review and Triage

 * closed and touched in the 7 days
 * No update for 4 weeks
 * No update for 3 weeks
 * No update for 2 weeks
 * No update for 1 week
 * All Open
 * Review To Triage column of #releng
 * Assigned
 * Unassigned

Once / month-ish review of backlog(s)

 * releng Review To Triage column of #releng
 * releng-kanban Review unassigned in kanban
 * releng-kanban Review 'backlog' colum of -kanban
 * releng-next - Review for things we need to put on our kanban backlog
 * releng-backlog - oh my, the huge backlog of things...

Kanban stats

 * Burnup chart