Wikimedia Release Engineering Team/Checkin archive/20180813

= 2018-08-13 =

Vacations/Important dates

 * https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
 * How to do it


 * August 13-24: Greg vacation
 * August 14: thcipriani birthday, buy him something nice
 * August 15 (Wednesday): WMF Monthly Holiday
 * August 15-17 (Wednesday-Friday): Željko holiday+vacation
 * August 16-17 (Thursday & Friday): Mukunda likes 5 day weekends
 * August 23-24 (Thursday-Friday): Željko vacation
 * August ~: Antoine
 * August 29-31: Dan vacation
 * September a week or so - Antoine

Train

 * Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/?project=PHID-PROJ-fmcvjrkfvvzz3gxavs3a&statuses=open%28%29&group=none&order=newest#R


 * July 02 - wmf.11 - Zeljko - no train, Fourth of July
 * July 09 - wmf.12 - Zeljko
 * July 16 - wmf.13 - Zeljko
 * July 23 - wmf.14 - Zeljko
 * July 30 - wmf.15 - Mukunda
 * Aug 06 - wmf.16 - Mukunda
 * Aug 13 - wmf.17 - Mukunda (No train - Wednesday is a holiday)   <
 * Aug 20 - wmf.18 - Tyler
 * Aug 27 - wmf.19 - Dan
 * Sep 03 - wmf.20 - Tyler
 * Sep 10 - wmf.21 - Dan
 * Sep 17 - wmf.22 - Zeljko
 * Sep 24 - wmf.23 - Zeljko
 * Oct 01 - wmf.24 - Antoine
 * Oct 08 - wmf.25 - Antoine
 * Oct 15 - wmf.26 - Mukunda (last 1.32 wmf.XX release, 1.33 starts the next week)
 * Oct 22 - wmf.1 - Mukunda

SoS

 * July 04 - Dan
 * July 11 - Antoine
 * July 18 - Antoine
 * July 25 - Tyler
 * Aug 01 - Tyler
 * Aug 08 - Zeljko
 * Aug 15 - Dan (probably not SoS because it's a WMF holiday?)  <
 * Aug 22 - Mukunda
 * Aug 29 - Mukunda
 * Sep 05 - Tyler
 * Sep 12 - Tyler
 * Sep 19 - Dan
 * Sep 26 - Dan
 * Oct 03 - Zeljko
 * Oct 10 - Zeljko
 * Oct 17 - Antoine
 * Oct 24 - Antoine
 * Oct 31 - Mukunda

First Offsite

 * waiting to hear back confirmation from Travel but... I was told that no more offsites can be scheduled next to TechConf in Portland in October, so the week of Nov 5th it is.

Needs attention

 * Create a production test wiki in group0 to parallel Wikimedia Commons - https://phabricator.wikimedia.org/T197616
 * Status: Mark H and Amanda reached out to me, I asked for a meeting with Mark H.

Scrum of Scrums

 * Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums

Release Engineering

 * Blocked by:
 * Blocking:
 * Feedback needed from various teams (too many to name each one) on two recent MediaWiki train related incident reports. Specifically, how problems could have been prevented.
 * 1.32.0-wmf.13, 9 blockers, feedback needed for all of them: https://wikitech.wikimedia.org/wiki/Incident_documentation/20180717-Train
 * 1.32.0-wmf.14, 6 blockers, feedback needed for 2 of them: https://wikitech.wikimedia.org/wiki/Incident_documentation/20180724-Train
 * Updates
 * Blubber test
 * Code health working group -- join up!
 * Quarterly cross-dependencies
 * Quarterly cross-dependencies

Last week

 * Blocked by:
 * Blocking:
 * Feedback needed from various teams (too many to name each one) on two recent MediaWiki train related incident reports. Specifically, how problems could have been prevented.
 * 1.32.0-wmf.13, 9 blockers, feedback needed for all of them: https://wikitech.wikimedia.org/wiki/Incident_documentation/20180717-Train
 * 1.32.0-wmf.14, 6 blockers, feedback needed for 2 of them: https://wikitech.wikimedia.org/wiki/Incident_documentation/20180724-Train
 * Updates
 * Quarterly cross-dependencies
 * Quarterly cross-dependencies
 * Quarterly cross-dependencies

Train status and happenings

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

Past week status updates

 * All of it in table form: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q4

Pipeline: Move verify stage from Minikube to CI k8s namespace in production context

 * tracking task


 * Generic blubber job working
 * Generic test entrypoint for dogfooding
 * refactoring in blubber for pipelinelib
 * Still needs KUBECONFIG for pipelinelib
 * Instance relabeling
 * Now that we have more things running in containers it broadens the tools to available agents
 * Instances all tagged "blubber"


 * moving blubber.yaml in mathoid
 * merging the pipeline stuff for ci namespace

Code Health

 * T199253 - Investigate and propose record of origin (ROO) for deployed code (currently Developers/Maintainers page)
 * Perform existing Stewardship review process for Q1 cycle.
 * T199254 - Add test evaluation to post mortem review process.
 * started adding to the PM process in prep for pending train PMs
 * Review existing e2e test coverage.
 * Define prioritization scheme.
 * Prioritize e2e testing gaps.
 * T199257 - make current unit testing coverage more visible by reporting out to Engineering Management.
 * T199259 - Platform and Search Platform teams are using TDM PoC
 * T199262 - Identify key Tech Debt areas
 * continued reviewing platform TD
 * T199263 - Put in place Tech Debt management process for PEP
 * T199261 - Define base Code Health metric set.
 * started forming working group

Developer Productivity

 * Make a hire to create the capacity needed for this program.
 * Write and share a survey to measure developer satisfaction and areas for investment. -

Selenium

 * Q1 goals task: T198389 Q1 Selenium framework improvements
 * T179188 Video recording for Selenium tests in Node.js
 * T193157 Quibble does not install ffmpeg - patch needs review https://gerrit.wikimedia.org/r/c/integration/quibble/+/451645
 * T188742 Run tests daily targeting beta cluster for all repositories with Selenium tests
 * T199113 All repositories with Selenium tests should use wdio-mediawiki
 * T185011 Create selenium-MediaWiki-jessie daily Jenkins job

Phabricator

 * Finally deployed antivandalism with notifications for banned accounts. I had to tune the parameters just a bit to get things right but I believe that it's working well now.
 * \o/

QA

 * completed discussion with EMs re QA strategy

Antoine

 * What I plan to do this week
 * What I'm blocked on
 * Other?
 * Other?
 * Other?

Dan

 * What I plan to do this week
 * Support for `KUBECONFIG=` in integration/pipelinelib
 * Review/merge service-pipeline change for using ci k8s namespace
 * Refactoring service-pipeline job to use integration/pipelinelib
 * What I'm blocked on
 * Nada. Thanks for the reviews!
 * Other?

Greg

 * What I plan to do this week
 * Be on Vacation
 * What I'm blocked on
 * Other?
 * Other?

Jean-Rene

 * What I plan to do this week
 * setup PMs for trains
 * setup Train retrospective
 * continue work on QA strat
 * prep for Code Health Metrics WG
 * What I'm blocked on
 * Other?
 * Other?

Mukunda

 * What I plan to do this week
 * Get caught back up on gerrit upstream
 * Re-Prioritize my assigned tasks and figure out where to go from here.
 * Write an email update about phabricator antivandalism efforts.
 * What I'm blocked on
 * Other?
 * Other?

Tyler

 * What I plan to do this week
 * Review https://gerrit.wikimedia.org/r/c/blubber/+/451688/3 w/dan
 * gerrit plugin (last week didn't have time)
 * pretend to be greg
 * review interview tests
 * review T193157 Quibble does not install ffmpeg - patch needs review https://gerrit.wikimedia.org/r/c/integration/quibble/+/451645
 * What I'm blocked on
 * https://gerrit.wikimedia.org/r/#/c/integration/config/+/451078/
 * Other?

Zeljko

 * What I plan to do this week
 * https://www.mediawiki.org/wiki/Wikimedia_Technology/Annual_Plans/FY2019/TEC13:_Code_Health/Goals#Outcome_2_/_Output_2.2
 * Review existing e2e test coverage.
 * Define prioritization scheme.
 * Prioritize e2e testing gaps.
 * T179188 Video recording for Selenium tests in Node.js
 * T193157 Quibble does not install ffmpeg - patch needs review https://gerrit.wikimedia.org/r/c/integration/quibble/+/451645
 * T188742 Run tests daily targeting beta cluster for all repositories with Selenium tests
 * T199113 All repositories with Selenium tests should use wdio-mediawiki
 * T185011 Create selenium-MediaWiki-jessie daily Jenkins job
 * Review received feedback for incident reports
 * https://wikitech.wikimedia.org/wiki/Incident_documentation/20180717-Train
 * https://wikitech.wikimedia.org/wiki/Incident_documentation/20180724-Train
 * What I'm blocked on
 * T193157 Quibble does not install ffmpeg - patch needs review https://gerrit.wikimedia.org/r/c/integration/quibble/+/451645
 * Other?
 * Wikimedia Portals Update and European Mid-day SWAT windows overlap, example: https://wikitech.wikimedia.org/wiki/Deployments#Monday,_August_13
 * I hate Gerrit's silent (merge confict) message when +2ing something - https://phabricator.wikimedia.org/T196910

Team Kanban Board Review and Triage

 * closed and touched in the 7 days
 * No update for 4 weeks
 * No update for 3 weeks
 * No update for 2 weeks
 * No update for 1 week
 * All Open
 * Review To Triage column of #releng
 * Assigned
 * Unassigned

Once / month-ish review of backlog(s)

 * releng Review To Triage column of #releng
 * releng-kanban Review unassigned in kanban
 * releng-kanban Review 'backlog' colum of -kanban
 * releng-next - Review for things we need to put on our kanban backlog
 * releng-backlog - oh my, the huge backlog of things...

Kanban stats

 * Burnup chart