Wikimedia Release Engineering Team/Checkin archive/20171018

= 2017-10-18 =

Vacations/Important dates

 * https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
 * How to do it


 * Oct week of 23rd thcipriani
 * October 25 (Wednesday) Željko - conference (Testival)
 * November 1 (Wednesday): Željko - holiday (All Saints' Day)
 * Nov 10 (Fri) - Veteran's Day
 * Nov 20th - Dec 1st: Greg vacation
 * Nov 23+24 - Thanksgiving
 * December 25 (Monday): Željko - holiday (Christmas Day)
 * December 26 (Tuesday): Željko - holiday (St Stephen's Day)
 * Dec 25-Jan 1 - End of year/new year holidays
 * January 1 (Monday): Željko - holiday (New Year's Day)

Rotating positions and absences
Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/?project=PHID-PROJ-fmcvjrkfvvzz3gxavs3a&statuses=open%28%29&group=none&order=newest#R

Oct 9 and Oct 16

 * Train: Chad
 * wmf.3
 * wmf.4
 * SoS: Mukunda
 * Out
 * October 4-10th: vacation all I ever wanted
 * Oct 9 - Indigenous People's Day

Oct 23 and Oct 30
Train Chad SOS: Mukunda

This week

 * Blocking
 * Blocked
 * Updates
 * Updates
 * Updates

Last week

 * Blocking
 * Blocked
 * Updates
 * MW deployment train for this week is behind by a day, we plan to catch up today (doing both group0 and group1)
 * Updates
 * MW deployment train for this week is behind by a day, we plan to catch up today (doing both group0 and group1)

Logspam \ Last week's train updates

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

Other Team Business

 * https://docs.google.com/document/d/1e6m2GNc3pc40sxE_PNCrJdRW9fGu1HYjnv2-aOHUxj4/edit#
 * https://etherpad.tylercipriani.com/p/releng-team-gaps
 * https://etherpad.wikimedia.org/p/monitoring-pitch

Q2 goal/project check-in

 * All of it in table form: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q2

Program 1: Outcome 5: Milestone 1: Migrate majority of developers to JavaScript based browser test framework (webdriver.io)

 * Due: End of this quarter
 * Quarter Goal Task: Port Selenium tests from Ruby to Node.js -


 * Mobile web team going strong
 * T162256 [EPIC] Port Selenium tests from Ruby to Node.js on Reading Web extensions
 * T177262 [subtask] Rewrite Page Previews browser tests in Node.js
 * I was mostly helping with this one
 * T174018 Port Minerva's browser tests to Selenium
 * T177260 [subtask] Rewrite MobileFrontend's browser tests
 * T177261 [subtask] Rewrite QuickSurveys browser tests in Node.js or remove them


 * T173505 Add createAccount method to nodemw
 * Working on it, should not be hard.


 * T177412 Mocha tests for Echo notifications
 * Porting Ruby API tests to Node.js. Almost there.


 * T171852 WebdriverIO tech talk
 * Rachel suggested two dates, both did not work for me. Waiting for another date.

Ruby

 * T167432 Run Wikibase daily browser tests on Jenkins
 * Might need help from Antoine on setting up screenshots and video recording
 * T177924 Run Popups Selenium tests daily targeting beta cluster
 * declined

Program 3: Outcome 1: Objective 1: Define a set of code stewardship levels (from high to low expectations)

 * Due: End of this quarter
 * Quatertly Goal task: -


 * Started pulling together rough code stewardship levels, should have something for initial review/discussion next week.

Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphans

 * Due: End of next quarter
 * Quaterly Goal task -


 * no progress since last week.

Program 3: Outcome 2: Objective 1: Define a “Technical Debt Project Manager” role that regularly communicates with all Foundation engineering teams regarding their technical debt

 * Due: End of this quarter


 * no progress since last week

Program 3: Outcome 2: Objective 2: Define and implement a process to regularly address technical debt across the Foundation

 * Due: End of next quarter


 * tech debt blog series post 1 should be ready for initial review in the next couple of days.

==== Program 6: Outcome 2: Objective 2: Set up a continuous integration and deployment pipeline to publish new versions of an application to production via testing and staging environments that reliably reproduce production ====
 * Due: End of this quarter
 * Complete build phase of release pipeline


 * Build test variant
 * Run test entrypoint w/developer feedback - services dependency
 * Build production variant w/developer feedback - services dependency
 * Tag production container
 * Push to production docker registry - ops dependency - staging namespace

Tracking: https://phabricator.wikimedia.org/T157469
 * current status: https://phabricator.wikimedia.org/project/view/2453/


 * Dan working on test pipeline for mathoid
 * Found some weirdness with contint1001 still trying to figure out
 * tyler puppetizing cleanup of old containers

Program 1: Outcome 1: Objective 1: Scap (Tech Debt Sprint FY201718-Q2)

 * workboard


 * https://phabricator.wikimedia.org/T137124 "Submodule space issues"
 * Made some progress on a patch that avoids duplicating the .git object store for each rev.
 * ~50% finished, will post a WIP for code review soon
 * Support git-lfs in gerrit
 * https://phabricator.wikimedia.org/T171758
 * Probably have an interim solution for now not backed by Swift
 * Lots of small code cleanups
 * Replace DOLOGMSGNOLOG
 * https://phabricator.wikimedia.org/T68049
 * Mostly done, working on patch tweaks
 * Eliminate symlinks from MW deploys
 * https://phabricator.wikimedia.org/T126306
 * PrivateSettings done, StartProfiler in progress -- these are the two worst
 * Rest being assessed

Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure

 * Goal: A generalized POC for a docker-based CI.
 * https://phabricator.wikimedia.org/project/view/3008/ (shipyard workboard)

Program 1: Outcome 6: Milestone 1: Maintain Gerrit

 * Totally swapped to Scap3-based deploys and using systemd instead of init.d
 * Support git-lfs in gerrit
 * https://phabricator.wikimedia.org/T171758
 * Probably have an interim solution for now not backed by Swift

Program 1: Outcome 6: Milestone 2: Maintain Phabricator

 * Last week's deployment broke some forms due to field visibility:
 * Bugs: https://phabricator.wikimedia.org/T178107, https://phabricator.wikimedia.org/T178068
 * Hotfix, deployed on Monday: https://phabricator.wikimedia.org/rPHABd606822dcce0ffc997fa21846e1c504ebded4a12

Team Kanban Board Review and Triage

 * closed and touched in the 7 days
 * No update for 4 weeks
 * No update for 3 weeks
 * No update for 2 weeks
 * No update for 1 week
 * All Open
 * Review To Triage column of #releng


 * Assigned
 * Unassigned

Once / month-ish review of backlog(s)

 * releng Review To Triage column of #releng
 * releng-kanban Review unassigned in kanban
 * releng-kanban Review 'backlog' colum of -kanban
 * releng-next - Review for things we need to put on our kanban backlog
 * releng-backlog - oh my, the huge backlog of things...

Kanban stats

 * Burnup chart