Wikimedia Release Engineering Team/Checkin archive/20190401

= 2019-04-01 =

Vacations/Important dates

 * https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
 * How to do it


 * March 29–April 1: James out (New Hampshire)
 * March 31: DST switchover in .eu, elsewhere ish.
 * April 9-12: Greg at tech-mgt F2F in Portland
 * April 11: Dan out
 * April 17-19 (Wednesday - Friday) - Željko vacation
 * April 18-19 (Thursday, Friday) - Lars on vacation in Chicago
 * April 22 (WMF Holiday) - US Staff
 * April 22-27: Team offsite in Chicago
 * April 29: Moved WMF Holiday for US staff at offsite
 * May 1st - Lars, Antoine and Željko, Labor Day / May Day
 * May 8th - Antoine, 1945 victory
 * May 15 (Wednesday) - Željko vacation
 * May 16-20 - Wikimedia Hackathon 2019 (Prague, Czechia)
 * Attending: Greg, JR, Zeljko, James, and Jeena
 * May 30th-31th - Antoine, Feast of the Ascension
 * June 10th - Antoine, Pentecost -- see https://en.wikipedia.org/wiki/Eastertide for Antoine/France Easter holidays
 * May 27 (Memorial Day) - US Staff
 * June 6-7 - Brennen, Apogaea
 * June 19 (Juneteenth) - US Staff
 * July 22 - August 9 - Željko vacation
 * August 25 - September 4 - Brennen vacation

Train

 * Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R


 * Jan 07 - wmf.12 - Dan
 * Jan 14 - wmf.13 - Dan
 * Jan 21 - wmf.14 - Mukunda
 * Jan 28 - wmf.15 - No Train (All Hands)
 * Feb 04 - wmf.16 - Mukunda
 * Feb 11 - wmf.17 - Tyler
 * Feb 18 - wmf.18 - Tyler
 * Feb 25 - wmf.19 - Antoine
 * Mar 04 - wmf.20 - Antoine
 * Mar 11 - wmf.21 - Zeljko 🐌
 * Mar 18 - wmf.22 - Zeljko 💣
 * Mar 25 - wmf.23 - Dan
 * Apr 01 - wmf.24 - Dan
 * Apr 08 - wmf.25 - Mukunda
 * Apr 15 - 1.34.0-wmf.1 - Mukunda
 * Apr 22 - wmf.2 - NO TRAIN, team offsite
 * Apr 29 - wmf.3 - Tyler
 * May 06 - wmf.4 - Tyler
 * May 13 - wmf.5 - Antoine
 * May 20 - wmf.6 - Antoine
 * May 27 - wmf.7 - Zeljko
 * June 03 - wmf.8 - Zeljko

SoS

 * Zeljko 4eva! :)

Book club

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club
 * Notes: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club/Continuous_Delivery
 * Next:
 * April 5th at the "same" time (9am Pacific/16:00 UTC)
 * Chapters 7-9, inclusive

Spring Offsite

 * Location: Chicago, IL (Central timezone, UTC-5 while we're there)
 * Dates: Arrive Monday 4/22, Depart Saturday 4/27.
 * Activity day
 * Fill out the spreadsheet: https://docs.google.com/spreadsheets/d/1zqO8Mk1wUU2ZtyAM9xU68CQTpJFEOPALfDKCj7aMNo4/edit
 * POLLING BOOTHS CLOSE FRIDAY EOD (iow: that's when I make a final choice/email Megan N to buy our tickets).
 * See email from Deb re Cubs game on Tuesday night.
 * Program:
 * start listing your topics! https://etherpad.wikimedia.org/p/releng-offsite-201904-topics
 * I think we're winding down. Will start agenda bashing.

Monthly reflection on accomplishments - April '19 edition

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
 * Add as you have them!

Annual Planning

 * https://etherpad.wikimedia.org/p/releng-fy1920ap-tec1
 * https://etherpad.wikimedia.org/p/releng-fy1920ap-tec3
 * https://etherpad.wikimedia.org/p/releng-fy1920ap-tec12
 * https://etherpad.wikimedia.org/p/releng-fy1920ap-tec13
 * https://etherpad.wikimedia.org/p/releng-fy1920ap-new

[Task] Add Scribunto to extension-gate in CI

 * https://phabricator.wikimedia.org/T125050
 * https://gerrit.wikimedia.org/r/#/c/integration/config/+/497574/
 * calling into question time spent on unit tests in pre-merge tests.
 * yes to having better guidelines

Incoming from last week

 * Blocking:

Release Engineering

 * Blocked by:
 * Blocking:
 * Updates:
 * Train Health
 * Last week: 1.33.0-wmf.23 - https://phabricator.wikimedia.org/T206677
 * This week: 1.33.0-wmf.24 - https://phabricator.wikimedia.org/T206678
 * Next week: 1.33.0-wmf.25 - https://phabricator.wikimedia.org/T206679
 * Code Health
 * Log Health
 * Code Health
 * Log Health

Callouts

 * Release Engineering

Train status and happenings

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

Quarterly Goals for Q4
https://www.mediawiki.org/wiki/Wikimedia_Technology/Goals/2018-19_Q4

TEC1 (Maint): Outcome 1 / Output 1.1

 * GOAL: Undeploy the CodeReview extension.
 * WHO: James, need help from CPT

TEC1 (Maint): Outcome 1 / Output 1.1

 * GOAL: Setup 1-3 of the CI WG options (Zuul v3, Argo, GitLab)
 * WHO:


 * Focus on a couple noteworthy repos: e.g.,
 * core
 * extensions
 * ops/puppet
 * Maybe setup in serial, i.e., a week per evaluation


 * Questions:
 * RelEng/Extended working group?
 * At least in the WG eval it was good to have non-familiar people
 * But maybe with the setup of options it might be beneficial to have experienced with current setup people.
 * Folks outside the original working group to join-in to setup options; people TBD
 * Do we need a rubric before we do this prototyping? (yes)
 * TODO lars to work on rubric week of 2019-04-01

TEC3 (Pipeline): Outcome 1 / Output 1.2

 * GOAL: Instrument Quibble for data collection
 * WHO: Mukunda, Antoine


 * Still no progress / nowhere to store this data and other tasks taking priority

TEC3 (Pipeline): Outcome 1 / Output 1.2

 * GOAL: Create a graph where time is spent and make a prioritized list for improvements.
 * WHO: Mukunda, Antoine

TEC3 (Pipeline): Outcome 1 / Output 1.2

 * GOAL: Prepare the Deployment Pipeline for changes to our CI tooling.
 * WHO: Lars, ???


 * Blocked by not having new CI tooling yet

TEC3 (Pipeline): Outcome 3 / Output 3.1

 * GOAL: Create a .pipeline/config.yaml standard to give users more control over how their tests are run in the pipeline and allow the easy saving of artifacts at pipeline completion. (RelEng)
 * WHO: Dan, Tyler, ???

TEC3 (Pipeline): Outcome 3 / Output 3.1

 * GOALS:
 * Adopt more services into Deployment pipeline -
 * Wikidata Termbox SSR, Kask for Session Storage Service, cpjobqueue (stretch), ORES (stretch)
 * WHO: Dan, Tyler, Lars


 * ✅ cxserver


 * changeprop


 * ORES
 * cf: Dan's comments


 * Wikidata Termbox SSR


 * Kask for Session Storage Service


 * cpjobqueue (stretch)

TEC12 (DevProd): Outcome 1 / Output 1.1

 * GOAL: Provide an "Official" Docker base image for local development of MediaWiki based on the production tooling.
 * WHO: Jeena, Brennen

TEC13 (Code Health): Outcome 1 / Outcome 3

 * GOALs: Presentation/session(s) at the Wikimedia Hackathon on the current state of Code Health projects (technical debt and code stewardship)
 * WHO: JR

TEC13 (Code Health): Outcome 1 / Output 1.1

 * GOAL:
 * Publish a re-imagination of the Review Queue process.
 * Develop and implement metrics around task and code-review responsiveness
 * WHO: Greg, JR (and Andre)

TEC13 (Code Health): Outcome 4 / Output 4.2

 * GOALs:
 * Expand SonarQube reporting into CI infrastructure
 * Perform SonarQube analysis on all extensions
 * Engage user communities in direct feedback solicitation
 * WHO: JR, Zeljko, Code Health Metrics

Selenium

 * T213268 Upgrade webdriverio to version 5
 * Might fix T210506 `npm install` fails for mediawiki/core with EPEERINVALID when running on Node 11
 * Blocked on T199116 Quibble should run `npm install` and `npm run selenium-test` for each extension/skin that has Selenium tests

Gerrit

 * Back to 2.15.12 this week (see upstream discussion: https://groups.google.com/forum/#!topic/repo-discuss/pBMh09-XJsw )
 * Plugin/ACL updates likely this week

QA/Code Health

 * T219156 Generate baseline analysis of all extensions - script ready, will be run today/tomorrow

Antoine

 * What I plan to do this week
 * Still dealing with aftermath of Debian removing jessie-backports component. That introduced breakage all other the place due to outdated or now missing packages. Already burned 3 days on that
 * Quibble upgrade for parallelism. docker-pkg was broken, quibble 0.0.30 is missing some data file due to an old setuptools (see above)
 * Hopefully some Zuul repackaging :-/


 * What I'm blocked on
 * Change Gerrit owners from Administrators > Gerrit Managers
 * Haven't looked into it E_NO_TIME
 * Have a look at Zuul upgrade that Paladox worked on. E_NO_TIME :(


 * Other?
 * Overall, trying to focus but the regular maintenance of Docker images is killing me.
 * TLDR: do not ever use Debian *-backports component.

Brennen

 * What I plan to do this week
 * local-charts
 * blubber.yaml / docker-pkg for MediaWiki
 * Installation script tweaks
 * Follow up with Eric Gardner on documentation
 * Continue learning about Gerrit (thcipriani: if you want to pair on upgrade, might be...fun(?)) (ack)
 * Read book
 * What I'm blocked on
 * Nothing
 * Other?
 * Avoid most of the internet all day today.

Dan

 * What I plan to do this week
 * TRAAAAINz
 * Continue hacking on pipelinelib to implement pipeline config
 * https://gerrit.wikimedia.org/r/c/integration/pipelinelib/+/499918
 * Debugging Jenkins pipelines is a PITA
 * What I'm blocked on
 * Nada
 * Other?
 * Hacked up some nasty system tests for pipelinelib. Gross but useful
 * https://gerrit.wikimedia.org/r/c/integration/pipelinelib/+/500134

Greg

 * What I plan to do this week
 * Brain dumping on annual plan etherpads
 * reviewing the perf team phab process, starting to write some ideas down there
 * Read the book chapters
 * What I'm blocked on
 * MTP reveal :)
 * TOO MANY EMAILS
 * Other?

James

 * What I plan to do this week
 * What I'm blocked on
 * Other?
 * Other?
 * Other?

Jean-Rene

 * What I plan to do this week
 * What I'm blocked on
 * Other?
 * Other?
 * Other?

Jeena

 * What I plan to do this week
 * Add to the planning documents
 * Read book
 * Figure out how to use X-debug in local-charts
 * Merge Mac OS install script in local-charts
 * sshfs script for local-charts volume sharing
 * Add goals/intentions of local-charts description to README
 * What I'm blocked on
 * Other?
 * Other?

Lars

 * What I plan to do this week
 * read CD book, participate in book club
 * ✅ reinstall Debian on work laptop to fix various breakages (e.g., Docker/minikube no worky)
 * improve my essay on production-like based on feedback, further thinking
 * annual planning
 * What I'm blocked on
 * Other?
 * various illnesses
 * various illnesses

Mukunda

 * What I plan to do this week
 * Read a book
 * Fix phabricator search
 * Refine the vandalism rollback tool
 * Help Tyler with Gerrit upgrade and whatever else he needs
 * What I'm blocked on
 * Time.
 * Other?

Tyler

 * What I plan to do this week
 * Gerrit
 * Meetings
 * Code review when I have time
 * Read book (sooo far behind :(
 * What I'm blocked on
 * Other?
 * Other?

Zeljko

 * What I plan to do this week
 * T219156 Generate baseline analysis of all extensions
 * T219437 Add MacOS installation Documentation and Install Script for local-charts repo
 * T219132 European Mid-day SWAT
 * What I'm blocked on
 * T213268 Upgrade webdriverio to version 5
 * Might fix T210506 `npm install` fails for mediawiki/core with EPEERINVALID when running on Node 11
 * Blocked on T199116 Quibble should run `npm install` and `npm run selenium-test` for each extension/skin that has Selenium tests
 * Other?
 * Already read the book! (Well, chapters for book club.)

Team Kanban Board Review and Triage

 * closed and touched in the 7 days
 * No update for 4 weeks
 * No update for 3 weeks
 * No update for 2 weeks
 * No update for 1 week
 * All Open
 * Review To Triage column of #releng
 * Assigned
 * Unassigned

Once / month-ish review of backlog(s)

 * releng Review To Triage column of #releng
 * releng-kanban Review unassigned in kanban
 * releng-kanban Review 'backlog' colum of -kanban
 * releng-next - Review for things we need to put on our kanban backlog
 * releng-backlog - oh my, the huge backlog of things...

Kanban stats

 * Burnup chart