Wikimedia Release Engineering Team/Checkin archive/20190729

= 2019-07-29 =

Vacations/Important dates

 * https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
 * How to do it


 * July 22–August 9 - Željko vacation
 * July 27–August 18 - Antoine


 * August 5–16 - Greg vacation
 * August 7–22 - James off (inc. Wikimania)
 * August 8-9 - Lars vacation
 * August 12 - September 8 - Dan leave
 * August 12 (Glorious Twelfth) - US Staff
 * August 14–18 - Wikimania
 * Attending: Lars, Jean-Rene; and James (in a personal capacity)
 * August 15 - Željko, Assumption of Mary
 * August 21-27: Lars vacation
 * August 28 - September 4 - Brennen vacation


 * September 2 (Labor Day) - US Staff
 * September 26 - October 1 - JR Vacation
 * September 27 - Mukunda


 * October 14 (Indigenous Peoples' Day) - US Staff


 * November 11 (Veterans' Day) - US Staff
 * November 28–29 (Thanksgiving) - US Staff


 * December 6 - Lars, Finnish Independence Day
 * December 25–31 (Christmas) - US Staff
 * December 25–26 - Lars, Christmas


 * 2020 January 1 (New Year's Day) - US Staff, Lars

Train

 * Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R


 * June 24 - wmf.11 - Jeena (with Mukunda)
 * July 1 - wmf.12 - No train (Fourth of July)
 * July 8 - wmf.13 - Jeena
 * July 15 - wmf.14 - Lars (with Antoine)
 * July 22 - wmf.15 - Lars
 * July 29 - wmf.16 - Brennen (with Tyler)
 * Aug 5 - wmf.17 - Brennen
 * Aug 12 - wmf.18 - No Train (Wikimania)
 * Aug 19 - wmf.19 - Zeljko 😱
 * Aug 26 - wmf.20 - Zeljko 😭
 * Sep 2 - wmf.21 - Antoine
 * Sep 9 - wmf.22 - Antoine
 * Sep 16 - wmf.23 - Mukunda
 * Sep 23 - wmf.24 - Mukunda
 * Sep 30 - wmf.25 - Tyler
 * Oct 7 - wmf.26 - Tyler
 * Oct 14 - 1.35.0-wmf.1 -

SoS

 * July 24: James
 * July 31: Mukunda
 * Aug 7: Mukunda
 * Aug 14: Zeljko

Timespent spreadsheet

 * For the avoidance of doubt: fill out the sheet week number for the previous week


 * spreadsheet! https://docs.google.com/spreadsheets/d/1UEmjIbv6voTF5bOnHdjOltw47AwPDtnmUo0h78wgYDY/edit#gid=946529670

Random script for timezones of team members: https://phabricator.wikimedia.org/P8817 $ time.is thcipriani thcipriani - America/Denver - 2019-07-29T08:09:34-06:00

November Offsite/Summit

 * TechConf19: November 12–15
 * Offsite: November 16–20
 * Arrive the 15th
 * 16th is our fun day/outing
 * 17–20 are working days
 * 21st fly home

Book club

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club

Monthly reflection on accomplishments - July '19 edition

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
 * Add as you have them!


 * Migrated all generic CI jobs from PHP 7.0 to PHP 7.2 https://phabricator.wikimedia.org/T225457
 * Three new folks have been spun up on and have successfully run the Train, by end-of-month
 * it-phabricator plugin updated; fixes errors in All-Users repo in Gerrit
 * Completed first book club iteration: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club/Continuous_Delivery
 * Unit vs Integration test split announcement: https://phabricator.wikimedia.org/phame/post/view/169/changes_and_improvements_to_phpunit_testing_in_mediawiki/
 * Gerrit 2.15.14 deployed
 * Contint1001 now storing docker images on seperate partition
 * Blubber 0.8.0 deployed - https://lists.wikimedia.org/pipermail/wikitech-l/2019-July/092344.html
 * Deployment Pipeline docs published on Wikitech - https://wikitech.wikimedia.org/wiki/Deployment_pipeline

Incoming/Needs attention

 * Phan now (wrongly) complains about code using variadic parameters
 * https://phabricator.wikimedia.org/T228695
 * James will take a look

Outgoing this week

 * Blocked by:
 * Core Platform Team:
 * MediaWiki installer silently ignores invalid extensions https://phabricator.wikimedia.org/T225512
 * Blocking:
 * Updates:
 * Train Health
 * Last week: 1.34.0-wmf.15 - https://phabricator.wikimedia.org/T220740 – Deployed on schedule
 * This week: 1.34.0-wmf.16 - https://phabricator.wikimedia.org/T220741
 * Next week: 1.34.0-wmf.17 - https://phabricator.wikimedia.org/T220742
 * Code Health
 * Log Health
 * Log Health

Callouts

 * Release Engineering

Train status and happenings

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

Monthly kanban review

 * First iteration!

Review kanban board for this month

 * https://phabricator.wikimedia.org/project/view/4105/

Views

 * All assigned: https://phabricator.wikimedia.org/project/board/4105/query/nUh0zISYaXyo/
 * All unassigned: https://phabricator.wikimedia.org/project/board/4105/query/ikcaa57y67UA/


 * Brennen: https://phabricator.wikimedia.org/project/board/4105/query/_fR1toqZBv8c/
 * Dan: https://phabricator.wikimedia.org/project/board/4105/query/n5gwK40h16e6/
 * James: https://phabricator.wikimedia.org/project/board/4105/query/jZhJ1JyLHuhl/
 * Jean-Rene: https://phabricator.wikimedia.org/project/board/4105/query/YcgXXlREy9jg/
 * Jeena: https://phabricator.wikimedia.org/project/board/4105/query/pL3CdfgtPE4i/
 * Lars: https://phabricator.wikimedia.org/project/board/4105/query/WCg9e9nRvJcO/
 * Mukunda: https://phabricator.wikimedia.org/project/board/4105/query/ZcxcWU5fV7m5/
 * Tyler: https://phabricator.wikimedia.org/project/board/4105/query/mfzr4YCZ8xlS/

Done within RelEng

 * Does this need to be tracked by us any longer?
 * No? Leave it
 * Yes? Move to #releng-todo-201908

Blocked Externally

 * Still needed?
 * Yes? Still blocked?
 * Yes? Move to #releng-todo-201908
 * No? Move to Ready in -201908 or some other TODO column (Next-ish, Soon-ish, Later)
 * No? Close out

Doing

 * Still doing?
 * Yes? Move to Doing in 201908
 * Why is it still Doing? Is it too big? Do you need help?
 * No?
 * Done? -> resolve
 * Not needed? -> decline
 * Blocked? -> Move to Blocked on 201908, and ping needed folks/teams

Ready

 * Going to happen/be worked on in August?
 * Yes? Move to Ready on #releng-todo-201908
 * No? Move to appropriate column on #releng-todo (Next-ish, Soon-ish, Later)

INBOX

 * Same as "Ready"

Review Next-ish column on #releng-todo

 * https://phabricator.wikimedia.org/project/board/4104/


 * Need to happen in August?
 * Yes? Move to Ready on #releng-todo-201908
 * No? Move to appropriate column on #releng-todo (Soon-ish, Later)

Standup!

 * Make sure your tasks are correct on our kanban board!
 * https://phabricator.wikimedia.org/project/board/4105/

Antoine

 * What I planned vs did last week
 * What I plan to do this week
 * What I'm blocked on
 * Other?
 * What I'm blocked on
 * Other?
 * Other?

Brennen

 * Planned vs. did last week:
 * dev-images mediawiki/core PHP situation
 * ❌ More local dev task cleanup
 * ❌ Review 524623: Support ubuntu 16.04
 * ❌ T228477: Ensure that local-charts installs and runs on Debian Buster
 * Decided not to break my entire environment the week before I do train the first time.
 * ✅, sorta - look at the skeleton CLI framework for local-charts
 * ✅ Register for tech conf
 * ✅ Read the Train docs again, sweat profusely
 * Other:
 * Met with Dan re: pipelinelib
 * Met with Lars about Train
 * What I plan to do this week
 * Review 525888: Use mediawiki-dev chart from releases.wikimedia.org/charts/
 * Patch deployment-charts mediawiki setup script
 * Finish 525972: Add .pipeline/ with dev image variant for local-charts
 * Review CLI stuff
 * Stretch: Meaningful work on Zuul v3 PoC
 * Train / new errors dashboard
 * What I'm blocked on
 * Other?
 * Other?

Dan

 * What I planned vs did last week
 * Met with folks about various things I'm involved in (beta, pipelinelib, mw dep management, etc.)
 * Worked on the Argo PoC. So far:
 * Gerrit propagates events on a per project basis (according to webhooks.config in refs/meta/config branch)
 * Argo Events webhooks gateway handles events, passing them on to a "sensor" which trigger Workflow script
 * A limitation was discovered in trigger configuration which made getting Workflow configuration from repo difficult
 * Had a great interaction with upstream about the limitation: filed issue with feature request, they said "sounds useful. let's do it", implemented said feature and submitted a PR, they said LGTM and merged it. Wee!
 * Argo Events PR was merged and will be included in next release
 * What I plan to do this week
 * Continue to work on Argo PoC
 * Source Workflow configuration from project repo
 * Get artifacts stored in Minio
 * Report status and Argo UI link to Gerrit PS
 * What I'm blocked on
 * Was blocked on the Argo Events limitation but no more! (the improvement still needs to be released, however)
 * Other?

Greg

 * What I planned vs did last week
 * ✅ First goal status check-in with Deb on Wednesday
 * ✅ Docker SIG Thursday (anything we should do differently?)
 * Cancelled, emailed asking for topics
 * ✅ Catch up on TechConf planning
 * ✅ Catch up on team workboards more (almost to the ongoing low-level churn)
 * getting there!
 * Travel planning/communication re fall offsite (week after TechConf)
 * What I plan to do this week
 * Feedback & Perforamnce working group
 * TechConf
 * Monthly manager roundatable
 * RelEng/SRE/CPT sync (Friday)
 * Figure out a thing?
 * Travel things
 * Triage meeting (TBC)
 * What I'm blocked on
 * Other?
 * Other?
 * Other?

James

 * What I planned vs did last week
 * ✅ Oh gods, enforced working from home. 😱😱😱
 * ❌ More shim work. https://phabricator.wikimedia.org/T222918
 * ✅ Train blockers ahoy.
 * ✅ Un"plan"ned:
 * Pipeline/MediaWiki in containers
 * static config experimentation.https://phabricator.wikimedia.org/T223602
 * Helping with initial pipeline set-up and config https://phabricator.wikimedia.org/T218360
 * MediaWiki is now tested on PHP 7.3
 * More Node 10 work
 * Final (hopefully) Zero clean-up work
 * CentralNotice work
 * What I plan to do this week
 * More pipeline/MediaWiki in containers work
 * More shim work https://phabricator.wikimedia.org/T222918
 * Not working from home
 * What I'm blocked on
 * Other?
 * This is my last full week until w/c 25 August.
 * This is my last full week until w/c 25 August.

Jean-Rene

 * What I planned vs did last week
 * Code Stewardship Reviews
 * Code Review workgroup - Current CR management practices.
 * Code Health Metrics -Worked on getting development environment working again so that I can progress on adding new extensions :-/
 * Quality and Test Engineering team planning/prep


 * What I plan to do this week
 * Send out invite to discuss Code Stewardship Review
 * Convert Code Health Office hours video to post onto Commons.
 * Code Health/Quality monthly reflection/planning.
 * Meeting with Daniel/CPT re: Phester (integration testing harness)


 * What I'm blocked on
 * Other?
 * Other?

Jeena

 * What I planned vs did last week
 * parsoid chart https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/525481
 * merge mediawiki chart and package
 * update local charts for mediawiki https://gerrit.wikimedia.org/r/c/releng/local-charts/+/525888
 * talked to Dan about https://phabricator.wikimedia.org/T222820
 * Worked with Brennen on fixing the mw core docker image
 * What I plan to do this week
 * ab tests for parsoid chart
 * merge parsoid chart
 * update local charts to use new parsoid chart
 * talk to Marco about restbase chart
 * get keyboard fixed
 * Experiment with hosted solutions for beta
 * What I'm blocked on
 * How can I use parsoid without connecting to mw?
 * Command line usage?
 * Other?

Lars

 * What I planned vs did last week
 * ✅ Re-promote to group2.
 * ✅ Run train again (wmf.15).
 * ✅ Review, contribute to the WMF CI near term planning doc.
 * ✅ Code Review Working Group meeting.
 * ✅ Watercooler chat.
 * ✅ RelEng SSD sync-up meeting.
 * ✅ 1:1 with Greg.
 * ✅ Watch recording of Alexandros's talk on the pipeline.
 * ✅ Review the July workboard (finally).
 * ✅ Stretch: Finish reading chapter 15 of the CD book.
 * ❌ Stretch: Skim Go book.
 * ✅ Brain-dumped on Brennen re what I've learnt about running the train
 * What I plan to do this week
 * Evaluate my own CI PoC implementation against the CI requirements, PoC goals.
 * Continue disucssion of CI WG PoC goals, evaluation.
 * Review, update CI arch document based on feedback, new thinking.
 * Skim Go book.
 * Skim Kubernetes book.
 * Read up on past WMF code health/review efforts.
 * Watch diversity and inclusion talk.
 * 
 * Watch Java logging talk.
 * 
 * Update the team docs page with what I know.
 * 
 * Attend Code Review WG meeting.
 * Attend RelEng watercooler.
 * Attend SSD sync-up meeting.
 * Have 1:1 with Greg.
 * Attend Deployment Pipeline meeting.
 * Have weekly chat with Tyler.
 * What I'm blocked on
 * Other?
 * Other?

Mukunda

 * What I planned vs did last week
 * Finish code review on the tarball stuff - https://gerrit.wikimedia.org/r/c/mediawiki/tools/release/+/521559
 * This got delayed until this week because the promised docs weren't done
 * ✅ Publish the blog post, really for real this time
 * ✅ Push skeleton CLI to local-charts repo
 * ✅ Learn more Go - I spent a lot of time on Go this week, I'm really liking it so far.
 * Slight optimism: Make a pretty phatality demo for the team
 * I sort-of demoed this on google meet, need a better demo though
 * Extreme optimism: Upgrade dev env to debian 10
 * epic fail
 * What I plan to do this week
 * What I'm blocked on
 * https://gerrit.wikimedia.org/r/c/releng/local-charts/+/525563
 * Other?
 * Other?

Tyler

 * What I planned vs did last week
 * ❌ Turn back on HTTP auth for Gerrit
 * Stuck thread on Monday
 * ✅ Rap with Dan about mediawiki dependencies stuff
 * ✅ Do the Blubberoid deploy
 * ✅ Finish pipeline docs tutorial and move into place
 * https://wikitech.wikimedia.org/wiki/Deployment_pipeline
 * ✅ Initial patchset for php7 restarts
 * https://gerrit.wikimedia.org/r/c/mediawiki/tools/scap/+/525117
 * What I plan to do this week
 * Scap -- patches finish php7 patches
 * Gerrit 2.15.15
 * (stretch) Barricade v2, Gerrit prometheus
 * train training.
 * What I'm blocked on
 * Other?
 * Other?

Zeljko

 * What I planned vs did last week
 * What I plan to do this week
 * What I'm blocked on
 * Other?
 * What I'm blocked on
 * Other?
 * Other?