Wikimedia Release Engineering Team/Checkin archive/20190225

= 2019-02-25 =

Vacations/Important dates

 * https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
 * How to do it


 * February 19 - March 1 - Dan, vacation
 * March 11 (WMF Holiday) - US Staff
 * April 22 (WMF Holiday) - US Staff
 * April 22-27: Team offsite in Chicago
 * April 22nd - Antoine, Easter - we're flying to Chicago?
 * May 1st - Antoine and Željko, Labor Day / May Day
 * May 8th - Antoine, 1945 victory
 * May 17-19 - Wikimedia Hackathon 2019 (Prague, Czechia)
 * May 30th-31th - Antoine, Feast of the Ascension
 * June 10th - Antoine, Pentecost -- see https://en.wikipedia.org/wiki/Eastertide for Antoine/France Easter holidays
 * May 27 (Memorial Day) - US Staff
 * June 19 (Juneteenth) - US Staff

Train

 * Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R


 * Jan 07 - wmf.12 - Dan
 * Jan 14 - wmf.13 - Dan
 * Jan 21 - wmf.14 - Mukunda
 * Jan 28 - wmf.15 - No Train (All Hands)
 * Feb 04 - wmf.16 - Mukunda
 * Feb 11 - wmf.17 - Tyler
 * Feb 18 - wmf.18 - Tyler
 * Feb 25 - wmf.19 - Antoine
 * Mar 04 - wmf.20 - Antoine
 * Mar 11 - wmf.21 - Zeljko
 * Mar 18 - wmf.22 - Zeljko
 * Mar 25 - wmf.23 - Dan
 * Apr 01 - wmf.24 - Dan
 * Apr 08 - wmf.25 - Mukunda

SoS

 * Zeljko 4eva! :)

Book club

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club
 * March 4th: discuss Part I plus Chapter 5.
 * ONE MORE WEEKS!!!!1eleven
 * Scheduled: Mar 7th, 9am Pacific

Spring Offsite

 * Location: Chicago, IL (Central timezone, UTC-5 while we're there)
 * Dates: Arrive Monday 4/22, Depart Saturday 4/27.
 * BOOK FLIGHTS BY: March 21
 * Activity day: Send your suggestions to me if you have them :) I'll make the voting spreadsheet later.
 * Chicago Bulls!!!11!oneone
 * April 10 -- Regular Season ends, so only if they're good this year :)
 * I've heard there's good pizza :P
 * I'm sure we'll have some of that for our dinners, unless you want to do a cooking class :)
 * Greenfield park conservatory?
 * Museum of Science and Industry - https://www.msichicago.org/
 * Any American sport would be fun (basketball, football, baseball..) (Lars doesn't like watching sports, but would be happy to sit somewhere quite for the duration) (thcipriani: baseball isn't so much about watching baseball :)) (Lars: going to the baseball stadium is stressful when there's thousands of others there (I'm difficult, sorry))
 * Program: Haven't started yet :)

Technical Advice IRC Meetings

 * What: Joint WMF/WMDE lead IRC advice/q&a session. See: https://docs.google.com/document/d/1kXE2k6nM_eyIzcFHkU-d8G2asD5EpgYc64XiKLFgSAI/edit
 * When: every Wednesday at 16:00 UTC (we always keep the meeting at 17:00 MEZ)
 * Signup to co-host: https://docs.google.com/spreadsheets/d/1ExZWzV8vQJ6WQbQrhpzBggGia9Tr7SrpbSfNjOOeosw/edit#gid=0

Monthly reflection on accomplishments

 * Let's start keeping a list of accomplishments we've had over the last month (instead of monthy or weekly)
 * Purpose: helps with morale :) and can be a way of identifying good blog post/other ways of showcases
 * blubber uses blubberoid.wikimedia.org in the pipeline and pipeline is almost there for end-to-end functionality (can't yet deploy to production, but nearly can)
 * scap development back on gerrit -- new contributors
 * local-charts repo created
 * docker SIG announced/setup
 * Developer satisfaction survey results https://www.mediawiki.org/wiki/Developer_Satisfaction
 * Scap 3.9.0-1 released in production
 * Deployed wmf.18
 * Updated phabricator to 2019-02-20 release, blog posted detailing some changes: https://phabricator.wikimedia.org/phame/post/view/145/phab_phebruary/

Recover from corrupted beta MySQL slave (deployment-db04)

 * https://phabricator.wikimedia.org/T216067
 * Mukunda will look into this more today
 * We talked about if we should "simply" recreate from scratch if needed and import some sample content from production

Pywikibot CI

 * https://phabricator.wikimedia.org/T132138
 * Antoine to take a time boxed look into this, this week

Scrum of Scrums

 * Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums

Incoming from last week

 * Blocking:

Release Engineering

 * Blocked by:
 * Blocking:
 * Updates:
 * Developer satisfaction survey results https://www.mediawiki.org/wiki/Developer_Satisfaction
 * New Phabricator features, phame blog posted: https://phabricator.wikimedia.org/phame/post/view/145/phab_phebruary/
 * Scap 3.9.0-1 is released, ping us if scap does anything weird :)
 * Train Health:
 * Last week: 1.33.0-wmf.18 - https://phabricator.wikimedia.org/T206671
 * This week: 1.33.0-wmf.19 - https://phabricator.wikimedia.org/T206672
 * Next week: 1.33.0-wmf.20 - https://phabricator.wikimedia.org/T206673
 * Log Health:
 * Code Health:
 * Code Health:

Callouts

 * Release Engineering

Train status and happenings

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

Quarterly Goals for Q3
https://www.mediawiki.org/wiki/Wikimedia_Technology/Goals/2018-19_Q3

TEC1 (Maint): Outcome 1 / Output 1.1

 * GOAL: Automate the generation of change log notes
 * WHO: Mukunda, (Tyler on backup)


 * No movement last week
 * Planned update to notes task this week

TEC1 (Maint): Outcome 1 / Output 1.1

 * GOAL: Investigate notification methods for developers with changes that are riding any given train
 * WHO: Mukunda, Tyler

TEC3 (Pipeline): Outcome 1 / Output 1.2

 * GOAL: Instrument Quibble for data collection
 * WHO: Mukunda, Antoine

TEC3 (Pipeline): Outcome 1 / Output 1.2

 * GOAL: Create a graph where time is spent and make a prioritized list for improvements.
 * WHO: Mukunda, Antoine

TEC3 (Pipeline): Outcome 2 / Output 2.1

 * GOAL: Select and integrate a code health metric solution into our tooling.
 * WHO: JR, ...

dependent on Code Health Group Metrics Group work

TEC3 (Pipeline): Outcome 3 / Output 3.1

 * GOALS:
 * Adopt more services into Deployment pipeline -
 * cxserver, ORES (partially), citoid, changeprop, cpjobqueue (stretch)
 * Deploy eventgate
 * WHO: Dan, Tyler, Lars


 * "I think we're mostly on track for it"

TEC12 (DevProd): Outcome 1 / Output 1.1

 * GOAL: Conduct interviews with development stakeholders and compile a report that informs future work creation of a rubric.
 * WHO: Jeena, Mukunda


 * Results are posted: https://www.mediawiki.org/wiki/Developer_Satisfaction

TEC13 (Code Health): Outcome 1 / Output 1.1

 * GOALs:
 * Develop and communicate guidelines and best practices for successful Code Stewardship.
 * (Continued from Q2) Update/refresh review queue (review process for initial code deployment)
 * WHO: JR

Progress last week.

TEC13 (Code Health): Outcome 2 / Output 2.2

 * GOAL: 5 of the 15 prioritized repositories have at least 1 end-to-end test -
 * WHO: Zeljko

TEC13 (Code Health): Outcome 2 / Output 2.3

 * GOALs:
 * Evolve/develop tools and processes to support the PE refactoring effort to improve code health.
 * Develop common test strategy that enable teams to engage in more effective and efficient testing practices. (maybe should be output 2.4?)
 * WHO: JR, Core Platform Team

Checked to see to what extent CHGM WG could help make progress in coverage metric tooling improvements.

TEC13 (Code Health): Outcome 3 / Output 3.2

 * GOALs:
 * Speak at All Hands on the status of Technical Debt
 * Engage and coach development teams on their approach to managing technical debt.
 * WHO: JR, Core Platform Team

No progress

TEC13 (Code Health): Outcome 4 / Output 4.1

 * GOALs: Code Health Dashboard with 50% of repositories covered.
 * WHO: JR, Core Platform Team

Minimal progress.

Selenium

 * T214478 The first Selenium test for AbuseFilter
 * T216424 The first Selenium test for ContentTranslation
 * T214480 The first Selenium test for TimedMediaHandler
 * T204068 QA: Automation Testing - port Echo Notification tests to Node.js

Gerrit

 * 2.15.10 is ready
 * https://gerrit.wikimedia.org/r/#/c/operations/software/gerrit/+/492025/
 * need to find window to deploy

Phabricator

 * Deployed almost 6 months worth of upstream changes
 * Summarized some key changes in this blog post:
 * https://phabricator.wikimedia.org/phame/post/view/145/phab_phebruary/
 * Schema changes took a long time, nearly disrupting some SRE on-site datacenter work that was unfortunately timed.
 * This could have been avoided with better planning, however, it highlights the need for high-availability of phabricator.
 * I'm tempted to build a static cache of our public phabricator content (perhaps look into what it would take to make our existing reverse-proxy / cache infrastructure do the job.)
 * There was one regression which I reported and it's now fixed upstream - I'll deploy a patch today. ( https://phabricator.wikimedia.org/T216849 )

QA/Code Health
** T217008 Report results from SonarCloud to Gerrit

SCAP

 * 3.9.0-1 released today, changes planned

Antoine

 * What I plan to do this week
 * What I'm blocked on
 * Other?
 * Other?
 * Other?

Brennen

 * What I plan to do this week
 * Land a few minor changes to local-charts setup scripting (better Debian, known-working Ubuntu)
 * Discussion with Lars, Zeljko, Antoine, et al. re: CI
 * Efforts to get a better handle on state of existing CI
 * First Docker SIG meeting on Thursday, want to feel more ready for that by the time it happens
 * What I'm blocked on
 * Other?
 * Started making lots of scribbly notes on Continuous Delivery book, planning to do a chapter a day until it's defeated.
 * Started making lots of scribbly notes on Continuous Delivery book, planning to do a chapter a day until it's defeated.

Dan

 * What I plan to do this week
 * What I'm blocked on
 * Other?
 * Other?
 * Other?

Greg

 * What I plan to do this week
 * Review Queue brain dumping/sense-making
 * ISOSSTWG thing, finally? (keeps being demoted in priority)
 * Follow-up with Erika re Phab workflows (in relation to the above)
 * Read book
 * Thinking about next year's TechConf ("developer productivity"?)
 * Docker SIG
 * Talking about Quality with Adam/Marcella (with JR)
 * Maybe https://help.github.com/en/articles/creating-a-default-community-health-file-for-your-organization for CoC?
 * What I'm blocked on
 * Other?
 * Other?

James

 * What I plan to do this week
 * What I'm blocked on
 * Other?
 * Other?
 * Other?

Jean-Rene

 * What I plan to do this week
 * Continue work on stewardship
 * Work on quality strategy stuff
 * work on CPT Goals
 * What I'm blocked on
 * Other?
 * Other?

Jeena

 * What I plan to do this week
 * Figure out why hyperkit now taking up bunch of CPU
 * Finish setting up restbase for local charts
 * Work with Brennen on figuring out where/how to publish docker images for the local dev environment
 * Read book
 * What I'm blocked on
 * Other?
 * Other?

Lars

 * What I plan to do this week
 * Get Quibble set up on my laptop, run the test suite to verify it works.
 * Discuss with Zeljko, Brennen how to do the CI future project and tool evaluation.
 * Interview people about CI requirements.
 * Find possible CI tools to review.
 * Docker-SIG, Tech Advice
 * What I'm blocked on
 * computers are complicated
 * Other?

Mukunda

 * What I plan to do this week
 * Deploy fix for phabricator regression + upstream changes that didn't make the cut last week
 * Fix beta cluster db
 * Start looking into quibble instrumentation
 * Figure out what is TEC3 (Pipeline): Outcome 1 / Output 1.2 all about. (thcipriani: let's pair! :))
 * Try out phabricator's new subtype field customization feature
 * Continue playing with docker / minikube phabricator test environment if time allows
 * Probably not read the book
 * What I'm blocked on
 * Time in a day
 * Other?

Tyler

 * What I plan to do this week
 * Gerrit 2.15.10
 * Update pipelinelib patch with feedback (thanks all!)
 * scap dev env
 * Train notes automagic
 * Gerrit duplicate users
 * Catchup with what's happening with sonarcloud patches re:branch vs patch
 * https://gerrit.wikimedia.org/r/#/c/integration/config/+/490950/
 * What I'm blocked on
 * Other?
 * Deployment pipeline book -- collecting thoughts/notes
 * Deployment pipeline book -- collecting thoughts/notes

Zeljko

 * What I plan to do this week
 * T217008 Report results from SonarCloud to Gerrit
 * T214478 The first Selenium test for AbuseFilter
 * T216424 The first Selenium test for ContentTranslation
 * T214480 The first Selenium test for TimedMediaHandler
 * T204068 QA: Automation Testing - port Echo Notification tests to Node.js
 * What I'm blocked on
 * Other?
 * Other?

Team Kanban Board Review and Triage

 * closed and touched in the 7 days
 * No update for 4 weeks
 * No update for 3 weeks
 * No update for 2 weeks
 * No update for 1 week
 * All Open
 * Review To Triage column of #releng
 * Assigned
 * Unassigned

Once / month-ish review of backlog(s)

 * releng Review To Triage column of #releng
 * releng-kanban Review unassigned in kanban
 * releng-kanban Review 'backlog' colum of -kanban
 * releng-next - Review for things we need to put on our kanban backlog
 * releng-backlog - oh my, the huge backlog of things...

Kanban stats

 * Burnup chart