Wikimedia Release Engineering Team/Checkin archive/20190225

From mediawiki.org


2019-02-25[edit]

Vacations/Important dates[edit]

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
How to do it
  • February 19 - March 1 - Dan, vacation
  • March 11 (WMF Holiday) - US Staff
  • April 22 (WMF Holiday) - US Staff
  • April 22-27: Team offsite in Chicago
  • April 22nd - Antoine, Easter - we're flying to Chicago?
  • May 1st - Antoine and Željko, Labor Day / May Day
  • May 8th - Antoine, 1945 victory
  • May 17-19 - Wikimedia Hackathon 2019 (Prague, Czechia)
  • May 30th-31th - Antoine, Feast of the Ascension
  • June 10th - Antoine, Pentecost -- see https://en.wikipedia.org/wiki/Eastertide for Antoine/France Easter holidays
  • May 27 (Memorial Day) - US Staff
  • June 19 (Juneteenth) - US Staff

Rotating positions[edit]

Train[edit]

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R
  • Jan 07 - wmf.12 - Dan
  • Jan 14 - wmf.13 - Dan
  • Jan 21 - wmf.14 - Mukunda
  • Jan 28 - wmf.15 - No Train (All Hands)
  • Feb 04 - wmf.16 - Mukunda
  • Feb 11 - wmf.17 - Tyler
  • Feb 18 - wmf.18 - Tyler
  • Feb 25 - wmf.19 - Antoine
  • Mar 04 - wmf.20 - Antoine
  • Mar 11 - wmf.21 - Zeljko
  • Mar 18 - wmf.22 - Zeljko
  • Mar 25 - wmf.23 - Dan
  • Apr 01 - wmf.24 - Dan
  • Apr 08 - wmf.25 - Mukunda

SoS[edit]

  • Zeljko 4eva! :)

Team Business[edit]

Book club[edit]


Spring Offsite[edit]

  • Location: Chicago, IL (Central timezone, UTC-5 while we're there)
  • Dates: Arrive Monday 4/22, Depart Saturday 4/27.
  • BOOK FLIGHTS BY: March 21
  • Activity day: Send your suggestions to me if you have them :) I'll make the voting spreadsheet later.
    • Chicago Bulls!!!11!oneone
      • April 10 -- Regular Season ends, so only if they're good this year :)
    • I've heard there's good pizza :P
      • I'm sure we'll have some of that for our dinners, unless you want to do a cooking class :)
    • Greenfield park conservatory?
    • Museum of Science and Industry - https://www.msichicago.org/
    • Any American sport would be fun (basketball, football, baseball..) (Lars doesn't like watching sports, but would be happy to sit somewhere quite for the duration) (thcipriani: baseball isn't so much about watching baseball :)) (Lars: going to the baseball stadium is stressful when there's thousands of others there (I'm difficult, sorry))
  • Program: Haven't started yet :)


Technical Advice IRC Meetings[edit]


Monthly reflection on accomplishments[edit]

  • Let's start keeping a list of accomplishments we've had over the last month (instead of monthy or weekly)
  • Purpose: helps with morale :) and can be a way of identifying good blog post/other ways of showcases
  • blubber uses blubberoid.wikimedia.org in the pipeline and pipeline is almost there for end-to-end functionality (can't yet deploy to production, but nearly can)
  • scap development back on gerrit -- new contributors
  • local-charts repo created
  • docker SIG announced/setup
  • Developer satisfaction survey results https://www.mediawiki.org/wiki/Developer_Satisfaction
  • Scap 3.9.0-1 released in production
  • Deployed wmf.18
  • Updated phabricator to 2019-02-20 release, blog posted detailing some changes: https://phabricator.wikimedia.org/phame/post/view/145/phab_phebruary/

Incoming/Needs attention[edit]

Recover from corrupted beta MySQL slave (deployment-db04)[edit]


Pywikibot CI[edit]


Scrum of Scrums[edit]

Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums

Incoming from last week[edit]

  • Blocking:


Outgoing this week (wrong section heading is on purpose for copy/pasting into Scrum of Scrums etherpad[edit]

Release Engineering[edit]


Callouts[edit]

  • Release Engineering


Train status and happenings[edit]

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor



Quarterly Goals for Q3[edit]

https://www.mediawiki.org/wiki/Wikimedia_Technology/Goals/2018-19_Q3

TEC1 (Maint): Outcome 1 / Output 1.1[edit]

GOAL: Automate the generation of change log notes
WHO: Mukunda, (Tyler on backup)
  • No movement last week
  • Planned update to notes task this week

TEC1 (Maint): Outcome 1 / Output 1.1[edit]

GOAL: Investigate notification methods for developers with changes that are riding any given train
WHO: Mukunda, Tyler


TEC3 (Pipeline): Outcome 1 / Output 1.2[edit]

GOAL: Instrument Quibble for data collection
WHO: Mukunda, Antoine


TEC3 (Pipeline): Outcome 1 / Output 1.2[edit]

GOAL: Create a graph where time is spent and make a prioritized list for improvements.
WHO: Mukunda, Antoine


TEC3 (Pipeline): Outcome 2 / Output 2.1[edit]

GOAL: Select and integrate a code health metric solution into our tooling.
WHO: JR, ...

dependent on Code Health Group Metrics Group work

TEC3 (Pipeline): Outcome 3 / Output 3.1[edit]

GOALS:
Adopt more services into Deployment pipeline - task T212801
cxserver, ORES (partially), citoid, changeprop, cpjobqueue (stretch)
Deploy eventgate
WHO: Dan, Tyler, Lars
  • "I think we're mostly on track for it"


TEC12 (DevProd): Outcome 1 / Output 1.1[edit]

GOAL: Conduct interviews with development stakeholders and compile a report that informs future work creation of a rubric.
WHO: Jeena, Mukunda


TEC13 (Code Health): Outcome 1 / Output 1.1[edit]

GOALs:
Develop and communicate guidelines and best practices for successful Code Stewardship.
(Continued from Q2) Update/refresh review queue (review process for initial code deployment)
WHO: JR

Progress last week.

TEC13 (Code Health): Outcome 2 / Output 2.2[edit]

GOAL: 5 of the 15 prioritized repositories have at least 1 end-to-end test - task T206621
WHO: Zeljko



TEC13 (Code Health): Outcome 2 / Output 2.3[edit]

GOALs:
Evolve/develop tools and processes to support the PE refactoring effort to improve code health.
Develop common test strategy that enable teams to engage in more effective and efficient testing practices. (maybe should be output 2.4?)
WHO: JR, Core Platform Team

Checked to see to what extent CHGM WG could help make progress in coverage metric tooling improvements.

TEC13 (Code Health): Outcome 3 / Output 3.2[edit]

GOALs:
Speak at All Hands on the status of Technical Debt
Engage and coach development teams on their approach to managing technical debt.
WHO: JR, Core Platform Team


No progress


TEC13 (Code Health): Outcome 4 / Output 4.1[edit]

GOALs: Code Health Dashboard with 50% of repositories covered.
WHO: JR, Core Platform Team

Minimal progress.

Other non-goal work[edit]

Selenium[edit]

  • T214478 The first Selenium test for AbuseFilter
  • T216424 The first Selenium test for ContentTranslation
  • T214480 The first Selenium test for TimedMediaHandler
  • T204068 QA: Automation Testing - port Echo Notification tests to Node.js

Gerrit[edit]

Phabricator[edit]

  • Deployed almost 6 months worth of upstream changes
  • Summarized some key changes in this blog post:
  • Schema changes took a long time, nearly disrupting some SRE on-site datacenter work that was unfortunately timed.
    • This could have been avoided with better planning, however, it highlights the need for high-availability of phabricator.
    • I'm tempted to build a static cache of our public phabricator content (perhaps look into what it would take to make our existing reverse-proxy / cache infrastructure do the job.)
    • There was one regression which I reported and it's now fixed upstream - I'll deploy a patch today. ( https://phabricator.wikimedia.org/T216849 )

Jenkins[edit]

QA/Code Health[edit]

   ** T217008 Report results from SonarCloud to Gerrit


SCAP[edit]

  • 3.9.0-1 released today, changes planned


Standup![edit]

Antoine[edit]

  • What I plan to do this week
  • What I'm blocked on
  • Other?


Brennen[edit]

  • What I plan to do this week
    • Land a few minor changes to local-charts setup scripting (better Debian, known-working Ubuntu)
    • Discussion with Lars, Zeljko, Antoine, et al. re: CI
      • Efforts to get a better handle on state of existing CI
    • First Docker SIG meeting on Thursday, want to feel more ready for that by the time it happens
  • What I'm blocked on
  • Other?
    • Started making lots of scribbly notes on Continuous Delivery book, planning to do a chapter a day until it's defeated.


Dan[edit]

  • What I plan to do this week
  • What I'm blocked on
  • Other?


Greg[edit]

James[edit]

  • What I plan to do this week
  • What I'm blocked on
  • Other?


Jean-Rene[edit]

  • What I plan to do this week
    • Continue work on stewardship
    • Work on quality strategy stuff
    • work on CPT Goals
  • What I'm blocked on
  • Other?


Jeena[edit]

  • What I plan to do this week
    • Figure out why hyperkit now taking up bunch of CPU
    • Finish setting up restbase for local charts
    • Work with Brennen on figuring out where/how to publish docker images for the local dev environment
    • Read book
  • What I'm blocked on
  • Other?


Lars[edit]

  • What I plan to do this week
    • Get Quibble set up on my laptop, run the test suite to verify it works.
    • Discuss with Zeljko, Brennen how to do the CI future project and tool evaluation.
    • Interview people about CI requirements.
    • Find possible CI tools to review.
    • Docker-SIG, Tech Advice
  • What I'm blocked on
    • computers are complicated
  • Other?


Mukunda[edit]

  • What I plan to do this week
    • Deploy fix for phabricator regression + upstream changes that didn't make the cut last week
    • Fix beta cluster db
    • Start looking into quibble instrumentation
    • Figure out what is TEC3 (Pipeline): Outcome 1 / Output 1.2 all about. (thcipriani: let's pair! :))
    • Try out phabricator's new subtype field customization feature
    • Continue playing with docker / minikube phabricator test environment if time allows
    • Probably not read the book
  • What I'm blocked on
    • Time in a day
  • Other?


Tyler[edit]

  • What I plan to do this week
  • What I'm blocked on
  • Other?
    • Deployment pipeline book -- collecting thoughts/notes


Zeljko[edit]

  • What I plan to do this week
    • T217008 Report results from SonarCloud to Gerrit
    • T214478 The first Selenium test for AbuseFilter
    • T216424 The first Selenium test for ContentTranslation
    • T214480 The first Selenium test for TimedMediaHandler
    • T204068 QA: Automation Testing - port Echo Notification tests to Node.js
  • What I'm blocked on
  • Other?


Grooming[edit]

Team Kanban Board Review and Triage[edit]


Once / month-ish review of backlog(s)[edit]


Kanban stats[edit]

Burnup chart
Retrieved from "https://www.mediawiki.org/w/index.php?title=Wikimedia_Release_Engineering_Team/Checkin_archive/20190225&oldid=3615617"