Wikimedia Release Engineering Team/Checkin archive/20180611

From MediaWiki.org
Jump to navigation Jump to search


2018-06-11[edit]

Vacations/Important dates[edit]

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
How to do it
  • June 19: WMF Monthly Holiday - https://en.wikipedia.org/wiki/Juneteenth
  • June 18-22: Dan – Vacation
  • July 2: Greg's BDay!!!
  • July 4: US Holiday
  • July 16: Mukunda's bday.....funtimes
  • August 15: WMF Monthly Holiday
  • Middle of August...a few days somewhere - thcipriani

Rotating positions[edit]

Train[edit]

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/?project=PHID-PROJ-fmcvjrkfvvzz3gxavs3a&statuses=open%28%29&group=none&order=newest#R
  • May 21 - wmf.5 - Mukunda
  • May 28 - wmf.6 - Tyler
  • June 04 - wmf.7 - Tyler
  • June 11 - wmf.8 - Dan (with Tyler doing Thursday)
  • June 18 - wmf.9 - Dan (no train, SRE summit)
  • June 25 - wmf.10 - Dan
  • July 02 - wmf.11 - Zeljko - no train, Fourth of July
  • July 09 - wmf.12 - Zeljko
  • July 16 - wmf.13 - Antoine
  • July 23 - wmf.14 - Antoine


SoS[edit]

  • May 21 - Chad
  • May 28 - Mukunda
  • June 04 - Mukunda
  • June 11 - Tyler <-----
  • June 18 - Tyler
  • June 25 - Tyler
  • July 02 - Dan
  • July 09 - Dan
  • July 16 - Zeljko
  • July 23 - Zeljko
  • July 30 - Antoine
  • August 06 - Antoine

Team Business[edit]

Updates[edit]

  • Train: Decided: Dan this week
  • Train EU time:
    • EU SWAT 1300-1400 CEST (1100-1200 UTC), 2 hours earlier than now
    • break 1400-1500 CEST (1200-1300 UTC), my usual lunch time
    • train 1500-1700 CEST (1300-1500 UTC)
    • break 1700-1800 CEST (1500-1600 UTC)
    • Puppet SWAT 1800-1900 CEST (1600-1800 UTC)


  • SWAT window on Wednesday
    • bad timing (with SoS)
    • was moved back for the pre-Train sanity hour
    • move it back to 11 Pacific?
    • DECIDED: move back to 11 Pacific time


Offsite notes and action items[edit]

Data Data Data[edit]

  • Talk with Analytics - JR
  • Talk with CE/Bitergia - JR
  • Explore Bitergia - JR
  • Identify data sources we want to collect - RelEng (who know what systems)
  • Erik Bernhardson / Guillaume Lederrey
    • After we get our list of data sources talk to them

SWATs/Trains[edit]

  • TODO: Tyler reasses scap swat in mw-config from Mukunda
  • Look into parsing scap messages for known patterns and pulling out the data
  • Look into enabling scap start/done
    • This should be trivial
  • Look into recording if mwdebug was used during the deploy (eg: 'scap stage')
  • H/Now will we get time for this?
  • Have Mukunda do a couple weeks of SWATs
    • Mukunda has a lot to say about this subject.... writeup incoming


TODO tl;dr: Tyler taskify the above and talk to Mukunda

Staging[edit]

  • Greg to talk with Deb about what to do next with talking to Victoria
    • Done
  • Greg to figure out how we can better market what we are accomplishing (eg "monthly showcase")
    • TODO
  • Get a k8s cluster from SRE for CI to deploy to.
    • Dan/Tyler discuss later today
      • potentially poke/get a committment on a timeline soon

Scrum of Scrums[edit]

Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums

This week[edit]

Release Engineering[edit]

  • Blocking
  • Blocked
  • Updates
  • Quarterly cross-dependencies

Last week[edit]

Release Engineering[edit]

Train status and happenings[edit]

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor


Past week status updates[edit]

All of it in table form: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q4

Quaterly Goals for Q4[edit]

Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure[edit]

Migrate away from Nodepool - task T190097
Migrate MediaWiki PHPUnit tests to Shipyard (docker-based CI) (~40% of Nodepool usage) - task T183512
Add Composer support to Blubber - task T186547
Add Python/Tox support to Blubber - task T186545
Add Ruby/Gem/Bundler/Rake support to Blubber - task T188950


Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphans[edit]

Broad role out of Code Stewardship model.
Update Maintainers/Developers page with currently known Code Stewards.
Use Code Stewardship review process to address gaps.
Deploy dashboard of Code Stewardship Coverage
  • Reviewed feedback and met with Toby and Victoria
    • Zotero issue seems to be addressed

Program 3: Outcome2: Objective 2: Define and implement a process to regularly address technical debt across the Foundation[edit]

Roll out of technical debt reduction approaches.
Identify early adopter engineering teams to test approaches.
  • Reviewed Platform technical debt tasks in phab
  • Reviewed general technical debt tasks in phab


Program 6: Outcome 2: Objective 2: Prove viability of testing staged service containers alongside MediaWiki extension containers[edit]

Add Composer support to Blubber - task T186547
Small, standalone, MediaWiki containers built using Blubber
Limited scope with: Debian Stretch, php7, composer dependencies, Mariadb, Apache (or last two with standalone containers)
Build MW base containers upon branch cut at master branch point from core
Build ext specific containers using MW image as base

Few discussions last week:


Quaterly non-goal "Work"[edit]

Program 1: Outcome 1: Objective 1: Scap (Tech Debt Sprint FY201718-Q2)[edit]

workboard


Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure[edit]

Program 1: Outcome 6: Milestone 1: Maintain Gerrit[edit]

Program 1: Outcome 6: Milestone 2: Maintain Phabricator[edit]

Streamline logspam workflows by adding some integration with phabricator
Store git-lfs (and other phab uploads) in swift: task T182085
  • Making some progress on a disaster recovery plan for phabricator:
   ** https://phabricator.wikimedia.org/T190572

Other work[edit]

Standup![edit]

Antoine[edit]

  • What I plan to do this week
    • Migrate mediawiki-extensions jobs
  • What I'm blocked on
  • Other?


Dan[edit]

  • What I plan to do this week
    • Train
    • Docker image build for Math extension
  • What I'm blocked on
  • Other?


Greg[edit]

  • What I plan to do this week
    • A couple high prio HR/Fiscal year things
    • Announce EU Train window and deploy schedule changes
    • Make a Senior Eng focused version of the DevProd JD
    • email the "what data sources do you know of" etherpad out to the team list
  • What I'm blocked on
    • nothing yet
  • Other?


Jean-Rene[edit]

  • What I plan to do this week
    • More on Search platform and platfom technical tech
    • Q4 stewardship reviews
    • Q3 stewardship sync-ups
    • offsite tasks
  • What I'm blocked on
  • Other?


Mukunda[edit]


Tyler[edit]

  • What I plan to do this week
    • "Train"ing
    • Math extension pipeline sense-making (see bullet points on task)
    • Scap 3.8.2-1 help/fallout/whatever's needed
  • What I'm blocked on
    • None?
  • Other?


Zeljko[edit]

  • What I plan to do this week
    • T190710 Minerva Ruby and Node.js browser tests running side by side
    • T194252 Configure the CI job that runs WikibaseLexeme's browser tests against beta wikidata
  • What I'm blocked on
  • Other?

Grooming[edit]

Team Kanban Board Review and Triage[edit]


Once / month-ish review of backlog(s)[edit]


Kanban stats[edit]

Burnup chart