Wikimedia Release Engineering Team/Checkin archive/20180402

From mediawiki.org


2018-04-02[edit]

Vacations/Important dates[edit]

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
How to do it
  • April 2: Ĺ˝eljko (Holidays in Croatia - Easter Monday)
  • Apr 3-13: Greg vacation
  • April 16 (Mon): WMF Holiday
  • May 1: Ĺ˝eljko (Holidays in Croatia - Labor Day / May Day)
  • May 14-17: Team offsite in Barcelona
  • May 18-21: Wikimedia Hackathon in Barcelona
  • May 21 (Mon): Tech-Mgt F2F
  • May 31: Ĺ˝eljko (Holidays in Croatia - Corpus Christi)

Rotating positions[edit]

Train[edit]

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/?project=PHID-PROJ-fmcvjrkfvvzz3gxavs3a&statuses=open%28%29&group=none&order=newest#R
  • Feb 19 - wmf.22 - Mukunda
  • Feb 26 - wmf.23 - Tyler
  • Mar 05 - wmf.24 - Tyler
  • Mar 12 - wmf.25 - Chad
  • Mar 19 - wmf.26 - Chad
  • Mar 26 - wmf.27 - Mukunda
  • Apr 02 - wmf.28 - Mukunda <----
  • Apr 09 - wmf.29 - Tyler
  • Apr 16 - wmf.30 - Tyler
  • Apr 23 - 1.32.0-wmf.1 - Chad
  • Apr 30 - wmf.2 - Chad

SoS[edit]

  • Feb 19 - Chad
  • Feb 26 - Mukunda
  • Mar 05 - Mukunda
  • Mar 12 - Tyler
  • Mar 19 - Tyler
  • Mar 26 - Chad
  • Apr 02 - Chad <----
  • Apr 09 - Mukunda
  • Apr 16 - Mukunda
  • Apr 23 - Tyler
  • Apr 30 - Tyler

Team Business[edit]

Updates[edit]

Staging: https://docs.google.com/document/d/1CT_pKjwiDmFhZZ9LW9mz0z434-wgr3NFdapUPWUvMNA/edit

  • Update from Greg
  • Please comment/let suggestions this week


Scrum of Scrums[edit]

Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums

This week[edit]

Release Engineering[edit]

  • Blocking
  • Blocked
  • Updates
    • Train status
    • Pencils down on MW 1.31.0

Last week[edit]

Release Engineering[edit]

  • Blocking
    • Nothing
  • Blocked
    • Nothing
  • Updates

Train status and happenings[edit]

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

Past week status updates[edit]

All of it in table form: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q4

Past Quarterly Goals - Final status update[edit]

Program 1: Outcome 5: Milestone 1: Develop and migrate to a JavaScript-based browser testing stack[edit]

Due: End of this quarter
What: Specific improvements to the now canonical framework, see: task T182421, notably:
Upgrade webdriverIO to version 4.9
Investigate replacing nodemw with mwbot
Video recording for Selenium tests in Node.js
Task: task T182421
  • T180144: Upgrade WebdriverIO to 4.12.0 - done
  • T181284: Replace nodemw with mwbot - done
  • T179188: Video recording for Selenium tests in Node.js - in progress - almost there, video for each test is recorded, but ffmpeg complains about something :/

Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure[edit]

Goals
Draft requirements for a Kubernetes based solution for CI - task T183513
Migrate MediaWiki PHPUnit tests to Shipyard (docker-based CI) (~40% of Nodepool usage) - task T183512
Will be worked on after the long tail task T187797
Unify production and CI docker image build process - task T177276
Yes Done 01/15



Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphans[edit]

Due: End of quarter
task T174091

Made final edits to Stewardship model and update wiki pages.

Program 3: Outcome 2: Objective 2: Define and implement a process to regularly address technical debt across the Foundation[edit]

Due: End of quarter
task T174095

Added: 

   *Engagement Model
   *Awareness campaign
   *Tech Debt/Code Reasouces

Program 3: Outcome 2: Objective 3: Promote and surface important technical debt topics at large gatherings of Wikimedia developers (e.g., DevSummit and Hackathon(s))[edit]

Due: End of next quarter
task T174096

No activitiy

Program 6: Outcome 2: Objective 2: Set up a continuous integration and deployment pipeline[edit]

Due: End of this quarter
Keyword: SSD
phab project: https://phabricator.wikimedia.org/project/view/2453/
Goal:
Verify basic functionality of 'production' deployment and image (initially targeting mathoid):
Functional PoC within integration in the deployment-pipeline
Deploy to isolated k8s
  • Major improvements to Blubber this quarter for more secure permissions/ownership scheme and policies
  • Verified a working PoC of `helm test` against minikube outside of CI but:
  • Still majorly blocked on lack of functional minikube/k8s/helm within CI
  • We are not far off once unblocked


Quaterly Goals for Q4[edit]

Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure[edit]

Migrate away from Nodepool - task T190097
Migrate MediaWiki PHPUnit tests to Shipyard (docker-based CI) (~40% of Nodepool usage) - task T183512
Add Composer support to Blubber - task T186547
Add Python/Tox support to Blubber - task T186545
Add Ruby/Gem/Bundler/Rake support to Blubber - task T188950


Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphans[edit]

Broad role out of Code Stewardship model.
Update Maintainers/Developers page with currently known Code Stewards.
Use Code Stewardship review process to address gaps.
Deploy dashboard of Code Stewardship Coverage


Updated Developer/Maintainer page with some known code stewards and status for code under review.

Program 3: Outcome2: Objective 2: Define and implement a process to regularly address technical debt across the Foundation[edit]

Roll out of technical debt reduction approaches.
Identify early adopter engineering teams to test approaches.


Program 6: Outcome 2: Objective 2: Prove viability of testing staged service containers alongside MediaWiki extension containers[edit]

Add Composer support to Blubber - task T186547
Small, standalone, MediaWiki containers built using Blubber
Limited scope with: Debian Stretch, php7, composer dependencies, Mariadb, Apache (or last two with standalone containers)
Build MW base containers upon branch cut at master branch point from core
Build ext specific containers using MW image as base



Quaterly non-goal "Work"[edit]

Program 1: Outcome 1: Objective 1: Scap (Tech Debt Sprint FY201718-Q2)[edit]

workboard


Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure[edit]

Program 1: Outcome 6: Milestone 1: Maintain Gerrit[edit]

Program 1: Outcome 6: Milestone 2: Maintain Phabricator[edit]

Streamline logspam workflows by adding some integration with phabricator
Store git-lfs (and other phab uploads) in swift: task T182085


Other work[edit]

Standup![edit]

Antoine[edit]

  • What I plan to do this week
  • What I'm blocked on
  • Other?


Chad[edit]

  • What I plan to do this week
    • MW security release prep (with Brian W)
      • hopefully really really soon (TM)
    • Helm/Blubber
  • What I'm blocked on
  • Other?
    • Gerrit 2.15.x prep? We should migrate sooner rather than later (2.14.x won't be getting much love, 2.16/3.0 will be huge. So 2.15.x is gonna be our "LTS")


Dan[edit]

  • What I plan to do this week
  • What I'm blocked on
    • Nada
  • Other?


Greg[edit]

  • What I plan to do this week
    • !!!!!!!!!!!!!!!!!!
    • Meeting-full day today and prep for leaving for almost 2 weeks
  • What I'm blocked on
  • Other?


Jean-Rene[edit]

  • What I plan to do this week
    • Code stewardship reviews
    • Code Stewardship Dashboard
  • What I'm blocked on
  • Other?


Mukunda[edit]

  • What I plan to do this week
    • Train for 1.31.0-wmf.27 and 1.31.0-wmf.28
    • More git-lfs work in scap and phabricator
  • What I'm blocked on
  • Other?


Tyler[edit]

  • What I plan to do this week
    • email/catchup
    • applied role::ci::slave::labs::pipelinebuilder to integration-slave-k8s-1013 and it work, so...good...
    • minikube/helm CI work
    • may revisit canary shifting baseline if there's time
  • What I'm blocked on
  • Other?


Zeljko[edit]

  • What I plan to do this week
    • T179188: Video recording for Selenium tests in Node.js
    • T190994 Q4 Selenium framework improvements
  • What I'm blocked on
    • T179188: Video recording for Selenium tests in Node.js - in progress - almost there, video for each test is recorded, but ffmpeg complains about something :/
    • T190269 Warning: Task "stylelint:src" failed due to postcss-less@1.1.4 - 1.1.5 does not fix the problem, I recommend that we stay pinned to 1.1.3
  • Other?

Grooming[edit]

Team Kanban Board Review and Triage[edit]


Once / month-ish review of backlog(s)[edit]


Kanban stats[edit]

Burnup chart
Retrieved from "https://www.mediawiki.org/w/index.php?title=Wikimedia_Release_Engineering_Team/Checkin_archive/20180402&oldid=3615609"