Wikimedia Release Engineering Team/Checkin archive/20180108

From mediawiki.org

2018-01-08[edit]

Vacations/Important dates[edit]

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
How to do it
  • Jan 15 (Mon): Martin Luther King Day (All US Staff)
  • Jan 22/23: Dev Summit
  • Jan 24: Tech Management F2F
  • Jan 25/26: WMF All Hands
  • Jan 29-31: Team offsite
  • Feb 19 (Mon): President's Day (All US Staff)
  • Mar 30 (Fri): WMF Holiday

Team Business[edit]

Rotating positions and absences[edit]

Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/?project=PHID-PROJ-fmcvjrkfvvzz3gxavs3a&statuses=open%28%29&group=none&order=newest#R

Jan 1 and Jan 8[edit]

  • Train: Mukunda
  • SoS: Tyler
  • Out:
    • January 1 (Monday): Holiday, everyone

Jan 15 and Jan 22[edit]

  • Train: Tyler
  • SoS:
  • Out
    • Jan 15 (Mon): Martin Luther King Day (All US Staff)

Actions from last meeting[edit]

Scrum of Scrums[edit]

Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums

This week[edit]

Release Engineering[edit]

  • Blocking
  • Blocked
  • Updates

Last week[edit]

  • Blocking
  • Blocked
    • Teams that did not port Selenium tests from Ruby to Node.js (T139740): No team (1), Editing (1), Fundraising Tech (1), Global Collaboration (4), Multimedia (1), Reading Web (3), WMDE Engineering (5)
  • Updates
    • REMINDER: No deploys this week and next (18th and 25th). Take a break! [wiki][email]
      • We’re (Chad) going to spend some time this week cleaning up log-spam.
    • Our Q3 goals posted
    • Completed the security upgrade of RuboCop and Rubyzip
    • Our Q2 “SSD” (Program 6) goals are now all complete [wiki][email]
    • Antoine is migrating the CI docker image build process to using docker-pkg (from Giuseppe)
    • Follow-up continues on the ORES post-mortem follow-ups


Puppet SWAT[edit]

list of patches you want to submit to Puppet SWAT


Logspam \ Last week's train updates[edit]

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor
* Almost all logspam eliminated:  https://i.imgur.com/1iOT9S1.png

Other Team Business[edit]


Q3 goal/project check-in[edit]

All of it in table form: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q3

Quarterly Goals[edit]

Program 1: Outcome 5: Milestone 1: Develop and migrate to a JavaScript-based browser testing stack[edit]

Due: End of this quarter
What: Specific improvements to the now canonical framework, see: task T182421, notably:
Upgrade webdriverIO to version 4.9
Investigate replacing nodemw with mwbot
Video recording for Selenium tests in Node.js
Task: task T182421
* no major updates this past week: Z's been sick over the holdiays, sadly


Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure[edit]

Goals
Draft requirements for a Kubernetes based solution for CI - task T183513
Migrate MediaWiki PHPUnit tests to Shipyard (docker-based CI) (~40% of Nodepool usage) - task T183512
    • most npm jobs are migrated. Gotta handle the /deploy repositories that have a node_modules commited in
    • PHPUnit not started yet
  • Unify production and CI docker image build process - task T177276
    • npm from the Debian package (1.4.x) does not support running behind a proxy task T183569. Prevents building npm based Docker container on contint1001.



Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphans[edit]

Due: End of quarter
task T174091
Nothing new to report

Program 3: Outcome 2: Objective 2: Define and implement a process to regularly address technical debt across the Foundation[edit]

Due: End of quarter
task T174095
Nothing new to report

Program 3: Outcome 2: Objective 3: Promote and surface important technical debt topics at large gatherings of Wikimedia developers (e.g., DevSummit and Hackathon(s))[edit]

Due: End of next quarter
task T174096

Investigating what can be done during this coming dev summit/all-hands

Program 6: Outcome 2: Objective 2: Set up a continuous integration and deployment pipeline[edit]

Due: End of this quarter
Keyword: SSD
phab project: https://phabricator.wikimedia.org/project/view/2453/
Goal:
Verify basic functionality of 'production' deployment and image (initially targeting mathoid):
Functional PoC within integration in the deployment-pipeline
Deploy to isolated k8s

Quaterly non-goal "Work"[edit]

Program 1: Outcome 1: Objective 1: Scap (Tech Debt Sprint FY201718-Q2)[edit]

workboard
  • Need to get the scap CI situation figured out because of repeated breakage of scap in beta. Two competing needs:
    • Need a place to test scap changes
    • Other teams use scap in beta to test their own deployments


Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure[edit]

Program 1: Outcome 6: Milestone 1: Maintain Gerrit[edit]

Program 1: Outcome 6: Milestone 2: Maintain Phabricator[edit]

Streamline logspam workflows by adding some integration with phabricator
Store git-lfs (and other phab uploads) in swift: task T182085


Program 1: Outcome 5: Objective 1: MW Nightlies server[edit]

  • We're building non-security nightlies! (not quite stable enough to announce to public yet)
    • \o/
  • Working with security team to figure out best way to manage patches with minimal overhead
  • any changes to weekly branch cut process coming soon?


Other work[edit]

  • Working on a Hive query to find out how many unique users are hitting WikipediaMobileFirefoxOS in a month
select count(distinct ip) from webrequest where year = 2017 and month = 12 and uri_host = 'meta.wikimedia.org' and uri_path = '/WikipediaMobileFirefoxOS/index.html';
^^^ Seems like it over-counts, given how frequently mobile IPs can change ^^^
  • More apache docroot cleanup


Grooming[edit]

Team Kanban Board Review and Triage[edit]


Once / month-ish review of backlog(s)[edit]


Kanban stats[edit]

Burnup chart
Retrieved from "https://www.mediawiki.org/w/index.php?title=Wikimedia_Release_Engineering_Team/Checkin_archive/20180108&oldid=3615576"