Wikimedia Release Engineering Team/Checkin archive/20180226

= 2018-02-26 =

Vacations/Important dates

 * https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
 * How to do it


 * Mar 2 (Fri): Mukunda vacation day
 * Mar 12-16 (week): Greg vacation
 * Mar 30 (Fri): WMF Holiday
 * April 2: Željko (Holidays in Croatia - Easter Monday)
 * Apr 3-13: Greg vacation
 * April 16 (Mon): WMF Holiday
 * May 1: Željko (Holidays in Croatia - Labor Day / May Day)
 * May 15?/16/17: Team offsite in Barcelona
 * May 18-20: Wikimedia Hackathon in Barcelona
 * May 21 (Mon): Tech-Mgt F2F
 * May 31: Željko (Holidays in Croatia - Corpus Christi)

Train

 * Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/?project=PHID-PROJ-fmcvjrkfvvzz3gxavs3a&statuses=open%28%29&group=none&order=newest#R


 * Feb 19 - wmf.22 - Mukunda
 * Feb 26 - wmf.23 - Tyler <---
 * Mar 05 - wmf.24 - Tyler
 * Mar 12 - wmf.25 - Chad
 * Mar 19 - wmf.26 - Chad
 * Mar 26 - wmf.27 - Mukunda
 * Apr 02 - wmf.28 - Mukunda
 * Apr 09 - wmf.29 - Tyler
 * Apr 16 - wmf.30 - Tyler

SoS

 * Feb 19 - Chad
 * Feb 26 - Mukunda <---
 * Mar 05 - Mukunda
 * Mar 12 - Tyler
 * Mar 19 - Tyler
 * Mar 26 - Chad
 * Apr 02 - Chad
 * Apr 09 - Mukunda
 * Apr 16 - Mukunda

Mid-year check-ins
A basic check-in: Go over what we hoped we'd do when we talked back for annual review

Then, the outline from T&C:
 * Celebrate accomplishments (highs):
 * What can we learn from (lows):
 * What goals or projects have been completed? What went well, what could have been better?
 * What goals/responsibilities are still ahead? Is any support needed to help get them done?  Does any work need to be adjusted (due to departmental/organizational change)?
 * Any peer feedback wanted or given? (Feel free to do this casually via email or conversation.)
 * [Greg: Let me know if anyone wants to do some kind of "ask your peers for feedback", I can set something up.]

Please come prepared to talk about those items; I'll be filling out a document we can look at during the meeting, just for our records. They are not shared with T&C (they will only be checking in with managers to verify the check-ins happened, not what the content was).

Scrum of Scrums

 * Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums

Release Engineering

 * Blocking
 * None?
 * Blocked
 * Updates
 * Updates

Last week

 * Blocking
 * None?
 * Blocked
 * None
 * Updates
 * None

Train status and happenings

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor

Past week status updates

 * All of it in table form: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q3

Program 1: Outcome 5: Milestone 1: Develop and migrate to a JavaScript-based browser testing stack

 * Due: End of this quarter
 * What: Specific improvements to the now canonical framework, see: task T182421, notably:
 * Upgrade webdriverIO to version 4.9
 * Investigate replacing nodemw with mwbot
 * Video recording for Selenium tests in Node.js
 * Task:


 * T180777 Move portal deployment artifacts into their own repo - minor fix needed to finish running selenium tests to portals/deploy repo
 * T99955 Write browser tests for DonationInterface - minor fix needed to finish the setup
 * T187862 Update README file for Selenium tests - updated readme for core, made some improvements in DonationInterface readme, will copy it to other skins/extensions
 * T187859 Move one Selenium tests from mediawiki/core to mediawiki/skins/Vector - done, waiting for review/merge
 * T185094 Update page object pattern in Selenium tests - created patch but it does not work (ERROR: Unexpected token import), will investigate and fix
 * T185315 selenium-EXTENSION-jessie Jenkins job should have e-mail notification - done, waiting for review/merge

Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure

 * Goals
 * Draft requirements for a Kubernetes based solution for CI -
 * Migrate MediaWiki PHPUnit tests to Shipyard (docker-based CI) (~40% of Nodepool usage) -
 * Will be worked on after the long tail
 * Unify production and CI docker image build process -
 * ✅ 01/15


 * operations/mediawiki-config.git CI jobs are now solely on Docker
 * 50% of builds happen on Docker!

Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphans

 * Due: End of quarter


 * made updates to Stewardship review process, de-emphasizing sunsetting as primary outcome.

Program 3: Outcome 2: Objective 2: Define and implement a process to regularly address technical debt across the Foundation

 * Due: End of quarter


 * worked on TD Blog post series - 2 of 3, Should have draft ready to share out 2/26

Program 3: Outcome 2: Objective 3: Promote and surface important technical debt topics at large gatherings of Wikimedia developers (e.g., DevSummit and Hackathon(s))

 * Due: End of next quarter


 * no progress

Program 6: Outcome 2: Objective 2: Set up a continuous integration and deployment pipeline

 * Due: End of this quarter
 * Keyword: SSD
 * phab project: https://phabricator.wikimedia.org/project/view/2453/
 * Goal:
 * Verify basic functionality of 'production' deployment and image (initially targeting mathoid):
 * Functional PoC within integration in the deployment-pipeline
 * Deploy to isolated k8s


 * Minikube packaging...done? Maybe. Finializing.
 * Waiting on review of Blubber permissions model refactor https://phabricator.wikimedia.org/D984

Program 1: Outcome 1: Objective 1: Scap (Tech Debt Sprint FY201718-Q2)

 * workboard

Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure

 * 3d2png and chromium-render services now have CI jobs (based on Docker)

Program 1: Outcome 6: Milestone 1: Maintain Gerrit

 * Started a "Wikimedia" plugin over the weekend :)

Program 1: Outcome 6: Milestone 2: Maintain Phabricator

 * Streamline logspam workflows by adding some integration with phabricator
 * Store git-lfs (and other phab uploads) in swift:


 * Working on swift this week for git-lfs support
 * Moritz says he's working on php 7.1 package for https://phabricator.wikimedia.org/T182832

Other work
Post Mortem Meeting - Legacy encoding Code Health Program planning

Antoine

 * What I plan to do this week
 * Migrate more jobs from Nodepool to Docker https://phabricator.wikimedia.org/T187797
 * What I'm blocked on
 * Corner cases with xgboost and wikidata/rdf/query (no tasks filled yet)
 * Testing mediawiki services, can it please be done via Blubber :]
 * Other?
 * Jenkins plugins update. Notably git :(

Chad

 * What I plan to do this week
 * Get back on track with Helm
 * What I'm blocked on
 * Other?
 * Kunal nerd-sniped Chad: https://phabricator.wikimedia.org/T188196 "Create a self-service portal for trusted users to easily create new Gerrit repos"
 * Kunal nerd-sniped Chad: https://phabricator.wikimedia.org/T188196 "Create a self-service portal for trusted users to easily create new Gerrit repos"

Dan

 * What I plan to do this week
 * Get reviews on and finish up Blubber permissions model refactor https://phabricator.wikimedia.org/D984
 * Get reviews on and finish up Python support https://phabricator.wikimedia.org/D976
 * If the above is finished, commit working blubber.yaml for scap (ooooo!!)
 * What I'm blocked on
 * The above reviews ;)
 * Other?
 * Help Tyler debug crazy minikube packaging woes

Greg

 * What I plan to do this week
 * Killer deck for Developer Productivity ask
 * stewardship review with Victoria/Toby
 * What I'm blocked on
 * Nothing? Brain?
 * Other?
 * Mid-year check-in

Jean-Rene

 * What I plan to do this week
 * complete post 2 of Tech Debt Blog series.
 * Post Mortem 20180129-MediaWiki Incident
 * Q3 Stewardship review w/Victoria and Toby
 * Update stewardship reviews page to include calendar of coming events/timelines
 * Code Health program planning
 * Logspam review/sync up.


 * What I'm blocked on
 * Other?
 * Other?

Mukunda

 * What I plan to do this week
 * Investigate problem with phabricator dumps
 * https://phabricator.wikimedia.org/T188149
 * Set up a swift server in labs (prototype for phabricator uploads & git-lfs storage backend)
 * https://phabricator.wikimedia.org/T182085
 * What I'm blocked on
 * Need review of https://gerrit.wikimedia.org/r/#/c/413640/
 * Other?

Tyler

 * What I plan to do this week
 * Train
 * Review Dan's code (blubber updates)
 * Review Mukunda's code (scap plugin)
 * Finalize minkube container
 * What I'm blocked on
 * None
 * Other?

Zeljko

 * What I plan to do this week
 * T185011 Create selenium-core-jessie daily Jenkins job
 * T180777 Move portal deployment artifacts into their own repo
 * T99955 Write browser tests for DonationInterface
 * T187862 Update README file for Selenium tests
 * T185094 Update page object pattern in Selenium tests
 * What I'm blocked on
 * T187859 Move one Selenium tests from mediawiki/core to mediawiki/skins/Vector - done, waiting for review/merge
 * T185315 selenium-EXTENSION-jessie Jenkins job should have e-mail notification - done, waiting for review/merge
 * Other?
 * T187733 Running smoke tests during deployment - waiting for reply, looking at Tyler o.O
 * T185094 Update page object pattern in Selenium tests - created patch but it does not work (ERROR: Unexpected token import)
 * It would be great if people with black belt in JavaScript could take a quick look and let me know if it's obvious what is wrong: https://gerrit.wikimedia.org/r/#/c/412956/

Team Kanban Board Review and Triage

 * closed and touched in the 7 days
 * No update for 4 weeks
 * No update for 3 weeks
 * No update for 2 weeks
 * No update for 1 week
 * All Open
 * Review To Triage column of #releng
 * Assigned
 * Unassigned

Once / month-ish review of backlog(s)

 * releng Review To Triage column of #releng
 * releng-kanban Review unassigned in kanban
 * releng-kanban Review 'backlog' colum of -kanban
 * releng-next - Review for things we need to put on our kanban backlog
 * releng-backlog - oh my, the huge backlog of things...

Kanban stats

 * Burnup chart