Wikimedia Release Engineering Team/Checkin archive/20180219

= 2018-02-19 =

Vacations/Important dates

 * https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
 * How to do it


 * Feb 2nd: Mukunda vacation day
 * Feb 19 (Mon): President's Day (All US Staff)
 * Mar 30 (Fri): WMF Holiday
 * April 2: Željko (Holidays in Croatia - Easter Monday)
 * April 14 (Fri): WMF Holiday
 * May 1: Željko (Holidays in Croatia - Labor Day / May Day)
 * May 15?/16/17: Team offsite in Barcelona
 * May 18-20: Wikimedia Hackathon in Barcelona
 * May 21 (Mon): Tech-Mgt F2F
 * May 31: Željko (Holidays in Croatia - Corpus Christi)

Train

 * Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/?project=PHID-PROJ-fmcvjrkfvvzz3gxavs3a&statuses=open%28%29&group=none&order=newest#R


 * Feb 19 - wmf.22 - Mukunda
 * Feb 26 - wmf.23 - Tyler
 * Mar 05 - wmf.24 - Tyler
 * Mar 12 - wmf.25 - Chad
 * Mar 19 - wmf.26 - Chad
 * Mar 26 - wmf.27 - Mukunda
 * Apr 02 - wmf.28 - Mukunda
 * Apr 09 - wmf.29 - Tyler
 * Apr 16 - wmf.30 - Tyler

SoS

 * Feb 19 - Chad
 * Feb 26 - Mukunda
 * Mar 05 - Mukunda
 * Mar 12 - Tyler
 * Mar 19 - Tyler
 * Mar 26 - Chad
 * Apr 02 - Chad
 * Apr 09 - Mukunda
 * Apr 16 - Mukunda

Mid-year check-ins
A basic check-in: Go over what we hoped we'd do when we talked back for annual review

Then, the outline from T&C:
 * Celebrate accomplishments (highs):
 * What can we learn from (lows):
 * What goals or projects have been completed? What went well, what could have been better?
 * What goals/responsibilities are still ahead? Is any support needed to help get them done?  Does any work need to be adjusted (due to departmental/organizational change)?
 * Any peer feedback wanted or given? (Feel free to do this casually via email or conversation.)
 * [Greg: Let me know if anyone wants to do some kind of "ask your peers for feedback", I can set something up.]

Please come prepared to talk about those items; I'll be filling out a document we can look at during the meeting, just for our records. They are not shared with T&C (they will only be checking in with managers to verify the check-ins happened, not what the content was).

Scrum of Scrums

 * Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums

Release Engineering

 * Blocking
 * None?
 * Blocked
 * Updates
 * Updates

Last week

 * Blocking
 * None?
 * Blocked
 * None
 * Updates
 * None

Train status and happenings

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor


 * wmf.21 was mostly uneventful, howver, there is some logspam left over from the past few weeks which still needs to get cleaned up.
 * Some of the cleanup is currently in-progress and I will tackle more of it with wmf.22

Past week status updates

 * All of it in table form: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201718Q3

Program 1: Outcome 5: Milestone 1: Develop and migrate to a JavaScript-based browser testing stack

 * Due: End of this quarter
 * What: Specific improvements to the now canonical framework, see: task T182421, notably:
 * Upgrade webdriverIO to version 4.9
 * Investigate replacing nodemw with mwbot
 * Video recording for Selenium tests in Node.js
 * Task:


 * T186724 Trouble running selenium tests inside of mediawiki-vagrant
 * fixed the problem, updated documentation
 * T185315 selenium-EXTENSION-jessie Jenkins job should have e-mail notification
 * created patch, waiting for review
 * T185094 Update page object pattern in Selenium tests
 * created patch for mediawiki-core, something is wrong - ERROR: Unexpected token import

Program 1: Outcome 5: Objective 1: Maintain existing shared Continuous Integration infrastructure

 * Goals
 * Draft requirements for a Kubernetes based solution for CI -
 * Migrate MediaWiki PHPUnit tests to Shipyard (docker-based CI) (~40% of Nodepool usage) -
 * Unify production and CI docker image build process -
 * ✅ 01/15

Program 3: Outcome 1: Objective 2: Identify and find stewards for high-priority/high use code segment orphans

 * Due: End of quarter


 * created summary of Q3's items under review and sent to Toby and Victoria
 * Scheduled review meeting with Toby and Victoria

Program 3: Outcome 2: Objective 2: Define and implement a process to regularly address technical debt across the Foundation

 * Due: End of quarter


 * worked on Avoiding Technical Debt blog post, ETA 2/21

Program 3: Outcome 2: Objective 3: Promote and surface important technical debt topics at large gatherings of Wikimedia developers (e.g., DevSummit and Hackathon(s))

 * Due: End of next quarter


 * no progress

Program 6: Outcome 2: Objective 2: Set up a continuous integration and deployment pipeline

 * Due: End of this quarter
 * Keyword: SSD
 * phab project: https://phabricator.wikimedia.org/project/view/2453/
 * Goal:
 * Verify basic functionality of 'production' deployment and image (initially targeting mathoid):
 * Functional PoC within integration in the deployment-pipeline
 * Deploy to isolated k8s


 * Minikube packaging still in progress
 * pip/python support for blubber in review
 * Implementing a better file ownership model in Blubber https://phabricator.wikimedia.org/T187372

Program 1: Outcome 1: Objective 1: Scap (Tech Debt Sprint FY201718-Q2)

 * workboard

Program 1: Outcome 6: Milestone 2: Maintain Phabricator

 * Streamline logspam workflows by adding some integration with phabricator
 * Store git-lfs (and other phab uploads) in swift:


 * Major update released with a lot of new features.
 * Announcement blog post: https://phabricator.wikimedia.org/phame/post/view/85/phabricator_updates_for_february_2018/
 * Apache workers are still hanging leading to instability if we fail to restart apache on ~weekly basis.

Other work

 * scheduled post mortem for non-train MediaWiki incident
 * followed up with Daniel re Review Queue process, however he's out on vacation until later this week.

Antoine

 * What I plan to do this week
 * Migrate more long tail of Docker jobs
 * Fill tasks for jobs that I am blocked on
 * Polish up a patch for Zuul with Tyler (re int != string)
 * What I'm blocked on
 * E_NOTIME :-(( to review Dan patch for Blubber/tox support
 * Other?
 * Focus on migration to Docker
 * chromium-render has a CI job running tests with the Debian Stretch package (and not some randomly downloaded package) - https://phabricator.wikimedia.org/T179552

Chad

 * What I plan to do this week
 * More helm/MW/Docker investigations
 * Some docroot/mw-config cleanup
 * What I'm blocked on
 * Nothing?
 * Other?
 * Zoran has been unblocked from Gerrit. Please be on the lookout for poor behavior.

Dan

 * What I plan to do this week
 * Finish implementing a more sane fs ownership model in Blubber https://phabricator.wikimedia.org/T187372
 * What I'm blocked on
 * Nothing
 * Other?

Greg

 * What I plan to do this week
 * What I'm blocked on
 * Other?
 * Other?
 * Other?

Jean-Rene

 * What I plan to do this week
 * Avoiding technical debt blog post
 * updating Stewrdship Reviews process (actually did this yesterday)
 * Update stewardship reviews page to include calendar of coming events/timelines
 * Logstash review (carry over from last week)


 * What I'm blocked on
 * Other?
 * Other?

Mukunda

 * What I plan to do this week
 * Train: mediawiki 1.31.0-wmf.22
 * Clean up (as much as possible) the logspam that's been accumulating up over the past few weeks
 * Still dealing with apache worker leaks, https://phabricator.wikimedia.org/T182832
 * Incident report is already completed: https://wikitech.wikimedia.org/wiki/Incident_documentation/20180206-Phabricator
 * Need to follow up on the actionables.
 * What I'm blocked on
 * Other?
 * Other?

Tyler

 * What I plan to do this week
 * Review pip/python support for blubber
 * finish minikube packaging
 * finish zuul patches
 * start on some puppet work for verify pipeline step
 * What I'm blocked on
 * Other?
 * https://phabricator.wikimedia.org/T187761 looks like a good idea
 * https://phabricator.wikimedia.org/T187761 looks like a good idea

Zeljko

 * What I plan to do this week
 * T180144 Upgrade WebdriverIO to 4.9
 * T181284 Investigate replacing nodemw with mwbot
 * T182691 Selenium tests should be easier to run
 * T182692 Document differences between Ruby and Node.js Selenium frameworks
 * T185094 Update page object pattern in Selenium tests
 * What I'm blocked on
 * T183456 Continuous integration for mediawiki-vagrant
 * The box 'debian/stretch64' could not be found
 * Other?

Team Kanban Board Review and Triage

 * closed and touched in the 7 days
 * No update for 4 weeks
 * No update for 3 weeks
 * No update for 2 weeks
 * No update for 1 week
 * All Open
 * Review To Triage column of #releng
 * Assigned
 * Unassigned

Once / month-ish review of backlog(s)

 * releng Review To Triage column of #releng
 * releng-kanban Review unassigned in kanban
 * releng-kanban Review 'backlog' colum of -kanban
 * releng-next - Review for things we need to put on our kanban backlog
 * releng-backlog - oh my, the huge backlog of things...

Kanban stats

 * Burnup chart