Wikimedia Release Engineering Team/Checkin archive/20170410

= 2017-04-10 =

Vacations/Important dates

 * https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
 * How to do it


 * April 10-13: Dan out
 * April 14: Monthly day off
 * April 13 and April 16th: Antoine travel - work on Friday 14th
 * April 17: Željko local holiday (Easter Monday)
 * April 19-21: Željko vacation
 * April 27-29th: Antoine in Amsterdam (unreacheable)
 * May 15-18: Team Offsite in Vienna
 * May 19-21: EU Hackathon
 * July 10-14th: Tyler adventure time

Time spent spreadsheet

 * week 14: https://docs.google.com/spreadsheets/d/1OZzvtlc116UIsFFbic1zX34LXgAJddPTXMGVE6uMsJw/edit#gid=1831444635

Rotating positions and absences
Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers

Mar 20 and Mar 27

 * Train: Tyler (plus Chad for goup2 on March 30th)
 * wmf.17
 * wmf.18
 * SoS: Chad
 * Out:
 * March 23-28: Chad in Miami
 * March 30, 31: Tyler in Wichita
 * Thu March 30 - Mon Apr 3: Greg in Berlin (Wikimedia Conference)

Apr 3 and Apr 10

 * Train: Chad
 * wmf.19
 * wmf.20
 * SoS: JR
 * Out:
 * April 10-17: Dan
 * April 13 and April 16th: Antoine travel
 * April 14 (Friday): US Staff holiday

April 17 and Apr 24

 * Train: Mukunda
 * [ wmf.21]
 * [ wmf.22]
 * SoS: Tyler
 * Out:

Scrum of Scrums

 * https://phabricator.wikimedia.org/project/board/64/
 * Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

This week

 * Blocking
 * Blocked
 * Updates
 * Updates
 * Updates

Last week

 * Blocking
 * Blocked
 * May need Ops help deploying 3d2png via scap3 (worked on Beta Cluster), need some +2 in puppet
 * Updates
 * Updates

Annual Planning
https://office.wikimedia.org/wiki/User:Kbrown_%28WMF%29/Programs/Technology

Logspam

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor


 * Email from Jon R

Q4 goal/project check-in

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201617Q4

Streamlined Services Delivery

 * Build a runnable image from tested and confirmed code that is suitable for promotion.
 * define 'tested and confirmed' / determine the entry-point for building a container
 * generate or consume a docker file for building
 * build image, upload and tag it in docker registry


 * Tyler to make some tasks in the workboard
 * Shared cross-team meeting, goal is still to push to the shared registry
 * JR talking with Marko and Alex re requirements: https://docs.google.com/spreadsheets/d/1igbl7X-u0joRwwTBHwrBcX1mRtLYr3yJ8XoD7Zv_PKQ/edit?ts=58e51f2c#gid=0

Train 2.0

 * Move MW+Extension deploys to scap3 - (part 3)
 * Integrate scap with etcd/pybal to automatically depool and repool servers -

Release MediaWiki 1.29

 * A quality MediaWiki 1.29 is successfully released -

Phabricator

 * Phabricator search now highlights results
 * Announcement to wikitech-l: https://lists.wikimedia.org/pipermail/wikitech-l/2017-April/087905.html

Browser tests

 * T139740 Port Selenium tests from Ruby to Node.js
 * Jenkins jobs for mediawiki/core ready to be merged and deployed https://gerrit.wikimedia.org/r/#/c/324719/


 * Math and mobile web teams interested, patches are being created
 * T162256 Port Selenium tests from Ruby to Node.js on Reading Web extensions
 * T162455 WebdriverIO tests for Math


 * a volunteer wants to help out (an outreach project?)
 * T69141 audit/update headers in files
 * T94001 Ruby gem documentation should state license


 * Somebody asked for another run of language screenshots, some problems, should be easy to fix
 * T162454 LanguageScreenshotBot fails with `Error: timeout of 40000ms exceeded. Ensure the done callback is being called in this test.`

Last week

 * Schedule Jenkins upgrade early next week during European morning
 * CI instances out of RAM when running Wikibase
 * TLDR: https://phabricator.wikimedia.org/T125050#3153282 PHPUnit uses ~2GB ram and fork fails due to not enough memory (instance only has 1.5G free and linux refuses to fork)
 * Fixed via Kernel setting vm.overcommit_memory=1
 * merge some jobs (eg for extensions: composer test + phpunit -- qunit + npm)
 * cache npm install

This week

 * Redis "could not connect" log spam with Elukey
 * POC for caching npm install
 * hide chocolates in garden

Last week

 * scap
 * train
 * security release

Last week

 * Take a closer look at build config specification
 * Possibly start building PoC command-line tool that converts to Dockerfile

This week

 * Time off

Last week

 * quality interview
 * Talking to a couple for folks this week
 * writing up report out.
 * bug/defect data wrangling
 * test results data wrangling
 * CI Pipeline requirements
 * Consolidating Ops/RelEng/Services requirements

This week

 * quality interview
 * complete write up
 * CI Pipeline requirements
 * roll in Ops req
 * start review with team
 * bug/defect data wrangling

Last week

 * Deploy snippets / highlighting
 * Done
 * Further work upstream
 * Polish `scap tag` for creating template-based phabricator milestones from the CLI
 * This is working well now
 * Evaluate the contributed "Release" app for phabricator (this is a thing that might replace Releeph, for cutting release branches in phabricator...)
 * This didn't happen
 * This is a series of patches from https://secure.phabricator.com/p/avivey/ which is mostly finished but not really well integrated yet
 * I got some tips from avivey about how to try it out locally
 * The patches:
 * https://secure.phabricator.com/D16981
 * https://secure.phabricator.com/D17020
 * https://secure.phabricator.com/D17004

This week

 * Fix bugs
 * Help chad with pybal stuff?
 * From last week
 * Evaluate the contributed "Release" app for phabricator (this is a thing that might replace Releeph, for cutting release branches in phabricator...)
 * Maybe work on more custom search results UI... maybe
 * Profit
 * Profit

Last week

 * 3d2png helping
 * RESTBase helping
 * Push built images to ci-staging docker registry
 * wrap service-runner docker generation in groovy? Maybe...will look

This week

 * Datacenter switchover scap deployment host -- need to make sure it's global only
 * Push built images to ci-staging
 * php55 lint -> docker (maybe)

Last week

 * T69141 audit/update headers in files
 * T94001 Ruby gem documentation should state license
 * T161603 Provisioning MediaWiki Vagrant VisualEditor role does not result in working VisualEditor
 * T162454 LanguageScreenshotBot fails with `Error: timeout of 40000ms exceeded. Ensure the done callback is being called in this test.`
 * T162455 WebdriverIO tests for Math
 * T139740 Port Selenium tests from Ruby to Node.js

This week

 * T139740 Port Selenium tests from Ruby to Node.js
 * T162256 Port Selenium tests from Ruby to Node.js on Reading Web extensions
 * T162454 LanguageScreenshotBot fails with `Error: timeout of 40000ms exceeded. Ensure the done callback is being called in this test.`