Wikimedia Release Engineering Team/Checkin archive/20161128

= 2016-11-28 =

Vacations/Important dates
How to do it: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off
 * Nov 30: Tyler: eye appointment 1:45pm -- may be useless afterwords (antoine: eyes are definitely useful, keep them)
 * Dec ~23 - ~ Jan 03: Antoine (yearly trip around the country for familly events)
 * December 26: Željko Holiday (St Stephen's Day)
 * December 26-30: XMas Holiday
 * January 2nd: New Year's Day (observed)
 * January 6: Željko Holiday (Epiphany)
 * January 9-11: Dev Summit
 * January 12-13: All Hands
 * January 16: MLK Jr Day
 * February 20: President's Day
 * March 13: New day off for some reason
 * April 14: New day off for some reason

Time spent spreadsheet

 * week 47: https://docs.google.com/spreadsheets/d/1YMflnOBggixLV-Ra0L6P7vxgUkR6sFik6Aas1y3Zsxg/edit#gid=15839968
 * For those who took Thur/Fri off, remember that's an automatic 40% in the time off column :)

Rotating positions and absences
Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers

Nov 14 and Nov 21

 * Train: Tyler
 * wmf.3
 * no wmf.4 this week, Thanksgiving
 * SoS: Mukunda
 * https://phabricator.wikimedia.org/E155/34
 * https://phabricator.wikimedia.org/E155/35
 * Out:
 * November 18: Greg in Seattle at RELENG Conference/workshop - http://releng.polymtl.ca/RELENG2016/html/index.html
 * November 24+25: US Holiday (Thanksgiving)
 * Antoine working as usual

Nov 28 and Dec 5

 * Train: Chad
 * wmf.4
 * wmf.5
 * SoS: Tyler
 * https://phabricator.wikimedia.org/E155/33
 * https://phabricator.wikimedia.org/E155/34
 * Out:
 * none

Dec 12 and Dec 19

 * Train: Mukunda
 * [ wmf.6]
 * no train/deploys week of Dec 19
 * SoS: Chad
 * https://phabricator.wikimedia.org/E155/35
 * https://phabricator.wikimedia.org/E155/36
 * Out:
 * none?

Dec 26 and Jan 2

 * Train:
 * No train/deploys week of Dec 26
 * [ wmf.7]
 * SoS:
 * https://phabricator.wikimedia.org/E155/37
 * https://phabricator.wikimedia.org/E155/38
 * Out:
 * Week of Dec 26th: Everyone
 * Jan 2nd: New Year's Day observed

Actions from last meeting

 * [Who?] Audit if any other projects than MW+Ext use gating
 * https://phabricator.wikimedia.org/T150701
 * Greg needs to make a timeline for some of the action items
 * Started, at a very high level: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Project/Planning

Scrum of Scrums

 * https://phabricator.wikimedia.org/project/board/64/
 * Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

This week

 * Blocking
 * Blocked
 * Updates
 * Reminder that deployments are weird between now and the New Year: https://lists.wikimedia.org/pipermail/wikitech-l/2016-November/086936.html
 * Updates
 * Reminder that deployments are weird between now and the New Year: https://lists.wikimedia.org/pipermail/wikitech-l/2016-November/086936.html

Last week

 * Blocking
 * Blocked
 * Updates
 * 1.28 this week!
 * Updates
 * 1.28 this week!

QA Hire

 * continuing to do HM screens
 * interviews ongoing with the rest of the loop

Future of CI plan

 * Determine future composition of the CI infrastructure with a plan on how to get there without disrupting expected services and performance.


 * TODO today: Figure out how we want to describe this work in our quarterly goals
 * Things to remember/account for:
 * ci-staging
 * jenkins 2.0
 * migration to nodepool completion
 * de-experimenting (maybe?) the docker based system


 * Docker based CI POC has been mostly successful
 * https://phabricator.wikimedia.org/T150504#2812971
 * https://phabricator.wikimedia.org/D455

(((Dan presented outcome of the Docker POC)))

Browser tests

 * T117418 Ensure chromedriver is installed (for Selenium)
 * Chromedriver is installed on Jenkins slaves
 * Antoine will make sure it is in PATH

Ruby

 * T146292 Add helper to Selenium that allows you to query whether JavaScript module has loaded
 * Waiting for review https://gerrit.wikimedia.org/r/#/c/312047/
 * Will release new version of the gem when merged

Node.js

 * T150435 Selenium tests for VisualEditor in Node.js
 * pairing weekly with Rummana
 * T139740 Port Selenium tests from Ruby to Node.js
 * ported 6 very simple tests
 * will probably not create more tests, but improve existing ones


 * T151442 Research webdriver.io + T151443 Research nightwatchjs
 * Managed to get it working without Java (on Chrome)
 * Will test if it works with Firefox

Phabricator

 * Turns out there is was no upload limit in phabricator.
 * So now people are using it as a dump for video piracy.
 * Task: https://phabricator.wikimedia.org/T151544

DB Inconsistencies
https://phabricator.wikimedia.org/T132416 and https://phabricator.wikimedia.org/T104459 (see also: https://www.mediawiki.org/wiki/Development_policy#Database_patches )

Last week

 * (week-end project) ElasticSearch/Kibana on CI for build logs
 * POC done. TODO write about it somewhere.
 * Ploticus/EasyTimeline this weeek
 * skipped due toThanksgiving
 * Nodepool quota to be bumped early this week. Labs needed clarifications.
 * skipped due toThanksgiving
 * Clone mw/core for the job running against operations/mediawiki-config (for dcausse/Erik B)

This week

 * Nodepool quota to be bumped on Tuesday

Last week

 * 1.28!

Last week

 * Continue hacking on proof of concept integration/docker instance(?)
 * Improve scap target failure tolerance

Last week

 * Continue working on phabricator privilege separation: https://phabricator.wikimedia.org/T146055
 * Done, for the most part
 * Help with scap release as needed
 * Scrum of scrums
 * eat food with family
 * sleep?
 * This took up a significant part of my weekend:
 * https://phabricator.wikimedia.org/T151228
 * Not as bad as chad's saturday.
 * Fixed git mirroring errors that I discovered in phabricator's logs - a bunch of repos were deleted from gerrit but left enabled in phabricator.
 * The errors were causing a major slowdown in the queue which affected phabricator's git commit parsing.
 * Will significantly improve import latency.

Last week

 * Line up next 2 scap releases
 * CI staging

Last week

 * T108108 Improve documentation around running/writing (with lots of examples) browser tests
 * pairing with Rummana on Node.js+Selenium tests for VisualEditor
 * pairing with Elena on Ruby+Rspec tests for Echo API
 * Senior QA Analyst hiring

This week

 * T117418 Ensure chromedriver is installed (for Selenium)
 * New release of mediawiki_selenium
 * T139740 Port Selenium tests from Ruby to Node.js
 * T151442 Research webdriver.io
 * T151443 Research nightwatchjs