Wikimedia Release Engineering Team/Checkin archive/20170227

= 2017-02-27 =

Vacations/Important dates

 * https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
 * How to do it


 * Feb 28: Dan out
 * March 13: Monthly day off
 * March 23-28: Chad in Miami
 * March 30, 31: Tyler in Wichita
 * March 30-Apr 3: Greg in Berlin (Wikimedia Conference)
 * April 14: Monthly day off
 * May 15-18: Team Offsite in Vienna
 * May 19-21: EU Hackathon

Time spent spreadsheet

 * week 8: https://docs.google.com/spreadsheets/d/1OZzvtlc116UIsFFbic1zX34LXgAJddPTXMGVE6uMsJw/edit#gid=949315358

Rotating positions and absences
Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers

Feb 6 and Feb 13

 * Train: Tyler
 * wmf.11
 * wmf.12
 * SoS: Chad
 * Out:

Feb 20 and Feb 27

 * Train: Chad
 * wmf.13
 * wmf.14
 * SoS: Mukunda
 * Out:
 * February 20: President's Day

Mar 6 and Mar 13

 * Train: Mukunda
 * wmf.15
 * wmf.16
 * SoS: Tyler
 * Out:
 * Mar 13th: Monthly day off

Actions from last meeting

 * TODO: Sign up for the Product and Technology consultation if you have any slight amount of interest: https://office.wikimedia.org/wiki/Product_and_consultation

Scrum of Scrums

 * https://phabricator.wikimedia.org/project/board/64/
 * Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

This week

 * Blocking
 * Blocked
 * Updates
 * Updates
 * Updates

Last week

 * Blocking
 * https://phabricator.wikimedia.org/T153038
 * Blocked
 * none
 * Updates

Other Team Business
How do we update weekly deployment calendar? Is there any documentation? https://wikitech.wikimedia.org/wiki/Deployments

Logspam

 * https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#Logspam


 * https://etherpad.wikimedia.org/p/logspam-update

Team Strategy/Planning

 * https://office.wikimedia.org/wiki/User:Greg/Release_Engineering_Team/1718-Strategy


 * "The logging bucket" nacent idea: https://docs.google.com/document/d/1b_SOn15hbqvERgL87a7IbquWipDUbBqjBz6vlvrOdco/edit

Technology-wide planning

 * CollabJam slides: https://docs.google.com/presentation/d/106U2p8gdPVvHyFmlQSJPKV85uchLELPC4_ESD-2CZKw/edit#slide=id.g15105b408d_0_287
 * Technology team goals: https://docs.google.com/document/d/1NwsUCAeHJAw4pyl0YWS1iGNsKnCFk1toM26acLm6JVE/edit#heading=h.eh5attm0n41


 * Greg to give a brain dump of what happened at the CollabJam

Q3 goal/project check-in

 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201617Q3

Continuous Integration Infrastructure modernization

 * Gather requirements for new CI system -


 * https://phabricator.wikimedia.org/T158812 dan made a task! :) where's my cookie!?


 * Changes ready for Jenkins to be managed by systemd

Build fanout support in scap3

 * https://phabricator.wikimedia.org/T121276


 * Mukunda cut a new release -- lots of bugfixes
 * Some work around submodule space issues
 * Fix for awful sync-common happening too late issue in master, probably out this week

Phabricator

 * I've done a massive amount of work on the elasticsearch integration and it's getting close to merging upstream:
 * https://secure.phabricator.com/D17384
 * Learned a lot and got a lot of great feedback from Evan as usual.
 * Will be able to handle elasticsearch failover across data centers as well as load balancing between multiple search services.
 * Also making repositories searchable: https://secure.phabricator.com/D17300
 * Previously only commits were easily searchable from the global search
 * This isn't new this week but I think I forgot to mention it previously

Browser tests

 * T152963 Increase in failures caused by Saucelabs
 * Updated Rake task to support rerunning failed tests, testing in Jenkins.
 * T158074 Update Ruby tests to Selenium 3
 * Ruby gem released, sent patches to all repos, most of the update trivial, some repos need more work to update.
 * T139740 Port Selenium tests from Ruby to Node.js
 * Wrote a timeline, including past, present and future.
 * Finally some feedback! Timo left some feedback about page objects, responded to it.

Last week

 * Jenkins systemd
 * rspec for puppet
 * fight to get autoload-dev from mw injected in vendor. Needed by wmde.

This week

 * composer autoloader breaks php 5.5 lint on mediawiki/vendor
 * Wikidata build is broken
 * gotta upgrade composer as well


 * Jenkins under systemd
 * Prepare to upgrade Jenkins on contint2001 (copy data, upgrade, see what happens)


 * as time allow:
 * migrate PHP 5.3 jobs to PHP 5.5
 * Think about getting more Jenkins instances (beta, one for browser tests, maybe tools-labs)

Last week

 * Gerrit
 * Train
 * FTP? (scap, really)

Last week

 * Research build manifest standardization
 * Hack on scap fanout PoC for realsies

This week

 * Same same, but different

Last week

 * quality interviews
 * spoke to Erik B
 * investigate test results reporting
 * investigate coorelating escapes to test coverage

This week

 * quality interviews
 * investigate test results reporting
 * get development environment up and running

Last week

 * Phabricator stuff
 * Address epriestley's feedback and get patches merged upstream
 * Not yet merged but getting close: https://secure.phabricator.com/D17384
 * Logspam stuff from last week
 * https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train
 * scap+Bittorrent
 * Didn't find the time
 * keyholder blog post
 * nope, moving forward to this week

This week

 * Phabricator stuff
 * Scrum of scrums
 * keyholder blog post?
 * dust off the phab milestone scap plugin
 * look at making it update the deployment schedule (in addition to the deployment blocker tasks)

Last week

 * Blog post
 * Scap3 stuffz (POC? One bug for mediawiki deployments, testing infra)
 * CI POC

This week

 * Blog post, actually write it
 * Scap3 stuff, actually do it
 * Finish work on submodule space issue
 * New release? Possible this week.
 * CI stuff, find an outcome for it

Last week

 * T152963 Increase in failures caused by Saucelabs
 * T158074 Update Ruby tests to Selenium 3
 * T139740 Port Selenium tests from Ruby to Node.js
 * T154894 Phase out jobs "pplint-HEAD" and "erblint-HEAD"
 * T158326 Move Rake and RuboCop dependency from repositories to mediawiki/selenium

This week

 * T152963 Increase in failures caused by Saucelabs
 * T158074 Update Ruby tests to Selenium 3
 * T139740 Port Selenium tests from Ruby to Node.js