Wikimedia Release Engineering Team/Checkin archive/20161212

= 2016-12-12 =

Vacations/Important dates
How to do it: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off
 * Dec 23: Greg, I need an extra day to prepare....
 * Dec ~23 - ~ Jan 03: Antoine (yearly trip around the country for familly events)
 * December 26: Željko Holiday (St Stephen's Day)
 * December 26-30: XMas Holiday
 * January 2nd: New Year's Day (observed)
 * January 6: Željko Holiday (Epiphany)
 * January 9-11: Dev Summit
 * January 12-13: All Hands
 * January 16: MLK Jr Day
 * February 20: President's Day
 * March 13: New day off for some reason
 * April 14: New day off for some reason

Time spent spreadsheet

 * week 49: https://docs.google.com/spreadsheets/d/1YMflnOBggixLV-Ra0L6P7vxgUkR6sFik6Aas1y3Zsxg/edit#gid=442167963

Rotating positions and absences
Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers

Dec 12 and Dec 19

 * Train: Mukunda
 * wmf.6
 * no train/deploys week of Dec 19
 * SoS: Chad
 * https://phabricator.wikimedia.org/E155/35
 * https://phabricator.wikimedia.org/E155/36
 * Out:
 * none?

Dec 26 and Jan 2

 * Train: Tyler
 * No train/deploys week of Dec 26
 * [ wmf.7]
 * SoS: Dan
 * https://phabricator.wikimedia.org/E155/37
 * https://phabricator.wikimedia.org/E155/38
 * Out:
 * Week of Dec 26th: Everyone
 * Jan 2nd: New Year's Day observed

Actions from last meeting

 * Greg: write the Q3 CI goal
 * DONE
 * Greg: Start conversation re Beta in prod and per-server rollouts

Scrum of Scrums

 * https://phabricator.wikimedia.org/project/board/64/
 * Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

This week

 * Blocking
 * Blocked
 * Updates
 * Reminder last week for deployments is this week until Jan 3rd: https://lists.wikimedia.org/pipermail/wikitech-l/2016-November/086936.html
 * Updates
 * Reminder last week for deployments is this week until Jan 3rd: https://lists.wikimedia.org/pipermail/wikitech-l/2016-November/086936.html

Last week

 * Blocking
 * Blocked
 * Updates
 * Reminder that deployments are weird between now and the New Year: https://lists.wikimedia.org/pipermail/wikitech-l/2016-November/086936.html
 * Updates
 * Reminder that deployments are weird between now and the New Year: https://lists.wikimedia.org/pipermail/wikitech-l/2016-November/086936.html

Volunteer deployers ?
Add more Volunteers? Is there any specific policy. Directed one at Greg.
 * https://wikitech.wikimedia.org/wiki/SWAT_deploys#New_SWAT_Team_member_check-list
 * Need trust, technical endorsement (eg approve kabal of deployers). Directed to Greg for questions.

QA Hire

 * Doing reference checks on one candidate today/tomorrow
 * circle up tomorrow with interview loop (probably a short meeting)

Future of CI plan

 * Determine future composition of the CI infrastructure with a plan on how to get there without disrupting expected services and performance.


 * Good meeting with Ops on Thursday (!!!)
 * see: https://etherpad.wikimedia.org/p/releng-ops-ci-sync
 * next steps:
 * Chase + Dan talking re Kubernetes this week
 * Explore Beta in production
 * Explore per server/percentage based rollouts
 * others?
 * What do we put as our goals for Q3 and... beyond!...?
 * Curious what Gabriel is working on...https://phabricator.wikimedia.org/T152684#2860452

Off meeting: need a reference disk/image

Use a unified git repo for MW deploys

 * On beta
 * Needs some cleanup -- lots of space used
 * git gc/repack/pack-refs etc

Assess new directory structure and how it will interplay with MW
see above

Stretch goal: Replace rsync with git syncing
nope. still nope :)

Browser tests

 * T152683 Set up Selenium tests for Kartographer extension
 * T152432 Make it possible to execute tests as a specific (new) MediaWiki user on beta cluster

Phabricator

 * Phabricator is getting 'compare branches' functionality
 * Deploying this week: https://phabricator.wikimedia.org/rPHDEPcf34cf262ed5a07adfe5643c315e94a8f6f9d825

DB Inconsistencies
https://phabricator.wikimedia.org/T132416 and https://phabricator.wikimedia.org/T104459 (see also: https://www.mediawiki.org/wiki/Development_policy#Database_patches )

Last week

 * EasyTimeline fix for Chinese wikipedia
 * OK
 * Nodepool/Permanent slaves doc
 * Dig in migrating jobrunner deployment to scap3
 * skip
 * Speed up boot of Nodepool instances (DHCP related issues delayed boot by ~ 30 seconds)
 * Played with Docker on scap repo
 * Played with Docker on scap repo

This week

 * EasyTimeline fix deployed. Have to double check then close task
 * CI: inject skins as dependencies of MW extensions for selenium jobs
 * Look Docker/k8s as time allow

Last week

 * Train + gerrit upgrade (and login snafu)

This week

 * Sorting a few last gerrit things (submodules)
 * Scap3 stuff

This week

 * Scap3 rollback refactoring
 * K8s meeting with Chase and follow up experiments for CI PoC

Last week

 * Phabricator Phabricator Phabricator Phabricator
 * Continue experimenting with elasticsearch
 * Come up with a way to a/b test queries on both mysql and elasticsearch
 * Done - append ?elastic=1 to your query url
 * https://phabricator.wikimedia.org/rSCAPEXT1908191626ddc143556422071e18e1eedfaef511

This week

 * Deploying:
 * https://phabricator.wikimedia.org/rPHDEPcf34cf262ed5a07adfe5643c315e94a8f6f9d825
 * Mediawiki Train
 * Maybe this week (if deployments don't eat up all the time)
 * fail over to phab2001
 * reimage iridium to jessie, renamed to phab1001

Last week

 * moar scap code review
 * Some puppet patches incoming, likely for ci-staging stuff

This week

 * Finish up scap mw quarterly goal things
 * May actually get to ci-staging this week :)

Last week

 * T152422 Release new version of mediawiki_selenium
 * T146916 RSpec tests for Echo Mention notification
 * T117418 Ensure ChromeDriver is installed for jobs that run Selenium tests
 * T139740 Port Selenium tests from Ruby to Node.js
 * T151442 Research webdriver.io
 * T151443 Research nightwatchjs
 * T152683 Set up Selenium tests for Kartographer extension
 * T152432 Make it possible to execute tests as a specific (new) MediaWiki user on beta cluster
 * QA hire
 * SWAT deploy

This week

 * SWAT deploy
 * T151443 Research nightwatchjs
 * T152683 Set up Selenium tests for Kartographer extension
 * T152432 Make it possible to execute tests as a specific (new) MediaWiki user on beta cluster