Wikimedia Release Engineering Team/Checkin archive/20160808

= 2016-08-08 =

Vacations/Important dates
How to do it: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off ...
 * July 25 - August 15: Željko vacation. Will have laptop with me. Reachable via phone.
 * July 30 - August 21: Antoine vacation. At home 1st week.
 * Sept 5th: Labor day
 * October 17: OFFSITE
 * October 31: Mukunda maybe?
 * January 9-11: Dev Summit
 * January 12-13: All Hands

Time spent spreadsheet

 * Week 31 - https://docs.google.com/spreadsheets/d/1IrwGPdTDZ6H8x9Mf5dmCYlkK4hZ8sbUSLODEM4cFc4g/edit#gid=749117798

Rotating positions and absences
Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers

weeks of July 25 and Aug 1

 * Train: Tyler
 * wmf.12
 * wmf.13
 * SoS: Mukunda / Tyler
 * https://phabricator.wikimedia.org/E155/17 - Mukunda
 * https://phabricator.wikimedia.org/E155/18 - Tyler
 * Out:
 * Zeljko: July 25 - Aug 15
 * Antoine: July 30 - Aug 21
 * Mukunda: Aug 1-5

weeks of Aug 8 and Aug 15

 * Train: Mukunda
 * wmf.14
 * wmf.15
 * SoS: Chad
 * https://phabricator.wikimedia.org/E155/19
 * https://phabricator.wikimedia.org/E155/20
 * Out:
 * Zeljko: July 25 - Aug 15
 * Antoine: July 30 - Aug 21

weeks of Aug 22 and Aug 29

 * Train: Antoine
 * wmf.16
 * wmf.17
 * SoS: ???
 * https://phabricator.wikimedia.org/E155/21
 * https://phabricator.wikimedia.org/E155/22
 * Out:

Actions from last meeting

 * none

Scrum of Scrums

 * https://phabricator.wikimedia.org/project/board/64/
 * Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

This week

 * Blocking
 * Blocked
 * Updates
 * New SWAT window schedule starting Aug 22nd
 * See: https://wikitech.wikimedia.org/wiki/Deployments#Week_of_August_22nd
 * And: https://wikitech.wikimedia.org/wiki/SWAT_deploys#The_team
 * https://phabricator.wikimedia.org/T137970
 * And: https://wikitech.wikimedia.org/wiki/SWAT_deploys#The_team
 * https://phabricator.wikimedia.org/T137970

Last week

 * Blocked
 * None
 * Blocking
 * None?
 * Updates
 * New Scap release that uses logstash_checker.py coming—live on beta already test please
 * Lots of folks out this week, next week less folks out.

Offsite

 * Rachel is working on venue options still; some good options so far
 * what do you want to talk about? Fill this out/vote on ideas:
 * https://etherpad.wikimedia.org/p/releng-offsite201610-proposedtopics

CI

 * Job mediawiki-extensions-php55 frequently fails due to "Segmentation fault" - https://phabricator.wikimedia.org/T142158
 * commented

Replace primary production Continuous Integration host -

 * NEXT: https://phabricator.wikimedia.org/T139771 - "Identify metric (or metrics) that gives a useful indication of user-perceived (Wikimedia developer) service of CI"
 * TODO: Tyler reply to Faidon's comment, keeping focused on getting off of gallium for now, we don't really care which network

Upgrade Beta Cluster database servers to Maria10/Jessie -

 * Beta Cluster db upgrade needs a (temp) quota bump - https://phabricator.wikimedia.org/T138778
 * NB: This might be alleviated thanks to some instance shrinking by Krenair

Reduce Technical Debt
Perform a technical debt analysis of software and services maintained by WMF Release Engineering -


 * Original mega sheet: https://docs.google.com/spreadsheets/d/1Kxj9p4fKVNo2h23yAQVoOGg77dZ4FLxeXuYrH-1CrPA/edit#gid=0
 * Already is tracking specific 'things' which need to be addressed
 * Redux: https://docs.google.com/spreadsheets/d/1Ncbgbg-ZPSSScOaGswQSJRtreuJOlizRCFln4KyfMWI/edit#gid=0
 * Simply severity+importance.
 * Redux Redux: https://docs.google.com/spreadsheets/d/1btVdLuV59GZkQax8Hk0jkWDeyF5O_M5HkylWL0WxHxo/edit#gid=0
 * Just severity


 * Next steps?
 * Fill out Redux Redux (THIS WEEK - week of Aug 1)
 * Based on Redux Redux identify the one thing to focus on (NEXT WEEK - week of Aug 8)
 * As of now looks like MW 3rd party release tooling and l10nupdate are the hot spots
 * CI/nodepool also on the list

Streamline deployments (long-lived branches)
keyresult task: project view: https://phabricator.wikimedia.org/project/view/2117/
 * Convert our production deployment strategy to use long-lived branches -


 * continue to talk over https://phabricator.wikimedia.org/T140921#2499463
 * maybe get a response from Timo
 * TODO: Chad lay out ideation on the ticket to then get Timo to review
 * Mukunda to share branch merging prototype code and solicit feedback from the team
 * Maybe start playing with jenkins api for SWAT tool

SWAT deploy changes

 * European SWAT deploys next steps (
 * NEXT: stalled pending finding people to do the SWAT window while Antoine and Zeljko are on vacation
 * Week of 20th August lets gogogo
 * Greg will email an announcement Tuesday Aug 9th

Browser tests

 * TODO: Check status of the gem update to fix the https issue

Differential migration
Differential weekly (https://etherpad.wikimedia.org/p/diffuerential-weekly ) TODOs:


 * Mukunda had questiosn for antione re puppet (keys into the private store, production or other? for CI image builder)
 * see: https://cloudbees.zendesk.com/hc/en-us/articles/203802500-Injecting-Secrets-into-Jenkins-Build-Jobs


 * Update documentation on creating/renaming of repos in Diffusion
 * https://phabricator.wikimedia.org/T139688


 * Update task with discussion about ACLs?
 * https://phabricator.wikimedia.org/T130786


 * Announce plan to migrate MW-Vagrant to Differential
 * https://phabricator.wikimedia.org/T131419#2439362
 * outstanding patches should be either merged, abandoned or migrated to differential revisions.

Beta Cluster

 * "deployment-fluorine becomes unresponsive frequently" - https://phabricator.wikimedia.org/T140313
 * TODO: Submit patch ( https://gerrit.wikimedia.org/r/#/c/299672/ ) for PuppetSWAT?

DB Inconsistencies

 * Figure out how to help Jaime with the DB schema inconsistencies issue:
 * https://phabricator.wikimedia.org/T132416 and https://phabricator.wikimedia.org/T104459 (see also: https://www.mediawiki.org/wiki/Development_policy#Database_patches )
 * What can we do in CI to help prevent, mostly?
 * Chad will lick this cookie :)

Last week

 * Vacation

This week

 * Vacation

Last week

 * Gerrit 2.12.3 (trivial, only a minute or two of downtime)
 * DB consistencies ....

Last week

 * Start poking at MW-Vagrant jessie base image https://phabricator.wikimedia.org/T136429
 * Migrate deployment-prep to jessie https://phabricator.wikimedia.org/T138778

This week

 * Start poking at MW-Vagrant jessie base image https://phabricator.wikimedia.org/T136429
 * Migrate deployment-prep to jessie https://phabricator.wikimedia.org/T138778
 * Follow up on mw-selenium/browser tests dependency updates re https://phabricator.wikimedia.org/T129483

Last week

 * Vacation

This week

 * Train
 * LLB
 * Mukunda to share branch merging prototype code and solicit feedback from the team
 * Maybe start playing with jenkins api for SWAT tool

Last week

 * Scap update
 * train
 * analytics/refinery move

Last week

 * Vacation

This week

 * Vacation