Wikimedia Release Engineering Team/Checkin archive/20151109

= 2015-11-09 =

Vacations/Confs/etc
How to do it: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off
 * Nov 25: Greg - Half day (working that morning)
 * Nov 26: US HOLIDAY - Thanksgiving
 * Nov 27: US HOLIDAY - Day after Thanksgiving
 * Dec 2?-Jan 0x - Antoine, no clue yet
 * Dec 4th: Greg - disconnected, leaving Thursday evening, returning Sunday :)
 * Dec 21-Jan 1: Greg - vacation, at least (maybe part of the week before)
 * Dec 22-29: Chad - Christmas
 * Dec 24-Jan 3: Dan - Holidays (probably)
 * Dec 25: US HOLIDAY - Christmas Day - December 25
 * Jan 1: US HOLIDAY - New Year's Day
 * Jan 4 - 8: WikiDev16 + All Hands
 * Jan 16-18: Chad - another music festival
 * Jan 18: US HOLIDAY - Martin Luther King Day
 * Feb 15: US HOLIDAY - President's Day
 * May 30: US HOLIDAY - Memorial Day
 * June-ish: Chad - EDC
 * August: France holiday - because french. :)

Actions from last meeting

 * DONE - EVERYONE: please review Antoine's caching proposal! https://lists.wikimedia.org/pipermail/qa/2015-October/002414.html
 * Antoine gave an update. Following discussion with Greg and Zeljo: will just do it based on rsync and a central server. Quick and dirty with race conditions but we can follow up later.
 * DONE - Mukunda: Get bd808+legoktm on Differential - https://phabricator.wikimedia.org/T117293
 * IN PROGRESS - Chad: re 1.26 release: "Going to push on all the assigned ones and find assignees for the remainder this week."
 * Dan to continue to bring up in SoS
 * TODO - Greg: re KPIs, do mw core gate-processing time for this quarter, reassess for next quarter if needed
 * TODO - No One Yet: investigate carbon aggregation of stats >1 month old behavior
 * ACTION: Antoine to create a task

WIkiDev16

 * Code Review RFC - https://phabricator.wikimedia.org/T114320
 * Scap3 - https://phabricator.wikimedia.org/T114045
 * Moved to "on-track" (thanks Dan!) https://phabricator.wikimedia.org/T114045

Other
not coming at all :-( :-
 * Any vetoes to spending an extra half week in SF after all-hands?
 * Specifically: Mukunda, Zeljko (already said OK), and Tyler (Antoine's
 * ACTION: Chad to investigate some place to hack other than the WMF office


 * Hate to say it: time to talk Q3 ;)
 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201516Q3


 * Staging
 * Let's not do this
 * Explore the idea: https://phabricator.wikimedia.org/T115497 Survey on needs related to Beta Cluster/Staging
 * Roll the ideas from staging into beta? Auto-provisioning, recent distros, puppet cleanup, etc?
 * End goal: make sure problems in production are reproducible
 * End goal: make sure problems in production are reproducible


 * Moving target trying to keep up with ops
 * ACTION: schedule time with ops to discuss dedicated opsen to help plan/review/merge
 * Promote shared ownership of ops/puppet related to BC/Prod
 * Talk about practices around puppet manifests (improvements in envirinment neutrality, taking care of existing debt)


 * Differential
 * Rfc on track for end of Q2/Dev Summit
 * Q3 will likely be spent responding to concerns, defining workflows, planning for migration
 * Will not be rolling out or performing any substantial migration

Example: https://www.mediawiki.org/wiki/User:Legoktm/ci  http://raita.wmflabs.org/ ?
 * QA Health Dashboard
 * What is the scope/purpose of this project?
 * One possibility is to show (us?) which projects are using which libraries/versions, data on unit/integration tests, coverage, etc.
 * API for querying this data would allow for ad hoc, more team specific dashboards

New vs Maint time spent

 * https://docs.google.com/a/wikimedia.org/spreadsheets/d/1FI90AefwdLHGzVVdrLS6AxcTcJtLFyX0aQTQfyc88s4/edit

#together

 * Team workboard: to triage: https://phabricator.wikimedia.org/project/board/20/query/TRiVy4zOMdR./
 * Team workboard: only-in-#releng(ish): https://phabricator.wikimedia.org/project/sprint/board/20/query/g2T5.QSLJVRQ/

Scrum of Scrums

 * https://phabricator.wikimedia.org/project/board/64/
 * Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R

CI Scaling

 * https://phabricator.wikimedia.org/project/board/1010/
 * Quarterly Goal: "CI cluster responds to spike in queued builds by starting and registering additional jenkins slaves" - https://phabricator.wikimedia.org/T111106


 * package cache, see above: Antoine to do a dirty rsync based system. Codename: CACHETTE
 * Antoine 11/11th Jenkins security upgrade ... Need first ot upgrade our Jenkins to latest LTS. Then watch ann

Deployment Cabal

 * Main: https://phabricator.wikimedia.org/project/board/349/
 * Scap3: https://phabricator.wikimedia.org/project/board/1449/
 * Quarterly Goal: "Migrate all Service team owned services and MW deploys to scap3" - https://phabricator.wikimedia.org/T109926


 * New documentation has been merging:
 * https://phabricator.wikimedia.org/D31
 * https://phabricator.wikimedia.org/D32
 * https://phabricator.wikimedia.org/D35
 * Updates to doc-publishing in the absence of zuul
 * https://phabricator.wikimedia.org/T117770
 * up-to-date now: https://doc.wikimedia.org/mw-tools-scap/

Diff[usion|erential] migration

 * https://etherpad.wikimedia.org/p/diffuerential-weekly
 * Gitblit-Deprecate: https://phabricator.wikimedia.org/project/board/46/
 * Quarterly Goal: https://phabricator.wikimedia.org/T111465
 * Gerrit-Migration: https://phabricator.wikimedia.org/project/board/9/

(Greg can create some tasks for these if/as needed)
 * Antoine + Mukunda should sit down and talk CI/Harbormaster/Nodepool
 * Find some Differential Ambassadors for each vertical
 * bd808 for Reading

Release MediaWiki 1.26

 * https://phabricator.wikimedia.org/project/board/1177/

Beta Cluster

 * https://phabricator.wikimedia.org/project/board/497/?order=priority