Wikimedia Release Engineering Team/Checkin archive/20151116

= 2015-11-16 =

Vacations/Confs/etc
How to do it: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off
 * Nov 25: Greg - Half day (working that morning)
 * Nov 26: US HOLIDAY - Thanksgiving
 * Nov 27: US HOLIDAY - Day after Thanksgiving
 * Dec 2?-Jan 0x - Antoine, no clue yet
 * Dec 4th: Greg - disconnected, leaving Thursday evening, returning Sunday :)
 * Dec 21-Jan 1: Greg - vacation, at least (maybe part of the week before)
 * Dec 22-29: Chad - Christmas
 * Dec 23–25: Tyler — Hopeful, probable, Christmas in Kansas!
 * Dec 24-Jan 3: Dan - Holidays (probably)
 * Dec 25: US HOLIDAY - Christmas Day - December 25
 * Jan 1: US HOLIDAY - New Year's Day
 * Jan 4 - 8: WikiDev16 + All Hands
 * Jan 16-18: Chad - another music festival
 * Jan 18: US HOLIDAY - Martin Luther King Day
 * Feb 15: US HOLIDAY - President's Day
 * May 30: US HOLIDAY - Memorial Day
 * June-ish: Chad - EDC
 * August: France holiday - because french. :)

Actions from last meeting

 * IN PROGRESS - Chad: re 1.26 release: "Going to push on all the assigned ones and find assignees for the remainder this week."
 * Dan to continue to bring up in SoS
 * Release is next week, the 25th of Nov. before thanksgiving (US Nov 26th).
 * TODO - Greg: re KPIs, do mw core gate-processing time for this quarter, reassess for next quarter if needed
 * TODO - No One Yet: investigate carbon aggregation of stats >1 month old behavior
 * ACTION: Antoine to create a task

WIkiDev16

 * Code Review RFC - https://phabricator.wikimedia.org/T114320
 * Scap3 - https://phabricator.wikimedia.org/T114045
 * Moved to "on-track" (thanks Dan!) https://phabricator.wikimedia.org/T114045

Other

 * Just FYI, deployment: https://wikitech.wikimedia.org/wiki/Deployments#End_of_year.2Fbeginning_of_new_year_.27code_freezes.27


 * Hate to say it: time to talk Q3 ;)
 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Goals/201516Q3


 * Staging
 * Let's not do this
 * Explore the idea: https://phabricator.wikimedia.org/T115497 Survey on needs related to Beta Cluster/Staging
 * Roll the ideas from staging into beta? Auto-provisioning, recent distros, puppet cleanup, etc?
 * End goal: make sure problems in production are reproducible
 * End goal: make sure problems in production are reproducible


 * Moving target trying to keep up with ops
 * ACTION: schedule time with ops to discuss dedicated opsen to help plan/review/merge
 * Promote shared ownership of ops/puppet related to BC/Prod
 * Talk about practices around puppet manifests (improvements in envirinment neutrality, taking care of existing debt)


 * Why?
 * reduce tech debt
 * fewer times bugging ops for help :)
 * making production errors (more) reproducible on Beta Cluster
 * helps find the gross corner cases in prod puppet (eg: tin, you can't just apply the deployment:: role on it and have it work)


 * Differential
 * Rfc on track for end of Q2/Dev Summit
 * Q3 will likely be spent responding to concerns, defining workflows, planning for migration
 * Will not be rolling out or performing any substantial migration
 * find more standalone/early adopter projects
 * End of Q3/early Q4 for MW and extensions moving over

Example: https://www.mediawiki.org/wiki/User:Legoktm/ci  http://raita.wmflabs.org/ ?
 * QA Health Dashboard
 * What is the scope/purpose of this project?
 * One possibility is to show (us?) which projects are using which libraries/versions, data on unit/integration tests, coverage, etc.
 * API for querying this data would allow for ad hoc, more team specific dashboards

New vs Maint time spent

 * https://docs.google.com/a/wikimedia.org/spreadsheets/d/1FI90AefwdLHGzVVdrLS6AxcTcJtLFyX0aQTQfyc88s4/edit

#together

 * Team workboard: to triage: https://phabricator.wikimedia.org/project/board/20/query/TRiVy4zOMdR./
 * Team workboard: only-in-#releng(ish): https://phabricator.wikimedia.org/project/sprint/board/20/query/g2T5.QSLJVRQ/

Scrum of Scrums

 * https://phabricator.wikimedia.org/project/board/64/
 * Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R


 * Scream about MW release 1.26

CI Scaling

 * https://phabricator.wikimedia.org/project/board/1010/
 * Quarterly Goal: "CI cluster responds to spike in queued builds by starting and registering additional jenkins slaves" - https://phabricator.wikimedia.org/T111106


 * Additional zuul-merger on labs host (Tomorrow 3pm UTC with Andrew B.)
 * Tyler/Mukunda got rid of ZUUL_UID for the publish jobs, let us push doc from Differential.
 * random reviews and infra related stuff (Zuul/Nodepool package updates)
 * zuul-cloner ready to clone from local mirrors
 * rake entry point being generalized

Deployment Cabal

 * Main: https://phabricator.wikimedia.org/project/board/349/
 * Scap3: https://phabricator.wikimedia.org/project/board/1449/
 * Quarterly Goal: "Migrate all Service team owned services and MW deploys to scap3" - https://phabricator.wikimedia.org/T109926


 * Chad/bd808/Mukunda: Lots of work on Scap Dual Masters
 * Dan Initial Debian packaging work
 * Mukunda: Service checks documentation, restructuring of docs
 * Documentation autogeneration merged Friday
 * patch for mirroring masters
 * ops/puppet change: https://gerrit.wikimedia.org/r/#/c/253040/
 * scap change: https://phabricator.wikimedia.org/D48
 * docs: https://doc.wikimedia.org/mw-tools-scap/index.html

Diff[usion|erential] migration

 * https://etherpad.wikimedia.org/p/diffuerential-weekly
 * Gitblit-Deprecate: https://phabricator.wikimedia.org/project/board/46/
 * Quarterly Goal: https://phabricator.wikimedia.org/T111465
 * Gerrit-Migration: https://phabricator.wikimedia.org/project/board/9/

(Greg can create some tasks for these if/as needed)
 * Antoine + Mukunda should sit down and talk CI/Harbormaster/Nodepool
 * Mukunda just needs to find time to finally test out harbormaster triggering jenkins jobs.
 * Find some Differential Ambassadors for each vertical
 * bd808 for Reading

Release MediaWiki 1.26

 * https://phabricator.wikimedia.org/project/board/1177/
 * Release date 11/25

Beta Cluster

 * https://phabricator.wikimedia.org/project/board/497/?order=priority