Wikimedia Release Engineering Team/Checkin archive/20150728

= 2015-07-28 =

Standard

 * Root access email from Mark
 * TODO: Greg expand, start etherpad
 * Vacations
 * GitHub

30 (ish) day checkin on Q1 goals

 * https://phabricator.wikimedia.org/tag/releng-201516-q1/

[Quarterly Success Metric] Jenkins: Run jobs in disposable VMs
https://phabricator.wikimedia.org/T47499
 * boot instances from OpenStack API
 * labnodepool is pretty much done. Going to be reimaged from scratch. https://phabricator.wikimedia.org/T107158
 * still missing the image to boot from (goal: end of week-ish?)
 * subset of jobs run in disposable VM (not isolated)
 * after Antoine's vacation
 * Bug 1/Task 2001
 * For now just some notes at: https://wikitech.wikimedia.org/wiki/Nodepool

Gerrit Migration stage 1

 * Prototype CI integration with Differential
 * https://phabricator.wikimedia.org/T103127
 * TODO: Mukunda and Antoine to pair or something this week


 * Allow cloning of Phabricator hosted git repositories
 * https://phabricator.wikimedia.org/T128
 * Completely working on HTTPS.
 * SSH a WIP, Chase was working on this last week
 * Cloning of SVN requires SSH, Phab doesn't support HTTP(S) + SVN

Create or improve the RESTBase deploy method (tracking)
https://phabricator.wikimedia.org/T102667

Seemingly on track at this point Not drowning!


 * A new workflow for RESTBase is deployed (task T102667 is complete)
 * Created reasonable replacement method via scap
 * Working on wrapping ansible to hide ansible :)
 * Goal to have systems to evaluate (roughly) by next week


 * All items in Deployment_tooling/Future#Future_Requirements completed
 * Continually evaluating approaches
 * Fill out evaluation of tools, further refine best approach
 * https://docs.google.com/a/wikimedia.org/spreadsheets/d/1MlEsFxrLvdZdV_G82WEAIvBXr7ArO7nCEKaFClHhJEw/edit?usp=sharing

Pairing (#together) / Weekly Triages

 * happenin'

Scrum of Scrums

 * https://phabricator.wikimedia.org/project/board/64/
 * Blocked on us: https://phabricator.wikimedia.org/maniphest/?statuses=open%28%29&projects=PHID-PROJ-arpazvuktn2l647rb6us#R

Beta Cluster

 * https://phabricator.wikimedia.org/project/board/497/?order=priority


 * Migrate Varnish caches from Trusty to Jessie https://phabricator.wikimedia.org/T98758
 * Shouldn't be hard, we can clean this up.
 * Chad took the task, started looking at it last week anyway
 * FYI: Might want to deploy MediaWiki services using scap/git-deploy/whatever...

Deployment Cabal

 * Already discussed above in quarterly.

Isolated CI instances

 * https://phabricator.wikimedia.org/tag/continuous-integration/board/?order=priority
 * Quarterly Priority: Disposable VMs - https://phabricator.wikimedia.org/T47499


 * Zuul upgraded, fixed regression
 * Antoine to write doc about building the Zuul .deb package and bumping from an upstream version.

Phabricator

 * Already discussed above in quarterly.

Developer Tooling (MW-Vagrant, MW-Selenium, etc.)

 * Working on video recording for headless browser test sessions
 * Done, just needs a couple merges (mw-selenium 1.5.0 release and support in jenkins slave script)
 * https://gerrit.wikimedia.org/r/#/c/226653/
 * https://gerrit.wikimedia.org/r/#/c/226651/
 * Antoine: seen them, that is all good.  The ruby video stuff looked legit though I haven't tested them.   Only concern was disk space consumption on slaves, but that has been dealt with by limiting the number of artifacts we keep.
 * next step offloading the videos to swift? :) :) :)

Other Work

 * Hosted Testing: Where does it hurt? session yesterday
 * Seemed like a successful first step in addressing teams' testing pain points
 * Grace and Dan will be reviewing notes and formulating next steps this Wednesday
 * start using semantic versioning for wmf branches:: https://phabricator.wikimedia.org/T67306
 * I am going to attempt to implement this asap, maybe today if I don't hit too many roadblocks with make-wmf-branch, etc.
 * I am curious...if we automated the release process...what if we actually did weekly point releases that coincide with deployment?
 * It needs freaking automation.

Vacations/Confs/etc
Please add your time off to your gcal and ADP, as appropriate


 * Dan: July 30-31 (reachable by gchat/phone/email)
 * Zeljko: July 27th - Aug 16th (3 weeks!)
 * Antoine: Aug 1st - 23rd (3 weeks!)