Wikimedia Release Engineering Team/Checkin archive

This is the Wikimedia Release Engineering Team's archive of our weekly check-ins. We take notes on an etherpad during the meeting and archive them here afterwards. = 2014-09-23 =

Team Business
From mail Antoine sent on RelEng list (corrected): Mon 19 - FREE (US holiday) / Travel day Tue 20 - FREE Wed 21 - All Hands Thu 22 - All Hands Fri 23 - Usual work day at office Sat-Sun: Free || offsite || team socializing at Alcatraz Mon 26th - tech days Tue 27th - tech days Wed 28th - FREE Thu 29th - FREE Fri 30th - FREE Follow up on mailing list
 * FOSS OPW projects? (similar to Google Summer of Code but restricted to ladies)
 * modernize rspec?
 * TODO: Chris to write up the idea (with Zeljko)
 * All Hands/Offsite current thinking:
 * 1 day at All Hands (Tuesday, the day before)
 * Week before Paris Hackathon
 * antoine: Wanna come to Nantes? :-]  maybe ;)   Also, why are you the same color?!
 * What's happening in Paris? yearly european hackathon like Zurich last year. Ohhh. i was thinking something "sooner" :D

Scrum of Scrums
The proxy itself is like OWASP Zed or whatever, we want to create the ability to send Selenium traffic to that particular proxy.
 * Dependency wall: (stupid mingle url...)
 * Chris/Dan card #135 https://wikimedia.mingle.thoughtworks.com/projects/scrum_of_scrums/cards/135

Phabricator

 * stuffs

Deployment tooling

 * scap stuffs

Jenkins

 * MediaWiki jobs switched to Zuul cloner. Now use the proper branch (was always using 'master')
 * Random fails of extensions patches against wmf branches.
 * Bug in Zuul cloner https://bugzilla.wikimedia.org/show_bug.cgi?id=71133 patch pending test + deploy

Beta cluster

 * monitoring based on graphite / Shinken. See YuviPanda announcements
 * http://shinken.wmflabs.org/host/beta-cluster (guest/guest)
 * http://graphite.wmflabs.org/ ( Look in the left tree for Graphite -> deployment-prep, all instances have metrics generated by Diamond)
 * Notifications:
 * IRC to #wikimedia-qa already
 * emails sent to a few people ACTION: need more people to be notified and act
 * TODO: Greg to sync up with the potential deployers

Browser tests

 * Pretty much everything that should be passing is passing
 * Throttling executors on Jenkins has improved pass rate
 * Chris is combing through Flow/Echo repos (and a little bit of MobileFrontend) doing refactoring and education per the quarterly goal
 * Chris would like to set up pairing sessions in SF Oct 22/23
 * MMV tests are driving performance measurement
 * Getting them up and running on a new labs instance (multimedia-perf.eqiad.wmflabs)
 * SauceLabs is likely culprit of inaccurate metrics
 * Yslow related, bug asking to add it as a job to run on patchset proposal https://bugzilla.wikimedia.org/show_bug.cgi?id=57137

Vagrant

 * Spun up a new labs instance for MMV performance testing using MWV (yay)
 * Finalize and send out the survey!
 * Researching:
 * Lightweight monitoring
 * resource monitoring
 * auto bug report helper
 * anonymous reporting
 * cookies & donuts?

Hiring


Vacations/Confs/etc

 * 10/3: Zeljko - Conference
 * 10/8: Zeljko - Croation Holiday
 * 10/6 - 10/10 Chris vacation
 * 10/20 - 10/30 - Antoine might skip morning and work during evening {european pov}.
 * 10/27 - 10/29 Chris at Google Test Automation Conference Seattle
 * 10/30 - 10/31 Chris vacation
 * 11/3 - 11/7: Antoine - OpenStack Summit Paris
 * 11/11 - Antoine Holiday (WW1)

= 2014-09-16 =

Phabricator

 * redirection scripts (BZ urls to Phab urls)
 * almost finished
 * Just waiting on launch, will work with chase to deploy it
 * the gerrit -> phab bot
 * Java :)
 * ask for help from Nik/Chad/Christian

Deployment tooling

 * l10n and scap colliding
 * https://bugzilla.wikimedia.org/show_bug.cgi?id=70446

Jenkins

 * extensions now being tested with:
 * proper mediawiki/core branch (deployed today)
 * mediawiki/vendor
 * Still have to migrate the extensions -qunit jobs (WIP)
 * Wikidata related jobs partly reintegrated on Wikimedia Jenkins
 * Next items:
 * early adopt phabricator
 * isolating tests using labs infra.
 * merge zuul-config and jjb-config repositories (suggested by cscott)
 * auto deploy CI related changes on +2
 * Anyone interested in some Jenkins training ? ( Timezones sucks :-/ )
 * Chris started re-doing docs on mw.o. Starting with getting rid of references to Cloudbees.
 * Jenkins perf improvements
 * plan a sane master/slave arrangements
 * Design load structure
 * TODO: GREG to find find out Timo's involvement

Beta cluster
Antoine: both are huge additions with a long record of proven success.
 * jeremyb rampage
 * matanya granted root on beta (ops & puppet volunteer)
 * Search slowness; https://bugzilla.wikimedia.org/show_bug.cgi?id=70869
 * We have monitoring on beta cluster thanks to Yuvi!
 * Wait on second cluster

Browser tests

 * early WIP of environment abstration layer
 * https://gerrit.wikimedia.org/r/#/c/159644/
 * Geolocation use case? Chris to send email I think :)
 * helping MMV with performance testing using MW-Selenium and an "isolated" labs instance
 * Chris to refactor Echo tests first in conjunction with corefeatures team

Vagrant

 * helping MMV with performance testing using MW-Selenium and an "isolated" labs instance
 * looking for ways to setup a "traffic shaper" role in MWV (using `tc` perhaps)
 * not sure how to achieve more isolation in labs (bigger instance == more dedicated?)
 * need to finalize MWV survey
 * https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Vagrant_survey

Hiring
HR.....................................................