Wikimedia Platform Engineering/MediaWiki Core Team/Check-ins/20140106

who: Brad, Nik, Bryan, Sumana, Ori, Chris, Greg, Aaron, Chad, Antoine

Search

 * Made cirrus primary for itwiki, wikidata, frwikisource, and all wikivoyages
 * 10x-15x increase in search traffic
 * Higher load than we’d like (http://ganglia.wikimedia.org/latest/?c=Elasticsearch%20cluster%20eqiad&m=cpu_report&r=hour&s=by%20name&hc=4&mc=2)
 * Caused by aggressive configuration on our glorious suggester. Deploying less aggressive configuration.
 * Made cirrus secondary on dewiki and all wikibooks. Building now.
 * Made cirrus BetaFeature on more large wikis (frwiki, eswiki, ruwiki, and ptwiki)
 * Grabbing more small wikis Wednesday
 * enwiki as secondary next Monday unless Chad or Nik decide that is a bad idea this week.

DevOps

 * Bryan has a Puppet module for Kibana (LogStash UI), now! Vetted by Antoine and Mark.
 * Ori is a jerk and has not merged Bryan’s Puppet commits for LogStash yet, but will do so today (or at Bryan’s earliest convenience).
 * Graphite is actually, really, totally migrated to tungsten in EQIAD. Now iterating on the setup to make improvements. Pairing with Faidon on this and tracking here: 
 * Scap: one more thing Aaron to get to before writing announce email.

Performance
(ori: please paste gerrit url so the lazy one can just click :D )
 * Added RunningStat (Ifedda276d) and MessagePack serialization (Id2833c5a9) to core.
 * Used by new Profiler implementation (I688e7231d). Gains: very efficient binary serialization. Data can be summarized in stages without fidelity. Measures variance and extrema (min / max) in addition to arithmetic mean and call count.
 * Domas agreed to Apache license for Mwprof, yay.
 * HHVM role in MediaWiki-Vagrant getting patches!
 * Submitted Tim’s xhprof calibration fix to HHVM: https://github.com/facebook/hhvm/pull/1488

Beta / CI
https://www.mediawiki.org/wiki/Wikimedia_Release_and_QA_Team
 * l10n-bot blacklisted from Zuul, would no more trigger jobs. Caused slowness during peak hours.
 * New Zuul tomorrow european morning. Half an hour window.
 * flow-charting hates Freedom, or vice versa

Scholarships

 * Fixed CSRF vulnerability reported by Chris on 2014-01-03
 * Application form live as of 2014-01-06T00:00Z
 * Small logging verbosity fix to deploy tomorrow

Bug escalation
https://bugzilla.wikimedia.org/show_bug.cgi?id=59677 - FlaggedRevs reviews are not visible in CheckUser

Quarterly review
https://www.mediawiki.org/wiki/Wikimedia_MediaWiki_Core_Team/Quarterly_review,_January_2014

Monthly status
https://www.mediawiki.org/wiki/Wikimedia_engineering_report/2013/December

Arch Summit
https://www.mediawiki.org/wiki/Architecture_Summit_2014/Straw_poll