Wikimedia Platform Engineering/MediaWiki Core Team/Check-ins/20140218

who: Chad, Brad, Bryan, Ori, Aaron, RobLa, Greg out today: Tim, Chris S, Antoine

Liaisons with other teams
e.g. Flow, Wikidata, etc

HHVM

 * (Re)-Kick off on Monday - if you want an invite and didn’t get one just ask.
 * Use Phabricator’s kanban board?
 * Need to triage/assign/estimate: 1) intl extension (facebook is working full steam ahead on this, I’ve made specific requests for things we’re missing), 2) igbinary (aaron?), 3) luasandbox (tim), 4) wmferrors (brad?), 5) puppetization/packaging (ori), 7) fast string search (might be able to live without?)

Performance

 * Eliminate /geoiplookup requests!
 * VE perf graphs! http://gdash.wikimedia.org/dashboards/ve/
 * Moar frontend perf graphs! http://gdash.wikimedia.org/dashboards/frontend/
 * mwgrep tool to grep site JS/CSS code on MediaWiki: NS, using elastic. (wooo! thanks nik & chad)
 * Escalation: gitblit performance: https://code.google.com/p/gitblit/issues/detail?id=274#c9 (comments 9 & 10)
 * Requirement in a nutshell: Gerrit plug-in that runs on merge and PURGEs affected views
 * Would allow us to serve vast majority of reqs out of Varnish
 * Chad will look & get back to Ori this week
 * In progress: analysis of impact of ULSFO rollout on page load time (w/Nuria / analytics)
 * Swift auth and container stat caching fixes (aaron)
 * External links API query improvement suggestions

Search

 * We’ve almost entirely cleared the backlog of Lucene bugs, either closing them or moving into Cirrus.
 * We need more hardware -- mostly disk space (4 promised boxes in row D won’t be enough)
 * Looking to possibly rebalance some lsearchd and steal stuff: https://wikitech.wikimedia.org/wiki/Search/lsearchd_inventory
 * Will probably start poking Elasticsearch 1.0.0 later this week or early next week
 * See ops-l post about this for more timeline
 * Want more traffic as primary
 * Should we do this before 1.0.0?
 * Nik is descending into Lucene land, trying to find ways to save us space without sacrificing features

Deploy Tooling

 * Chipping away at scap refactor/python port
 * Gerrit change 113652 add detailed duration timing for scap & scap-1
 * Gerrit change 113996 remove external script dependencies from scap-1
 * Add bootstrap initialization for l10n update in new branches https://gerrit.wikimedia.org/r/#/c/113260/
 * Working on using ssh directly (bypasing dsh) to get better reporting/logging
 * Will be used for Bug 59922
 * Requests:
 * Change wikiversions.dat to wikiversions.json (that is, update the PHP multiversion code to work with a JSON file rather than a custom .dat file format)
 * Drop now-unused ext: field from CDB

Beta/CI
Antoine (not here, copy/paste from RelEng/QA weekly):
 * Status:    In progress Complete integration of browsertests for VisualEditor
 * One build worked and triggered two successful scenario!!
 * Status:    In progress Train Zeljkof on Jenkins Job Builder script
 * Zeljkof started on it. Will pair with him to finish up.
 * Status:    In progress Help migrating Cloudbees Jenkins template to JJB YAML templates
 * Zeljkof started on it. Will pair with him to finish up.

See also: Bug escalation below.

Security

 * Password hashing and expiry patch review (aaron)
 * Review token timing attack fix (aaron) (https://bugzilla.wikimedia.org/show_bug.cgi?id=61346)
 * https://bugzilla.wikimedia.org/show_bug.cgi?id=61362

Bug escalation

 * https://bugzilla.wikimedia.org/show_bug.cgi?id=61491 - “no WikiEditor edit controls on any page in beta labs”
 * https://bugzilla.wikimedia.org/show_bug.cgi?id=54193 - “Recursion detected in RequestContext::getLanguage” still out there waiting for an awesome fix (51422 times in the last 7 days)