Scrum of scrums/2016-05-04

= 2016-05-04 =

Release Engineering
For all:
 * T128190 - Migration of browser tests Jenkins jobs to selenium jobs


 * The migration of browsertests* to selenium* is almost complete, however, Željko needs people to claim their failing browser tests. See the task for more information.
 * The task has a table, but it's not clear what you want people to do (are you just asking about the rows with missing "contact from browsertests.yaml" fields)?

For operations:


 * T126594 - Disable HHVM fcgi server on CI slaves
 * Need help from ops to review and merge these two patches (we dont need HHVM running as a daemon on CI boxes):
 * https://gerrit.wikimedia.org/r/#/c/269946/
 * https://gerrit.wikimedia.org/r/#/c/269947/


 * https://phabricator.wikimedia.org/T133911 - Bump quota of Nodepool instances (contintcloud tenant)
 * More instances needed. Clarified with Chase last week: pending Andrew. No urgency.


 * Two related tasks, each have patches that are needed to streamline the scap3 migration:
 * T133211 - Automate the generation deployment keys (keyholder-managed ssh keys)
 * https://gerrit.wikimedia.org/r/#/c/284418/
 * T132747 - scap::target shouldn't allow users to redefine the user's key
 * https://gerrit.wikimedia.org/r/#/c/285519/

Security

 * Reviews:
 * json-schema done, AuthManger done (no more comments, a few minor things before all patches are +1'ed)
 * Starting on T129584 this week
 * Starting work on AuthService next week (heads up to Services, we'll probably be scheduling a few meetings with you) (Marko: ack && yay!)
 * Ops: ping again on T128819

Services
(Marko cannot attend today, sorry)
 * RESTBase
 * working on storing all auth checks locally (now we are calling the MW API every time)
 * EventBus / Change propagation
 * started using it in production for the summary endpoint today
 * more dependency updates to follow soon
 * Cassandra move to 2.2.6 soon
 * first up: maps cluster
 * use Scap3 - https://lists.wikimedia.org/pipermail/wikitech-l/2016-April/085299.html

Technical Operations

 * Blocking:
 * none
 * Blocked:
 * none
 * Updates:
 * May 15 (Chrome SPDY removal deadline). Getting HTTP/2 working fully deployed till then
 * started using letsencrypt for various small services

Reading

 * Most of Reading engineering is at an offsite today, I believe.

Reading Infrastructure

 * AuthManager core patches are just waiting for security +1s. Work is ongoing on extensions; CentralAuth, LdapAuthentication, ConfirmEdit could use reviews if anyone is interested.

Collaboration

 * Blocking:
 * External store work. External Store deployed everywhere on Beta with no complications.  Work on this continues.  We now need to set up a second External Store on Beta for Flow, to test the migration.
 * Blocked:
 * Work on Flow dumps continuing on the ops side. https://phabricator.wikimedia.org/T119511 and https://phabricator.wikimedia.org/T89398.
 * Updates:
 * Continuing notification work on:
 * Cross-wiki notifications coming by default on May 12th!
 * Echo email formatter
 * Work continues on the new Echo MVC architecture

Parsing

 * We got our first visual diff test run comparing Tidy with HTML5depurate. Results @ http://mw-expt-tests.wmflabs.org/ ... Making notes @ https://www.mediawiki.org/wiki/Parsing/Replacing_Tidy ... We will use this as the basis for figuring out what things might break if we replace Tidy today and what needs fixing and where.
 * Scott has been working with Ops to get OCG kinks ironed out.

Language

 * Blocking:
 * Apertium->Jessie. Yet to finalize plan and proceed.
 * Blocked:
 * Updates:
 * cxserver service will be migrated to scap3 deployment soon.
 * Translate (twn, meta,..) now using Apertium MT from cxserver.

Discovery

 * Blocking: none
 * Blocked: none
 * Preparing for ElasticSearch 2.0 migration
 * Results for A/B test on portal language link location published: https://commons.wikimedia.org/wiki/File:Wikipedia_Portal_Test_of_Language_Detection_and_Primary_Link_Resorting.pdf
 * TextCat A/B test launching soon
 * Portal A/B test adding descriptions to project links to start this week
 * WDQS redeployed, some performance issues
 * Graphs have ability to use WDQS directly now
 * Search Team offsite in 2 weeks (17-21)

Analytics

 * Scaling of pageview API, more work than anticipated
 * Working new domain analytics.wikimedia.org, wikistats 2.0 migration, meeting with research to map early states of project
 * Still trouble with jenkins

Fundraising Tech

 * coding new PayPal integration
 * pulling in lots of CiviCRM upstream changes
 * making CentralNotice fail gracefully in odd cache edge cases
 * Casey hanging out with reading offsite
 * more work towards replacing ActiveMQ