Scrum of scrums/2016-02-17

= 2016-02-17 =

Analytics

 * Blocking:
 * Discovery with a pageview API bug: T127034, Dan is working on it right now
 * Multimedia with dumps parsing asks: T126808, T126809, Analytics will triage hopefully soon (within one or two weeks, but backlog is huge)
 * Blocked
 * Services (known) because we need to refactor / move AQS (Analytics Query Service) out of the restbase repo
 * Updates:
 * Same as last time, nothing new is ongoing

Architecture
[No update.]

Performance
[No update.]

Release Engineering

 * Blocking:
 * Nothing new
 * Blocked:
 * Looking for review on Phabricator ops/puppet role cleanup. See https://phabricator.wikimedia.org/T125851
 * Looking for a merge from Ops on scap3 provider changes. See https://phabricator.wikimedia.org/T127215
 * Updates:
 * See wmf.14 group1 deployment blockers https://phabricator.wikimedia.org/T125597
 * Save latency regression
 * Progress on JS-based end-to-end (browser) tests in core. See https://gerrit.wikimedia.org/r/#/c/256404/

Research

 * Blocking:
 * Nothing
 * Blocked:
 * ORES still blocked on Ops. See https://phabricator.wikimedia.org/T106867
 * Updates:
 * Reader survey test went live 16 Feb in 16:00-17:00 PST SWAT time (5:100K sampling): for QA purposes
 * Reader survey at full rate will go out 17 Feb 8:00-9:00 PST, for less than 2 weeks, at a 1:500 sampling rate: https://meta.wikimedia.org/wiki/Research:Characterizing_Wikipedia_Reader_Behaviour

Security

 * Blocking:
 * Nice to have: https://phabricator.wikimedia.org/T125382 (Maps)
 * Blocked:
 * None.
 * Updates:
 * 2FA for wikis progressing
 * Security patches

Services

 * Blocking:
 * Nobody
 * Blocked:
 * Separate AQS off of RESTBase - https://phabricator.wikimedia.org/T126294
 * need to schedule a time with Analytics Ops for the move
 * Mathoid - SVG to PNG support
 * librsvg(-dev) for Jessie
 * Updates:
 * RESTBase: dropping listing URIs (/pagr/html/, ...)
 * Cassandra multi-instance work _still_ undergoing

Technical Operations

 * Blocking:
 * ORES moving into production, finally hardware is in place
 * Blocked:
 * Nothing
 * Updates:
 * Ongoing discussions/work about the switchover goal
 * Moved with LE cxserver to jessie and node 4.2

Community Tech

 * Blocking:
 * Nothing
 * Blocked:
 * Gadgets 2.0 - blocked on ResourceLoader cache invalidation issue (Performance team) - https://gerrit.wikimedia.org/r/#/c/269901/
 * Updates:
 * PageAssessments

Discovery

 * Blocking:
 * none
 * Blocked:
 * none
 * Updates:
 * Building more analytics about user satisfaction in completion
 * TextCat merged, A/B tests to follow
 * WDQS Blazegraph 2.0 work still in progress, getting there
 * Discussing adding caching layer, for ops attention: https://phabricator.wikimedia.org/T126730
 * Discussing QuickSurvey with ops

Maps & Graphs

 * Updates
 * Kartographer (maps) launched on beta cluster, getting ready to enable it on Wikivoyage
 * VE has been helping, thanks Ed Sanders
 * Graphs can support WDQS, but might need caching (N.B. Operations)
 * Created a page-views graph - can be placed on a talk page to show corresponding view for the past N days. https://en.wikipedia.org/wiki/Template:Graph:PageViews


 * Blockers
 * Security: need SVG sanitization lib review (Security) - https://phabricator.wikimedia.org/T125382
 * Note that Performance were thinking of shipping sanitised user-provided SVGs to clients (instead of server-rendered PNGs), which would also need this functionality.
 * Are we sanitizing SVG on upload/download? Or do we always convert them in a sanbox env to PNG?
 * RIght now in production we always convert in a sandbox to PNG for normal page views, and (?) don't sanitise at all for download of the original SVG (on file pages).
 * We sanitize on upload, mostly show PNG's in articles. Raw svg's are served from upload.wm.o (untrusted domain)

Collaboration

 * Blocking:
 * Dry run patch for external store migration is merged. Now we need to set External Store up on Beta, then test the dry run patch there: https://phabricator.wikimedia.org/T119567
 * Blocked:
 * Flow dump generation on dumps.wikimedia.org: https://phabricator.wikimedia.org/T119511
 * Updates:
 * Human-readable name patch is almost done: https://phabricator.wikimedia.org/T121936
 * Will be enabling cross-wiki notifications on first set of wikis soon (https://gerrit.wikimedia.org/r/#/c/265413/)

Language

 * Blocking:
 * Apertium packages?
 * Blocked:
 * None.
 * Updates:
 * cxserver migrated to Jessie with help of Alex

Multimedia

 * Blocking:
 * None
 * Blocked:
 * Thumbor deployment blocks ImageTweaks deployment. Currently not a problem, as ImageTweaks is still rough.
 * Security review of ImageTweaks pending, not currently ready to go, would like it to happen sometime this quarter ideally - more updates coming. https://phabricator.wikimedia.org/T126492
 * Illustration metrics "blocked" but not urgent. https://phabricator.wikimedia.org/T126809 https://phabricator.wikimedia.org/T126808
 * Updates:
 * Labs instance with ImageTweaks and Thumbor currently up and running, a bit of a demo as to what's coming to the cluster. See http://multimedia-alpha.wmflabs.org/wiki/index.php/Main_Page
 * OOUI performance issues being worked on by MatmaRex, as part of UploadWizard performance improvements.

Parsing

 * Blocking:
 * None
 * Blocked:
 * None
 * Updates:
 * Work ongoing setting up mass visualdiff testing of rendering between 2 different mediawiki versions -- will appreciate help / feedback setting up mediawiki VMs (one per wiki) that closely reflects production config (extensions, skins, etc.). Currently considering vagrant, as well as manual setup (via scripts).
 * Awaiting additional reviews / merge on the path to serialize HTML while using TemplateData settings (hopefully this week) -- first round of reviewing and edits done.

VisualEditor

 * Blocking:
 * None.
 * Blocked:
 * Waiting on Design Research availability for user testing of Single Edit Tab integration
 * Updates:
 * Will release the Single Edit Tab integration to a single wiki next Tuesday (huwiki) and assess impact
 * Working with Performance on assessing the performance impact of OOUI on all read pages https://gerrit.wikimedia.org/r/#/c/271144/ – will update next week on results.
 * Otherwise, we're working on performance issues, bugs, and language support, as normal.

Fundraising Tech
No blockers, most work is continued from last week
 * Implemented updates for new CiviCRM financial tracking, filling in the last missing pieces
 * fixes and enhancements for backup credit card processor
 * prep for Latin America fundraising expansion
 * beefing up fraud filters

Android

 * Updates:
 * v2.1.141 published. Includes A/B test of readmore results.

Web

 * Updates:
 * Exploring surfacing references via API / lazy loading in web (see https://phabricator.wikimedia.org/T123328) - making headway

Reading Infrastructure

 * Nothing of note this week.