Scrum of scrums/2018-04-18

= 2018-04-18 =

Callouts

 * Fundraising campaigns https://meta.wikimedia.org/wiki/CentralNotice/Calendar - Netherlands 2018-04-03 through 2018-05-01
 * Analytics: we added trash folder to hadoop to “aid” in case of accidental deletions of data in cluster.
 * Need help from RelEng with WDQS GUI build automation: https://phabricator.wikimedia.org/T189811
 * Research: In the next two/three weeks we'll be collecting citation usage data via EventLogging: https://phabricator.wikimedia.org/T191086 and https://meta.wikimedia.org/wiki/Schema:CitationUsage. cc Reading Infrastructure, Adam Baso, Security, Legal, Analytics.
 * Phabricator: Create tasks with a Deadline date/time which is displayed on workboards: https://phabricator.wikimedia.org/maniphest/task/edit/form/37/

iOS native app

 * Blocked by:
 * Blocking:
 * Updates:

Android native app

 * Blocked by:
 * Blocking:
 * Updates:
 * Reading lists at 10% production, full rollout pending regression tests and finalizing marketing materials.

Readers Web

 * Blocked by:
 * Blocking:
 * Updates:

Readers Infrastructure

 * Blocked by:
 * Blocking:
 * Updates:

Maps

 * Blocked by:
 * Blocking:
 * Updates:

Multimedia

 * Blocked by:
 * Blocking:
 * Updates:

Community Tech

 * Blocked by:
 * Blocking:
 * Updates:
 * GlobalPreferences, CodeMirror, TemplateWizard

Anti-Harassment Tools

 * Blocked by: None
 * Blocking: None
 * Updates:
 * Improving block notices on mobile
 * Adding cookie blocking for anonymous users

Editing

 * Blocked by:
 * Blocking:
 * Updates:

Parsing

 * Blocked by:
 * Blocking:
 * Updates:

Collaboration

 * Blocked by:
 * Blocking:
 * Updates:

Language

 * Blocked by:
 * Blocking:
 * Updates:

Audiences Design

 * Blocked by:
 * Blocking:
 * Updates:

UI Std

 * Blocked by:
 * Blocking:
 * Updates:
 * OOUI – v0.26.4 released: https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v0.26.4
 * One hotfix, that has already made it to MW1.31 before, one keyboard accessibility improvement
 * Continued work on icon/size unification aftermath in different products (Notifications, Flow, RevisionSlider)
 * Style Guide technical and contents improvements ongoing with 2 open PRs currently
 * Transforming core/extensions to use OOUI, 6 extensions accomplished last week, build on strong volunteer support

Analytics
- Monitoring the launch of the page previews, currently working on the aggregation job. - Done with updates to jupyter notebooks for now - Issues with pageviews from Opera Mini not geo locating correctly in Africa are now resolved. - Fnishing new geowiki infrastructure before we turn off the old jobs that calculated this data (editors per country). - Google Summer of Code, plenty Code Reviews for contributions to Wikistats UI: http://stats.wikimedia.org/v2
 * Blocked by:
 * Blocking:
 * Updates:

Cloud Services

 * Blocked by:
 * Blocking:
 * Updates:

Fundraising Tech

 * Blocked by:
 * Blocking:
 * Updates:
 * Working on new recurring contribution API for main card processor
 * Debugging CN patch deploy to add CSP headers on banner preview
 * CiviCRM: Work on exports, fixing custom fields, new fraud-hunter's report
 * Working on getting landing page and banner impression EventLogging data into payments cluster DBs

MediaWiki Platform

 * Blocked by:
 * Blocking:
 * Updates:

Performance

 * Blocked by: None
 * Blocking: None
 * Updates:
 * Moving our apps/etc out of puppet, to scap deploy
 * Blog post on Singapore DC should be up shortly, been working on that with Traffic
 * Lots of CRs
 * working with RelEng/Platform on a few changes to CI and to MW Core
 * mcrouter is now deployed in deployment-prep, next steps are to configure, and working with SRE to figure out how to do cross-DC correctly.
 * Trying out Digital Ocean for WebPageTest (got free credits from them)

Release Engineering

 * Blocking
 * Working on Scap 3.8.0 to unblock ores git-lfs deployments.
 * Blocked
 * n/a
 * Updates
 * Deadlines in phabricator are now visible on workboards.

Research

 * Blocked by:
 * None
 * Blocking:
 * None
 * Updates:
 * In the next two/three weeks we'll be collecting citation usage data via EventLogging: https://phabricator.wikimedia.org/T191086 and https://meta.wikimedia.org/wiki/Schema:CitationUsage. cc Reading Infrastructure, Adam Baso, Security, Legal, Analytics.

Scoring Platform

 * Blocked by:
 * Blocking:
 * Updates:
 * Waiting on the scap deployment to unblock us from git-lfs--it works on beta :) (Almost there! Thanks Releng!)*
 * Virtualenv is now cached with deployments (so that we can quickly rollback)
 * This is relevant for anyone who is deploying a python service with virualenvs as they might want to follow our lead
 * New, dynamic table with ORES support status.
 * https://tools.wmflabs.org/ores-support-checklist/

Search Platform

 * Blocked by:
 * Blocking:
 * Updates:
 * Need help with WDQS GUI build automation: https://phabricator.wikimedia.org/T189811
 * Selenium Wikibase tests still broken: https://phabricator.wikimedia.org/T189762
 * Job queue issues fix merged: https://phabricator.wikimedia.org/T191024 https://phabricator.wikimedia.org/T190958
 * Lexeme completion search merged: https://phabricator.wikimedia.org/T190970 Continuing work on Forms support
 * Evaluating feature generation by `query_explorer` functionality of LTR plugin: https://phabricator.wikimedia.org/T187148
 * Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108

Security

 * Blocked by:
 * Blocking:
 * Updates:

Services

 * Blocked by:
 * search with CirrusSearch job JSON serialization T191024 (Not any more according to Stas :)
 * language with Translate job JSON serialization T192111


 * Blocking: none?
 * Updates:
 * There was an issue with wikidata recent changes job, resolved no
 * EventBus (and kafka job queue) going to private wikis this week
 * Cassandra 3.11.2 evaluation

Site Reliability Engineering

 * Blocked by:
 * None
 * Blocking:
 * None
 * Updates:
 * ICU57 migration completed on all wikis
 * Work started on upgrading all mediawiki application servers to Debian Stretch
 * The image scalers have been decommissioned (thumbor provides fully that fuctionality now)
 * mcrouter is being tested and are going to post an architecture proposal for review
 * Discussions on establishing a timeline for deprecation of non-forward-secret ciphers and TLSv1.0 started
 * Proton discussions came to a result on hosting this on 2 ganeti VMs per datacenter, will be resolved this week
 * helm charts repo published https://releases.wikimedia.org/charts

Wikidata

 * Blocked by:
 * Blocking:
 * Updates:
 * Send thanks to John and the security team for the quick response they gave us for our security review for our coming release
 * Lexeme will be released on May 23rd
 * wb_terms fire fighting is stopping, strategy work starts now how to get ourselves out of the situation properly and in a way we can scale

German Technical Wishlist

 * Blocked by:
 * Blocking:
 * Updates:
 * MediaWiki CodeSniffer performance improvements already released as version 18, thanks Lego!
 * Backported a fix in a 10 year old File export/import util, please watch for positive/negative consequences if this sounds familiar: https://gerrit.wikimedia.org/r/426959
 * Final 2 sprints working on MoveFilesToCommons: https://phabricator.wikimedia.org/tag/move-files-to-commons/
 * DeepCategory integration in AdvancedSearch: https://phabricator.wikimedia.org/T170533

SoS Meeting Bookkeeping

 * Updates: