Scrum of scrums/2018-05-30

=2018-05-30=

Callouts

 * From last week, all WIndows NT operating systems are under the "Windows" os family in analytics metrics
 * Security: Security review for Wikidata queries data release proposal https://phabricator.wikimedia.org/T190875

iOS native app

 * Blocked by:
 * Blocking:
 * Updates:
 * Continuing work on tech debt release, 5.8.2 ( https://phabricator.wikimedia.org/project/view/3358/ )
 * Starting work on next major release, 5.9 ( https://phabricator.wikimedia.org/project/view/3238/ )

Android native app

 * Blocked by:
 * Blocking:
 * Updates:
 * Released maintenance update to production (improvements to reading list syncing / fix no-such-project errors)
 * Finalizing multilingual features based on user testing at Hackathon -- on track for release in ~1 week.

Readers Web

 * Blocked by:
 * Blocking:
 * Updates:
 * Quarterly goal dependency update:
 * Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
 * Reading Web depends on SRE, RelEng, Reading Infra

Readers Infrastructure

 * No updates this week.


 * Quarterly goal dependency update:
 * Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
 * Reading Web depends on SRE, RelEng, Reading Infra
 * Increase code sharing of client apps by coalescing and moving more logic to the server
 * Reading Infra depends on Parsing, Services

Maps

 * Blocked by:
 * Blocking:
 * Updates:

Multimedia

 * Blocked by:
 * Blocking:
 * Updates:
 * Looking into OOUI migration for Wikibase per discussions at the hackathon/elsewhere
 * UploadWizard work for multilingual captions pretty much complete
 * Indexing wikibase statements (searchable via haswbstatement:XXXX), work continues on quantities


 * Quarterly goal dependency update:
 * Objective 3.1 Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
 * SDC depends on Multimedia,SRE, WMDE, Search Platform, MediaWiki Platform, Research
 * Objective 2.1 Integrate structured file captions into search
 * SDC depends on Search Platform, Multimedia
 * Segment 4, Outcome 2: Develop a better understanding of existing needs for Structured Commons- T171252
 * Research depends on Multimedia

Community Tech

 * Blocked by:
 * Blocking:
 * Updates:
 * Working on PageTriage improvements

Anti-Harassment Tools

 * Blocked by:
 * Blocking:
 * Updates:
 * Working on Blocking Tools

Editing

 * Blocked by:
 * Blocking:
 * Updates:
 * None

Parsing

 * Blocked by:
 * Blocking:
 * Updates:
 * Tidy -> RemexHtml: final switch planned for June 27th / July 11th

Increase code sharing of client apps by coalescing and moving more logic to the server. Outcome 2: Objective 1: Revision storage scaling
 * Quarterly goal dependency update:
 * Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
 * Parsing depends on MediaWiki Platform, Services
 * Increase code sharing of client apps by coalescing and moving more logic to the server
 * Reading Infra depends on Parsing, Services
 * Services depends on SRE, Parsing

Collaboration

 * Blocked by:
 * Blocking:
 * Updates:
 * Patches to solve most of Echo's multi-DC incompatibilities now awaiting review https://phabricator.wikimedia.org/T164860
 * Deleted Echo's rspec tests to unbreak CI

Language

 * Blocked by:
 * Blocking:
 * Updates:


 * Quarterly goal dependency update:
 * Goal 3.1 Improve and consolidate our unified editing platform so that it's great on all devices
 * Language depends on Editing

UI Standardization

 * Blocked by:
 * Blocking:
 * Updates:
 * OOUI – v0.27.1 released yesterday: https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v0.27.1
 * 1 deprecation in this release. Additionally 9 style amendments, 9 code & 2 accessibility improvement. Among those
 * Toolbar: Add a required 'name' property to toolgroup configs; deprecating change (Ed Sanders)
 * Clarify and align TabSelectWidget focus (Volker E.) https://phabricator.wikimedia.org/T194863
 * Allow dropdown menus to be larger than their handles (Ed Sanders) https://phabricator.wikimedia.org/T195257
 * Continuing work on Design Style Guide, this week starting 'Resources' page with all repo resources
 * Continuing work on a minor UI/UX issues in AdvancedSearch with WMDE team

Analytics

 * Blocked by:
 * Blocking:
 * Updates:
 * Updated user agent string parsing regexes in eventlogging and refinery
 * Migrated zookeeper to new hardware
 * Migrating druid to debian stretch, should be finished this week
 * Revision score now available in eventstreams

Cloud Services

 * Blocked by:
 * Blocking:
 * Updates:

Fundraising Tech

 * Blocked by:
 * Blocking:
 * Updates:
 * Working on getting Ingenico Connect API campaign ready.
 * Still working on backend pipeline for CentralNotice EventLogging stats
 * Working on a Donor Deletion tool for Civi in response to GDPR

MediaWiki Platform
T174022 Implement multi-content revisions, T174023 Implement MCR storage layer, T174045 DB schema migration for MCR, T174044 Deploy MCR storage layer, T174043Deploy Multi-Content Revision
 * Blocked by:
 * Blocking:
 * Updates:
 * MCR:
 * ar_rev_id deduplication is merged and maintenance script has been run
 * API "templated parameters" patch was merged
 * TemplateStyles:
 * Implemented a feature request.
 * An enwiki RFC about enabling it as soon as Remex is enabled there is passing.
 * MediaWiki core master now requires PHP 7.0 or HHVM
 * MediaWiki-CodeSniffer 19.0.0 and 20.0.0 released, to allow for safe PHP 7 features to be used
 * Bug triage and fixes for MassMessage and GlobalUserPage
 * Finished development of "CoverMe": https://tools.wmflabs.org/coverme/ (https://blog.legoktm.com/2018/05/29/introducing-coverme-find-the-most-called-mediawiki-code-lacking-test-coverage.html)
 * Deployed postgres in CI, filed T195807 for failures
 * Work towards PSR-4 in MediaWiki core, including enabling PSR-4 autoloader for more directories, and implementing a structure test to validate PSR-4 compliance
 * Hackathon projects:
 * MySQL client wrapper to replace "sql" shell script: https://gerrit.wikimedia.org/r/#/c/434188/
 * Refactor API parameter validation: https://gerrit.wikimedia.org/r/q/topic:%2522bug%252FT142080-api-param-validation%2522+(status:open+OR+status:merged)
 * Script to import Phabricator task information into a wiki: https://gerrit.wikimedia.org/r/#/c/433919/
 * The usual code review and bug work
 * Quarterly goal dependency update:
 * Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
 * Parsing depends on MediaWiki Platform, Services
 * Planning underway for next FY Platform Evolution program
 * Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
 * SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
 * MCR capabilities in active development
 * Objective 1.1 Assist with deploying MultiContent Revisions on Commons


 * SDC depends on MediaWiki Platform, WMDE
 * MCR capabilities in active development

Performance

 * Blocked by:
 * Blocking: Readers Web (review of CitationUsage) - will be done this week
 * Updates:
 * performance perception survey live on several wikis
 * Trialing mobile performance testing on SauceLabs device lab
 * More fixes to ChronologyProtector
 * Still pulling jQuery deps out of base javascript modules
 * Bunch of resourceloader bug fixes
 * mcrouter expected to be ready in prod this week, will test on testwiki next week

Release Engineering

 * Blocking
 * Blocked
 * Updates
 * Train status: https://phabricator.wikimedia.org/T191051
 * 1.32.0-wmf.5 got held up last week by an incident that happened during the scheduled Thursday train deployment window.
 * https://wikitech.wikimedia.org/wiki/Incident_documentation/20180524-wikidata
 * We should be back on track this week, wmf.5 is clear of blockers and wmf.6 should be rolling out as usual
 * https://wikitech.wikimedia.org/wiki/Incident_documentation/20180524-wikidata
 * We should be back on track this week, wmf.5 is clear of blockers and wmf.6 should be rolling out as usual


 * Quarterly goal dependency update:
 * Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
 * Reading Web depends on SRE, RelEng, Reading Infra

Research

 * Blocked by: Performance: https://gerrit.wikimedia.org/r/#/c/432534/
 * Blocking: None
 * Updates:
 * Deploying the gapfinder-tools app and gathering section mappings.
 * Have been gathering synonym mappings.
 * Analyzed the first incoming labels from WikiLabels citations campaign


 * Quarterly goal dependency update:
 * Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
 * SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
 * Segment 4, Outcome 2: Develop a better understanding of existing needs for Structured Commons- T171252
 * Research depends on Multimedia

Scoring Platform

 * Blocked by:
 * Blocking:
 * Updates:

Search Platform

 * Blocked by: Security: https://phabricator.wikimedia.org/T190875
 * Blocking:
 * Updates:
 * Wikidata reindexed and now external ID and string properties can be searched for with haswbstatement keyword
 * Deep category search enabled on all wikis except private ones: https://phabricator.wikimedia.org/T194260
 * all: keyword enabled on all wikis: https://phabricator.wikimedia.org/T165110
 * Exploring ideas for applying NLP to search: https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Potential_Applications_of_Natural_Language_Processing_to_On-Wiki_Search
 * Looking into fixing regex highlighting that does not time out as expected: https://phabricator.wikimedia.org/T195491
 * Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108
 * Working on Polish analyzer: https://phabricator.wikimedia.org/T186046
 * Working on fulltext search for Lexemes


 * Quarterly goal dependency update:
 * Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
 * SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
 * *Objective 2.1 Integrate structured file captions into search
 * SDC depends on Search Platform, Multimedia

Security

 * Blocked by:
 * Blocking:
 * Updates:


 * Quarterly goal dependency update:
 * Goal 3.6: Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
 * Parsing depends on MediaWiki Platform, Services

Services

 * Blocked by:
 * Parsing on language variants transformation support
 * Echo on non JSON-serializable job https://phabricator.wikimedia.org/T192945
 * Who knows who's resonsible for GWToolset extension? It has non-json-serializable job https://phabricator.wikimedia.org/T192946
 * Blocking: none?
 * Updates:
 * Kafka queue enabled for all jobs everywhere except some exceptions and cirrus search
 * revision-score event exposed via event streams

Outcome 2: Objective 1: Revision storage scaling
 * Quarterly goal dependency update:
 * Increase code sharing of client apps by coalescing and moving more logic to the server.
 * Reading Infra/Parsing, Services
 * Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
 * Parsing depends on MediaWiki Platform, Services
 * Services depends on SRE, Parsing

Site Reliability Engineering

 * Blocked by:
 * Collaboration for flow, T172025
 * Blocking:
 * None
 * Updates:
 * Had a wikidata outage https://wikitech.wikimedia.org/wiki/Incident_documentation/20180524-wikidata
 * row C move+upgrade went quite well
 * mcrouter to be deployed this week

Outcome 2: Objective 1: Revision storage scaling
 * Quarterly goal dependency update:
 * Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
 * Reading Web depends on SRE, RelEng, Reading Infra
 * Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
 * SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
 * Services depends on SRE, Parsing

Wikidata
T174022 Implement multi-content revisions, T174023 Implement MCR storage layer, T174045 DB schema migration for MCR, T174044 Deploy MCR storage layer, T174043Deploy Multi-Content Revisions
 * Blocked by:
 * Blocking:
 * Updates:
 * Quarterly goal dependency update:
 * Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
 * SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
 * Objective 1.1 Assist with deploying MultiContent Revisions on Commons
 * SDC depends on MediaWiki Platform, WMDE

German Technical Wishlist

 * Blocked by:
 * Blocking:
 * Updates:

SoS Meeting Bookkeeping

 * Updates: