Scrum of scrums/2018-06-27

Callouts

 * Fundraising campaigns https://meta.wikimedia.org/wiki/CentralNotice/Calendar :
 * 2018-07 es, 2018-07-09 to 2018-11-11 de, 2018-07-01 to 2018-11-31 en, 2018-07-10 to 2018-12-31 de, no, he, fr, nl, da, pl, ru, uk, pt, lv, ru, ro, sk, hu, en, fr, de, zh, es
 * Multi-Content Revisions: revision storage / page update rewrite (T174024, T174038) goes live this week, RfC on further page update changes today (T198075)

iOS native app

 * Blocked by:
 * Blocking:
 * Updates:

Android native app

 * Blocked by:
 * Blocking:
 * Updates:
 * Multi-language support now in production

Readers Web

 * Blocked by:
 * Ruby to JS Cucumber refactor needs help from the RelEng team to fix our flaky Ruby tests: https://phabricator.wikimedia.org/T190710
 * Blocking:
 * Updates:
 * Mobile website (MinervaNeue / MobileFrontend):
 * Improvements to diff T197491 T197581
 * Improvements to page issues T197728 T191303
 * Investigating parser cache pollution T173949
 * Miscellaneous fixes and improvements T196947 T156186 T197273 T192725 T190549 T193517
 * Mobile navigation for advanced contributors is in planning and design https://www.mediawiki.org/wiki/Reading/Web/Advanced_mobile_contributions
 * Desktop website (Popups):
 * Miscellaneous fixes and improvements T192928 T193792 T196952 T193519
 * PDF rendering (Proton):
 * Miscellaneous fixes and improvements to concurrency and queue management T186748 T186748 T186748
 * Investigating grave kerning and spacing issues T178665
 * Quarterly goal dependency update:
 * Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
 * Reading Web depends on SRE, RelEng, Reading Infra

Readers Infrastructure

 * Blocked by: Ping RelEng for CI patch review: https://gerrit.wikimedia.org/r/#/c/integration/config/+/442126/
 * Blocking:
 * Updates:
 * Wikipedia Reading Lists extension for Safari is ready for release
 * Integration of Wikimedia Page Library in the Page Content Service is in progress — see https://gerrit.wikimedia.org/r/#/q/topic:page-lib2+(status:open+OR+status:merged)
 * Maps infrastructure handoff updates:
 * Validated loading documentation on Wikidata for new map styles (though that work is on hold)
 * TODO: Validate loading docs for existing styles on Stretch in preparation to upgrade the maps servers to Stretch (currently running Jessie); pending https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/442258/
 * Quarterly goal dependency update:
 * Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
 * Reading Web depends on SRE, RelEng, Reading Infra
 * Increase code sharing of client apps by coalescing and moving more logic to the server
 * Reading Infra depends on Parsing, Services

Maps

 * Blocked by:
 * Blocking:
 * Updates:
 * Planning on reimaging test servers to see if there are any issues running on stretch

Multimedia

 * Updates
 * Work is progressing but tied up in administrative stuff to some extent
 * Search interface prototyping currently so users can search by Wikibase properties/values
 * Also continuing work on search backend
 * Quarterly goal dependency update:
 * Objective 3.1 Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
 * SDC depends on Multimedia, SRE, WMDE, Search Platform, MediaWiki Platform, Research
 * Objective 2.1 Integrate structured file captions into search
 * SDC depends on Search Platform, Multimedia
 * Segment 4, Outcome 2: Develop a better understanding of existing needs for Structured Commons- T171252
 * Research depends on Multimedia

Community Tech

 * Blocked by:
 * Blocking:
 * Updates:
 * Nothing new to report

Anti-Harassment Tools

 * Blocked by:
 * Blocking:
 * Updates:

Editing

 * Blocked by:
 * Blocking:
 * Updates:

Parsing

 * Blocked by:
 * Blocking:
 * Updates:
 * Language variants endpoint in production -- selectively exposed for some languages by the REST API on the RESTBase end.
 * Tidy -> RemexHtml on track for July 5th completion
 * Quarterly goal dependency update:
 * Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
 * Parsing depends on MediaWiki Platform, Services
 * Increase code sharing of client apps by coalescing and moving more logic to the server
 * Reading Infra depends on Parsing, Services
 * Outcome 2: Objective 1: Revision storage scaling
 * Services depends on SRE, Parsing

Collaboration

 * Blocked by:
 * Blocking:
 * Updates:

Language

 * Blocked by: Editing: https://phabricator.wikimedia.org/T196136 (and T191011)
 * Blocking:
 * Updates:
 * Continue work on ContentTranslation v2.
 * CX draft purge dry-run this week, actual run next week (Monday)
 * Quarterly goal dependency update:
 * Goal 3.1 Improve and consolidate our unified editing platform so that it's great on all devices
 * Language depends on Editing

UI Standardization

 * Blocked by:
 * Blocking:
 * Updates:
 * OOUI – v0.27.4 special release last Thu https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v0.27.4
 * 3 style, 16 code and 2 accessibility improvements. Highlights:
 * Refactor how we apply `display: none` to unused icons and indicators (Bartosz Dziewoński)
 * FieldLayout: Add `for` attribute to inline help label (Prateek Saxena)
 * PopupWidget: Listen to 'click' for 'mousedown' events in iOS (Moriel Schottlender)
 * styles: Remove proprietary IE 8 & 9 `-ms-filter` properties (Volker E.)
 * Continuing work on Design Style Guide

Analytics

 * Blocked by:
 * Blocking:
 * Updates:
 * New UI work on wikistats. Bookmarks for graphs are deployed, see for example new registered users for Arabic wikipedia: https://stats.wikimedia.org/v2/#/ar.wikipedia.org/contributing/new-registered-users/normal|bar|2-Year~2016050100~2018061900|~total
 * Looks like we might be able to move forward in the outstanding privacy conversation of what to do with AppInstallID (the token that identifies wikipedia app install on a phone)
 * We will be working with security to do a threat model of analytics infrastructure next quarter
 * JSONSchema vs Avro RFC submitted for Modern Event Platform program: https://phabricator.wikimedia.org/T198256

Cloud Services

 * Blocked by:
 * Blocking:
 * Updates:

Fundraising Tech

 * Blocked by:
 * Blocking:
 * Updates:
 * Off-site this week with the advancement teams

MediaWiki Platform
T174022 Implement multi-content revisions, T174023 Implement MCR storage layer, T174045 DB schema migration for MCR, T174044 Deploy MCR storage layer, T174043Deploy Multi-Content Revisions
 * Blocked by:
 * Blocking:
 * Updates:
 * Quarterly goal dependency update:
 * Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
 * Parsing depends on MediaWiki Platform, Services
 * Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
 * SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
 * Objective 1.1 Assist with deploying MultiContent Revisions on Commons
 * Objective 1.1 Assist with deploying MultiContent Revisions on Commons
 * SDC depends on MediaWiki Platform, WMDE

Performance

 * Blocked by:
 * None
 * Blocking:
 * SRE (Aaron has work to do to finish the mcrouter rollout, everyone is aware)
 * Updates:
 * Offsite last week
 * Nifty blog post: https://techblog.wikimedia.org/2018/06/22/mobile-web-performance-the-importance-of-the-device/
 * Updating some dashboards to tighten down alerts
 * Perf perception survey continues
 * Continuing to split out mediawiki base to push jQuery load back, expect that to land this week sometime

Release Engineering

 * Blocked by:
 * Blocking:
 * readers web
 * will review https://gerrit.wikimedia.org/r/c/integration/config/+/442126
 * Updates:
 * FYI: Release Engineering will start including Europeans in our train rotation meaning that the MW Train will now include European appropriate windows for those weeks. Exact schedule TBA to wikitech-l@, ops@, engineering@, and @wikitech-ambassadors@
 * Quarterly goal dependency update:
 * Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
 * Reading Web depends on SRE, RelEng, Reading Infra

Research

 * Blocked by:
 * Blocking:
 * Updates:
 * Added Arabic and RLT support to the Gapfinder tools project.: http://gapfinder-tools.wmflabs.org/
 * Done with training models for translation recommendation: https://github.com/wikimedia/research-translation-recommendation-models/
 * Collecting data for Schema:CitationUsage starting tomorrow.
 * Quarterly goal dependency update:
 * Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
 * SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
 * Segment 4, Outcome 2: Develop a better understanding of existing needs for Structured Commons- T171252
 * Research depends on Multimedia

Scoring Platform

 * Blocked by:
 * Blocking:
 * Updates:

Search Platform

 * Blocked by:
 * Blocking:
 * Updates:
 * Added analysis chain for Mirandese: https://phabricator.wikimedia.org/T197890
 * Finished analysis chain for Esperanto: https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Esperanto_Stemmer_Analysis
 * Added Lexeme to instant indexing setup: https://phabricator.wikimedia.org/T196896
 * Fixed a number of bugs in WDQS MWAPI: https://phabricator.wikimedia.org/T197495 https://phabricator.wikimedia.org/T197496
 * Started preparation to upgrade to ElasticSearch 6.3: https://phabricator.wikimedia.org/T198067
 * Working on Lexeme fulltext search: https://phabricator.wikimedia.org/T196188
 * Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108
 * Quarterly goal dependency update:
 * Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
 * SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
 * *Objective 2.1 Integrate structured file captions into search
 * SDC depends on Search Platform, Multimedia

Security

 * Blocked by:
 * Blocking:
 * Updates:
 * Quarterly goal dependency update:
 * Goal 3.6: Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
 * Parsing depends on MediaWiki Platform, Services
 * Parsing depends on MediaWiki Platform, Services

Services
Not attending in person today Outcome 2: Objective 1: Revision storage scaling
 * Blocked by: none
 * Blocking: none as we know
 * Updates:
 * JobQueue migration completed. No need for Redis queue any more, so far so good
 * Language variants support in REST API is coming soon, working with clients to
 * Quarterly goal dependency update:
 * Increase code sharing of client apps by coalescing and moving more logic to the server.
 * Reading Infra/Parsing, Services
 * Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
 * Parsing depends on MediaWiki Platform, Services
 * Services depends on SRE, Parsing

Site Reliability Engineering

 * Blocked by:
 * None
 * Blocking:
 * Readers web on proton. Should be unblocked this week.
 * Updates:
 * Back from SRE offsite, no updates
 * Quarterly goal dependency update:
 * Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption
 * Reading Web depends on SRE, RelEng, Reading Infra
 * The service is after some changes done this and last week seems in a better shape to withstand the monitoring load. Next step is to pool it in LVS and make it available.
 * Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
 * SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
 * Outcome 2: Objective 1: Revision storage scaling
 * Services depends on SRE, Parsing

Wikidata

 * Blocked by:
 * Blocking:
 * Updates:
 * Quarterly goal dependency update:
 * Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
 * SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
 * Objective 1.1 Assist with deploying MultiContent Revisions on Commons
 * T174022 Implement multi-content revisions, T174023 Implement MCR storage layer, T174045 DB schema migration for MCR, T174044 Deploy MCR storage layer, T174043Deploy Multi-Content Revisions
 * SDC depends on MediaWiki Platform, WMDE
 * SDC depends on MediaWiki Platform, WMDE

German Technical Wishlist

 * Blocked by:
 * Blocking:
 * Updates:

Multi-Content Revisions

 * Blocked by:
 * Blocking:
 * Updates:
 * page update / revision storage refactoring goes live this week:
 * https://gerrit.wikimedia.org/r/c/mediawiki/core/+/405015
 * https://gerrit.wikimedia.org/r/c/mediawiki/core/+/406595
 * https://gerrit.wikimedia.org/r/c/mediawiki/core/+/416465
 * RfC on future steps of page update refactoring today: https://phabricator.wikimedia.org/T198075
 * new revision schema will be enabled on beta soon (this week or next): https://phabricator.wikimedia.org/T197818

SoS Meeting Bookkeeping

 * Updates: