Scrum of scrums/2018-04-25

Callouts

 * Fundraising campaigns https://meta.wikimedia.org/wiki/CentralNotice/Calendar - next up: Netherlands 2018-04-03 through 2018-05-01
 * RelEng could use some help to get rebuildLocalisationCache.php back up-to-normal speed -- if you have experience with hhvm internals/cli-options: https://phabricator.wikimedia.org/T191921

iOS native app

 * Blocked by:
 * Blocking:
 * Updates:
 * Released 5.8 with Reading Lists, now working on a point release (https://phabricator.wikimedia.org/tag/ios-app-v5.8.1-manatee-on-a-scootscoot/)
 * Joe to return next week (4/30)

Android native app

 * Blocked by:
 * Blocking:
 * Updates:
 * Released Reading list syncing!

Readers Web

 * Blocked by:
 * Blocking:
 * Updates:
 * Page previews enwiki launch
 * Post-launch page preview bug fixes and clean up https://phabricator.wikimedia.org/T192622
 * Starting page issues work https://phabricator.wikimedia.org/T159262
 * Planning for MobileFrontend & MinervaNeue frontend architecture improvements https://www.mediawiki.org/wiki/Reading/Web/Projects/Invest_in_the_MobileFrontend_%26_MinervaNeue_frontend_architecture
 * Fixing mobile watchlist bugs https://phabricator.wikimedia.org/T191454
 * Quarterly goal dependency update:
 * Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption https://phabricator.wikimedia.org/T181079
 * Reading Web depends on SRE, RelEng, Reading Infra

Readers Infrastructure

 * Blocked by:
 * Blocking:
 * Updates:
 * CSS endpoints rolled out (https://en.wikipedia.org/api/rest_v1/#!/Mobile/get_data_css_mobile_site)
 * Added Bosnian Wikipedia to supported wikis for featured article, In-the-news, and On-This-Day
 * Working on simplistic browser extension to add the current page to the default reading list (for logged in users)
 * Quarterly goal dependency update:
 * Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption https://phabricator.wikimedia.org/T181079
 * Reading Web depends on SRE, RelEng, Reading Infra
 * Increase code sharing of client apps by coalescing and moving more logic to the server
 * Reading Infra depends on Parsing, Services

Maps

 * Blocked by: None
 * Blocking: None
 * Updates:
 * Work being done by collab team
 * Paul is out next scrum of scrums

Multimedia

 * Updates
 * Wikibase patches for file page prototype going through
 * Search work continuing for 'depicts'
 * File captions - currently working through changing the name of the field for MediaInfo
 * Quarterly goal dependency update:
 * Objective 3.1 Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
 * SDC depends on Multimedia,SRE, WMDE, Search Platform, MediaWiki Platform, Research
 * Objective 2.1 Integrate structured file captions into search
 * SDC depends on Search Platform, Multimedia
 * Segment 4, Outcome 2: Develop a better understanding of existing needs for Structured Commons- T171252
 * Research depends on Multimedia

Community Tech

 * Blocked by:
 * Blocking:
 * Updates:
 * Just like last week: GlobalPreferences, CodeMirror, TemplateWizard

Anti-Harassment Tools

 * Blocked by:
 * Blocking: None
 * Updates: None
 * Updating Block Notices on Mobile https://phabricator.wikimedia.org/T165535
 * Adding Cookie Blocking to IP Users https://phabricator.wikimedia.org/T152462

Editing

 * Blocked by:
 * Blocking:
 * Updates:

Parsing

 * Blocked by:
 * Blocking:
 * Updates:
 * We are considering removing newline stripping in image captions. See https://gerrit.wikimedia.org/r/#/c/425726/
 * In https://phabricator.wikimedia.org/T192037 we are beginning to make wikitext handling a bit more uniform across extensions and outside extensions, so there are fewer surprises / edge cases. That is yet to be flushed out, but is an advance heads up.
 * Tidy removal is going apace -- another 40+ wikis will switch next week.

Increase code sharing of client apps by coalescing and moving more logic to the server.
 * Quarterly goal dependency update:
 * Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
 * Parsing depends on MediaWiki Platform, Services
 * Increase code sharing of client apps by coalescing and moving more logic to the server


 * Reading Infra depends on Parsing, Services

Outcome 2: Objective 1: Revision storage scaling phab task ?
 * Services depends on SRE, Parsing

Collaboration

 * Blocked by:
 * Blocking:
 * Updates:
 * Localized maps deployed on testwiki and test2wiki, announcement coming soon
 * Test page: https://test2.wikipedia.org/wiki/Map_internationalization_examples
 * Going to deploy to English Wikipedia on April 30th https://phabricator.wikimedia.org/T191584

Language

 * Blocked by: None
 * Blocking: None
 * Updates:
 * Quarterly goal dependency update:
 * Goal 3.1 Improve and consolidate our unified editing platform so that it's great on all devices
 * Language depends on Editing
 * Language depends on Editing

UI Standardization

 * Blocked by:
 * Blocking:
 * Updates:
 * OOUI – v0.26.5 released: https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md;v0.26.5
 * 5 style changes, 5 code improvements. Among those
 * De-emphasize toolgroup borders in order to visually de-clutter VE toolbar
 * PopupTool: Set active state depending on whether popup is open, again a change with visual impact, providing better user-friendliness
 * Toolbar: Put all popups (from PopupToolGroup and PopupTool) into an overlay. https://phabricator.wikimedia.org/T192505
 * DateTimeInputWidget has been aligned to other WikimediaUI widgets https://phabricator.wikimedia.org/T189352
 * Style Guide technical and content improvements ongoing with 6 open PRs currently
 * Transparency Report now fully conformant to WCAG 2.0 level AA

Analytics

 * Blocked by:
 * Blocking:
 * Updates:
 * Wikistats outage: bad data load led to a couple of days of unstable data, found the problems and rolled back, will update again soon, numbers are good now but missing 2018-03
 * Wikistats is a little more mobile touch friendly, hover interaction a little better in general
 * Wikistats titles and meta tags are now more SEO-friendly
 * Spark 2 is now the default spark experience on the cluster
 * lots of prep work for the Kafka cluster upgrade, already started updating some of the machines, monitoring, etc.
 * page preview aggregate data is available now in a Hive table
 * fixed wmf.mediawiki_user_history and wmf.mediawiki_page_history tables (they had bad column names which led to null values)
 * fixed pagecounts-ez and mediacounts datasets outage problem

Cloud Services

 * Blocked by:
 * Blocking:
 * Updates:

Fundraising Tech

 * Blocked by:
 * Blocking:
 * Updates:
 * DonationInterface: new recurring contribution API for main card processor
 * CiviCRM: Debugging nasty transaction handling failures
 * Working on getting landing page and banner impression EventLogging data into payments cluster DBs

MediaWiki Platform
T174022 Implement multi-content revisions, T174023 Implement MCR storage layer, T174045 DB schema migration for MCR, T174044 Deploy MCR storage layer, T174043 Deploy Multi-Content Revisions
 * Blocked by:
 * Blocking:
 * Updates:
 * Quarterly goal dependency update:
 * Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
 * Parsing depends on MediaWiki Platform, Services
 * Prepare for launch of the first Structured Data on Commons feature (multilingual file captions) phab task ?
 * SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
 * Objective 1.1 Assist with deploying MultiContent Revisions on Commons
 * Objective 1.1 Assist with deploying MultiContent Revisions on Commons
 * SDC depends on MediaWiki Platform, WMDE

Performance

 * Blocked by:
 * None
 * Blocking:
 * None
 * Updates:
 * Good progress consolidating our tools, getting them out of puppet
 * Rolling out a tool called PerformanceInspector over the next couple of weeks -- will allow community members to get a bunch of performance data about pages on the wikis
 * Doing some optimizations of ResourceLoader
 * Making some fixes to MW Core to prep for PHP7
 * Refactoring Varnish logging stuff to use mtail instead of a couple of deprecated varnish tools
 * mcrouter is now being used in deployment-prep
 * WebPageTest fully migrated over to Linux hosts

Release Engineering

 * Blocked by:
 * rebuildLocalisationCache.php/localization update rebuilds are taking 40 minutes for full scaps (used to take 8minutes)
 * See: https://phabricator.wikimedia.org/T191921 if you have hhvm internals help to give :)
 * Blocking:
 * none?
 * Updates:
 * 1.32.0-wmf.1 is going out this week, wmf.30 was finally completed Monday
 * Scap MediaWiki canary changes using service-check (hopefully live Soon™, working in beta)
 * Quarterly goal dependency update:
 * No updates from us (if something specific needed from us, ping us!) Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption https://phabricator.wikimedia.org/T181079
 * Reading Web depends on SRE, RelEng, Reading Infra

Research

 * Blocked by: None
 * Blocking: None
 * Updates:
 * Quarterly goal dependency update:
 * Prepare for launch of the first Structured Data on Commons feature (multilingual file captions) phab task ?
 * SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
 * Segment 4, Outcome 2: Develop a better understanding of existing needs for Structured Commons- T171252
 * Research depends on Multimedia
 * Most of the teams is at the Web Conference https://www2018.thewebconf.org/

Scoring Platform

 * Blocked by:
 * Blocking:
 * Updates:

Search Platform

 * Blocked by:
 * Blocking:
 * Updates:
 * New analysis plugin deployed: https://phabricator.wikimedia.org/T189239 enabling Serbian and in the future other stemmers
 * Slovak stemmer added, deploy & reindexing next: https://phabricator.wikimedia.org/T190815
 * Some fixes for deep category search: https://phabricator.wikimedia.org/T192270, https://phabricator.wikimedia.org/T188350
 * Wikibase Lexeme search patches merged
 * Internal WDQS cluster installed, switching traffic to it soon: https://phabricator.wikimedia.org/T192942
 * Working on indexing external IDs and string properties for Wikibase: https://phabricator.wikimedia.org/T99899
 * Evaluating feature generation by `query_explorer` functionality of LTR plugin: https://phabricator.wikimedia.org/T187148
 * Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108
 * WDQS GUI automatic build moving along, thanks RelEng: https://phabricator.wikimedia.org/T189811
 * Quarterly goal dependency update:
 * Prepare for launch of the first Structured Data on Commons feature (multilingual file captions) phab task ?
 * SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
 * *Objective 2.1 Integrate structured file captions into search
 * SDC depends on Search Platform, Multimedia

Security

 * Blocked by:
 * Blocking:
 * Updates:
 * Quarterly goal dependency update:
 * Goal 3.6: Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
 * Parsing depends on MediaWiki Platform, Services
 * Parsing depends on MediaWiki Platform, Services

Services
Outcome 2: Objective 1: Revision storage scaling phab task ?
 * Blocked by: Several job serialization tasks, will talk to owners of the said jobs
 * Blocking: none
 * Updates:
 * Enabled support for EventBus and kafka job queue for private wikis
 * Replaced SSDs on restbase1010, rebootstrapped cassandra there
 * CSS endpoint for reading infra deployed
 * Quarterly goal dependency update:
 * Increase code sharing of client apps by coalescing and moving more logic to the server.
 * Reading Infra/Parsing, Services
 * Goal 3.6 Support work towards unifying MediaWiki's parser implementations, in liaison with Technology's MediaWiki team
 * Parsing depends on MediaWiki Platform, Services
 * Services depends on SRE, Parsing

Site Reliability Engineering
Outcome 2: Objective 1: Revision storage scaling phab task ?
 * Blocked by:
 * None
 * Blocking:
 * None
 * Updates:
 * Have a look at https://blog.wikimedia.org/2018/04/24/new-data-center-singapore/
 * Work on getting proton up (QR goal for Reading Web) and running started https://phabricator.wikimedia.org/T192983
 * Quarterly goal dependency update:
 * Outcome 1, Objective 4: Continue improving the ways that users can download articles of interest for later consumption https://phabricator.wikimedia.org/T181079
 * Reading Web depends on SRE, RelEng, Reading Infra
 * Prepare for launch of the first Structured Data on Commons feature (multilingual file captions)
 * SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
 * Services depends on SRE, Parsing

Wikidata
T174022 Implement multi-content revisions, T174023 Implement MCR storage layer, T174045 DB schema migration for MCR, T174044 Deploy MCR storage layer, T174043Deploy Multi-Content Revisions
 * Blocked by:
 * Blocking:
 * Updates:
 * Quarterly goal dependency update:
 * Prepare for launch of the first Structured Data on Commons feature (multilingual file captions) phab task ?
 * SDC depends on Multimedia/,SRE, WMDE, Search Platform, MediaWiki Platform, Research
 * Objective 1.1 Assist with deploying MultiContent Revisions on Commons
 * Objective 1.1 Assist with deploying MultiContent Revisions on Commons
 * SDC depends on MediaWiki Platform, WMDE

German Technical Wishlist

 * Blocked by:
 * Blocking:
 * Updates:
 * ICU 57 migration done
 * Appservers are being reimaged to Debian Stretch

SoS Meeting Bookkeeping

 * Updates:
 * Request from SRE: Please either add phab tasks to all goals so that work can be tracked and updates can be made in a meaningful way even across large and diverse teams, or let's just drop the quarterly goal dependency updates.