Scrum of scrums/2019-06-05

2019-06-05

Callouts

• DBAs: s4 (commonswiki) database primary master will be failed over the 19th 05:00-05:30 UTC (read only required) https://phabricator.wikimedia.org/T224516
• Readers Infrastructure: for Release Engineering (thcipriani) / Site Reliability Engineering (akosiaris): Input (related to Blubberfile contents) needed on https://gerrit.wikimedia.org/r/#/c/mediawiki/services/wikifeeds/+/510574/
• Wikidata: termbox SSR service deployment stalled on Site Reliability Engineering https://phabricator.wikimedia.org/T220402
• Release Engineering: Next week - NO TRAIN OR ANY OTHER DEPLOYS due to Site Reliability Engineering Off-site

Audiences

Readers

iOS native app

• Updates:
  • Finishing off the 6.3 release that has Talk Pages (https://phabricator.wikimedia.org/tag/ios-app-v6.3-lobster-on-a-motorcycle/)
  • slower week cause 2 / 3 engineers are at Apple's WWDC conference

Android native app

• Updates:
  • Completing workflow for editing structured Commons captions: https://phabricator.wikimedia.org/T223129
  • ...as well as translating structured captions: https://phabricator.wikimedia.org/T223128

Readers Web

• Updates:
  • Summary: planning for desktop refresh, Wikimania, and next year's technical projects; continuing ongoing development for the advanced mobile contributions.
  • Responsive website (MinervaNeue / MobileFrontend / Related Articles):
    • Advanced mobile contributions https://www.mediawiki.org/wiki/Reading/Web/Advanced_mobile_contributions
      • Updates to user page treatment (apply for IP address and always show toolbar) T220114
      • Style the history page for AMC users T219895
      • PageActions Menu should use Builder pattern and reuse existing Menu elements T221792
      • Deploy AMC overflow menu to wikis with AMC enabled T223883
    • Invest in the MobileFrontend & MinervaNeue frontend architecture https://www.mediawiki.org/wiki/Reading/Web/Projects/Invest_in_the_MobileFrontend_%26_MinervaNeue_frontend_architecture
      • BetaOptInPanel should use ES6 classes NOT mfExtend T220847
      • Planning for next year
    • Browser tests
      • MinervaNeue wdio build fails with PHP error from Wikibase "Failed to map interlanguage prefix es to a global site ID." T224605
      • Minerva Node.js browser tests failing and not running against commits T223676
    • Miscellaneous bug fixes and maintenance T221624 T223204 T150377 T222834
  • QuickSurveys support
  • Planning
    • Desktop refresh design and planning
    • Wikimania proposal planning

Readers Infrastructure

• Blocked by:
  • Release Engineering and Site Reliability Engineering: Kubernetesization of node.js services blocked on feedback on https://gerrit.wikimedia.org/r/#/c/mediawiki/services/wikifeeds/+/510574/ (see Callouts)
• Updates:
  • Commons image caption edit suggested APIs are in review, and to be deployed as part of the Recommendation API hopefully next week

Multimedia

• Updates:
  • still working on qualifiers for depicts on commons ... integrating new feedback
  • next: other statements, delayed until after qualifiers release

Technology

Fundraising Tech

• Updates:
  • More improvements to contact de-duplication in CiviCRM: https://phabricator.wikimedia.org/T217903
  • Planning work for fundraising in India: https://phabricator.wikimedia.org/T211155
  • UI for one-time->recurring donation upsell: https://phabricator.wikimedia.org/T216562
  • Investigating outage in FundraiserLandingPage EventLogging data: https://phabricator.wikimedia.org/T224733
  • Investigating discrepencies in data for bulk email lists: https://phabricator.wikimedia.org/T219401, https://phabricator.wikimedia.org/T223935

Core Platform

• Blocking:
  • Release Engineering (low priority): https://phabricator.wikimedia.org/T205361 is blocking undeployment of CodeReview.
  • German Technical Wishlist: not a critical blocker at this point yet, but it would be lovely if Release Engineering (and possible Core Platform) could make sure https://phabricator.wikimedia.org/T225068 progresses
• Updates:
  • Actor table is write-new everywhere
  • Parameter validation in REST API and Action API
  • Kask deployed
  • Proton is only PDF renderer
  • Off-site June 17-23

Release Engineering

• Blocked by:
  • Core Platform (low priority): https://phabricator.wikimedia.org/T205361 is blocking undeployment of CodeReview.
  • Site Reliability Engineering
    • phabricator: Install php-mailparse - fixes loss of incoming mail processing - https://gerrit.wikimedia.org/r/#/c/513713/
    • Traffic Team (low priority): https://phabricator.wikimedia.org/T213769 is blocking undeployment of Wikipedia Zero.
  • Wikidata: We need to update wikiba.se tests to PHP7 so we can drop php56 from CI. https://phabricator.wikimedia.org/T224905
• Blocking:
  • Wikidata: It would be great if Željko could have a look at https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/512665
  • Wikidata: Daily browser tests of WikibaseLexeme targetting beta wikidata failing due to odd 500 errors. Some "regular" php fatals discovered on beta cluster, could someone smarter than us have a look: https://phabricator.wikimedia.org/T224899
  • Readers Infrastructure: Input (related to Blubberfile contents) needed on https://gerrit.wikimedia.org/r/#/c/mediawiki/services/wikifeeds/+/510574/
  • German Technical Wishlist: not a critical blocker at this point yet, but it would be lovely if Release Engineering (and possible Core Platform) could make sure https://phabricator.wikimedia.org/T225068 progresses
• Updates:
  • kask deployed for session storage service. Core Platform unblocked.
  • Train Health
    • Last week: 1.34.0-wmf.7 - https://phabricator.wikimedia.org/T220732
    • This week: 1.34.0-wmf.8 - https://phabricator.wikimedia.org/T220733
    • Next week: 1.34.0-wmf.9 - NO TRAIN OR ANY OTHER DEPLOYS due to Site Reliability Engineering Off-site

Research

• Updates:
  • GSoC and Outreachy mentorships
  • Recommendation API: Verify newly generated data before pushing it to production: https://phabricator.wikimedia.org/T213761
  • Citaiton Usage - defined the next steps for the project.
  • Started running larger-scale GPU experiments
  • Reader Demographics survey translations: https://phabricator.wikimedia.org/T222744
  • Budget, annual plan, hiring

Search Platform

• Blocked by:
  • Waiting for Wikidata team on https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/507910 and https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/489447
• Updates:
  • Wikidata Special:Search improvements deployed: https://phabricator.wikimedia.org/T55652
  • Fixed breakage in suggested articles: https://phabricator.wikimedia.org/T224879
  • Fixed GeoData not providing coordinates on Commons: https://phabricator.wikimedia.org/T223767
  • Fixed fatal error with n3 RDF format: https://phabricator.wikimedia.org/T224024
  • Fixed broken VIAF URIs in WDQS: https://phabricator.wikimedia.org/T223946
  • Increased metrics sampling rates for smaller wikis: https://phabricator.wikimedia.org/T197129
  • Working on Slovak diacritics folding: https://phabricator.wikimedia.org/T223787
  • Working on creating RDF export for SDC/MediaInfo: https://phabricator.wikimedia.org/T221917
  • Working on CirrusSearch configuration for cloudelastic: https://phabricator.wikimedia.org/T220625
  • Working on CirrusSearch query dispatcher: https://phabricator.wikimedia.org/T216429

Site Reliability Engineering

• Blocking:
  • Release Engineering
    • phabricator: Install php-mailparse - fixes loss of incoming mail processing - https://gerrit.wikimedia.org/r/#/c/513713/
    • Traffic Team (low priority): https://phabricator.wikimedia.org/T213769 is blocking undeployment of Wikipedia Zero.
  • Wikidata: termbox SSR service deployment https://phabricator.wikimedia.org/T220402
  • Readers Infrastructure: Input (related to Blubberfile contents) needed on https://gerrit.wikimedia.org/r/#/c/mediawiki/services/wikifeeds/+/510574/
• Updates:
  • DBAs: s4 (commonswiki) database primary master will be failed over the 19th 05:00-05:30 UTC (read only required) https://phabricator.wikimedia.org/T224516

Wikidata

• Blocked by:
  • Release Engineering: Daily browser tests of WikibaseLexeme targetting beta wikidata failing due to odd 500 errors. Some "regular" php fatals discovered on beta cluster, could someone smarter than us have a look: https://phabricator.wikimedia.org/T224899
  • Release Engineering: It would be great if Željko could have a look at https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/512665
  • Site Reliability Engineering: termbox SSR service deployment https://phabricator.wikimedia.org/T220402
• Blocking:
  • Release Engineering: We need to update wikiba.se tests to PHP7 so we can drop php56 from CI. https://phabricator.wikimedia.org/T224905
  • Search Platform: https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/507910 and https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/489447
• Updates:
  • Shape Expressions live on wikidata.org: https://lists.wikimedia.org/pipermail/wikidata/2019-May/013072.html
  • Migration of Wikidata secondary storage (wb_terms) to a better designed tables to start soon
  • Work on the mobile termbox editing progresses

German Technical Wishlist

• Blocked by:
  • not a critical blocker at this point yet, but it would be lovely if Release Engineering (and possible Core Platform) could make sure https://phabricator.wikimedia.org/T225068 progresses
• Updates:
  • Not putting it to Blocked By yet, but we've been struggling with Jenkins recently. Maybe Release Engineering would be interested in hearing those thoughts?
    • There have been multiple tests flapping, which are included in gated skins and extensions. These are annoying and a waste of CI resources since the usual response is to just 'recheck' an inappropriate number of times. We would like to see some way of increasing the visibility of these failures and encouraging either skipping or fixing.
    • The CI and Zuul dashboards in Grafana don't seem to include failure metrics--We'd be especially interested in tracking how often a patch gets V+2 and then tests fail during gate-and-submit.

SoS Meeting Bookkeeping

• Updates:
  • Deb volunteered for backup facilitator 🎉 (still looking for one more)
  • The meeting starts at 15:35 UTC. If 15:40 UTC would be a better starting time, let me know.