Scrum of scrums/2019-09-18

= 2019-09-18 =

Callouts

 * SRE says: various PDU upgrades throughout the next few weeks, we might reach out to specific teams.
 * Release Engineering - REMINDER: We're at 1.34.0-wmf.23 this week. The last branch for this release will be wmf.25 on 30 September. Teams who want to ship things for MW 1.34 should land them now. (If you do not mark code as deprecated in the next few weeks, you have to maintain it for another nine months.)
 * Analytics is blocking Search Platform: T229882

Editing

 * Updates:
 * Engaging in research to support talk pages improvements
 * ApiVisualEditorEdit: Remove special handling for SpamBlacklist (task T211443)
 * Add new EditAttemptStep stage: firstChange (task T229079)
 * Add another looser selector for catching pasted references (task T232461)
 * Implement firstChange logging (task T229079)
 * Updated linters in Citoid (q/ac54ad79 ), CodeMirror (q/81ce8b33), Math (q/085ee7dc), Popups (q/9b3029e0), Score (q/dd534e19), Universal Language Selector (q/dae53b62), MinervaNeue (q/8e579c37)

Growth

 * Updates:
 * Homepage discovery for desktop no-JS users (task T225318)
 * Standardize error handling (task T230798)
 * [MW core RecentChanges] ChangesListSpecialPage: Cache the change tag list and its summary

iOS native app

 * Updates:
 * 6.4 released yesterday (09/17) https://phabricator.wikimedia.org/tag/ios-app-v6.4-seamonkey-on-a-hoverboard/
 * iOS 13 & iPadOS updates
 * New loading screen for dark mode
 * Bug fixes
 * external URLs > open in Safari
 * 6.5 in development
 * History & diffs API discussions with CorePlatform https://phabricator.wikimedia.org/tag/ios-app-v6.5/
 * Wrapping up first round of diff engine PR feedback T232231

Android native app

 * Updates:
 * Released a minor version to production with a timed survey https://play.google.com/store/apps/details?id=org.wikipedia&hl=en_US
 * Continuing work on Suggested Edits V3
 * Bug fixes

Product Infrastructure

 * Updates:
 * DBA and security readiness reviews are in progress for Extension:MachineVision
 * wikifeeds service (split out from mobileapps) deployed to production; not yet handling traffic
 * Maps
 * Production incident caused instability in eqiad cluster Incident_documentation/20190913-maps

Structured Data

 * Updates:
 * also working on T230862 (blocker from last week)
 * working on - input types for structured data, machine-aided tagging, some minor campaigns stuff

Parsing

 * Updates:
 * Working with Marko / CPT to get Parsoid/PHP deployed and enabled on the beta cluster.
 * Continuing to fix bugs found during mass roundtrip testing on scandium ( now 99.93% tests run without crashing ).

Analytics

 * Blocking:
 * Search Platform: T229882

Fundraising Tech

 * Updates:
 * Payments-wiki
 * More form behavior variants T224929, T231452
 * CiviCRM
 * Annual totals receipt for recurring donors T195907
 * Troubleshooting new screen-scraping data importer from mass mail house T230509
 * CentralNotice
 * Deploying last fixes for using EventLogging to track banner views
 * Scheduling jobs on fundraising cluster to import EventLogging stats into local DBs

Core Platform

 * Blocking:
 * Search Platform: RecentChange support for SDC: T230862
 * Performance: CR for rdbms/LoadMonitor changes 394430, T230800
 * Updates:
 * API testing
 * Kask testing
 * New REST API interfaces

Performance

 * Blocked by:
 * SRE: Need CR and deploy for Apache SVG compression fix. – 535860
 * CPT: CR for rdbms/LoadMonitor changes 394430, T230800
 * Updates:
 * Attended the We Love Speed conference in Lille, France.
 * (Q-goal) Finished the AbuseFilter rework (Thanks to @Daimona) which will reduce Save Timing. Deployment expected in 1-2 weeks. – T156095

Release Engineering

 * Blocked by:
 * Search Platform: Need resolution on the Cirrus tests in mw-config; this is blocking general testing/expansion framework for this repo T232691
 * Updates:
 * The phabricator "Report Error Code" form (https://phabricator.wikimedia.org/maniphest/task/edit/form/46/ ) has been updated with separate fields for the stack trace and error code/request id.
 * REMINDER: We're at 1.34.0-wmf.23 this week. The last branch for this release will be wmf.25 on 30 September. Teams who want to ship things for MW 1.34 should land them now. T232026 (If you do not mark code as deprecated in the next few weeks, you have to maintain it for another nine months.)
 * Train Health
 * Last week: 1.34.0-wmf.22 - T220747
 * This week: 1.34.0-wmf.23 - T220748
 * Next week: 1.34.0-wmf.24 - T220749

Scoring Platform

 * Updates:
 * ORES deploy: T232660
 * Trims metrics down: T232164
 * Allow POST at some endpoint for large arguments: T232500
 * Expand feature injection to all scoring endpoints: T232143
 * Ongoing stability issue in WMFLabs (NOT production -- production is solid): T232228
 * Discussing expanding the topic models with the Growth Team: Topic:Ub3g57qa9gflrlrc & T231506
 * Built a library for detecting revert tools T226426

Search Platform

 * Blocked by:
 * Core Platform (or Multimedia?): RecentChange support for SDC: T230862
 * SRE: dumpRDF for MediaInfo entities loads each page individually: T222497
 * Analytics: T229882
 * Blocking:
 * Release Engineering: Need resolution on the Cirrus tests in mw-config; this is blocking general testing/expansion framework for this repo T232691
 * Updates:
 * Added explanation api for completion suggester scoring: T230919
 * Migrated integration testing to node10

Security

 * Updates:
 * Data Map / GDPR Compliance updates
 * Security Reviews in Progress are:
 * Security Review for MediaWiki REST API, assigned to Sam, T230140
 * Security review of Ex:DoubleWiki, in-progress - T131199
 * Parsoid-PHP, moved to active, Scott this week - T227209
 * Page Content Service route /page/mobile-html, Scott will post 9/17 - T227114
 * Security review of WebAuthn library dependencies, in-progress - T227244

Site Reliability Engineering

 * Blocking:
 * CPT on restrouter deployment
 * Search Platform: dumpRDF for MediaInfo entities loads each page individually: T222497
 * Performance: Need CR and deploy for Apache SVG compression fix. – 535860
 * Updates:
 * Helped product infrastructure team deploy wikifeeds \o/.
 * Various PDU upgrades throughout the next few weeks, we might reach out to specific teams.

= 2019-09-18 =

Callouts

 * SRE says: various PDU upgrades throughout the next few weeks, we might reach out to specific teams.
 * Release Engineering - REMINDER: We're at 1.34.0-wmf.23 this week. The last branch for this release will be wmf.25 on 30 September. Teams who want to ship things for MW 1.34 should land them now. (If you do not mark code as deprecated in the next few weeks, you have to maintain it for another nine months.)
 * Analytics is blocking Search Platform: T229882

Editing

 * Updates:
 * Engaging in research to support talk pages improvements
 * ApiVisualEditorEdit: Remove special handling for SpamBlacklist (task T211443)
 * Add new EditAttemptStep stage: firstChange (task T229079)
 * Add another looser selector for catching pasted references (task T232461)
 * Implement firstChange logging (task T229079)
 * Updated linters in Citoid (q/ac54ad79 ), CodeMirror (q/81ce8b33), Math (q/085ee7dc), Popups (q/9b3029e0), Score (q/dd534e19), Universal Language Selector (q/dae53b62), MinervaNeue (q/8e579c37)

Growth

 * Updates:
 * Homepage discovery for desktop no-JS users (task T225318)
 * Standardize error handling (task T230798)
 * [MW core RecentChanges] ChangesListSpecialPage: Cache the change tag list and its summary

iOS native app

 * Updates:
 * 6.4 released yesterday (09/17) https://phabricator.wikimedia.org/tag/ios-app-v6.4-seamonkey-on-a-hoverboard/
 * iOS 13 & iPadOS updates
 * New loading screen for dark mode
 * Bug fixes
 * external URLs > open in Safari
 * 6.5 in development
 * History & diffs API discussions with CorePlatform https://phabricator.wikimedia.org/tag/ios-app-v6.5/
 * Wrapping up first round of diff engine PR feedback T232231

Android native app

 * Updates:
 * Released a minor version to production with a timed survey https://play.google.com/store/apps/details?id=org.wikipedia&hl=en_US
 * Continuing work on Suggested Edits V3
 * Bug fixes

Product Infrastructure

 * Updates:
 * DBA and security readiness reviews are in progress for Extension:MachineVision
 * wikifeeds service (split out from mobileapps) deployed to production; not yet handling traffic
 * Maps
 * Production incident caused instability in eqiad cluster Incident_documentation/20190913-maps

Structured Data

 * Updates:
 * also working on T230862 (blocker from last week)
 * working on - input types for structured data, machine-aided tagging, some minor campaigns stuff

Parsing

 * Updates:
 * Working with Marko / CPT to get Parsoid/PHP deployed and enabled on the beta cluster.
 * Continuing to fix bugs found during mass roundtrip testing on scandium ( now 99.93% tests run without crashing ).

Analytics

 * Blocking:
 * Search Platform: T229882

Fundraising Tech

 * Updates:
 * Payments-wiki
 * More form behavior variants T224929, T231452
 * CiviCRM
 * Annual totals receipt for recurring donors T195907
 * Troubleshooting new screen-scraping data importer from mass mail house T230509
 * CentralNotice
 * Deploying last fixes for using EventLogging to track banner views
 * Scheduling jobs on fundraising cluster to import EventLogging stats into local DBs

Core Platform

 * Blocking:
 * Search Platform: RecentChange support for SDC: T230862
 * Performance: CR for rdbms/LoadMonitor changes 394430, T230800
 * Updates:
 * API testing
 * Kask testing
 * New REST API interfaces

Performance

 * Blocked by:
 * SRE: Need CR and deploy for Apache SVG compression fix. – 535860
 * CPT: CR for rdbms/LoadMonitor changes 394430, T230800
 * Updates:
 * Attended the We Love Speed conference in Lille, France.
 * (Q-goal) Finished the AbuseFilter rework (Thanks to @Daimona) which will reduce Save Timing. Deployment expected in 1-2 weeks. – T156095

Release Engineering

 * Blocked by:
 * Search Platform: Need resolution on the Cirrus tests in mw-config; this is blocking general testing/expansion framework for this repo T232691
 * Updates:
 * The phabricator "Report Error Code" form (https://phabricator.wikimedia.org/maniphest/task/edit/form/46/ ) has been updated with separate fields for the stack trace and error code/request id.
 * REMINDER: We're at 1.34.0-wmf.23 this week. The last branch for this release will be wmf.25 on 30 September. Teams who want to ship things for MW 1.34 should land them now. T232026 (If you do not mark code as deprecated in the next few weeks, you have to maintain it for another nine months.)
 * Train Health
 * Last week: 1.34.0-wmf.22 - T220747
 * This week: 1.34.0-wmf.23 - T220748
 * Next week: 1.34.0-wmf.24 - T220749

Scoring Platform

 * Updates:
 * ORES deploy: T232660
 * Trims metrics down: T232164
 * Allow POST at some endpoint for large arguments: T232500
 * Expand feature injection to all scoring endpoints: T232143
 * Ongoing stability issue in WMFLabs (NOT production -- production is solid): T232228
 * Discussing expanding the topic models with the Growth Team: Topic:Ub3g57qa9gflrlrc & T231506
 * Built a library for detecting revert tools T226426

Search Platform

 * Blocked by:
 * Core Platform (or Multimedia?): RecentChange support for SDC: T230862
 * SRE: dumpRDF for MediaInfo entities loads each page individually: T222497
 * Analytics: T229882
 * Blocking:
 * Release Engineering: Need resolution on the Cirrus tests in mw-config; this is blocking general testing/expansion framework for this repo T232691
 * Updates:
 * Added explanation api for completion suggester scoring: T230919
 * Migrated integration testing to node10

Security

 * Updates:
 * Data Map / GDPR Compliance updates
 * Security Reviews in Progress are:
 * Security Review for MediaWiki REST API, assigned to Sam, T230140
 * Security review of Ex:DoubleWiki, in-progress - T131199
 * Parsoid-PHP, moved to active, Scott this week - T227209
 * Page Content Service route /page/mobile-html, Scott will post 9/17 - T227114
 * Security review of WebAuthn library dependencies, in-progress - T227244

Site Reliability Engineering

 * Blocking:
 * CPT on restrouter deployment
 * Search Platform: dumpRDF for MediaInfo entities loads each page individually: T222497
 * Performance: Need CR and deploy for Apache SVG compression fix. – 535860
 * Updates:
 * Helped product infrastructure team deploy wikifeeds \o/.
 * Various PDU upgrades throughout the next few weeks, we might reach out to specific teams.