Scrum of scrums/2018-09-26

= 2018-09-26 =

Callouts
Release Engineering:


 * Deployments of MediaWiki with scap cause a spam of "web request took longer than 60 seconds and timed out"
 * https://phabricator.wikimedia.org/T204871


 * Scap is checking canary servers in dormant instead of active-dc
 * Switchover process needs an update. Long term the list of canaries should be in conftool.
 * https://phabricator.wikimedia.org/T204907


 * ComTech:
 * We're starting to work on showing SVGs in page language - https://phabricator.wikimedia.org/T205040

iOS native app

 * Blocked by:
 * Blocking:
 * Updates:
 * Planning to be feature complete for 6.1 (https://phabricator.wikimedia.org/tag/ios-app-v6.1-narwhal-on-a-bumper-car/) by the end of this week
 * Apps offsite next week,

Android native app

 * Blocked by:
 * Blocking:
 * Updates:
 * Working on productionising new navigation
 * Apps offsite next week.

Readers Web

 * Blocked by:
 * Blocking:
 * Updates:
 * Mobile website (MinervaNeue / MobileFrontend):


 * SkinMinerva.php file logs "Undefined variable: returntoquery` error T205449


 * Invest in the MobileFrontend & MinervaNeue frontend architecture https://www.mediawiki.org/wiki/Reading/Web/Projects/Invest_in_the_MobileFrontend_%26_MinervaNeue_frontend_architecture
 * Continue Webpack and test transition of mobile.startup T203817
 * Add more tests to mobile.startup files T203818
 * Simplify CategoryOverlay T191987
 * Add Sinon.JS configuration T204885
 * Update test file naming T197884
 * Bundle Hogan.js T205128 T205129
 * Enable client side error reporting T167699


 * Page issues https://www.mediawiki.org/wiki/Reading/Web/Projects/Mobile_Page_Issues
 * Limited A/B test in progress T204609
 * ReadingDepth logging sometimes initializes before PageIssues T204144
 * Add new treatment opt-in query parameter override T204746
 * Don't cache config flag with HTML T205355
 * What % of pages feature issues? T201123
 * Increase sampling ratio for ReadingDepth T205176


 * Working with editing
 * Add share icon to beta T181195
 * Lighten default theme color T204691
 * Maintenance and bug fixes T199066 T204584 T197105 T198018 T205321


 * Advanced mobile contributions https://www.mediawiki.org/wiki/Reading/Web/Advanced_mobile_contributions
 * Generate list of most used special pages T198218
 * Design and product continuing special pages work in Minerva


 * Data working on "better use of data" requirements


 * PDF rendering (Proton) https://www.mediawiki.org/wiki/Reading/Web/PDF_Functionality
 * Remaining work tracked in T186748
 * Working with Services on a Grafana dashboard T201158 T204055
 * Chromium-render doesn't handle browser connection abort well T181623
 * Miscellaneous maintenance and bug fixes


 * Supporting Multimedia/Test hiring processes

Readers Infrastructure

 * Blocked by:
 * Blocking:
 * Updates:
 * PCS: Continue work on mobile-html endpoint.
 * Maps
 * maps1004 migrated to stretch successfully
 * It will now receive OSM data load to start generating tiles T205462
 * Investigation of tilerator crash in eqiad has an workaround but still need permanent fix T204047

Parsing

 * Blocked by: None
 * Blocking: None
 * Updates: All code review requests from last week have been handled, thanks
 * Will pass along: (Parsing) T205497 [Regression pre-wmf.23] REST API on Beta cluster returns content of different pages than requested (breaks VE)

Multimedia

 * Blocked by:
 * Blocking:
 * Updates

Community Tech

 * Blocked by:
 * Blocking:
 * Updates:
 * We're starting to work on showing SVGs in page language - https://phabricator.wikimedia.org/T205040 Ping Parsing and SRE

Anti-Harassment Tools

 * Blocked by:
 * Blocking:
 * Updates:

Editing

 * Blocked by:
 * Blocking:
 * Updates:
 * Removed dedicated annotation operation types in the VE data model and instead model annotation transactions using replacements
 * Improved mobile dialogs in the visual editor
 * Completed move of MobileFrontend's VisualEditor styles back to MobileFrontend from Minerva

Growth

 * Blocked by:
 * Blocking:
 * Updates:

Language

 * Blocked by:
 * Blocking:
 * Updates:
 * Preparing for ContentTranslation v2 continue.

Audiences Design

 * Blocked by:
 * Blocking:
 * Updates:

UI Standardization

 * Blocked by:
 * Blocking:
 * Updates:
 * Special:Preferences OOUI rollout
 * Resolving remaining typography/imagery quests on Design Style Guide
 * Accessibility work on wikimediafoundation.org website

Analytics
- Analytics team off-site - Replacement of hadoop cluster node managers without issues - 2 new metrics for Wikistats2: pages to date (total article count) and top contributors, deploy before end of quarter - Final work on Wikistats2 graph annotations (tricky UI), also deploy before end of quarter - Modern Event Data Platform internal discussions, tickets and naming reworked for a clearer picture of what we will be working on
 * Blocked by:
 * Blocking:
 * Updates:

Cloud Services

 * Blocked by:
 * Blocking:
 * Updates:

Fundraising Tech

 * Blocked by:
 * Blocking:
 * Updates:
 * Thanks to the people who are helping out with the MessageCache issue affecting CentralNotice (Ian Marlier, Jaime Crespo, Daniel Kinzler, Niklas Laxström et al)
 * Got a patch out to support Amazon Alexa donations, just in time for their announcement
 * Working on distinguishing endowment gifts throughout the whole donation pipeline
 * Fixing a couple of issues in spreadsheet imports
 * Interviewing for engineer position

Core Platform

 * Blocked by:
 * Blocking:
 * Updates:
 * Session management service design and implementation is being moved up to this quarter to get to unblock multi-DC
 * Preparing for moving to production early Q3
 * MediaWIki tarball release script updated
 * Work starting on Excimer - New profiler for PHP to replace XHProf https://phabricator.wikimedia.org/T205059

Performance

 * Blocked by:
 * Blocking:
 * Updates:

Release Engineering

 * Blocked by:
 * 1.32.0-wmf.23 deployment blockers
 * (Readers Web) T205449 SkinMinerva.php file logs "Undefined variable: returntoquery` error
 * Done
 * (Core Platform) T205469 Fatal error from LinkRenderer on special pages ("Object of class HtmlArmor could not be converted")
 * Done
 * (Search Platform) T205473 Fatal error "Invalid operand type" from CirrusSearch LinksUpdate
 * Done
 * (Parsing) T205497 [Regression pre-wmf.23] REST API on Beta cluster returns content of different pages than requested (breaks VE)
 * Done
 * Blocking:
 * Updates:
 * Train Health:
 * Scap is checking canary servers in dormant instead of active-dc - Switchover process needs an update. Long term the list of canaries should be in conftool - https://phabricator.wikimedia.org/T204907
 * Log Health:
 * We are seing a lot of T204871 "web request took longer than 60 seconds and timed out" in `fatalmonitor`
 * Code Health:
 * Creating communication channels (Phabricator https://phabricator.wikimedia.org/tag/code-health-metrics/, IRC channel, mailing list)
 * Creating communication channels (Phabricator https://phabricator.wikimedia.org/tag/code-health-metrics/, IRC channel, mailing list)

Research

 * Blocked by: None
 * Blocking: None
 * Updates:
 * Data collection for CitationUsagePageLoad at 33.3% (was 10% previously)
 * Retaining de-identified CitationUsage data beyond 90 days
 * Recommendation API service to MySQL connection: https://phabricator.wikimedia.org/T205452

Scoring Platform

 * Blocked by:
 * Blocking:
 * Updates:
 * PoolCounter is deployed everywhere, now the limit of parallel connections is being enforced
 * Started to work on improving logs in ores, specially sending them to logstash
 * Building javascript library in mediawiki to make requesting scores to ores easier: https://phabricator.wikimedia.org/T201691

Search Platform

 * Blocked by:
 * Blocking:
 * Updates:
 * Made sanetizer process to constantly reindex the wikis: https://phabricator.wikimedia.org/T203622
 * Implemented support for Lexemes in RDF (not enabled yet, waiting for dumps): https://phabricator.wikimedia.org/T202459
 * Finished evaluation of image quality as query-independent ranking signal: https://phabricator.wikimedia.org/T202339
 * Conclusion: positive, image quality is a good signal, will plan implementation
 * Upgraded ElasticSearch plugins for 6.3: https://phabricator.wikimedia.org/T197960
 * Added ntriples RDF dump for Wikidata: https://phabricator.wikimedia.org/T144103
 * Reindexing Wikidata to enable several newly deployed features
 * Reindexed Esperanto wiki after new analysis enabled: https://phabricator.wikimedia.org/T203005
 * Working on calculating examination probabilities for completion queries: https://phabricator.wikimedia.org/T205348
 * Working on improving Korean analyzers: https://phabricator.wikimedia.org/T178925
 * Working on running multiple Elastic instances on the same hardware: https://phabricator.wikimedia.org/T193654
 * Working on searching for statement values without additional keywords for Wikidata: https://phabricator.wikimedia.org/T163642
 * Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108

Security

 * Blocked by:
 * Blocking:
 * Updates:

Site Reliability Engineering

 * Blocked by:
 * None
 * Blocking:
 * None
 * Updates:
 * Preparing for the switchback
 * Finishing goals

Wikidata

 * Blocked by:
 * Blocking:
 * Updates:

German Technical Wishlist

 * Blocked by:
 * Blocking:
 * Updates:

Multi-Content Revisions

 * Blocked by:
 * Blocking:
 * Updates:
 * "read new" enabled on testwiki
 * "read new" being enabled on mediawiki.org this week
 * waiting for DC switch back to enable "read new" on Commons and other wikis
 * reactive minor bug fixes

SoS Meeting Bookkeeping

 * Updates: