Scrum of scrums/2018-08-01

= 2018-08-01=

Callouts

 * SREs say FYI:
 * Switchover tentative timeline announced. Please take a look and voice concerns if any

Switchover:

Services: Tuesday, September 11th 2018 14:30 UTC Media storage/Swift: Tuesday, September 11th 2018 15:00 UTC Traffic: Tuesday, September 11th 2018 19:00 UTC Mediawiki: Wednesday, September 12th 2018: 14:00 UTC

Switchback:

Traffic: Tuesday, October 9th 2018 19:00 UTC (and maybe some prep work on Monday) Mediawiki: Wednesday, October 10th 2018: 14:00 UTC Services: Thursday, October 11th 2018 14:30 UTC Media storage/Swift: Thursday, October 11th 2018 15:00 UTC


 * MCR Schema migrations are happening
 * Beta is set to write both / read new with no problems identified
 * Production set to write both / read old this week
 * Starting with migration scripts to copy data from old schema to new one

iOS native app

 * Blocked by: -
 * Blocking: -
 * Updates:
 * 6.0 in beta (https://phabricator.wikimedia.org/tag/ios-app-v6.0-walrus-on-a-unicycle/), expected to push another beta this week

Android native app

 * Blocked by:
 * Blocking:
 * Updates:
 * Maintenance update released to Beta, will go to production tomorrow (Thurs)
 * User testing of navigation design prototypes will commence shortly.

Readers Web

 * Blocked by:
 * Blocking:
 * Updates:
 * RFC: Modernise our JavaScript with the goal that the startup module and mediawiki object should not depend on jQuery https://phabricator.wikimedia.org/T200868
 * Mobile website (MinervaNeue / MobileFrontend):
 * Page issues UI and instrumentation: T191532 T191303 T197932 T197931 T200867
 * Invest in the MobileFrontend & MinervaNeue frontend architecture: T188261 T197133 T197639
 * Other fixes and hygiene T193172 T200491 T186823 T199282 T199000 T199066 T197110 T198151
 * Product and design are collating research and interviews from Wikimania and working on advanced contributions

Readers Infrastructure

 * Blocked by:
 * Blocking:
 * Updates:
 * mobile-html exposed but needs fixes for CSP header and a URL to CSS. Won't run CollapseTable transform on server for the time being.
 * Maps:
 * New tile regeneration cron job for low-zoom vector tiles https://phabricator.wikimedia.org/T194787
 * Snapshot low DPI bug is waiting for a pull request review from upstream on third party library https://phabricator.wikimedia.org/T152196
 * Working on migrating test servers to Cloud VPS
 * Working with SRE (Gehel) on migrating all servers to Debian Stretch

Multimedia

 * No representative today - two team members on vacation and Mark has a conflicting meeting
 * Updates
 * Breaking change in MediaWiki Core OOUI widget nearly caught us out - luckily something else broke in the meantime so the related fatal never occurred because of another fatal. Both fixed now.
 * Search for SDC coming along slowly with various people on vacation.
 * Next up: OOUI rendering for SDC first feature (captions), coming down the pipeline soon™
 * MCR rollout plan basically set, we'll need some time to sort out our integration, but should all work out well.

Community Tech

 * Blocked by:
 * Blocking:
 * Updates:

Anti-Harassment Tools

 * Blocked by:
 * Blocking:
 * Updates:

Editing

 * Blocked by: None
 * Blocking: None
 * Updates:
 * Unblocked languages on previous issues.

Parsing

 * Blocked by:
 * Blocking:
 * Updates:

Growth

 * Blocked by:
 * Blocking:
 * Updates:

Language

 * Blocked by:
 * CX patches still blocked from merging due to test failures occuring in Wikibase Lexeme
 * Thanks to everyone who helped/are helping to solve issues (4 separate ones) that prevent merging patches to CX&Translate
 * Blocking:
 * Providing guidance on https://phabricator.wikimedia.org/T195910 (ios app language selection related issue)
 * Updates:
 * Grant Metrics enabled for translation in translatewiki.net
 * Niklas will work on https://phabricator.wikimedia.org/T195293 (follow-ups to an issue causing an outage a while ago)

UI Standardization

 * Blocked by:
 * Blocking:
 * Updates:
 * Preparation of OOUI v0.27.6

Analytics

 * Blocked by:
 * Blocking:
 * Outage in Eventlogging
 * Updates:
 * Added data quality checks in mediawiki history and mediawiki history reduced datasets
 * Cleaning of user directories in hadoop
 * Improved data sanitization in Eventlogging (salt creation/rotation)
 * Improved partition cleaning in hive

Cloud Services

 * Blocked by:
 * Blocking:
 * Updates:

Fundraising Tech

 * Blocked by:
 * Blocking:
 * Updates:
 * Making our exchange rates available on a WMF-visible spreadsheet for travel reimbursement
 * Work continues on the ingress scripts for EventLogging data from banner and landing page impressions
 * Experimenting with different ways to let donors from certain countries opt in to emails
 * CiviCRM: new search filters, looking at mailing house data import bug and data erasure requests
 * Reviewing CiviCRM core team code for contact view editor
 * More error-handling work prompted by full-scale tests of card processor's new API

MediaWiki Core Platform

 * Blocked by:
 * Blocking:
 * Updates:
 * Cherry-picked API statsd improvement into production. Updated API dashboard in Grafana.
 * https://grafana.wikimedia.org/dashboard/db/api-backend-summary?refresh=5m&orgId=1
 * Platform Evolution kick-offs and TechConf prep are ongoing
 * Language variants for summary REST API deployed - Page Previews will now show your preferred variant
 * Only serbian language is supported now, but more will be added as Parsoid supports more conversions
 * Memory issues with EventStreams service in codfw affected other services, now resolved.

Multi-Content Revisions

 * Blocked by:
 * Blocking:
 * Updates:
 * MCR Schema migrations are happening
 * Beta is set to write both / read new with no problems identified
 * Production set to write both / read old this week
 * Starting with migration scripts to copy data from old schema to new one
 * Discussion on-going on whether a production test wiki is necessary in addition to a test wiki on beta: https://phabricator.wikimedia.org/T197616
 * Requires Wikibase change propagation
 * Development and code review continues

Performance

 * Blocked by:
 * Blocking:
 * Updates:
 * Updates:
 * Updates:

Release Engineering

 * Blocked by:
 * Related to 1.32.0-wmf.14 train https://wikitech.wikimedia.org/wiki/Incident_documentation/20180724-Train#Actionables
 * Feedback needed from Wikidata team on how T200340 (Wikibase\DataModel\Entity\EntityIdParsingException $serialization must not be an empty string) could be prevented.
 * Feedback needed from Readers/Performance team(s) on how T200346 (wmf.14 failing to execute ThumbnailRender jobs "error: ThumbnailRenderJob::run: HTTP request failure") could be prevented.
 * Feedback needed from ORES/Wikidata team(s) on how T200412 (PageTriage requires ORES to be installed) could be prevented.
 * Feedback needed from Wikidata team on how T200420 (Wikidata dispatching stuck (not releasing lockmanager locks)) could be prevented.
 * Feedback needed from Readers team on how T200456 (MapCacheLRU::has called with invalid key. Must be string or integer) could be prevented.
 * Blocking:
 * Updates:
 * Moved the beta deployment server to deployment-deploy01, yell if anything seems amiss there

Research
https://phabricator.wikimedia.org/T199457
 * Blocked by: None
 * Blocking: None
 * Updates:
 * We've been analyzing the Citation usage data and improving the schema.
 * Working on recommending missing articles based on translation pageview predictions.
 * Have been interviewing candidates for a research position.

Scoring Platform

 * Blocked by:
 * Waiting for a TechCom review of JADE proposal for deployment.
 * Trying to get Global Collaboration's attention about this.
 * "Everything is a wiki page", yet we're not allowed to deploy an extension that might increase the number of wiki pages... Who will be blocked next?
 * Blocking:
 * Updates:
 * GSoC project by Saurabh Batra to identify donations fraud has resulted in a successful model! We're beginning integration work now.

Search Platform

 * Blocked by:
 * Blocking:
 * Updates:
 * Lexeme fulltext search merged: https://phabricator.wikimedia.org/T196188
 * Started collecting click stats for Wikidata completion search: https://phabricator.wikimedia.org/T196186
 * Quality constraints violations are now in WDQS: https://phabricator.wikimedia.org/T172380
 * Fixed intitle search not matching stopwords: https://phabricator.wikimedia.org/T68969
 * Fixed problems in completion search on shard failure: https://phabricator.wikimedia.org/T180807
 * Added task to purge query click data according to privacy policy: https://phabricator.wikimedia.org/T189845
 * Working on running multiple Elastic instances on the same hardware: https://phabricator.wikimedia.org/T193654
 * Working on ES 6.3 upgrade: https://phabricator.wikimedia.org/T197960
 * Working on Esperanto analyzer: https://phabricator.wikimedia.org/T200099
 * Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108

Security

 * Blocked by:
 * Blocking:
 * Updates:

Site Reliability Engineering

 * Blocked by:
 * None
 * Blocking:
 * None
 * Updates:
 * eqiad row B and C upgrades went quite fine with some minor hiccups
 * work on the switchover preparation ongoing. Tentative timeline posted. Take a look at calls out section

Wikidata

 * Blocked by:
 * Blocking:
 * ContentTranslation CI red because of failing Wikidata-related tests: https://phabricator.wikimedia.org/T200693
 * working on understanding and fixing failures
 * Updates:
 * Work in Lexicographical data continues:
 * adding senses
 * improving the editor workflow
 * https://phabricator.wikimedia.org/project/view/2292/

German Technical Wishlist

 * Blocked by:
 * Blocking:
 * Updates:

SoS Meeting Bookkeeping

 * Updates:
 * move the meeting to 2 hours earlier as soon as week of 2018-08-06- look for new invite!
 * some changes to the notes template
 * keep the meeting as is- a forum for teams to share updates and ask for help and keep the notes as useful as possible
 * decision to handle goals dependencies outside this meeting