Scrum of scrums/2018-08-01

From mediawiki.org

2018-08-01[edit]

Callouts[edit]

  • SREs say FYI:
    • Switchover tentative timeline announced. Please take a look and voice concerns if any

Switchover:

Services: Tuesday, September 11th 2018 14:30 UTC Media storage/Swift: Tuesday, September 11th 2018 15:00 UTC Traffic: Tuesday, September 11th 2018 19:00 UTC Mediawiki: Wednesday, September 12th 2018: 14:00 UTC

Switchback:

Traffic: Tuesday, October 9th 2018 19:00 UTC (and maybe some prep work on Monday) Mediawiki: Wednesday, October 10th 2018: 14:00 UTC Services: Thursday, October 11th 2018 14:30 UTC Media storage/Swift: Thursday, October 11th 2018 15:00 UTC

  • MCR Schema migrations are happening
    • Beta is set to write both / read new with no problems identified
    • Production set to write both / read old this week
    • Starting with migration scripts to copy data from old schema to new one

Audiences[edit]

Readers[edit]

iOS native app[edit]

Android native app[edit]

  • Blocked by:
  • Blocking:
  • Updates:
    • Maintenance update released to Beta, will go to production tomorrow (Thurs)
    • User testing of navigation design prototypes will commence shortly.

Readers Web[edit]

  • Blocked by:
  • Blocking:
  • Updates:
    • RFC: Modernise our JavaScript with the goal that the startup module and mediawiki object should not depend on jQuery https://phabricator.wikimedia.org/T200868
    • Mobile website (MinervaNeue / MobileFrontend):
      • Page issues UI and instrumentation: T191532 T191303 T197932 T197931 T200867
      • Invest in the MobileFrontend & MinervaNeue frontend architecture: T188261 T197133 T197639
      • Other fixes and hygiene T193172 T200491 T186823 T199282 T199000 T199066 T197110 T198151
    • Product and design are collating research and interviews from Wikimania and working on advanced contributions

Readers Infrastructure[edit]

  • Blocked by:
  • Blocking:
  • Updates:
    • mobile-html exposed but needs fixes for CSP header and a URL to CSS. Won't run CollapseTable transform on server for the time being.
    • Maps:


Multimedia[edit]

  • No representative today - two team members on vacation and Mark has a conflicting meeting
  • Updates
    • Breaking change in MediaWiki Core OOUI widget nearly caught us out - luckily something else broke in the meantime so the related fatal never occurred because of another fatal. Both fixed now.
    • Search for SDC coming along slowly with various people on vacation.
    • Next up: OOUI rendering for SDC first feature (captions), coming down the pipeline soon™
    • MCR rollout plan basically set, we'll need some time to sort out our integration, but should all work out well.

Contributors[edit]

Community Tech[edit]

  • Blocked by:
  • Blocking:
  • Updates:

Anti-Harassment Tools[edit]

  • Blocked by:
  • Blocking:
  • Updates:

Editing[edit]

  • Blocked by: None
  • Blocking: None
    • Updates:
    • Unblocked languages on previous issues.

Parsing[edit]

  • Blocked by:
  • Blocking:
  • Updates:

Growth[edit]

  • Blocked by:
  • Blocking:
  • Updates:

Language[edit]

  • Blocked by:
    • CX patches still blocked from merging due to test failures occuring in Wikibase Lexeme
    • Thanks to everyone who helped/are helping to solve issues (4 separate ones) that prevent merging patches to CX&Translate
  • Blocking:
  • Updates:

Audiences Design[edit]

UI Standardization[edit]

  • Blocked by:
  • Blocking:
  • Updates:
    • Preparation of OOUI v0.27.6

Technology[edit]

Analytics[edit]

  • Blocked by:
  • Blocking:
    • Outage in Eventlogging
  • Updates:
    • Added data quality checks in mediawiki history and mediawiki history reduced datasets
    • Cleaning of user directories in hadoop
    • Improved data sanitization in Eventlogging (salt creation/rotation)
    • Improved partition cleaning in hive

Cloud Services[edit]

  • Blocked by:
  • Blocking:
  • Updates:

Fundraising Tech[edit]

  • Blocked by:
  • Blocking:
  • Updates:
    • Making our exchange rates available on a WMF-visible spreadsheet for travel reimbursement
    • Work continues on the ingress scripts for EventLogging data from banner and landing page impressions
    • Experimenting with different ways to let donors from certain countries opt in to emails
    • CiviCRM: new search filters, looking at mailing house data import bug and data erasure requests
    • Reviewing CiviCRM core team code for contact view editor
    • More error-handling work prompted by full-scale tests of card processor's new API

MediaWiki Core Platform[edit]

  • Blocked by:
  • Blocking:
  • Updates:
    • Cherry-picked API statsd improvement into production. Updated API dashboard in Grafana.
    • Platform Evolution kick-offs and TechConf prep are ongoing
    • Language variants for summary REST API deployed - Page Previews will now show your preferred variant
      • Only serbian language is supported now, but more will be added as Parsoid supports more conversions
    • Memory issues with EventStreams service in codfw affected other services, now resolved.

Multi-Content Revisions[edit]

  • Blocked by:
  • Blocking:
  • Updates:
    • MCR Schema migrations are happening
      • Beta is set to write both / read new with no problems identified
      • Production set to write both / read old this week
      • Starting with migration scripts to copy data from old schema to new one
    • Discussion on-going on whether a production test wiki is necessary in addition to a test wiki on beta: https://phabricator.wikimedia.org/T197616
      • Requires Wikibase change propagation
    • Development and code review continues

Performance[edit]

  • Blocked by:
  • Blocking:
  • Updates:

Release Engineering[edit]

  • Blocked by:
    • Related to 1.32.0-wmf.14 train https://wikitech.wikimedia.org/wiki/Incident_documentation/20180724-Train#Actionables
      • Feedback needed from Wikidata team on how T200340 (Wikibase\DataModel\Entity\EntityIdParsingException $serialization must not be an empty string) could be prevented.
      • Feedback needed from Readers/Performance team(s) on how T200346 (wmf.14 failing to execute ThumbnailRender jobs "error: ThumbnailRenderJob::run: HTTP request failure") could be prevented.
      • Feedback needed from ORES/Wikidata team(s) on how T200412 (PageTriage requires ORES to be installed) could be prevented.
      • Feedback needed from Wikidata team on how T200420 (Wikidata dispatching stuck (not releasing lockmanager locks)) could be prevented.
      • Feedback needed from Readers team on how T200456 (MapCacheLRU::has called with invalid key. Must be string or integer) could be prevented.
  • Blocking:
  • Updates:
    • Moved the beta deployment server to deployment-deploy01, yell if anything seems amiss there

Research[edit]

  • Blocked by: None
  • Blocking: None
  • Updates:
    • We've been analyzing the Citation usage data and improving the schema.

https://phabricator.wikimedia.org/T199457

    • Working on recommending missing articles based on translation pageview predictions.
    • Have been interviewing candidates for a research position.

Scoring Platform[edit]

  • Blocked by:
    • Waiting for a TechCom review of JADE proposal for deployment.
      • Trying to get Global Collaboration's attention about this.
      • "Everything is a wiki page", yet we're not allowed to deploy an extension that might increase the number of wiki pages... Who will be blocked next?
  • Blocking:
  • Updates:
    • GSoC project by Saurabh Batra to identify donations fraud has resulted in a successful model! We're beginning integration work now.

Search Platform[edit]

Security[edit]

  • Blocked by:
  • Blocking:
  • Updates:


Site Reliability Engineering[edit]

  • Blocked by:
    • None
  • Blocking:
    • None
  • Updates:
    • eqiad row B and C upgrades went quite fine with some minor hiccups
    • work on the switchover preparation ongoing. Tentative timeline posted. Take a look at calls out section

Wikidata[edit]

German Technical Wishlist[edit]

  • Blocked by:
  • Blocking:
  • Updates:

SoS Meeting Bookkeeping[edit]

  • Updates:
    • move the meeting to 2 hours earlier as soon as week of 2018-08-06- look for new invite!
    • some changes to the notes template
    • keep the meeting as is- a forum for teams to share updates and ask for help and keep the notes as useful as possible
    • decision to handle goals dependencies outside this meeting