Scrum of scrums/2017-11-08

From mediawiki.org

2017-11-08[edit]

Callouts[edit]

  • No MW Train the week of the 20th due to Thanksgiving, SWATs will be open on Mon and Tuesday (Wednesday is “Friday” that week).
  • RelEng: Please port your browser tests to the nodejs framework. 7 repositories have not started yet (still in ruby, which is no longer maintained). task
  • Tidy replacement: if you are an editor on some wiki, please get the word out to your wikis to fix the high-priority linter issues. We want to get Tidy removed from the cluster sooner than later.A bunch of wikis (including mediawiki) no longer have Tidy, and a few 100 small wikis can get Tidy replaced based on stats about linter issues ( https://www.mediawiki.org/wiki/Parsing/Replacing_Tidy/Linter/Stats/2017-11-06#Wikis_with_zero_high-priority_errors ). But would be good to get some largish wikis moved over so we can identify any lingering problems sooner than later.


Audiences[edit]

Readers[edit]

iOS native app[edit]

Android native app[edit]

  • Blocked by:
  • Blocking:
  • Updates:
    • Released version 2.6.206 to production.
    • Continuing to test / integrate with Reading List service.

Reading Web[edit]

Reading Infrastructure[edit]

  • Blocked by:
  • Blocking:
  • Updates:
    • Continuing work on MCS summary, media (gallery) endpoints.
    • Continuing with Reading Lists

Multimedia[edit]

  • Blocked by:
  • Blocking:
  • Updates:

Discovery[edit]

  • Blocked by:
  • Blocking:
  • Updates:
    • continuing work on portal automation. going well.
Maps[edit]
  • Blocked by: N/A
  • Blocking: N/A
  • Updates: None


Contributors[edit]

Editing[edit]

  • Blocked by:
  • Blocking:
  • Updates:

Parsing[edit]

  • section + figure-inline + html5-ids changes aren't going out this week after all -- reviews not yet finalized + we need thorough testing in beta cluster. We are still hoping to get it out next week.
  • Tidy replacement: if you are an editor on some wiki, please get the word out to your wikis to fix the high-priority linter issues. We want to get Tidy removed from the cluster sooner than later. A bunch of wikis (including mediawiki) no longer have Tidy, and a few 100 small wikis can get Tidy replaced based on stats about linter issues

Global Collaboration[edit]

  • Blocked by: nobody
  • Blocking: ops maybe? There's the Flow dumps issue but not sure how much of a blocker that is
  • Updates:
    • Going to roll out RCFilters to remaining (FlaggedRevs) wikis on Nov 15
    • Early work on using wikitext instead of HTML for storing Flow content, need something like pcache except 1) it's Parsoid HTML not PHP HTML 2) Flow comments aren't pages

UI Standardization[edit]

Community Tech[edit]


Technology[edit]

Analytics[edit]

  • New kafka Jumbo cluster is up, for now mirror-ing topics from analytics cluster.
  • New DB hosts for eventlogging back in place, purging data out of compliance at a faster rate due to better hardware.
  • We have spark2 in cluster!
  • Still troubleshooting metric difference wikistats 1.0 on wikistats 2.0. Take a look edit metrics available now (some of them have a 5% difference, so not final yet): https://stats.wikimedia.org/v2/#/am.wikipedia.org
  • Work on refining eventlogging data in hadoop continues so hadoop can be a easy to query backend for eventlogging data


Cloud Services[edit]

  • Blocked by:
  • Blocking:
  • Updates:

Fundraising Tech[edit]

MediaWiki Platform[edit]

  • Blocked by:
  • Blocking:
  • Updates:

Performance[edit]

  • Blocked by:
  • Blocking:
  • Updates:

Release Engineering[edit]

  • Blocking
    • ???
  • Blocked
    • Please port your browser tests to the nodejs framework. 7 repositories have not started yet (still in ruby, which is no longer maintained).
  • Updates
    • No MW Train the week of the 20th due to Thanksgiving, SWATs will be open on Mon and Tuesday (Wednesday is “Friday” that week).
    • [TechDebt program] First pass of the service levels for component ownership was shared with the Code Health Group last week; feedback on-going.
    • [TechDebt program] The next blog post should be posted Real Soon Now™ (done on our side).
    • [SSD Program] Working on getting the mathoid tests running on submit.
    • [SSD Program] A new release of Blubber is on the horizon.
    • [scap tech debt] Working to support both pre git-2.11 and post git 2.11 hosts (namely Trusty and Jessie (with backports)/Stretch, respectively) to let us use newer functionality (notably `--jobs`).
    • [CI] Most tox jobs are moved to Docker containers
    • [CI] Investigating why many docker containers are left behind after a SIGTERM

Research[edit]

  • Blocked by:
  • Blocking:
  • Updates:

Scoring Platform[edit]

  • Blocked by:
  • Blocking:
  • Updates:
    • frwiki -- ongoing issue. https://phabricator.wikimedia.org/T179711 (should be fixed by SOS)
    • Draft quality data is coming to English Wikipedia (ping Commtech and Global Collab)
      • You can use this to help patrollers sort new pages by (Spam, Attach, Vandalism/Hoax, or OK). OK == not immediately concerning but not necessarily good.
      • [Reponse from Roan: we don't plan to use draftquality directly at this point]
    • Wikilabels getting some improvements.
      • Links to on-wiki documentation for each campaign ("info" link)
      • Statistics about labelers will have usernames
    • Amir is working on Icelandic language support.

Search Platform[edit]

Security[edit]

  • Blocked by: None
  • Blocking: Everyone waiting for security reviews
  • Updates:
    • Reviews:
      • BeautifulSoup (done, comments will be added shortly)
      • vue.js (done, same)
      • mediawiki-services-chromium-render
    • Preparing for MW security release

Services[edit]

  • Blocked by: none
  • Blocking: none
  • Updates:
    • Parsoid storage switched to new storage model for all but wikipedias
    • Definitions storage switched to new model
    • Planning on switching RecordLintJob to kafka-based JobQueue

Technical Operations[edit]

Wikidata[edit]

German Technical Wishlist[edit]

  • Blocked by:
  • Blocking:
  • Updates: