Scrum of scrums/2017-07-19

2017-07-19

• contact: https://www.mediawiki.org/wiki/Wikimedia_Engineering

Callouts

• FR-tech requesting help with Translate extension: https://phabricator.wikimedia.org/T170968

• Skilled in RewriteRules? https://gerrit.wikimedia.org/r/360891 and https://gerrit.wikimedia.org/r/357985 need review.

• Help cleaning up /srv/deployment - if you have software on the deployment server that is no longer deployed please add it here: https://phabricator.wikimedia.org/T170881

• Need some ops help/review with WDQS spam problem: https://phabricator.wikimedia.org/T170860

• Node.js upgrade is on the way, please test your service if you didn't yet: https://phabricator.wikimedia.org/T170548
• Reading Web: Input would appreciated if you are familiar with Special:ShortPages (https://phabricator.wikimedia.org/T170687#3444846)

Audiences

Readers

iOS native app

• Blocked by: none

• Blocking: none

• Updates: 5.5 (with Places & feed design updates) is (our first?) sustained 5-star rated release, Continuing work on 5.6 (dark mode, on this day feed content) https://phabricator.wikimedia.org/project/view/2701/

Android native app

• Blocked by: n/a

• Blocking: n/a

• Updates:
  • Cookie release work is all in QA/design review (https://phabricator.wikimedia.org/project/view/2763/)
  • Offline compilations work is well underway (https://phabricator.wikimedia.org/project/view/2833/)
  • Stephen working on cross-platform CSS/JS consolidation, lazy loaded images in articles, dark mode UI
  • engineer interviews in progress; resumes are coming in for the PM position

Reading Web

• Blocked by:
  • RelEng: We have PHPUnit tests that are not being run https://phabricator.wikimedia.org/T170880 - would appreciate some help debugging the issue

• Blocking:

• Updates:
  • Working on print styles for desktop.
  • Input would appreciated if you are familiar with Special:ShortPages (https://phabricator.wikimedia.org/T170687#3444846)
  • Planning to roll out Page previews to all wikis except German and English.
  • Updating Vector's print styles
  • Planning new HTML summary endpoint ( https://phabricator.wikimedia.org/T113094 )

Reading Infrastructure

• Blocked by: N/A

• Blocking: N/A

• Updates:
  • working on Reading Lists
  • TemplateStyles deployed to wikitech, mediawiki.org
  • Measured payload differences of output between Parsoid and various transformations in MCS. https://phabricator.wikimedia.org/T164033
  • Looking into structured reference list content.

Multimedia

• Blocked by: (maybe) RelEng re: issues with Beta thumbnailing of 3D files (sent Tyler an e-mail) - https://phabricator.wikimedia.org/T170444

• Blocking: N/A

• Updates: Design work on 3D extension is nearly done for our MVP release.

Discovery

• Blocked by: N/A

• Blocking: N/A

• Updates:
  • Maps team out this week
  • Finishing up AB test on Special:Search page

Community Tech

• Blocked by:

• Blocking:

• Updates:
  • Still working on section IDs, LoginNotify and CodeMirror

Contributors

Editing

• Blocked by:

• Blocking:

• Updates:

Parsing

• Updates:
  • https://www.mediawiki.org/wiki/Parsing/Notes/Section_Wrapping documents constraints around adding <section> wrappers in Parsoid's output ( we aren't going to do this for PHP parser output because it isn't DOM based ). This will eliminate the need for MobileContentService to do their own thing. However, our proposed solution behaves differently from MCS' currently deployed version in some edge cases (<div> wrapping multiple sections or partial sections, for ex) -- MCS folks are already aware of this. But, if anyone else has opinions / thoughts on this, please leave them on the talk page. https://phabricator.wikimedia.org/T114072 is the associated phab task

Global Collaboration

Language

• Blocked by:

• Blocking:
  • https://phabricator.wikimedia.org/T170591 Blocking FT. Kartik looking at it, but more eyes are welcome!

• Updates:
  • Adaption logic moving to cxserver.
  • OOjs UI work for ContentTranslation continue.

Collaboration

• Updates
  • RCFilters
  • RCFilters UI: Add 'remove' and 'restore defaults' to filter list
  • RCFilters UI: Read default states of filters
  • rcfilters: Remove implemented filters from list of links
  • Bug fixes

Contributors Design

• Blocked by:

• Blocking:

• Updates:

UI Standardization

• Updates:
  • WikimediaUI Style Guide:
  • Added WikimediaUI Style Guide own imagery to repo's resources directory and make style guide use HiDPI images instead of 1x PNGs
  • OOjs UI: no release this week, changes/ongoing since v0.22.3
  • (continued from last week): Further aligning OOjs UI with WikimediaUI Base
  • Connecting documentation on mediawiki.org with OOjs UI demo
    • Reverting "FieldsetLayout: Temporarily remove use of `<legend>` due to Chrome 55... – accessibility improvement (James Forrester)
    • WikimediaUI theme: Use icon instead of indicator in Tag-/CapsuleItemWidget
    • MW core:
    • Simplify print style rules and tackle improvements desktop print

Technology

Analytics

• Blocked by:

• Blocking:

• Updates:
  • Running eventlogging purging as of now, still deleting data from 2014/early 2015. Had an outage on eventlogging after consuming data from eventbus events are backfilled now
  • https://wikitech.wikimedia.org/wiki/Incident_documentation/20170711-EventLogginghttps://wikitech.wikimedia.org/wiki/Analytics/Systems/EventLogging#Changes_and_Known_Problems_with_Dataset
  • DE data analyst leaked password for db, that is corrected and changed now Working on our first deployment of wikistats 2.0, still no backend, just frontend and pageview metrics against AQS. Added detailed desktop browser stats for all wikimedia sites.
  • Numbers very stable for a while with Chrome on the lead with 44% https://analytics.wikimedia.org/dashboards/browsers/#desktop-site-by-browser
  • Waiting for final vetting of project-family unique devices data from data analysts (unique devices on *.wikipedia.org)

Cloud Services

• Blocked by:

• Blocking:

• Updates:

Fundraising Tech

• Blocked by:

• • Translate extension is writing huge numbers of db rows on banner save: https://phabricator.wikimedia.org/T170968

• Blocking:

• Updates:
  • Doing weekly one hour tests of Big English countries, getting some good data (and plenty of donations!)
  • CentralNotice
    • Met with WMDE fundraising to get them involved with CentralNotice coding
    • They reported timeouts saving banners: https://phabricator.wikimedia.org/T170591
    • See root cause in 'blocked by' and callouts
  • CiviCRM:
    • more work on third-party mailer integration
    • https://phabricator.wikimedia.org/T161760, https://phabricator.wikimedia.org/T161758, https://phabricator.wikimedia.org/T170900
    • more location import fixes: https://phabricator.wikimedia.org/T169025
  • DonationInterface and SmashPig payments library
    • Fixing last couple bugs in new PayPal integration
    • https://phabricator.wikimedia.org/T167923 and https://phabricator.wikimedia.org/T170478
    • making steady progress with new API for main credit card processor (Ingenico):
      • https://phabricator.wikimedia.org/T163946 and https://phabricator.wikimedia.org/T163948

MediaWikiPlatform

• Blocked by:

• Blocking:

• Updates:

Performance

• Blocked by:

• Blocking:

• Updates:

Release Engineering

• Blocked by: None

• Blocking: None?

• Updates:
  • Train back on track, wmf.9 rolled forward Monday thanks to ebernhardson and jdlrobson for the heroic debugging and patch making respectively
  • An attempt at cleanup of /srv/deployment halp please

Research

• Blocked by:

• Blocking:

• Updates:

Scoring Platform

• Blocked by:

• Blocking:
  • Scheduling a meeting with Collaboration, hopefully to finalize details of splitting ownership of the Extension:ORES repo, and cleaning up preferences for the legacy and noscript ORES UI.

• Updates:
  • Deployed a bevy of new models, https://phabricator.wikimedia.org/T170485, supporting Albanian, Bengali, Greek, Romanian, Tamil, and Turkish.
  • Noticed that a wdqs thing "recommendation api" is breaking puppet on beta labs. https://phabricator.wikimedia.org/T171075

Search Platform

• Blocked by: none

• Blocking: none

• Updates:
  • Continuing work on ML-assisted ranking
  • Japanese analyzer research finished, not deploying for now (https://phabricator.wikimedia.org/T166731)
  • "Explore similar" A/B test running
  • Working on interleaved search results A/B test
  • Ops help needed for WDQS spam problem (https://phabricator.wikimedia.org/T170860)

Security

• Blocked by: Comm. with Legal on several issues

• Blocking: Legal, and several other teams who are waiting for security reviews

• Updates:
  • Security reviews:
    • vue.js
    • OIT apps
  • Bawolff will be mostly unavailable until August 1

Services

• Blocked by: none

• Blocking: none

• Updates:
  • Working on new storage model on RESTBase
  • Node.js 6.11.1 upgrade is coming
  • https://phabricator.wikimedia.org/T170548

Technical Operations

• Blocked by: none

• Blocking: none?

• Updates:
  • Work on goals ongoing https://www.mediawiki.org/wiki/Wikimedia_Technology/Goals/2017-18_Q1#Technical_Operations
  • Switch upgrades in codfw almost finished

Wikidata

• Blocked on reviews of two patches that introduce RewriteRules:
  • https://gerrit.wikimedia.org/r/360891
  • https://gerrit.wikimedia.org/r/357985

• Reworked the query service UI: https://phabricator.wikimedia.org/T170279

• Units in quantities are now properly usage-tracked: https://phabricator.wikimedia.org/T170167

• Spend time to think about constraint reports on deprecated statements: https://phabricator.wikimedia.org/T167653

• Final touches on Lexeme demo for Wikimania: https://phabricator.wikimedia.org/T165588

German Technical Wishlist

• Collecting input and assigning priorities to the top 10 wishes from the recent poll.