Scrum of scrums/2017-04-26

2017-04-26

contact: https://www.mediawiki.org/wiki/Wikimedia_Engineering

Call outs:

• Datacenter switch back Wednesday, May 3rd 2017 14:00 UTC (user visible, requires read-only mode)
  • https://wikitech.wikimedia.org/wiki/Switch_Datacenter
• RelEng/Ops: Reading Web needs your help! Config is being ignored and shipping feature that communities have explicitly asked to be disabled and we don't understand why. https://phabricator.wikimedia.org/T163114

Product

Reading

Web

• Mostly bug fixing and improving code quality for pending Page previews launch
• Need help from RelEng/Ops to address `Regression: Fix config to disable related pages where it's not wanted( https://phabricator.wikimedia.org/T163114)`. Config is being ignored and shipping feature that communities have explicitly asked to be disabled and we don't understand why.

iOS

• Last Week
  • Continued work on 5.4.1 - https://phabricator.wikimedia.org/project/view/2600/
    • Regression testing, new public beta
    • Crash fixes & performance enhancements
  • 5.5 - https://phabricator.wikimedia.org/project/view/2602/
    • Places (UserTesting feedback)
    • Article footer content rendered in HTML/CSS rather than native views
• This Week
  • Submit 5.4.1 to the App Store
  • Continue work on 5.5
    • Updates to Places from user feedback

Android

• Beta released last week containing Wikidata title description editing expanded to many more languages, as well as various offline UX improvements
  • Hotfix release Friday (4/21), promoted to prod yesterday: https://lists.wikimedia.org/pipermail/mobile-l/2017-April/010503.html
• Planning is underway for implementing offline ZIM compilations (Q4 goal)
  • https://phabricator.wikimedia.org/project/view/2723/
• Continuing work on cross-platform consolidation of CSS & JS
• Current release board: https://phabricator.wikimedia.org/project/view/2352/

Reading Infrastructure

• ORES: working on api.php abuse + DB size issues, hoping to reenable after data center switchback
• librarized https://www.mediawiki.org/wiki/Testing-access-wrapper
• MCS: stop annoucement of past survey, fix handling of links in section titles

Editing

UI Standardization

• This week:
  • Continued work to provide WikimediaUI Base variables in core https://phabricator.wikimedia.org/T123359
• Updates:
  • OOjs UI:
    • Release of v0.21.2 with 11 UI/a11y improvements https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md – among those:
      • MediaWiki theme: Full WCAG level AA contrast support of widgets accomplished
      • MediaWiki theme: Fix IE 7 oversized buttons
      • MediaWiki theme: Improve SearchWidget design
      • Set ARIA `role=combobox` on DropdownWidget and LookupElement too (Bartosz Dziewoński)
      • Set `aria-owns` for everything with a dropdown list (ARIA `role=combobox`) (Bartosz Dziewoński)

Parsing

• Parsoid: Audio / video support in place -- we plan to deploy today.
• Linter: Improved documentation and guidance for fixing linter errors @ https://www.mediawiki.org/wiki/Help:Extension:Linter
• Tidy replacement: Updated documentation @ https://www.mediawiki.org/wiki/Parsing/Replacing_Tidy/FAQ
• Language Variant tweaks in preprocessor: Fixups required documented @ https://www.mediawiki.org/wiki/Parsoid/Language_conversion/Preprocessor_fixups ... an editor has been diligently fixing them. We plan to make an announcement about this upcoming change soon and then merge the core patch ( https://gerrit.wikimedia.org/r/#/c/333997/ ) after that.

Language

• CX reenabled; We're watching logs and ready to disable if needed. Incident report in progress.
  • https://phabricator.wikimedia.org/T163344
• OOjs UI migration work in progress.

Collaboration

• RCFilters: Optimization so if we know a query will return 0 results, we won't do the query at all. Some of these no-result queries have extremely poor performance.
• Working on GuidedTour to make people aware of RCFilters beta feature
• Working on next generation of RCFilters, including namespace and user filters, saved settings, and more sophisticated time filtering.
• DId a deploy Monday to enable RCFilters on English Wikipedia, plus almost all non-ORES wikis. Some issues with preferences, but these have been partly tracked down.
• Other bug fixes

Community Tech

No blockers

• Rollling out Cookie Blocking to all wikis next Monday
• Further polish work on CodeMirror extension (syntax highlighting)
• Getting community feedback on LoginNotify extension (currently on Beta Cluster for testing)
• User rights expiration is live on all wikis

Technology

Research

• Reader research surveys are most likely to go out next week
  • We will be running these surveys in 14 languages with the help of Reading team
  • https://meta.wikimedia.org/wiki/Research_talk:Characterizing_Wikipedia_Reader_Behaviour/Robustness_across_languages#What_other_languages_to_run_the_surveys_in.3F
  • https://phabricator.wikimedia.org/T151835

Wikidata

• Focusing on the Lexeme extensions UI, example: http://wikidata-lexeme.wmflabs.org/index.php/Lexeme:L2
• Had to work around a change in core that blocked undeleting Wikidata entities: https://phabricator.wikimedia.org/T163144
• Going to deploy Echo notifications when linking pages via Wikidata: https://phabricator.wikimedia.org/T110604

German Technical Wishlist

• Planning next steps for the book referencing wish: https://phabricator.wikimedia.org/T151301

Discovery

• No blockers
• Building infrastructure for machine learning assisted ranking (aka MjoLniR)
• Chinese analyzer seems to be doing well, enabling soon. Working on Hebrew analyzer.
• Completed analysis of second sister wiki search A/B test: https://commons.wikimedia.org/wiki/File%3ASecond_Test_Of_Cross-wiki_Search_-_Helping_More_Users_Discover_Content_On_Wikipedia%E2%80%99s_Sister_Projects.pdf
• Published notes from discussion on scoring functions: https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Some_Thoughts_on_the_Math_of_Scoring
• Updated WDQS dashboard to include traffic from all SPARQL endpoints: https://discovery.wmflabs.org/wdqs/
• Updated the external search dashboard to display non-bot traffic (https://discovery.wmflabs.org/external/, task T161932)
• Portal statistics (task T128546) and translations (task T142582) were updated
• Working on Wikidata search improvement
• Working on Mediawiki API integration for WDQS

Analytics

• Ongoing work on EventLogging analysis support in Hadoop - Not yet finished
• Ongoing work on Wikistats 2.0 data back-end - Finalizing Design
• Started to define webrequest tagging project
• Daily uniques are in Pivot
• Waiting for feedback on Wikistats 2.0 consultation
• Dashiki configuration articles on meta still broken, can't fix them until the codfw-related deployment moratorium is over

TechOps

• Blocked
  • None
• Blocking
  • None?
• Updates
  • Wrapping up switchover action items https://etherpad.wikimedia.org/p/codfw-switchover-AprMay2017
  • ToolsProxy incident report https://wikitech.wikimedia.org/wiki/Incident_documentation/20170419-ToolsProxy

Security

• Reviews
  • WikibaseMediaInfo
  • TemplateStyles

Services

• Blockers: none
• Updates:
  • Service-runner doesn't support node 0.1x any more
  • https://github.com/wikimedia/service-runner/pull/163

RelEng

• Blocked
  • None
• Blocking
  • None?
  • Config symlinks should be touched when they're deployed, Reading callout above https://phabricator.wikimedia.org/T126306
• Updates
  • New version of scap out https://github.com/wikimedia/scap/blob/release/debian/changelog#L1 (config diffs in a basic format, env announce in IRC)
  • 1.29 is coming...see wikitech email for more info

Fundraising Tech

• More Paypal Express Checkout fixes
• Investigating potential extra session creation on paymentswiki
• Planning Ingenico integration changeover, which will include moving a lot of functionality from MW extension to lib
• Coordinating with Comms to update the WMF logo in various places: https://phabricator.wikimedia.org/T144254
• CentralNotice: Banner sequence feature is in code review https://phabricator.wikimedia.org/T144453
• CiviCRM: getting rid of the rest of our local core hacks, using upstream buildkit in CI
• Found a dozen repos we can delete