Scrum of scrums/2017-03-29

contact: https://www.mediawiki.org/wiki/Wikimedia_Engineering

Call outs

• New version of the PDF render service in beta: https://en.wikipedia.beta.wmflabs.org/api/rest_v1/#!/Page_content/get_page_pdf_titleWMDE, please verify it's all good!

Product

Reading

Android

• Last week:
  • New saved page cache implementation in review \o/ T156917
  • Upgraded Mapbox SDK
• Next week (https://phabricator.wikimedia.org/project/view/2352/ ):
  • Reading on site
  • Continue 2.5.x release https://phabricator.wikimedia.org/project/board/2667/

iOS

• Last Week
  • Released 5.4 https://phabricator.wikimedia.org/project/view/2326/
• This week
  • Reading offsite

Community Tech

• Unable to attend hangout due to poor WiFi in WMCON hotel
• Collaborating with WMDE's Technical Wishes team in testing and providing feedback on prototypes of features both teams are working on
• No other major updates, most of our team is out this week for WMCON or on holiday

Multimedia

• Not blocking anything, waiting for some help from Services on deploying 3d2png, based on their recommendation to use the service template deploy method. Expect that to be done soon.

Reading Infrastructure

• TemplateStyles:
  • CSS sanitizer library https://gerrit.wikimedia.org/r/#/q/project:css-sanitizer
• Mobile Content Service: https://phabricator.wikimedia.org/project/view/2445/
  • Last week: adding more languages to TFA (Today's Featured Article) in aggregated feed T150806
  • This week: deploy ^ + reading offsite

Web

• Last week: Reading Web off-site
• This week: Reading off-site

Editing

UI Standardization

• • Continued work on style guide components. Both technical and content-wise https://phabricator.wikimedia.org/tag/wikimediaui_style_guide/
  • Unify padding/position of labels/icons/indicators across OOjs UI widgets in a generalized manner https://phabricator.wikimedia.org/T161177
  • Align the style for lists of pages https://phabricator.wikimedia.org/T153417
• Updates:
  • OOjs UI:
    • Release of v0.20.1 (still undergoing release) https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md
      • Implement `grunt add-theme` task to ease theme creation (Bartosz Dziewoński)

Collaboration

• Blocked
• Blocking
• Updates
  • RecentChanges Filters
    • Port Wikidata to new RC Filters system.
    • Add conflicts (tracking which filters don't make sense together)
    • Continued enhancements to EventLogging for RC Filters
    • Deployed as Beta Feature to Polish Wikipedia and Portuguese Wikipedia
  • Flow
    • Fix for long-standing DB issue
    • Cleanup unused library

Parsing

• https://tools.wmflabs.org/wikitext-deprecation/ dashboard now tracks results from the Linter extension as well. Working through some bugs in the Linter extension and will continue with additional rollout this / next week.
• Doing a bunch of CSS tweaking as part of visual diff tests (https://parsoid-vd-tests.wikimedia.org/ ) comparing Parsoid rendering and PHP parser rendering. Continuing to update https://www.mediawiki.org/wiki/Parsoid/Known_differences_with_PHP_parser_output#Differences_identified_via_visual_diff_testing based on results of investigating the differences.
• Going through a bunch of bugs filed against Parsoid and fixing them.
• Parser Migration extension is ready for rollout -- probably next week.

Language

• Work on OOjs migration for Content Translation continue.

Discovery

• No blockers
• Elasticsearch 5 upgrade complete for search
• Logstash upgraded on beta cluster, production update will follow soon
• There are some issues with realtime suggestion updates, so it is stalled for now
• Second A/B test for displaying sister wiki results finished, analysis in progress
• First A/B test for sister wiki results analyzed: https://commons.wikimedia.org/wiki/File:A_Test_Of_Cross-wiki_Search_-_Helping_Users_Discover_Content_On_Wikipedia%E2%80%99s_Sister_Projects.pdf
• WDQS federation (calling out to other services) has been enabled, with small whitelist for starters

Technology

Security

• Reviews:
  • 2FA for iOS continues
  • CodeMirror planned for next week
• Meeting this week to discuss handoff of MW

Services

• Blockers: none

Updates:

• New version of electron PDF render service in BETA
  • https://en.wikipedia.beta.wmflabs.org/api/rest_v1/#!/Page_content/get_page_pdf_title
  • First update in half a year, big changes. Reading, WMDE, all parties interested - please beta-test
  • Moving to production in next several days
• Cassandra client encryption enforced for the RESTBase cluster

Technical Operations

• Blocking
  • No one
• Blocked
  • DBAs asking for help on https://phabricator.wikimedia.org/T159319
• Updates
  • Work on switchover goal concluding this week. Services are being switchover to discovery URLs across the infrastructure
  • Precise Pangolin (Ubuntu 12.04) is officially removed from production (last instance done today) and the last few VMs that have not been migrated by their owners in labs will be forcefully shutdown
  • Removal of precise supporting code from puppet has begun.
  • HHVM 3.18 upgrade started, and then stalled. 3.18 follows strict Zend PHP 7.0 behavior, mediawiki code needs to be updated T161095
  • ganglia officially deprecated (since last Q), removal has started

Fundraising Tech

• Blockers: none
• Mostly focused on the job-runner script to replace Jenkins
• testing on some simple jobs
  • Trickiest thing so far is streaming the subprocess's stdout to a file
• More investigations about importing 3rd-party mailer data into CiviCRM
• CentralNotice banner sequence feature: https://phabricator.wikimedia.org/T144453
• More PayPal express checkout fixes

Analytics

• Now serving pagecounts per project from AQS (legacy metric) [still beta - subject to changes]
• Finalizing the replacement of the reportcard using the mentioned new AQS metric and others
• More work on the Wikistats2.0 prototype, adding visual stubs for all functionalities before asking for feedback
• Deploying right now, replacing user agent string by user agent map in EventLogging