Scrum of scrums/2017-03-22

contact: https://www.mediawiki.org/wiki/Wikimedia_Engineering

Call outs

 * CodeMirror extension (for syntax highlighting) needs security review https://phabricator.wikimedia.org/T108687

Android

 * Last week:
 * Many miscellaneous UI enhancements for better offline support
 * New saved page cache implementation still in progress T156917
 * Next week (https://phabricator.wikimedia.org/project/view/2352/ ):
 * Continue improving the offline experience
 * Continue 2.5.x release https://phabricator.wikimedia.org/project/board/2667/

iOS

 * Last Week
 * 5.4 https://phabricator.wikimedia.org/project/view/2326/
 * Removed places from 5.4 so that updates can be made in response to user feedback
 * Shipped release candidate for 5.4
 * This week
 * Release 5.4
 * Login enhancements
 * Two factor auth
 * Bug fixes
 * 5.4.1 https://phabricator.wikimedia.org/project/view/2600/
 * Any fixes for 5.4 required after release
 * JS consolidation
 * 5.5 https://phabricator.wikimedia.org/project/view/2602/
 * Places updates in response to user feedback

Reading Infrastructure

 * TemplateStyles:
 * CSS sanitizer library https://gerrit.wikimedia.org/r/#/q/project:css-sanitizer
 * RfC closed, discussing implementation plans for deduplicating tags in https://phabricator.wikimedia.org/T160563
 * PageViewInfo: in production
 * https://en.wikipedia.org/w/index.php?title=Main_Page&action=info
 * https://en.wikipedia.org/w/api.php?action=query&format=json&prop=pageviews&list=mostviewed&meta=siteviews&titles=Main+Page&formatversion=2&pvipmetric=pageviews&pvipdays=3&pvimlimit=3&pvisdays=3
 * https://en.wikipedia.org/w/api.php?action=query&format=json&formatversion=2&titles=Planetary_nebula&prop=pageviews|extracts|pageterms|pageimages|pageprops|revisions&explaintext=&exchars=512&wbptterms=description&piprop=thumbnail&pithumbsize=320
 * ORES:
 * https://gerrit.wikimedia.org/r/#/c/336963/ (hooks + data attributes for change list items) waiting for +2
 * Mobile Content Service:
 * deployed a couple of bug fixes for mobile-sections endpoint
 * adding more languages to TFA (Today's Featured Article) in aggregated feed

Multimedia

 * No blocking/blockers
 * Deployment work for Extension:3d stalled on deployment work for 3d2png. We're working through that now, and hopefully it won't take too long.
 * Obviously we're in a different section this week. Team is moving. More to come.

Web

 * Sprint: https://phabricator.wikimedia.org/tag/reading-web-sprint-94/
 * Last week:
 * Page Previews tech debt clean-up and bug fixes
 * Print styles
 * This week:
 * Reading Web off-site

Community Tech

 * LoginNotify high-priority, aiming for an early April release https://phabricator.wikimedia.org/T11838 https://phabricator.wikimedia.org/T160094
 * XTools going very well, "Articleinfo" and "Top Edits" working https://tools.wmflabs.org/xtools-dev/
 * Now working on the edit counter https://phabricator.wikimedia.org/T160481
 * Cookie blocks all merged and on next week's deploy train, Tuesday we will test on Testwiki https://phabricator.wikimedia.org/T158129
 * Popular pages bot now includes pageviews of all redirects to each page in the WikiProject https://phabricator.wikimedia.org/T160201
 * Editing team graciously tested a solution to have CodeMirror (syntax highlighting) work in new wikitext editor, seems promising so we will test further https://phabricator.wikimedia.org/T161052
 * Blocker: Ready to move forward with adding it to old wikitext editor, but needs security review https://phabricator.wikimedia.org/T108687

UI Standardization

 * This week
 * Style guide work on components. Both technical and content-wise https://phabricator.wikimedia.org/tag/wikimediaui_style_guide/
 * Wikimedia UI/OOjs UI icon fundamentals: https://phabricator.wikimedia.org/T135081, https://phabricator.wikimedia.org/T141801 and https://phabricator.wikimedia.org/T139351
 * Updates
 * OOjs UI:
 * Release of v0.20.0 (postponed from last week, due to Jenkins trouble)
 * Huge improvement on/resolving almost entirely `em` sizing based interface issues across browsers
 * Also including 11 UI touching patches (icon deprecations, removed icon flags, color amendments, vertical rhythm) https://phabricator.wikimedia.org/diffusion/GOJU/browse/master/History.md

Language

 * OOjs migration for ContentTranslation continue.
 * Team will ask Services help in https://phabricator.wikimedia.org/T107914 (if needed)

Collaboration

 * Blocked
 * Blocking
 * Updates
 * RC Filters deployed to test.wikipedia.org and test2.wikipedia.org. Going to Portuguese and Polish on Tuesday.
 * RC Filters GuidedTour
 * Add ORES filters to new RCFilters
 * Allow the ORES extension features to be 'on' by default
 * RCFilters UI: Add a 'what's this?' link to filter groups
 * More RC Filters UI improvements. E.g.
 * Rework conflicts to be objects in filter or group context
 * Create tooltips for filter states

Parsing

 * Linter now deployed on small wikis; Bugs being fixed based on feedback / testing; Likely deployed to medium wikis this week
 * Planning rollout of ParserMigration extension to let editors compare Tidy output with its replacement (RemexHTML).
 * Based on visual diff testing of a language variants patch in core (https://gerrit.wikimedia.org/r/#/c/333997/ ), we have identified some pages (primarily chemical element pages like enwiki:Isavuconazole and others on multiple wikis that use language variant markup that is being affected by this patch. We are thinking of updating the markup on these pages to nowiki the "-{" and "-}" that might be encountered there. Doing a dump grep to find these

Analytics

 * finished productionizing edit reconstruction jobs, Data Lake tables in Hive now have a "snapshot" partition column and will be updated regularly
 * not urgent but blocked on people to review mediawiki-config and mediawiki-extensions changes: https://gerrit.wikimedia.org/r/#/c/344007/, https://gerrit.wikimedia.org/r/#/c/342913/, https://gerrit.wikimedia.org/r/#/c/336446/. Especially 342913, which solves errors in production on every edit.  Some people seem to review these in their own time, but it would be nice to have organizational support, or should we get +2 rights on our team and do it?
 * MF: Deployers have +2 for mediawiki-config. You may want to request at least one person on your team to become a deployer, for this and other reasons (e.g. running scripts and mwrepl in production).
 * ongoing: legacy pagecount metrics being added to AQS, will be queryable via the API soon
 * ongoing: wikistats 2.0 prototype with Vue, in a little over a week we are very comfortable with the framework, so great learning curve as advertised

Security

 * Reviews:
 * 2FA login on iOS App


 * MediaWiki 1.28.1/1.27.2/1.23.16 nearly ready for release

Technical Operations

 * Blocked
 * Blocking
 * Updates
 * Special:Allpages outage incident report https://wikitech.wikimedia.org/wiki/Incident_documentation/20170320-Special_AllPages
 * Labs: nfs-exportd not setting correct permissions on exports (resolved with patch) https://phabricator.wikimedia.org/T160818
 * Adjusting Prometheus retention caused missing data https://phabricator.wikimedia.org/T160677
 * Mark on parental leave

Services

 * Blockers: none
 * Updates:
 * Node.js kafka driver upgraded for all services using kafka (Change-Prop, Trending, EventStreams
 * Cassandra client encryption enabled in RESTBase Cassandra cluster: https://phabricator.wikimedia.org/T111113
 * Thanks to discovery maps updated to node 6 and the node migration is now complete

Discovery

 * No blockers
 * All searches now served from ElastitcSearch 5.1.2. eqiad cluster upgrade soon.
 * Completion suggester temporarily disabled to accommodate a bugfix for title length, will be re-enabled soon (probably today).
 * Second A/B test for displaying sister wiki results in search launched (https://lists.wikimedia.org/pipermail/wikitech-l/2017-March/087800.html)
 * Working on adding search to Special:Undelete (https://phabricator.wikimedia.org/T109561)
 * Working on Wikidata search
 * Various updates to portal code & stats, see weekly for details (https://www.mediawiki.org/wiki/Discovery/Status_updates/2017-03-13)

Fundraising Tech

 * No external blockers
 * Blocking: DonationInterface vendor lib double-inclusion https://phabricator.wikimedia.org/T159099
 * Sounds like Reedy doesn't consider it high priority, mostly just annoying for IDEs to have two versions of classes
 * DonationInterface
 * More tech debt work https://phabricator.wikimedia.org/T160385
 * CentralNotice
 * Banner Sequencing https://phabricator.wikimedia.org/T144453
 * Reducing cache purges for https://phabricator.wikimedia.org/T154954
 * CiviCRM
 * Finishing up the address fixes https://phabricator.wikimedia.org/T158268
 * Investigating importing 3rd party bulkmailer data
 * Opsy
 * https://phabricator.wikimedia.org/T159289
 * Trying to get our last (and most complicated) Precise box migrated to Jessie
 * Writing some wrapper scripts to run jobs using cron instead of via Jenkins
 * Thanks for the interest and comments from releng!