Scrum of scrums/2017-12-20

= 2017-12-20 =

Callouts

 * Reminder: Failover for wikidata (new s8 shard) arranged for 9th Jan - T181645
 * Would like somebody from performance/MediaWiki team to look at: https://phabricator.wikimedia.org/T183101 we’ve got some fails on LinksUpdate which blocked search index update which makes Wikidata items invisible in search (~50 items)

iOS native app

 * Blocked by: none
 * Blocking: none
 * Updates:
 * 5.7.3 with faster article loading, pure black mode for OLED releasing this week

Android native app

 * Blocked by:
 * Blocking:
 * Updates:

Reading Web

 * Blocked by:
 * Blocking:
 * Updates:

Reading Infrastructure

 * Blocked by: Ops on puppet code review:
 * https://gerrit.wikimedia.org/r/#/c/397623/
 * https://gerrit.wikimedia.org/r/#/c/395694/
 * Blocking:
 * Updates:

Multimedia

 * Blocked by:
 * Blocking:
 * Updates: 3D deployment pushed to January, MediaInfo work is unblocked and progressing, and very little else is happening

Maps

 * Blocked by: service-runner build failures
 * Blocking: N/A
 * Updates:

Editing

 * Blocked by:
 * Blocking:
 * Updates:

Parsing

 * Blocked by:
 * Blocking:
 * Updates:

Global Collaboration

 * Blocked by:
 * Blocking: Flow dump performance improvement is blocking ops and in progress. I'm resuming this now.
 * Updates:
 * RCFilters
 * Bug fixes, especially regarding RecentChangesLinked page; also, LiveUpdate
 * Ruby browser tests
 * We're removing most of our Ruby browser tests, since we decided the value doesn't justify the time investment of converting them to node.js, and Ruby support is being removed completely.
 * Ongoing work on Flow frontend experimentation; mostly consolidated on a plan for this.

UI Standardization
Will be removed in v0.26.0
 * Special OOUI v0.24.4 release coming today with some backports to address issues uncovered in v0.24.3
 * 2 deprecating changes, icons 'bellOn' of 'alerts' pack, 'quotesAdd' & 'redirect' of 'editing-advanced' have been identified to be unused nor won't be used in future.
 * Add 'lightbulb' icon to 'interactions' pack
 * Also introduce OO.ui.getDefaultOverlay function that provides a more solid default OOUI overlay handling within other core theme elements (Bartosz Dziewoński)
 * Ongoing:
 * OOUI & based products:
 * icons: Finalizing work on icon set to be more harmonious and align to WikimediaUI Style Guide https://phabricator.wikimedia.org/T177432 – currently addressing remaining RTL issues
 * Unify SVG markup across Foundation products https://phabricator.wikimedia.org/T178867
 * All products aligned
 * Introducing per-project proof SVGO optimization for future SVG additions, see also https://www.mediawiki.org/wiki/Manual:Coding_conventions/SVG

Community Tech

 * Finally received green light with our core refactoring for GlobalPreferences. Otherwise, wrapping up this year's stuff. New wishes in the new year, whee!

Analytics

 * Blocked by:
 * Blocking:
 * Updates:
 * Announced alpha release of wikistats: https://stats.wikimedia.org/v2/ (Working on UI bugs filed by users, we love our users for caring and filing them)
 * Blogposts on the way for wikistats, on both the back-end and front-end work
 * Working on new public apis to power map data, pageviews-per-country
 * Some performance issues with druid private cluster, resolved (some tricky interaction with OS Page Cache)
 * New kafka jumbo cluster work progressing, at the request of Brandon we are going to take a second look at supported ciphers for TLS
 * Updated dashiki dashboards with a CC0 license link, see, for example: https://edit-analysis.wmflabs.org/multimedia-health/

Cloud Services

 * Blocked by:
 * Blocking:
 * Updates:
 * All puppetmasters now running 4.x puppet
 * Agent upgrade pending Trusty agent packages
 * All Wiki Replica usage now on the "new" cluster. 
 * labsdb1001 & labsdb1003 can be decommissioned on or after 2018-01-03
 * Some things a bit blocked by the broken puppet compiler (at least as of Friday)

Fundraising Tech

 * Blocked by: nothing
 * Blocking: nothing
 * Updates:
 * Fundraiser still going really smoothly, showing very few banners
 * Investigating some low-level errors
 * Getting some civi stuff merged upstream
 * fixes & enhancements to internal dashboard and grafana stats

MediaWiki Platform

 * Blocked by: N/A
 * Blocking: N/A
 * Updates:
 * Q3/Dev Summit/Audiences Technology Working Group planning
 * Multi-content revisions
 * Actor table patch being rebased after merge of some Revision table patches
 * Code review
 * Reviewing development needs
 * Comment table schema change continuing to be applied
 * cleanupUsersWithNoId script has been run on most wikis
 * Helping GCI students with their tasks
 * Prepping the next MediaWiki-CodeSniffer release
 * Socializing and publishing https://www.mediawiki.org/wiki/Best_practices_for_extensions page since people are starting to comment on it

Performance

 * Blocked by: N/A
 * Blocking: N/A
 * Updates:
 * Q3 goals posted
 * Intro to Performance measurement posted: https://wikitech.wikimedia.org/wiki/Measure_Performance -- training based on this to come in Q3
 * WebPageRelay variability reduced to ~2%, well positioned for Q3
 * Improved Varnish slow log landed on Vagrant, will be hitting prod right after the holidays
 * mcrouter configuration will be hitting prod right after the holidays, for testing

Release Engineering

 * Blocking
 * Blocked
 * Teams that did not port Selenium tests from Ruby to Node.js (T139740): No team (1), Editing (1), Fundraising Tech (1), Global Collaboration (4), Multimedia (1), Reading Web (3), WMDE Engineering (5)
 * Updates
 * REMINDER: No deploys this week and next (18th and 25th). Take a break! [wiki][email]
 * We’re (Chad) going to spend some time this week cleaning up log-spam.
 * Our Q3 goals posted
 * Completed the security upgrade of RuboCop and Rubyzip
 * Our Q2 “SSD” (Program 6) goals are now all complete [wiki][email]
 * Antoine is migrating the CI docker image build process to using docker-pkg (from Giuseppe)
 * Follow-up continues on the ORES post-mortem follow-ups
 * Follow-up continues on the ORES post-mortem follow-ups

Research

 * Blocked by:
 * Blocking:
 * Updates:

Scoring Platform

 * Blocked by:
 * Blocking:
 * Updates:

Search Platform

 * Blocked by:
 * Blocking:
 * Updates:
 * Would like somebody from performance team to look at: https://phabricator.wikimedia.org/T183101 we’ve got some fails on LinksUpdate which blocked search index update which makes Wikidata items invisible in search (~50 items)
 * Working on fixes for completion suggester & redirects namespaces
 * Working on Wikidata search fixes for delay & space handling
 * Working on refactoring search profiles to make them more config-like https://phabricator.wikimedia.org/T183279
 * Wikidata fulltext search prototype published and collecting feedback: https://www.wikidata.org/wiki/Wikidata:Project_chat#Wikidata_fulltext_search_prototype

Security

 * Blocked by:
 * Blocking:
 * Updates:
 * Reviews:
 * Google MT reviewed, with more notes coming
 * mo
 * mediawiki-services-chromium-render
 * stacktraces on wikis
 * git mirroring to diffusion

Services

 * Blocked by:
 * Blocking:
 * Updates:

Technical Operations

 * Blocked by:
 * Usual issue about Flow dumps, global collaboration, Ops welcomes Matt back :-)
 * Blocking:
 * None
 * Updates:
 * Reminder: Failover for wikidata (new s8 shard) arranged for 9th Jan - T181645
 * Ganglia is finally dead!
 * Mysterious crashes of HHVM on api still ongoing, with low frequency. Investigating in the background.
 * Goals posted

Wikidata

 * With many people on vacation, we started a small "cleanup/pet project" sprint over the holidays.
 * Re-introducing PSR-4 in all Wikibase code bases.
 * Good progress on statement editing on sub-entities, namely Form entities in the Lexeme extension.

German Technical Wishlist

 * Blocked by:
 * Blocking:
 * Updates:

SoS Meeting Bookkeeping

 * Updates: