Scrum of scrums/2015-10-28

2015-10-28

Reading

Android

• Beta release (v2.1.133-beta-2015-10-26) published October 26th. Promoted to production October 28th. Crash reporting is already proving useful.
• Lots of volunteer contributions lately.

iOS

• Ramping up to release internal Alpha soon
• Closer to being able to evaluate API usage impact

Web

Team has been on offsite - catching up with backlog. Web team has switched to its own release model for its projects to manage changes going out to production: https://www.mediawiki.org/wiki/Reading/Web/Release_process

Content Services

Continuing to move to Parsoid instead of mobileview. The restrictions of this move are:

   * Having a harder time getting to the full URL of the spokenWikipedia article audio files. If anyone knows the right Parsoid calls to get the content of a File: page, like
   * no srcset attributes in <img> tags. We're relying on Parsoid to fix this. https://phabricator.wikimedia.org/T88827

Reading Infrastructure

• Block: Need security review for php-session-serializer and SessionManager, see https://phabricator.wikimedia.org/T116413 for details
• Block: ApiSandbox is still ultimately blocked on whoever owns oojs-ui for https://phabricator.wikimedia.org/T91148
  • Block: Language is *still* requested to comment on said Datetime widget, https://gerrit.wikimedia.org/r/#/c/216909/
• Not going to pretend https://phabricator.wikimedia.org/T110274 (CI) will ever be a blocker anymore, we'll just redo the unit tests

Infrastructure

Technical Operations

• Blocking: https://phabricator.wikimedia.org/T102039
• Blocked by: https://phabricator.wikimedia.org/T87036 need help testing the Dallas deployment server
• Updates:

   * work on multi-instance Cassandra is ongoing
   * Starting to move cronjobs off of terbium for the migration to trusty (e.g. HHVM finalization),

Release Engineering

• Blocking:
  • T114694 Create deployment for wikimedia/portals: ongoing discussion on task, we're mostly ready
• Blocked by: (none)
• Updates:
  • Deployment tooling implementation continues
    • https://phabricator.wikimedia.org/project/view/1449/
    • Documentation (for user centric docs) sprint this week
  • Investigating caching options for dependencies on isolated CI instances
  • MW release 1.26 Nov 20-ish
  • Continuing to dogfood arc/Differential
    • Starting a weekly meeting to address pitfalls/concerns

Services

• RESTBase:

• some Cassandra health issues, working on them now

• QG - High-traffic API

• https://phabricator.wikimedia.org/T115876
• imageinfo - https://phabricator.wikimedia.org/T116840
• textextracts - https://phabricator.wikimedia.org/T115876

• QG - EventBus

• currently defining events - https://phabricator.wikimedia.org/T116247
• would like to emit events from MW-core - https://phabricator.wikimedia.org/T116786

• QG - API-driven front-end

• basic server-side serviceworker support at https://github.com/gwicke/node-serviceworker
• need to benchmark it and implement caching support

Analytics

• Event Logging problems caused delays in data getting to analytics-store, backfilled as of yesterday, reports should be re-run for October 14 and 22 through 27
• Pageview API had some storage problems and hiccups but we removed hourly resolution and it's up and available, go nuts! :)
• We're looking at alternative data stores for the Pageview API (Druid and Elastic Search mostly, or a hybrid)
• new pageview definition statistics are starting to be dumped on ... dumps: http://dumps.wikimedia.org/other/pageviews/ (empty until it rsyncs)

Security

• Revscoring review should be done this week, AuthManager/SessionManager scheduled for this week
• Reviewing a bunch of CORS issues

Editing

Language

• Blocking: Still https://gerrit.wikimedia.org/r/#/c/216909/
• Niklas working on https://phabricator.wikimedia.org/T86385 (was blocker/high priority)
• CX Suggestion work continue. More features coming this/next week!

Parsing

• Gradual deployment strategy for https://phabricator.wikimedia.org/T89331.
  • First step is https://gerrit.wikimedia.org/r/#/c/246148/ (disables empty-
  • removal and uses CSS to preserve existing rendering; use Parsoid to identify templates relying on <empty>-li behavior + work with those template authors to address them)
  • Exploring visual diff solutions that we can get reliable metrics on for mass testing to detect problems -- we are likely going to use a combination of techniques: one to get a numeric metric that is reliable, and a separate one for visualization.
• We'll start working on https://phabricator.wikimedia.org/T88827 to get srcsrc attributes for image tags (VE, mobile services depend on this)
• We'll also start work on adding support for reading TemplateData during serialization (VE depends on this)
• cscott has been hacking away on https://github.com/cscott/node-mediawiki-express to support ( https://phabricator.wikimedia.org/T114457 )

Collaboration

• https://phabricator.wikimedia.org/T116700 - Issue with converting a specific post from HTML to wikitext with Parsoid - Parsoid team is already looking into it.
• Working on the artificial primary key for Flow wiki and external references, for DB team.
• Will soon be working on finishing Flow work for External Store
• Work on the changes for cross-DC memcached is in progress
• Other than that, working on various things, especially notifications and anti-spam

Advancement

Fundraising Tech

• About to throw the switch on CiviCRM upgrade
• Assessing backup processors for December campaign
• More work on fundraising-focused CentralNotice features

Research

• Revscoring blocked on privacy/security (security review)