Scrum of scrums/2016-07-06

= 2016-07-06 =

iOS

 * 5.0.5 has been delayed for 2 more weeks due to new regressions.
 * We are restarting the entire beta process because the 5.0.5 release diverged significan;ty from the trunk
 * A new 5.0.5 with changes more recent bugfixes from the main trunk is being redeployed to beta this week
 * 5.0.5 will re-enter regression next week
 * 5.1 features are being re-evaluated due to the long development time of 5.0.5
 * Some 5.1 features will likely be moved to 5.2
 * Discovery is helping us improe the map UI first developed on Android by implementing some Geodata API enhancements (https://phabricator.wikimedia.org/T139378)

Android
Finishing touches on the feed.

Mobile Content Service
Blocked on Services team:
 * Experienced more than a dozen Nagios checker failures (timeouts) due to increased memory usage by ORES last weekend. Got fixed on Monday. https://phabricator.wikimedia.org/T139177
 * Feed endpoint improvements:
 * redirect to summary endpoint for random and TFA if possible. https://phabricator.wikimedia.org/T139424 + https://phabricator.wikimedia.org/T136960
 * adding date input validation for feed endpoints which accept dates
 * We need the public feed endpoints (aggregated feed + random page) to enable the feed functionality for a beta Android app release. This is blocking the Android teams quarterly goal.

Reading Web

 * Wikidata descriptions to mobile web stable in ca.wiki and pl.wiki
 * Deployed lazy references and images to mobile web tl.wiki
 * Fixing some bugs with hovercards to improve data analysis from A/B test
 * Started working in improvements to language switcher in mobile web

Community Tech

 * Deploying PageAssessments extension to test.wikipedia (https://www.mediawiki.org/wiki/Extension:PageAssessments)
 * Finishing work on CopyPatrol Tool (https://tools.wmflabs.org/copypatrol)
 * Replication lag on Tool Labs has been a major problem. We are migrating from local DB queries to API requests to avoid the problem.
 * Figuring the out the best implementation plan for switching to UCA collation + numerical sorting for categories
 * No blockers

Multimedia

 * https://phabricator.wikimedia.org/T138273#2410743 MatmaRex needs review from anomie, tgr, and AaronSchulz.
 * Still waiting for Thumbor deployment to carry ImageTweaks forward, Gilles says he's working on Debian packaging
 * Continuing work on FileAnnotations
 * Continuing work on getting rid of fatal errors in UploadWizard

Collaboration

 * Blocking - No change
 * Blocked - None
 * Updates
 * Deployed to group 0 new enhanced Echo bunding (with the ability to expand and collapse bundles of notifications and act on individual notifications), changed sorting of Alerts and Messages
 * Deployed new version of Special:Notifications with per-page notification lists

Parsing

 * Co-ordinating with Services to resume work on Parsoid migration to use service-runner utility. This blocks upgrade of parsoid production cluster to node 4.x (from 0.10) and deployment process to scap3 (from trebuchet)
 * Continuing to work on a bunch of bug fixes in Parsoid.
 * Work ongoing (Tim & Scott) to land a PHP HTML5 parser in core which can serve as a default Tidy replacement solution for mediawiki.

Wikidata

 * Focus on refactoring the Sites mess in core, starting with: https://phabricator.wikimedia.org/T137537, tracked in: https://phabricator.wikimedia.org/T113034
 * Core support for multilingual wikis: https://phabricator.wikimedia.org/T114640
 * Ongoing communication about Multi Content Revision support in core: https://phabricator.wikimedia.org/T107595

Analytics

 * Will start working on migrating refinery to SCAP 3 tomorrow (cc: release team)
 * Ongoing work on Event Bus, scaling AQS and the Pageview API, reconstructing mediawiki history, and loading Druid with pageview data

Research

 * ores.wikimedia.org online (woo ops). ores.wmflabs.org will remain online and a deprecation plan will be announced "soon"
 * Major ORES downtime was exacerbated by icinga config failure (301 is a good response and not followed by default) https://wikitech.wikimedia.org/wiki/Incident_documentation/20160610-ORES
 * ORES extension deployed to fawiki and wikidatawiki. Large wikis coming soon.

Security

 * Other security reviews are being schedule; if you have need, please submit your request: https://www.mediawiki.org/wiki/Wikimedia_Security_Team/Security_reviews
 * A security release will be prepared soon
 * Reviews: 3d2png (cont.), Tool Labs Console

Services

 * out for two weeks - Wikimania + Offsite
 * lots of interesting discussions
 * Auth / session storage service
 * discussed the plan with Darian
 * will draft an Arch RfC soon
 * Nodejs migration to 4.4.6
 * https://phabricator.wikimedia.org/T138561
 * scheduled for next wednesday
 * test your services and update your package.json to use node v4.4.6
 * especially important for SCB services

Fundraising tech

 * Building and deploying new payments servers to get off precise and php 5.3
 * Also upgrading mediawiki and CiviCRM, planning how we'll more closely follow mw master
 * More work towards de-duplicating donor database
 * CentralNotice: don't load anything on Special: or action=edit
 * Still investigating what looks like missing log entries (delivered via Kafkatee): https://phabricator.wikimedia.org/T132500

Discovery

 * Blocking: none
 * Blocked: none
 * Hired new data analyst, she starts end of July
 * TextCat A/B finished, analyzing results
 * Working on enabling boxed search by coordinates with near: and neartitle: - https://gerrit.wikimedia.org/r/#/c/297524/
 * Logstash elasticsearch upgrade planned for July 7th (https://phabricator.wikimedia.org/T136001). This also includes upgrade to Kibana 4.
 * Portal stats updated on June 30th
 * Portal survey on why people come to Portal are published: https://phabricator.wikimedia.org/T136874#2418095

Maps/Graphs

 * Geoshapes service is integrated with WDQS and can provide both wikidata data and shapes: http://data.wmflabs.org/wiki/Regional_maps

RelEng

 * Blocking: none?
 * Blocked:
 * Target architecture without gallium (email followup) https://phabricator.wikimedia.org/T133300
 * Updates
 * Browser Testing survey still open (phab task for info: https://phabricator.wikimedia.org/T131123)
 * CI reduced yesterday, should be good now
 * Scap3 migration - new guide posted on wikitech https://wikitech.wikimedia.org/wiki/Scap3/Migration_Guide

Technical Operations

 * Blocking
 * None
 * Blocked
 * By noone
 * Updates
 * All image scalers are now on jessie with updated librsvg, fixes plenty of bugs (also related to changes to fonts while at it)
 * Enabled TCP Fast Open on some caching clusters
 * gitblit is finally dead
 * Working with LE to get apertium packages reviewed/uploaded on apt.wikimedia.org. Some 20% done