Scrum of scrums/2016-08-17

= 2016-08-17 =

Reading Web

 * Current sprint: https://phabricator.wikimedia.org/project/view/2126/
 * Next sprint: https://phabricator.wikimedia.org/project/view/2158/
 * Lazy loading images on mobile web is going live very soon
 * Heads up, we're looking to release Related Articles on mobile web potentially in 6-10 weeks. More api.php calls.
 * Any ideas on "Various browser tests failing due to login error" (https://phabricator.wikimedia.org/T142600 )?

Mobile Content Service (MCS)
Not stripping title attributes from links anymore. https://gerrit.wikimedia.org/r/#/c/304785/

Android native app

 * Current sprint: https://phabricator.wikimedia.org/project/view/2142/
 * Next sprint:
 * Beta release this week with minor feed updates (tab icon update, access to tabs from the feed, persistent dismissal of cards)
 * Nav overhaul work continues apace
 * Working with Discovery to get Nearby search going

iOS native app

 * 5.0.6 shipped this week: https://phabricator.wikimedia.org/tag/ios-app-v5.0.6-hotfix/


 * Current release board: https://phabricator.wikimedia.org/project/board/1736/
 * Major features are iPad and Find in Page
 * Feature Complete and in beta
 * Still wrapping up minor tweaks and bug fixes


 * Next release board: https://phabricator.wikimedia.org/project/view/2150/
 * Started development this week week
 * Adding iOS 10 support
 * Dropping iOS 8 support
 * Major features are Widgets and Feed improvements
 * Expected to go to beta in early september

Security

 * MediaWiki 1.27.1 release delayed to this week
 * Security reviews this week: Html5Depurate, GlobalGroupPermisions, PerformanceInspector
 * Planning for captcha improvements continues
 * https://phabricator.wikimedia.org/T125132
 * https://phabricator.wikimedia.org/T141490
 * First step will be re-generating images using current script

Language

 * Blocked:
 * Blocking:
 * Updates:
 * Security review for Youdao needed: https://phabricator.wikimedia.org/T143185
 * Apertium->Jessie packaging work almost done; Few packages left to upload.
 * Improvements in Content Translation continue: MT card, templates, DB errors.

Multimedia

 * Blocked:
 * Is there an update on thumbor production status? (Performance?) It's still blocking ImageTweaks deployment.
 * Blocking:
 * None of which we're aware.
 * Updates:
 * Continuing our work on FileAnnotations; currently pending on a decision on whether we're waiting for structured data or will go early and re-write content after the fact when it goes live.

VisualEditor

 * Blocked:
 * We (and other teams depending on Phlogiston) remain blocked with Ops/Labs on server issues, with the system either completely broken or impaired continuously since mid-June; this week it's T142742, before that T141796, T142165, T137736 and others from related issues. Is there a better mechanism for getting these kinds of issues fixed more rapdily?
 * Blocking:
 * Parsing team are still waiting for our response on "native" Parsoid implementation. Thalia and Ed will look at it more.
 * Updates:
 * Major work this week on client-side DOM diffing (for smaller save bandwidth demands), re-orderable transactions (for enhanced IME support and maybe offline editing), and the new wikitext editor (now merged in a feature-flagged state; Beta Feature expected in a month or so).

Discovery

 * No blockers
 * Working on BM25 implementation
 * Working on multi-wiki indexes
 * Working on integrating Polestar (http://vega.github.io/polestar/) and WDQS GUI to allow create graphs visually from WDQS results
 * Improved suggestions with typos in first characters: https://phabricator.wikimedia.org/T107006
 * Analysis of ASCII folding/stemming on enwiki: https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/Re-Ordering_Stemming_and_Ascii-Folding_on_English_Wikipedia
 * TLDR: results positive, we should do it
 * Summary of Portal changes published: https://lists.wikimedia.org/pipermail/wikitech-l/2016-August/086312.html

Interactive Team

 * Working on deploying and to all non-Wikipedia sites
 * Working on replacing GeoHack with + info screen on all Wikipedias
 * Working on deploying Tabular data on Commons. Already synced up with Wikidata.
 * In progress of deploying eqiad maps cluster

Release engineering

 * Blocked
 * ops - need a set of eyes on https://gerrit.wikimedia.org/r/#/c/302601/ so we can easily put logs for Java-based applications into Logstash
 * Blocking
 * Security - security release of 1.27.1 & co. This week.
 * Updates:
 * New SWAT window schedule starting Aug 22nd
 * See: https://wikitech.wikimedia.org/wiki/Deployments#Week_of_August_22nd
 * And: https://wikitech.wikimedia.org/wiki/SWAT_deploys#The_team
 * https://phabricator.wikimedia.org/T137970

Analytics

 * loading of new AQS (pageview API) cluster ongoing, will switch over to it when done
 * new event bus logging from mw hooks merged, will start being available on event bus soon
 * re-ran massive sqoop of all mediawiki databases, parallelizing most of the small wikis together, and dbstore1002 doesn't seem impacted
 * re-worked some dataset documentation to help people transition from the old pagecounts-raw: https://wikitech.wikimedia.org/wiki/Analytics/Data
 * Joseph and Luca are on vacation for two and one week respectively

Services

 * Blockers: none
 * Kafka upgraded to 0.9, now working on replacing the driver in Change-Prop
 * Parsoid move to scap3 is in progress
 * Puppetisation of the PDF render electron service

Research

 * Substantial update to ORES is live
 * CPU usage down by 66%
 * Memory usage down by 26%
 * Some minor regressions that will be handled in incoming patches.

Community Tech

 * Updating affected abuse filters as the wikis receive the new code for norm and ccnorm function https://phabricator.wikimedia.org/T29987
 * Working on acceptance tests for InternetArchiveBot (https://phabricator.wikimedia.org/T140386) and releasing some code as a composer package (https://phabricator.wikimedia.org/T140135)
 * Migrations to centralauth database for cross-wiki watchlist https://phabricator.wikimedia.org/T141951
 * Semi-blocker: update on when the watchlist IDs will be added by the TCB team
 * Testing numeric sorting on Swedish Wikipedia https://phabricator.wikimedia.org/T142113
 * Helping out with Education Program’s Dashboard tool
 * Nearing completion of feature releases for CopyPatrol

Technical Operations

 * Blocked
 * None
 * Blocking
 * None
 * Updates:
 * apertium packages for LE reviews ongoing
 * thumbor service getting installed this week, no definite ETA yet, but ongoing
 * Work ongoing on puppetDB, xkey, varnish4

Wikidata

 * Blockers: None.
 * Implemented user feedback on ArticlePlaceholder.
 * Series of small fixes to make error messages in the UI more actionable.
 * Need Ops input on https://phabricator.wikimedia.org/T142944. Performance and caching considerations when we make ArticlePlaceholder pages visible to search engines.
 * Today: ArchCom meeting about proposals for content model storage. First step towards allowing multiple content objects. https://phabricator.wikimedia.org/E261

Fundraising Tech

 * More queue work
 * Running CiviCRM batch de-duplication, fixing issues as they arise

Architecture
https://www.mediawiki.org/wiki/Architecture_committee/Status 2016W33: 2016-08-17 (Wednesday)


 * ArchCom Planning meeting: Phab:E260 20 UTC (1pm PDT)
 * Notes: Architecture committee/2016-08-17
 * ArchCom-RFC office hour: Phab:E261 21 UTC (2pm PDT)
 * Agenda: Revisiting T105652 (content model storage)