Scrum of scrums/2016-12-07

= 2016-12-07 =

iOS native app

 * Last Week
 * Shipped 5.3.1 with bug fixes
 * Continued work on 5.3.2 - Dynamic text size, data layer update, performance enhancements
 * This week
 * Finish work on 5.3.2, fix bugs from beta feedback
 * Feature complete on 5.3.2 Friday 12/9

Android native app

 * Last week:
 * Continuing Q2 goals for Wikidata descriptions
 * New beta v2.4.182
 * Fundraising and survey cards now configurable remotely (beta)
 * Next week (https://phabricator.wikimedia.org/project/view/2352/):
 * More Q2 goals for Wikidata descriptions (tutorial and polish)

Mobile Content Service (MCS)

 * Remove obsolete mobile-summary endpoint (handled by RESTBase directly)
 * Moved to node template version 0.5.0, moved to ES2015 and eslint

Reading Web

 * Current sprint: https://phabricator.wikimedia.org/project/view/2362/
 * So far:
 * ReadMore has been enabled on Japanese and Spanish wikis (mobile site)
 * Wikidata Page banner has been enabled on Finnish Wikivoyage
 * Wikidata page descriptions has been enabled on French and German wikipedias (mobile site)
 * Lead image has been disabled from the mobile site, beta mode.
 * Until we meet the next time:
 * Create importable test pages that can be used to test various Reading Web related changes
 * Hovercards rewrite finish up
 * Continue working on returning page images from the lead section only

Reading Infrastructure

 * API i18n changes going out with next train: https://lists.wikimedia.org/pipermail/mediawiki-api-announce/2016-December/000121.html
 * you can use the new errorformat, errorlang, errorsuselocal paramers to get localized, parsed errors; if you don't, most API modules will behave the same as before. Exceptions:
 * for query modules the error codes won't be prefixed anymore the way parameter names are;
 * for a few modules (see announcement) which put errors in some non-default location in the response data, that location might change and/or the contents might change from a single error to an array of errors.
 * could use some advice from Performance or Language on dealing with huge JS data blobs: https://phabricator.wikimedia.org/T32574#2836570
 * MediaViewer tests failing, mw.language tests seem to be the cause: https://phabricator.wikimedia.org/T152476

Collaboration

 * Working on new filter UI for Special:Recentchanges; a bunch of backend patches for this landed in MW core recently, more will land soon. Will be behind a hidden preference for the time being.
 * Converted Flow and Echo to extension.json. This has caused a few minor issues for Flow and may cause some for Echo as well. Also, if you have open patches, they'll probably conflict now.
 * Going to convert PageTriage next; and FlaggedRevs after we clear out the CR backlog a bit there

Parsing

 * Blocked: Tim asked ops for someone to assist him with puppetizing HTML5Depurate for a pilot deployment to the production cluster for our Q2 goal. No response yet.
 * See "[Ops] Need Html5Depurate playmate" mail from Tim dated 11/24
 * Ongoing investigation of https://phabricator.wikimedia.org/T151702 and followups with Ops and Services
 * Parsoid deploy today after almost a month (https://www.mediawiki.org/wiki/Parsoid/Deployments will be updated later today)
 * Parsoid-native rendering + a bunch of other changes going out today (Most interesting for MCS: heading ids now assigned that match core output).
 * HTML version bump to 1.3.0; See https://www.mediawiki.org/wiki/Specs/HTML/1.3.0#Changes_since_Specs.2FHTML.2F1.2.1 for changes since 1.2.1
 * Tim is close to finishing the first version of remex-html ( https://github.com/tstarling/remex-html ) -- a HTML5 parser in PHP

Discovery

 * No blockers
 * Started discussion on how to combine various models of user query enhancements/transformations to improve search results: https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/So_Many_Search_Options
 * Continuing work on crosswiki searches, load test successful
 * Published analysis of WDQS traffic to detect parallel connections: https://phabricator.wikimedia.org/T149963
 * WDQS now limits parallel connections to 5 per IP. Working fine so far.

Analytics

 * Blocker -- None
 * Ongoing
 * Wikistats 2.0 UI has kicked off with new contractor designer.
 * RecentChanges via EventBus is on its way, we will soon have events flowing in Kafka. Purpose is later to turn off Redis based producer.
 * Mediawiki history reconstruction is at final review stage (will be long, heavy code) -- Plans to communicate early next quarter
 * Old logs on stat1002 have been deleted. More at https://phabricator.wikimedia.org/T84618. Now working on removing some old generation processes in the cluster.
 * Cross team collaboration in migrating limn editor-engagement dashboards to dashiki

Release Engineering

 * Blocking:
 * None?
 * Blocked
 * None
 * Updates
 * Reminder that deployments are weird between now and the New Year: https://lists.wikimedia.org/pipermail/wikitech-l/2016-November/086936.html
 * Gerrit is updating, pretty much right now

Security

 * Security Reviews
 * Recommendations API continues from last week
 * Continuing work on CSRF protection for anonymous users (https://phabricator.wikimedia.org/T40417)
 * Question for Parsing: Can we limit the amount of nesting in lists?
 * https://phabricator.wikimedia.org/T151834
 * Question for Reading: Should page requests containing invalid characters in title still result in 200 OK if curid is valid?
 * https://phabricator.wikimedia.org/T144100

Services

 * Blockers: none
 * Updates:
 * PDF render service and API endpoint deployed and completely operational:
 * https://en.wikipedia.org/api/rest_v1/#!/Page_content/get_page_pdf_title
 * Working on followups for the API cluster outage
 * https://phabricator.wikimedia.org/T152074

Technical Operations

 * Blocked:
 * Community Tech
 * https://phabricator.wikimedia.org/T152080 page_assessments creating duplicate key errors
 * Blocking:
 * None
 * Updates:
 * Still working on API cluster failure. https://phabricator.wikimedia.org/T151702
 * new labsdbs are almost ready to start being used
 * AB testing design still under discussion https://phabricator.wikimedia.org/T143694
 * Goals for next quarter being drafted, if you have any dependencies on Ops contact us

Wikidata

 * I still can not join the Hangout when not being a WMF employee. I know multiple people already looked into this. Please forgive me when I'm not trying any more. I still find the information given in this Etherpad very helpful, and love sharing relevant bits via a WMDE mailing list.
 * Grace to look into this ^
 * Blocked on security reviews of:
 * Cognate extension: https://phabricator.wikimedia.org/T149082
 * InterwikiSorting Extension: https://phabricator.wikimedia.org/T149083

Fundraising Tech

 * Investigating banner impression drop from 08:00-09:00 UTC on 12/1 and 12/2: https://phabricator.wikimedia.org/T152122
 * Fixing CiviCRM reports & internal dashboard
 * Tweaking mailing list export
 * Planning for next year
 * Estimating effort for next year's required payment processor integrations
 * Potential extra-curricular work supporting ORES: https://www.mediawiki.org/wiki/User:Adamw/Study_abroad_proposal