Scrum of scrums/2016-12-14

Product

Reading

iOS native app

• Last week
  • Finished work on 5.3.2, shipped to beta (Dynamic text size, data layer update, performance enhancements) https://phabricator.wikimedia.org/project/view/2281/
• This week
  • Monitor 5.3.2 beta & regression testsing, fix any issues, release 5.3.2 on Thursday or Friday
  • Start work on 5.4 (Nearby, Login updates) https://phabricator.wikimedia.org/project/view/2326/

Android native app

• Last week:
  • Bug fixes for new release
  • Continuing Q2 goals for Wikidata descriptions
  • New prod release v2.4.183
  • Initial survey
  • Internal test automation discussions; now over 300 unit tests in CI
• Next week (https://phabricator.wikimedia.org/project/view/2352/ ):
  • More Q2 goals for Wikidata descriptions (polish)

Mobile Content Service (MCS)

• Board: https://phabricator.wikimedia.org/project/board/1323/query/open/
• Deployed:
  • Updated announcements endpoint to shorten survey for Android app (getting lots of responses)
  • Caching announcement responses
• To be deployed:
  • Emitted etags have double quotes now. https://phabricator.wikimedia.org/T150886

Reading Web

• Current sprint: https://phabricator.wikimedia.org/project/view/2362/
• Last week:
  • Create importable test pages that can be used to test various Reading Web related changes https://phabricator.wikimedia.org/T137527
  • Hovercards rewrite finish up
  • Continue working on returning page images from the lead section only
• Until we meet next time:
  • Make hovercards preferences available on the settings page
  • PagePreviews reading depth

Reading Infrastructure

• API i18n patches go live this week! announcement: https://lists.wikimedia.org/pipermail/mediawiki-api-announce/2016-December/000121.html
• starting work on TemplateStyles
• blocked:
  • WMDE on the last i18n patch before we can move to hard deprecation: https://gerrit.wikimedia.org/r/#/c/321464/
  • could use some advice from Performance on dealing with huge JS data blobs: https://phabricator.wikimedia.org/T32574#2836570
  • MediaViewer tests failing, mw.language tests seem to be the cause: https://phabricator.wikimedia.org/T152476
• not blocking

Community Tech

• Blockers: None
• Blocked: Nope
• Updates:
  • Created a special page report for looking at page assessment data: https://en.wikipedia.org/wiki/Special:PageAssessments?project=History
    • Note that pagination is broken at the moment and the fix will be deployed soon
  • Converted a bunch more wikis to numeric and uca collation: https://phabricator.wikimedia.org/T149002
  • Continued work on supporting Programs Dashboard
  • Bug fixes on CopyPatrol
  • Work in progress for deploying Copypatrol for Czech wikipedia
  • Community Wishlist Survey ended with 265 proposals and loads of exciting proposals.

Editing

Collaboration

• Updates
  • https://www.mediawiki.org/wiki/Collaboration/Deployment_planning
  • Edit Review Improvements
    • New RecentChanges filters
    • Drop inconsistent filters
  • Echo
    • Fixed unread notification count caching
    • Switched to extension.json
  • FlaggedRevs (Collaboration team is taking more active involvement here in support of deferred changes (https://en.wikipedia.org/wiki/Wikipedia:Deferred_changes) project)
    • Various fixes
  • ORES
    • Various fixes

Language

• Blocked:
  • Performance: https://phabricator.wikimedia.org/T152180 - This is Unbreak Now for ULS, but need moreinfo on it. Language team can't reproduce it.
  • CI/Jenkins: https://phabricator.wikimedia.org/T153038 - mwext-qunit-jessie test fails on unrelated change(s).
  • In ContentTranslation, there's a significantly larger number of badtoken errors in saving articles lately. Did anybody notice this for editing in general?

Parsing

• Linter extension is now in beta cluster (ex: https://en.wikipedia.beta.wmflabs.org/wiki/Special:LintErrors )
• Services, VE, and Parsing teams collectively decided to postpone deployment of splitting data-mw attribute from the HTML for later when it has higher urgency since Mobile Content Service is already doing this split on their own and no other Parsoid client wants it, and VE doesn't like it right now.
• We are still trying to figure out whether we want to use HTML5Depurate (Java) or a PHP version for our pilot deployment of a Tidy replacement.
• Work ongoing to parse and render language variants in Parsoid (which includes some fixes to the PHP parser's language variant parsing as well). Close to being finished.

Discovery

• No blockers
• Continuing work on crosswiki search and refactoring Special:Search. Load tests OK, now doing relevancy tests.
• Refactoring query parsing to allow extensions to add search keywords
• Improved handling of characters containing diacritics or accents
• Released tabular and map data namespaces to Commons: https://www.mediawiki.org/wiki/Help:Tabular_Data and https://www.mediawiki.org/wiki/Help:Map_Data
• Discovery narrative and roadmap 2016-2017: https://www.mediawiki.org/wiki/File:Discovery_narrative_FY_2016-17.pdf

Technology

Release Engineering

• Blocking
  • (Language) CI/Jenkins: https://phabricator.wikimedia.org/T153038 - mwext-qunit-jessie test fails on unrelated change(s).
• Blocked
  • Nothing right now
• Updates
  • Reminder last week for deployments is this week until Jan 3rd: https://lists.wikimedia.org/pipermail/wikitech-l/2016-November/086936.html

Security

• Security Reviews
  • Recommendations API
  • Sanitarium review
  • LoginNotify
  • Working on scheduling reviews for Wikidata:
    • Cognate extension: https://phabricator.wikimedia.org/T149082
    • InterwikiSorting Extension: https://phabricator.wikimedia.org/T149083

Services

• Blockers: none
• Updates:
  • Trending service deployed. Some bugs were discovered and still to be fixed
    • https://en.wikipedia.org/api/rest_v1/#!/Feed/trendingEdits
  • Citoid is behind RESTBase now.
    • https://en.wikipedia.org/api/rest_v1/#!/Citation/getCitation

Technical Operations

• Alex has a conflicting meeting up, will probably make the last 10 minutes of the meeting though
• Blocked
  • CommunityTech on "Frequent duplicate key errors by page assessments" https://phabricator.wikimedia.org/T152080
• Blocking
  • None
• Updates
  • API woes ongoing
  • Draft goals posted, again if teams have dependencies on ops for next Quarter, please inform us.
  • Labs team is at low capacity, due to severe weather conditions in India
  • There is a goal for full precise deprecation next quarter, so expect anything precise in labs or production to have to either migrate of cease existing

Performance

• Not blocked
• Team offsite last week. Redefined our long-term goals and short-term projects. Cleaned up by backlog (trimmed by 16%). https://www.mediawiki.org/wiki/Wikimedia_Performance_Team#Focus
• Experimented with Grafana 4 alerts. Available right now, use them!

Fundraising Tech

• added googleweblight to non-JS browser list
  • proxy works like opera mini, runs JS server side and renders page down, sometimes breaking it
  • https://phabricator.wikimedia.org/T152602, about to deploy https://gerrit.wikimedia.org/r/327043
• Eileen published our first real CiviCRM extension to https://civicrm.org/extensions/unsubscribe-email-data-entry-screen
  • existing extensions are all actually Drupal modules, not publicized except in gerrit
  • hope more of our code becomes widely usable https://www.mediawiki.org/wiki/Fundraising_tech/Free_Software_Citizenship
  • Katie is helping push for time in 2017 to further those goals
  • If you have contacts at other non-profits that might be interested in open source payment processing and donor relationship software, please email fr-tech@
• more work on internal dashboard, including adding a vagrant role

Analytics

No blockers nor blocked Updates:

• Hired a new engineer who started this week
• Worked on information architechture of wikistats2.0 with designer contractor and Erik Z
• Worked on cleaning up our mediawiki history reconstruction scala code