Scrum of scrums/2015-10-07

2015-10-07

Reading

Web

• PageImages API now supports foreign files from commons
• ZeroBanner had regressions
• Bug that impacted the search schema resolved [cc discovery team] https://phabricator.wikimedia.org/T114599
• Pagebanner extension now live on Catalan wiki and Chinese Wikivoyage
• R&D on RESTBase/Parsoid powered reading experience.

Mobile Content Service

• Added URLs to spokenWikipedia articles https://phabricator.wikimedia.org/T108372
• Working on moving the new routes to Parsoid. https://phabricator.wikimedia.org/T108777

Android

• Nothing significant to report.

iOS

• Nothing significant to report.

Reading Infrastructure

• Block: Language is still requested to comment on https://gerrit.wikimedia.org/r/#/c/216909/
• Thanks to Ops for resolving https://phabricator.wikimedia.org/T95864
• Stuff from last time:
  • https://phabricator.wikimedia.org/T91148 is still ultimately blocked on whoever owns oojs-ui
  • Not blocked on https://phabricator.wikimedia.org/T110274 (CI) yet, but it's on the horizon

Community Tech

• Talking about working on Gadgets 2.0 (what team owns this? Collaboration?)

Tech

Security

• Finishing initial Analytics assessment
• WMDE reviews scheduled this week
• UrlShortener review scheduled this week
• openvas packaging continues

Infrastructure

Services

• Analytics Query Service (pageviews) is up && running!
• REST v1 Transform API

• deprecating bodyOnly (=> body_only) and scrubWikitext (=> scrub_wikitext)

• Starting work on API driven / client-side front-end prototype - https://phabricator.wikimedia.org/T111588 - in collaboration w/ reading team
  • Working out page component interfaces at https://phabricator.wikimedia.org/T105845
  • Considering API options for exposing core content as page components at https://phabricator.wikimedia.org/T114596
  • Working with Parsoid team on <section> wrapping to make RB section retrieval API more useful: https://phabricator.wikimedia.org/T114072

Release Engineering

• Blocking: https://phabricator.wikimedia.org/T92871
• Blocked by: (none)
• Updates:
  • Deployment tooling implementation continues
    • https://phabricator.wikimedia.org/project/view/1449/
    • Quarterly goal is to migrate all Services team projects to use scap3
      • https://phabricator.wikimedia.org/T109926
    • About to land base impementation for post stage checks
    • Config deployment merged
    • Icinga checks and canary deployments this week
  • Continuing to migrate simple CI jobs to nodepool instances
  • Starting to dogfood Differential while working on scap3

Technical Operations

• Blocking: https://phabricator.wikimedia.org/T102039 (parsoid restarts)
• Blocked by: https://phabricator.wikimedia.org/T106386 (ES compression)
• Updates:

• ops is going away on an offsite. That means limited availability
• codfw as a caching pop is up and running again
• OTRS test migration went OK
• 86% of hosts now firewalled. You have been informed
• Jaime Crespo (DBA) is requesting assistance on https://phabricator.wikimedia.org/T106386 . Flow people have already responded (thanks Matt), more required.
• Cassandra fails to fully utilize a host, moving into a multi-cassandra setup in coordination with services. This might influence aqs/maps, the idea is it will not.

Analytics

• Analytics Query Service cluster is up! We have to fill it with data and open public endpoints into it. We'll announce when everything's done and ready to query on the lists. Details: the cluster is made up of aqs100[1-3].eqiad.wmnet and runs RESTBase with Cassandra for storage. It's similar to the content RESTBase cluster but has only a single module (pageviews) which is most succinctly defined here: https://github.com/wikimedia/restbase/blob/master/mods/pageviews.yaml
• Been working on the Quarterly wrap-up and trying to find other teams with long-term dependencies on us. Please speak up if we haven't contacted you yet.

Advancement

Fundraising Tech

• starting to batten down the hatches for peak fundraising season
  • please consult with fr-tech if you're planning to do anything that might mess with Central Notice in the next few months
• tested banner history mixin on live campaigns
• working on audit/reconciliation report parsing for new Amazon and Worldpay formats
• making lots of progress towards CiviCRM 4.2->4.6 upgrade, upstreaming some fixes

Editing

Language

• No blocker.
• Blocking: https://gerrit.wikimedia.org/r/#/c/216909/
• Working: Suggestions, cxserver -> service runner.

Collaboration

• Continuing design work on cross-wiki notifications, notification formatter, and follow-up work from Echo notification split
• Discussing rolling out Flow opt-in to additional wikis
• Working on Flow dumps
• Preparing to convert pt Wikibooks LQT to Flow
• No blocked/blocking External Store.

Performance

• https://gerrit.wikimedia.org/r/#/c/234173/ (Translate master queries)
• https://phabricator.wikimedia.org/T86385 (huge DELETE/INSERTs by Translate)
• Jaime still working on pt-heartbeat support for ES boxen and puppet monitoring
• Timo/Aaron beta testing CentralAuth slave usage patch (ran into problems with master as is)

Discovery

• Team offsite last week
• Blocked
  • https://phabricator.wikimedia.org/T112349 - figuring out best way to do it with language team
  • https://phabricator.wikimedia.org/T114694 - waiting for scap3 deployment
• Blocking
  • https://phabricator.wikimedia.org/T92796 - still working on it