Scrum of scrums/2015-07-29

2015-07-29

Research

• Revscoring outreach and language expansion. Moving towards productionization of the service & a beta feature. Talking with Gabriel and Faidon.
  • first meeting was on 2015-07-28, decided to move revscoring in prod and hook it up in RESTBase
• Article recommendation app on Tool Labs: started hacking in Wikimania
• Link recommendation in VE: discussions starting this week with Ed, Subbu, Nirzar
• Opt-in/Opt-out options for communications with users (global, includes many teams)
• Kicked off discussion on releasing browse traces with Chris.

Reading

iOS

• Release of 4.1.7 maintenance update proceeding smoothly so far. Should hear back on regression tests today, app is ready for release.
  • Task is T106106

Editing

Language

• Apologies; Jetlag;
• https://phabricator.wikimedia.org/T107270 is issue and there will be more inputs after discussing with upstream and Alex K (when he is back). Until then, restarting apertium-apy is fine.
• Work on Content Translation continue.

Parsing

• Deployed some (Parsoid) parsing performance fixes last week -- will evaluate results later this week by looking at grafana charts
• scrubWikitext API param (normalzes HTML so that "good wikitext" is generated in some scenarios) is now functional in production after RESTBase started forwarding that from its clients. This should help with some of the nowiki scenarios that have been seen in some VE edits
• "git deploy service restart" still broken for Parsoid deploys ( https://phabricator.wikimedia.org/T102039 ) -- continuing to use a known workaround for it.

Collaboration

• LQT->Flow conversion on MediaWiki.org done except for two pages (VisualEditor/Feedback and Project:Support desk), which will be soon
• Continuing work on Flow data model and OOification
• Working on a security issue
• Working on making sure Flow doesn't block the External Store recompression; we think we will need a new ES cluster for this (https://phabricator.wikimedia.org/T106363)
• Initial work on personal feed
• Need review on "Make page_props.pp_sortkey a double instead of float" https://phabricator.wikimedia.org/T107323 / https://gerrit.wikimedia.org/r/#/c/223552/

Community Tech

• Still in limbo waiting for decisions on resourcing
• In the meantime...
  • Looking at sharing backlog with WMDE TCB Team
  • Working on updating SecurePoll extension
  • Working on converting extensions to extension registration system

Discovery

• Blockers:
  • Waiting for WDQS hardware & security review
• Blocking:
  • Nothing on board: https://phabricator.wikimedia.org/tag/blocked-on-search/
• Updates
  • New representative on SoS - Stas
  • Great Discovery presentation on Wikimania. Good participation from audience. Recorded in https://archive.org/details/videoeditserver-102
  • Maps running on production
  • Researching zero results logs & looking for patterns
  • WDQS deployment scripts ready & tested
  • Reaching out to advisors from DuckDuckGo, AltaVista, others

Services

• RESTBase
  • integrating new nodes into the cluster - rb1007 successful stream of Cassandra data - https://phabricator.wikimedia.org/T102015
  • worked on various bugs
• Plan to migrate SCA to Jessie - https://phabricator.wikimedia.org/T96017
  • citoid, zotero, graphoid, mathoid, cxserver, apertium
• Would like to talk to LangEng
  • move apertium && cxserver to Jessie
  • basing cxserver on service-runner
  • usage of RESTBase and Parsoid API in cxserver

Release Engineering

Blocking: (none) Blocked by: operations

• https://gerrit.wikimedia.org/r/#/c/158016/

Updates:

• mwext-mw-selenium Gerrit/Zuul job now considered stable enough for general use
  • Includes video recordings saved as Jenkins artifacts for failed scenarios
  • Simply follow https://www.mediawiki.org/wiki/Continuous_integration/Browser_tests to get started with it
• Co-hosted testing discussion last Monday
  • Grace and Dan to parse notes this afternoon for actionable follow-ups
• CI isolation and deployment tooling work continues
  • RESTbase workflow implemented (https://phabricator.wikimedia.org/T102667)
• Fighting some Beta Cluster instability at the moment

Fundraising Tech

• second round of full-scale testing Latin American payment processing
• payments cluster upgraded to 1.25 without any big problems
• CentralNotice refactor work continues
  • GeoIP lookup should be its own thing: https://phabricator.wikimedia.org/T102848
• examining options for looming Amazon Payments changes
• more work on replacing ActiveMQ with Redis

Security

• Continued work with services on T98533
• Need DBA/Ops for T90300
• Reviews: PageBanner, composer this week

Analytics

• Pageview API work starting (heads up to Services, we're looking to add endpoints to RESTBase but host the data on our own Cassandra cluster)
• Scalable Messaging system kickoff meeting on Monday (please let us know if you want to join)
• Wikistats requirements gathering starting (we're migrating away from old reports soon, need to know which reports are most important to focus on first). The discussion is starting here: https://phabricator.wikimedia.org/T107175