Scrum of scrums/2017-08-16

= 2017-08-16 = contact: https://www.mediawiki.org/wiki/Wikimedia_Engineering

Callouts

 * Releng: Trebuchet's days are numbered. If you care about these projects please get in touch with #RelEng
 * These are the last remaining trebuchet projects:
 * iegreview
 * scholarships
 * ocg
 * dropwizard
 * Wikidata:
 * For weeks we see thousands of hard to track user-facing Lua errors, see https://phabricator.wikimedia.org/T170039. We believe https://phabricator.wikimedia.org/T171166 might fix it, but need help by devs willing to touch LuaSandbox build.

Wikidata

 * Callout: For weeks we see thousands of hard to track user-facing Lua errors, see https://phabricator.wikimedia.org/T170039. We believe https://phabricator.wikimedia.org/T171166 might fix it, but need help by devs willing to touch LuaSandbox build.

Web

 * Completing roll out of Page previews to all projects but enwiki and dewiki (likely to be stalled until post Wikimania)
 * RelatedArticles now renders articles in footer rather than side bar. (https://phabricator.wikimedia.org/T165991)

Reading Infrastructure

 * Blocked by:
 * Blocking:
 * Updates:
 * MCS gets geo coordinates from action API instead of Parsoid.
 * Got rid of action=mobilview API calls for regular pages.

Reading Discovery

 * Updates
 * Working on search thumbnail AB test https://phabricator.wikimedia.org/T149811

Collaboration

 * Most of our team was at Wikimania.
 * However, we continued work on RC Filters and Echo
 * Echo: Merged a "Mark all as read" patch from community member and worked on additional patches (e.g. edit-user notification)
 * RCFilters: Small fixes
 * Flow: In-progress work on a feature to allow you to add inline Flow discussion linked to specific text.

Analytics

 * 2 team members in wikimania, 2 on family leave, 1 of our team members coming back next week from parental leave. Not a lot happened.
 * We figured out issue with timeouts in varnishkafka, there was one host running too new of a version of kafka API
 * Still working on purging eventlogging data, moving to cluster some data out of MySQL (will make DBAs happy). Couple tables that are about 0.5 tb.
 * Ordering new hosts to replace eventlogging MYSQL hosts using some budget we will not need for the new Kafka cluster.
 * Edit History Reconstruction, made a snapshoot custom for Neil (editing data analysts) to calculate metrics on.
 * Wikimetrics had stop working due to some recent changes to labs db connection limits, fixed that.

Services

 * Blockers: none
 * Updates:
 * Wiped out Parsoid HTML cache in preparation for Cassandra 3 upgrade
 * Elevated VE latencies for a while while new storage is populated

Technical Operations

 * Blocked:
 * by noone
 * Blocking:
 * none
 * Updates:
 * Wikimania + Debconf week, not much happened.

Community Tech

 * Updates: CodeMirror and LoginNotify are still coming!

Fundraising Tech

 * looking into db replication lag - it'll get up to like 5000 sec behind, but restarting mysql on the replicated copy will make it catch up in less than a minute
 * continuing new API work with main credit card processor
 * updating our interrupted-donation-resolver to work generically so we can use it for PayPal express checkout
 * refinements to CiviCRM<->bulk mailer data flows
 * CentralNotice clone campaign feature almost ready for CR

Scoring platform

 * Blocked
 * Feeling the pain of no git-fat in labs deployments (our git repos are huge!)
 * https://phabricator.wikimedia.org/T171758
 * Releng, can this be prioritized?
 * Updates
 * New ORES model information available at https://ores-misc.wmflabs.org. Demo coming soon.
 * Mostly an FYI for Collab Team

Release Engineering

 * Last projects moving to scap3
 * These have patches but deployment window scheduled:
 * iegreview
 * scholarships
 * No idea about:
 * ocg
 * dropwizard metrics(???) - Speak up now or forever hold your peace (we'll delete it)