Flow/Analytics

Goals:
 * determine engagement with Flow boards
 * We'll do this by running queries against the Flow DB
 * Probably want to compare with regular talk pages. Wikimetrics can get metrics for regular talk pages, but it's only for a cohort, a defined group of users.
 * measure how people use the UI
 * Second we'll do using EventLogging, logging m:Schema:FlowReplies and other actions.
 * also involves qualitative User Research.

Determining engagement
Flow can determine metrics like new topics, and average number of replies to topics because these are separate updates DB.

We'll probably want to compare with regular talk pages.
 * Wikimetrics can get metrics for regular talk pages, but it's only for a cohort, a defined group of users.
 * Wikimetrics page edits aren't currently talk-aware. Determining similar metrics (New topics, count replies, etc.) for regular user talk pages is harder. Echo has a   that can help, but it's intensive, parsing each revision.

Cohort
Typical wikimetrics involves identifying a cohort ("People who signed up at our Editathon") and then tracking their page edit success.

Flow doesn't have obvious cohorts to compare, we could just pick a bunch of newly-registered users. Danny has mechanically counted regular talk page edits vs. Flow board edits.

How to get info to a dashboard?

 * Limn for now

Mobile team has automated this, they have a server running cron jobs.

Dan Andreescu will tell us how.

Privacy: not too much data, not too long, not too personal

 * don't store data for long periods.
 * don't store personally-identifiable information data.
 * don't log for every single user

Note that Echo does all this for logged-in users who click on the Echo [NN] red badge.

Next steps
Talk to Dan Andreescu

Make sure we define what success is
For comparison, Analytics has developed a well-defined funnel for "editor success": user registers, user edits successfully, and user sticks around.

Example:Query how many people visit a talk page

 * and never try again
 * and try to edit
 * and try to add a new topic
 * and "get their answer"