Analytics/Visualization, Reporting & Applications/status

Last update on: 2013-05-monthly

2012-07-31
Limn released on GitHub!

2012-07-monthly
The Analytics team published the source code for Limn to GitHub this month.

2012-08-10
Phabricator to track GitHub Limn

2012-08-monthly
We started working on the migration from dygraphs to d3.js, and improving documentation to ease the on-boarding of our new front-end engineer.

2012-09-21
Finishing first steps of conversion to d3. Start to migrate some more dashboards to use Limn.

2012-09-monthly
Initial prototype of d3-based graphing is done, which now needs to be integrated into Limn. The team has been training other groups to use Limn to create custom dashboards.

2012-10-monthly
The migration to d3 rendering was completed. The design for the new Edit UI is complete. We are porting over the monthly metrics meeting dashboard to the new Limn and are aiming to show it off in December.

2012-11-19
We are porting over the monthly metrics meeting dashboard to the new Limn and are aiming to show it off in December.

2012-11-monthly
<section begin="2012-11-monthly"/>David Schoonover and Dan Andreescu are working on a major rework of Limn, using Knockout.js and d3.js. The team hopes to have this ready to present the metrics for the December 6 metrics meeting at the Wikimedia Foundation.<section end="2012-11-monthly"/>

2012-12-monthly
<section begin="2012-12-monthly"/>A major rework of Limn to use d3.js and Knockout.js is complete and will be used for the next ReportCard. Dan Andreescu and David Schoonover are working on graph editing and geospatial data visualization.<section end="2012-12-monthly"/>

2013-01-monthly
<section begin="2013-01-monthly"/>The team made performance improvements and added new visualizations. Bar, line, and geo plots can now be built ad hoc from arbitrary data. Evan Rosen's Grantmaking and Programs dashboard was migrated to this new version of Limn. Current work includes a collaboration with the E3 team to provide visualizations, and development of a MediaWiki extension that will allow creation and editing of graphs.<section end="2013-01-monthly"/>

2013-02-monthly
<section begin="2013-02-monthly"/>Highlights in the past month include
 * Stacked charts
 * Debianization & Puppetization
 * New E3 and Grantmaking dashboards
 * Ad-hoc visualization of datasource<section end="2013-02-monthly"/>

2013-04-monthly
<section begin="2013-04-monthly"/>We published our monthly report card. As part of Wikimedia's ongoing mobile initiative, we also helped develop analytics that would support ongoing delivery and planning of mobile functionality: We also introduced new dashboards for our Editor engagement team, that will help them monitor the usage of the new Notifications system. Finally, we've added pageview stats for the Hungarian and Ukranian Wikivoyages.<section end="2013-04-monthly"/>
 * We've started to analyze mobile site pageviews by device class, in order to determine how we will invest in building applications and sites that support various device formats.
 * We've also started to perform session analysis of mobile site visits, in order to help us understand user behavior when using the mobile sites, which will inform decisions about ongoing development efforts. At present, this data is only for internal consumption by the Mobile team.
 * A new overall mobile pageviews report is now available, which has improved the accuracy of our reporting due to changes in how the MobileFrontend extension requests a wiki article (improving performance).
 * More information about how we're calculating mobile pageviews is available in our documentation.

2013-05-monthly
<section begin="2013-05-monthly"/>

Kraken

 * For the mobile team, we started collecting pageview counts for both official and non-official Wikipedia Apps.
 * We changed our Kafka import configuration so that the raw webrequest folders are directly queryable using Hive.

UMAPI
The decision was made to re-platform the UMAPI codebase; we have spent quite some time specifying user stories and had productive discussions about the architecture during the Amsterdam Hackathon.

On the development side we made the following progress:


 * The 'page count' metric was introduced
 * We adapted Ori's Mediawiki Vagrant VM to also support UMAPI in combination with test data. This will make it much easier to debug issues and open development up to community members.
 * We fixed numerous stability bugs and we are exposing the version info. <section end="2013-05-monthly"/>