Reading/Multimedia/Research

Key metrics
To measure our progress with the multimedia program, we propose to track these two primary metrics on a monthly basis:
 * files uploaded
 * files used in pages

While we have been tracking the number of uploads for several years now, this metric only provides a partial measure of success, as a large number of uploaded files are never used in articles. Hence the need for a second metric to track how many files are actually published in articles on our sites, serving our ultimate goal to provide a richer multimedia experience for our users.

Besides these two metrics, we plan to collect other data to inform our next steps for the plan above. For example, we have already started to collect these file metrics, as well as these user metrics.

Going forward, here are some of our key research questions related to file feedback, curation, discovery and publication.

Usage Patterns
For our first products, we will want to track basic usage patterns, leveraging EventLogging and other technologies. Here are some examples of what metrics we hope to collect.

Beta Features
Here are some questions we hope to answer for the upcoming beta features preference, ideally on a daily basis and on a cumulative basis: (repeat for each feature)
 * How many users clicked on the 'Beta' link in action menu?
 * How many of these enabled (or disabled) features after clicking on the 'Beta' link? (total and percentage)
 * How many users enable all beta features?
 * How many users disable all these beta features?
 * How many users enabled feature x?
 * How many users disabled feature x?

Media Viewer
Here are some questions we hope to answer for the upcoming media viewer feature, ideally on a daily basis and on a cumulative basis:
 * How many users clicked on a thumbnail that opened the media viewer? how many clicks total?
 * How many of these clicked on the full screen button? (total and percentage)
 * How many of these clicked on the Commons link? (total and percentage)
 * How many of these clicked on the close button? (total and percentage)
 * How many users enabled this beta feature? (pull data from beta features)
 * How many users disabled this beta feature? (pull data from beta features)

File feedback / curation
(for the last two questions, we are prepared to start a separate data table if there is no good match, but wanted to leave no stone unturned)
 * What are the many different workflows that people use to curate files on Commons today?
 * Can we quantify which curation tools/workflows are used the most? Map out the most popular workflows?
 * Primary workflow: How many files are uploaded, categorized, edited, overwritten, rated or featured on Commons? (see first stats)
 * Orphan workflow: How many files are uncategorized and/or never edited or used on Commons? (see first stats)
 * Deletion workflow: how many files are nominated for deletion and/or deleted per month on Commons? (see first stats)
 * Is there a current 'quality rating' tool that could be adapted so that any user could 'mark a file as useful' in the media viewer?
 * Is there a current 'flag as inappropriate' tool that could be adapted so that any user could 'mark a file as inappropriate' in the media viewer?

File discovery / publishing
(Note that 'file usage' or 'file user' metrics could be the most important measure of success of our multimedia program)
 * What are the different workflows which Wikipedia editors use to find and publish media files on articles?
 * Publication workflow: How many files are used in articles on other wikis? (see GlobalUsage extension)
 * Can we quantify which discovery/publishing tools/workflows are used the most? Map out the most popular workflows?
 * How often do editors search for media files to add to their articles? can we tell how many of these searches are successful?
 * What data do we have now on how often the Visual Editor's new 'Insert Media' tool is being used to browse and/or add files to articles?
 * How many files are used today on the article name space of Wikipedia? How many images vs. sounds vs. videos? How many from Commons?
 * How many articles have multimedia files on Wikipedia? How many files per article? How many articles have no media files?
 * How many unique editors publish files on other wikis each month? how many for the English Wikipedia in particular?
 * How often are files added to articles reverted/removed? (compared to text edits, is this more or less?)

In coming days, these questions will be prioritized and turned into a long-term metrics plan for multimedia, based on available resources.