Extension:WikibaseMediaInfo

WikibaseMediaInfo is an extension to 1>Special:MyLanguage/Extension:Wikibase|Wikibase adding a MediaInfo entity for handling structured data about multimedia files.

The extension hooks into the File Page. It stores supplemental metadata (captions and depicts statements) about the file in a MediaInfo Entity. The user can view, create, edit, and delete this data.

Requirements

 * UniversalLanguageSelector
 * CirrusSearch
 * Wikibase (follow instructions for both client and repo)
 * WikibaseCirrusSearch

Installation

 * Ensure CirrusSearch and Wikibase (client and repo) are set up properly.


 * Add required configuration.

Configuration
Extension configuration variables are sets of key-value pairs. They are documented in more detail in. All config variables are added to.

The following config options are available for this extension:

Required Config (must be added to LocalSettings)

 *   Default wikibase properties that will always be shown on the File page/UploadWizard, whether or not they have a value. On live commons this is the 'depicts' property, as we want to encourage users to fill in values for this in particular. Value is an array of key-value pairs connecting a label name to an existing wikibase database id.


 *   Set to true to allow users to add statements with properties that are not specified in  via the UI on File page/UploadWizard. ATM only properties whose values are wikibase items are supported, properties with data-type 'string', 'geo-coordinate', 'quantity' etc will be supported at some stage in the future.


 *   If  is false then properties for qualifiers for statements are limited to those properties defined in this variable (if it's true any property with data type 'wikibase-id', 'string' or 'quantity' can be used, so this variable is ignored). Value is an array of key-value pairs connecting a label name to an existing wikibase database id.

Other Config:

 *   Enables MediaInfo data on UploadWizard when set to true.
 *   Defaults to true.
 *   (temporary feature flag) . Defaults to true.

Property (P-item)
A property is used to categorize or describe a file. It has a unique id in wikibase in the form  such as. Examples of file properties are ‘depicts’ (what an image is a picture of), ‘resolution’, ‘created by’, ‘license’.

Item (Q-item)
An item is the concept, topic, or object. It is represented by a unique id in the form. For example on Wikidata the planet Earth is the item  and the CC0 licence is.

Claim
A single fact about a media file consisting of a key-value pair (usually a property-item) such as  or. Claims are stored simply as strings, using the property ids and item ids as appropriate. For example, an image depicting a black cat could have the claim.

Caption
A short piece of text describing a media file, plus its language. This is used to WikibaseMediaInfo to provide a short description of the file (the same as ‘labels’ in wikibase).

MediaInfo Entity (M-item)
A Wikibase entity that contains structured data about media files. It is stored in a slot on a File page and consists of


 * an ID in the form Mxxx, where xxx is the id of the associated wiki page
 * any number of captions
 * any number of claims

(Note: if there is no caption or claim data then the entity is not stored in the database - in this case the entity is known as a ‘virtual entity’)

Qualifier
A qualifier is a secondary claim that modifies the primary claim. For example an image might have a tree in the foreground and the sea in the background, in which case it could have 2 ‘depicts’ claims associated with it - ‘depicts=tree(applies to part=foreground)’ and ‘depicts=sea(applies to part=background)’.

MediaInfo UI
MediaInfo entities are shown on, and can be edited from, their associated File page. Captions and claims are shown separately, and claims are split into ‘depicts’ claims and ‘other’ claims.

Search by caption
Users can search for files by their MediaInfo captions just as they would search for anything else. For example, if a user uploads a picture of the Eiffel Tower, and enters ‘Tour Eiffel’ (French) and ‘Eiffel Tower’ (English) as multilingual file captions, the picture is findable by another user searching for either ‘Eiffel Tower’ or ‘Tour Eiffel’.

Searching for claims/statements
Searching for claims/statements happens via WikibaseCirrusSearch keywords, for details see:

Search implementation
When the File page is saved, the following MediaInfo data is written to the Elasticsearch index (all examples use Wikidata Property and Item ids):


 * Captions data in every language is stored in the  field


 * Claims are stored in the format  as array elements in the   field using the wikibase property ID (and item id, if value is an item) - e.g. ‘depicts house cat’ is stored as  


 * Claims with qualifiers are stored in the  field along with their qualifiers in the format  .  For example, the Mona Lisa painting (Wikidata item Q12418) depicts a sky (Q13217555) in the background (Wikidata property P518). If we arrange this data in a Wikibase claim, it would be: ‘depicts sky, applies to part background’, which would be stored as  


 * Note that claims with qualifiers are also stored without the qualifier, to increase their findability. So, for example, if someone entered the above claim-plus-qualifier, the claim   is also stored, so that someone can find the file by searching for ‘depicts sky’ alone, as well as by searching for ‘depicts sky, applies to part background’.


 * Claims data with qualifiers where the qualifier value is a quantity is stored in the  field in the format , eg. ‘depicts human, quantity 1’ is stored as  .

Note that not all claims are stored. A claim will be indexed in ElasticSearch only if ALL of the following conditions are true:


 * The claim has a real value (i.e. its value is not ‘no value’ or ‘unknown value’) AND


 * We know how to process its value for indexing. More value processors may be added in future, but currently we require the claim’s value to be either a Q item ID, a string (alphanumeric), or a quantity (numeric) AND


 * the claims’s Wikidata property ID is NOT in a configurable list of excluded IDs AND either its property ID is in a configurable list of property IDs that should be indexed  ORits property type is in a configurable list of property types that should be indexed

Note that for a claim’s quantities to be stored, the claim must meet all the criteria above AND the property ID for the quantity qualifier must be present in a configurable list of property IDs.

Tests
PHPUnit tests are located in. You can run tests not requiring the MediaWiki framework (located in ) by running. This command also runs code style checks using PHPCS.

Tests relying on the MediaWiki framework (located in ) must by run using MediaWiki core’s   endpoint.

Javascript tests are located in. You can run tests from a terminal with. Node version 6.x should be used.

More information about the testing approaches being used in this extension's development can be found here.