User:CFeng (WMF)/MachineVisionSetup

Introduction
This page introduces you to install mediawiki-docker and set up the MachineVision extension.

Install Docker Compose
https://docs.docker.com/compose/install/

Clone mediawiki-docker-dev
Clone the code to the path you would like to work on, I would recommend to clone it into :

git clone git@github.com:addshore/mediawiki-docker-dev.git

And now, it is in the

Clone MediaWiki and the skin
Since the repository above only contains settings and scripts about setting up MediaWiki on Docker, we will need to install the MediaWiki by ourselves.

Clone it into : git clone git@github.com:wikimedia/mediawiki.git

And now, it is in the

Also, you will need a default skin for the entire MediaWiki page to the skins folder:

git clone git@github.com:wikimedia/mediawiki-skins-Vector.git Vector

Install Composer
Before running the MediaWiki installation scripts, you will need the Composer. Please download and install it on your machine. https://getcomposer.org/download/

Run composer install for MediaWiki
Run the followingg script to install MediaWiki

Create a LocalSettings.php for MediaWiki
The LocalSettings.php contains the information that MediaWiki needs and you will need to update this file every time you add extensions.

Since the  needs a lot of extensions and other settings, here is the copy of my LocalSettings.php and please copy that into the User:CFeng_(WMF)/MachineVisionSetup/LocalSettings.php

Install extensions for mediawiki
The LocalSettings.php has the following code:

which you will need to install the extensions manually.

Please go to the https://www.mediawiki.org/wiki/Special:ExtensionDistributor to find the extensions and copy them to the

or, you can run the following scripts:

Setting up Wikibase
Include the following into  at the  :

and run the script to apply the changes at the  installation composer install

MediaWiki-Docker environment configuration
Copy the  in   and into a new file called.

Please make sure to update the  path of your installation. DOCKER_MW_PATH=/Users/[USERNAME]/Documents/mediawiki

Some other settings in the  you might need to update, for example, the PHP version you've installed, or the port has already taken by other services.

Create and start the Docker container
cd ~/Documents/mediawiki-docker-dev ./create

The script waits up to 120 secs (4 x 30 seconds) for the database containers to initialize and respond.

Host name resolution configuration
Adding the following configuration to your Please note that you might need  when editing the hosts.

For more details of mediawiki-docker configuration, please visit: https://github.com/addshore/mediawiki-docker-dev/blob/master/README.md

MachineVision extension configuration
Run  in the MachineVision extension folder: cd ~/Documents/mediawiki/extensions/MachineVision composer install

and then go to the mediawiki-docker to  into the   container cd ~/Documents/mediawiki-docker-dev ./bash php maintenance/update.php

Import the MachineVision mapping data
Download the mapping data from Google: https://developers.google.com/freebase/#freebase-wikidata-mappings

Extract the downloaded file from its archive and place it somewhere that MediaWiki can access it. To import, run the following maintenance script: php maintenance/populateFreebaseMapping.php --mappingFile [FILE_PATH].nt

This process may take some time to complete.

Apply and enable the Google Cloud Vision API
Go to https://console.cloud.google.com and create a project, for example,  and then click on APIs & Services on the left menu to enable the API we need.

In the API list, search Cloud vision and enable it.

To use the API, we will NEED to add credentials to the project. Once you have created a credential, you can choose the format of the credential to be JSON, and download it to your machine. Not sure if this is associate with the service, but you might need to activate the free trial status with $300.00 credit on your account in order to activate the service successfully. Since we have already set the credential path in LocalSettings.php, we will need to copy the credential to  and rename the file as   to match the following setting:

For more details please vision here: https://github.com/wikimedia/mediawiki-extensions-MachineVision/blob/master/README.md

Upload images and test the API
Go to http://default.web.mw.localhost:8080/, create an account and log in. Once you have logged in, you can upload images to the MediaWiki.

After the images being uploaded, you will need to run a script to communicate with Cloud Vision API.

cd ~/Documents/mediawiki-docker-dev ./bash php maintenance/runJobs.php

and, check the local  API to see if you have done all the configurations right. http://default.web.mw.localhost:8080/mediawiki/api.php?format=json&formatversion=2&errorformat=plaintext&action=query&generator=unreviewedimagelabels&guillimit=10&prop=imagelabels%7Cimageinfo&iiprop=timestamp%7Cuser%7Curl%7Cmime&iiurlwidth=320&uselang=en

If you see an empty response, please make sure you have set up the Cloud Vision API credential correctly.