Content translation/Deployments/How-to


This document describes deployment procedure for ContentTranslation, cxserver, Apertium and OpusMT.


Content Translation is updated via regular MediaWiki train. In case of manual update needed,

  1. Use Backport window to Cherry-pick desired changes.
  2. Make sure that Gerrit patch is merged only "after" deployment server is updated to the branch we want to deploy.

See also[edit]

  1. Branches at Gerrit interface:,branches
  2. To manually update extension branch: (You'll need clean copy of Mediawiki/core)



Note image tag version from Gerrit patch to be deploy. For eg: gerrit:502964 has 2019-04-11-112002-production tag.

Run it:

docker run -p 4000:8080 --it --entrypoint /bin/bash -c

Where, is local cxserver config file.

Endpoints can be tested at: http://localhost:4000

Config files[edit]

cxserver on Production config stays in:

helmfile.d/services/cxserver/values.yaml and,

WMF specific config stays in:


When config.yaml is updated. Update cxserver version in deployment-charts/charts/cxserver/Chart.yaml

Also see[edit]


  1. Clone deployment-charts repository (for first time).
  2. Do needful changes in config (update image or other configuration changes as needed).
  3. Make a CR (Example: and after a successful review, merge it.
  4. After merge, log in in a deployment server (eg: deploy1001), there is a cron (1 minute) that will update the /srv/deployment-charts directory with the contents from git.
  5. Go to /srv/deployment-charts/helmfile.d/services/cxserver.
  6. Execute: helmfile -e ${CLUSTER} diff This will show the changes that it will be applied on the cluster.
  7. Execute: helmfile -e ${CLUSTER} -i apply This will materialize the previous diff in the cluster and also will log into SAL the change.


If secrets like API key or token need update, it need to be done via SRE at Private Puppet repository.

To update or new keys, open Phabricator task with details and subscribe SRE clinic duty person. Example: task T284887


This is done using helmfile:

  1. Change directory to /srv/deployment-charts/helmfile.d/services/${CLUSTER}/cxserver on a deployment server
  2. Unless you are mid un-applied changes the current values files should reflect the deployed values
  3. You can check for un-applied changes with: helmfile -e ${CLUSTER} diff
  4. You can see the status with helmfile -e ${CLUSTER} status


  • cxserver logs are available in logstash as 'cxserver-last-24-hours' dashboard.
  • Logs can be access from deploy1002 if needed:

kube_env cxserver eqiad

kubectl logs cxserver-production-6c4f65bc-z6hcb cxserver-production

cxserver-production-6c4f65bc-z6hcb is pod name.

To see all logs:

kubectl logs -l app=cxserver -c cxserver-production

Rolling back changes[edit]

If you need to roll back a change because something went wrong:

  1. Revert the git commit to the deployment-charts repository.
  2. Merge the revert (with review if needed)
  3. Wait one minute for the cron job to pull the change to the deployment server
  4. Change directory to /srv/deployment-charts/helmfile.d/services/cxserver
  5. Execute helmfile -e ${CLUSTER} diff to see what you'll be changing.
  6. Execute helmfile -e ${CLUSTER} -i apply where CLUSTER is one of (staging, eqiad, codfw).

When patch with chart reverted, helmfile will pick highest number of chart present. Reverting such change will require pinning desired chart after revert configuration. eg.

Updating Template Parameter Alignment database[edit]


  • x1: wikishared.cx_*: cxserver main database.
  • m5-master: titles: section title mapping database.



x1 can be access via sql.php script on mwmaint server. See:

Note that ContentTranslation in testwiki is not using wikishared and using separate database testwiki.


m5-master requires cxserver user password access.

% mysql --skip-ssl -h m5-master.eqiad.wmnet -ucxserver -p
Enter password:

Also see[edit]


OpusMT service runs on cloud instance.


To see status of the service,

sudo service opusmt status

To restart the service,

sudo service opusmt restart

systemd service file[edit]

Description=OpusMT service 



Add new language support[edit]

  1. Follow documentation to download new language pair and setup on the instance.
  2. Update language pair at: and submit patch for review. This requires deployment of cxserver in production via deployment-charts.
  3. Make sure to restart opusmt service.