Project:Sandbox

This is a tutorial which explains how to use Git and Gerrit for Wikimedia development.


 * If you want to save time and are tech-savvy, use the very short how-to guide instead:


 * For power users,  has additional documentation.


 * If you only want to play with Gerrit and do not want to write a patch for a "real" Wikimedia software project, use our 1>wikitech:Gerrit test instance|Gerrit test instance instead.

In this tutorial, commands to enter start with a dollar sign in a box, like this: .

Do not enter the   prefix.

If a command also include a variable which you must to change yourself, then the variable is shown in red: .

What is Git?
Git is a free and open source distributed version control system.

“Distributed” means that there is no central copy of the repository.

With Git, once you’ve cloned the repository, you have a fully functioning copy of the source code, with all the branches and tagged releases at your disposal.

What is Gerrit?
Gerrit is a free, web-based collaborative code review tool that integrates with Git.

Basically: You submit your proposed software change (often called "patch", in Gerrit called "changeset") as a new branch.

If the first version ("patchset 1") is not yet perfect, you can make more changes ("amend") in that branch ("patchset 2", etc).

Once a patchset receives a "+2" review, it will get accepted and merged into the main branch of the code repository (usually called "master").

Merging means that your change is included by default when anyone checks out or downloads that code repository.

Create a Wikimedia developer account
If you do not have a 1>Special:MyLanguage/Developer account|Wikimedia developer account yet, 2>wikitech:Special:CreateAccount|go to wikitech.wikimedia.org and create an account.

The same username and password will be used to log into Gerrit below.

Set up Git
These instructions explain how to install Git as a command-line (terminal window) tool.

If you prefer a graphical user interface (GUI) instead of the command line, then check the [https://git-scm.com/downloads/guis list of clients maintained by the Git project].

For alternate installation instructions see [https://www.git-scm.com/book/en/v2/Getting-Started-Installing-Git</> the official documentation].

Font Awesome 5 brands linux.svg Linux

 * Use the graphical software package management tool of your Linux distribution to install the <tvar|1> </> package.


 * If git has not been packaged by your distribution, then please ask in a support forum of your distribution.

Font Awesome 5 brands windows.svg Windows

 * Install Git for Windows from <tvar|1>https://gitforwindows.org/</>. This gives you Git, plus a shell called "Git Bash" that allows most of the command lines in these instructions to work on Windows.

Apple logo black.svg macOS

 * Install the <tvar|1>Homebrew</> package manager and then run the command <tvar|2></> – This is recommended, as it allows simple updating and easy installing of other packages.


 * As an alternative, you can install the stand-alone <tvar|1>Git for Mac</>.

Configure Git
Now that you have Git installed, it’s time to configure your personal information.

You should have to do this only once.

You can also change your personal information at any time by running these commands again.

Git tracks who makes each commit by checking the user’s name and email.

In addition, this info is used to associate your commits with your Gerrit account.

Enter the two commands below to set your username and email address.

Replace <tvar|1></> with your own Gerrit username and replace <tvar|2></> with your own email address:

Set Up SSH Keys in Gerrit
We use an SSH key to establish a secure connection between your computer and Gerrit.

To make sure whether you need to generate a brand new key, let's check if an SSH key already exists on your system.

Run this command in a terminal:

The command will list the files that are in the (hidden) <tvar|1> </> directory.

If the directory already exists on your system and if the output lists a file called <tvar|1> </>, then you can go directly to 2>#Copy your SSH Public key</>|#Copy your SSH Public key.

Generate a new SSH key
To generate a new SSH key, enter the command below and replace <tvar|1></> with your own email address.

We want the default settings so when asked to enter a file in which to save the key, just press enter.

Enter a strong and unique passphrase and press the [Enter] key.


 * Why do passphrases matter?


 * ''Passwords aren’t very secure. If you use one that’s easy to remember, it’s easier to guess or brute-force.  If you use one that’s random it’s hard to remember, so you might write the password down.  Both are very bad.  This is why you’re using ssh keys.  But using an ssh key without a passphrase is basically the same as writing down that random password in a file on your computer.  Anyone who gains access to your drive has gained access to every system you use that key with.  That's why you also add a passphrase.  To not enter a long passphrase every time you use the key, there’s a tool called <tvar|1> </>.  It can save your passphrase securely.

If you use macOS or Linux, then your keys can be saved in the system’s keychain to make your life even easier.''

The <tvar|1> </> command will create 2 files in <tvar|2> </> directory:


 * <tvar|1> </> : your private SSH key (for identification)
 * <tvar|2> </> : your public SSH key

Copy your SSH Public key
Get the content of your public key file (e.g. <tvar|1> </>) to copy it to your clipboard:

One option is to open your public key file with your favorite text editor (Notepad, TextEdit, gedit, etc).

In the file chooser dialog of your text editor, you may need to turn on “View hidden files” to find the file, because the <tvar|1> </> directory is hidden.

Sometimes the “View hidden files” option is available by right-clicking in the file chooser dialog.

Other options are:


 * On Linux, run <tvar|1></> and manually copy the output to the clipboard.
 * On Windows, you can open Git GUI, go to Help 🡒 Show Key, and then press "Copy To Clipboard" to copy your public key to your clipboard.
 * On macOS, you can run <tvar|1></> to copy the contents of the your public key file to your clipboard.

It’s important you copy your SSH Public key exactly as it is written, without adding any newlines or whitespace.

Copy the full text, including the "ssh-rsa" prefix, the key itself, and the email address suffix.

Add SSH Public key to your Gerrit account

 * Log into the [<tvar|1>https://gerrit.wikimedia.org</> web interface for Gerrit]. The username and password for your Gerrit are the same as for 1>#Create a Wikimedia Developer account</>|your Wikimedia Developer account.
 * Click on your username in the top right corner, then choose "Settings".
 * Click "SSH Public Keys" in the menu on the left.
 * Paste your SSH Public Key into the corresponding field and click "Add".

Add SSH Private key to use with Git
Start the Git Bash command line.

Get ssh-agent running using
 * Be sure to use the accent <tvar|1> </>, not the single quote <tvar|2> </>. (You could copy and paste from this page if you cannot easily enter this special character.)
 * Be sure to use the accent <tvar|1> </>, not the single quote <tvar|2> </>. (You could copy and paste from this page if you cannot easily enter this special character.)


 * Add your private key to the agent. If you followed the steps above and your key has the default name <tvar|1> </>, then the command is:


 * Connect to the Gerrit server via <tvar|1> </> to check if everything works as expected. Replace <tvar|1></> by your username as shown 2>gerrit:#/settings/</>|in your Gerrit settings:


 * Be paranoid and compare that the "RSA key fingerprint" is the same as the [<tvar|1>https://wikitech.wikimedia.org/wiki/Help:SSH_Fingerprints/gerrit.wikimedia.org:29418</> SSH fingerprint for <tvar|2>gerrit.wikimedia.org:29418</>]. If it is the same, answer "Yes" to "Are you sure you want to continue connecting?".  Then enter the passphrase for your key.
 * You should get a message "Welcome to Gerrit Code Review". The last line should show "Connection to gerrit.wikimedia.org closed."
 * If you run into problems, use <tvar|1></> (replace <tvar|2></> by your username). The <tvar|1> </> will provide verbose output to help find problems.  Then read 1>Gerrit/Troubleshooting</>|Gerrit Troubleshooting.

An example Gerrit SSH connection success message looks like this:

Download code using Git
Let's practice by downloading (also called "cloning") the repository called "sandbox".

Run the following on the Git Bash command line:

(Replace <tvar|1></> by your Gerrit username. And make sure the URL begins with <tvar|1> </> and not <tvar|2> </>).

This will copy the entire history and the code base of the "sandbox" extension repository onto your machine.

You will have a working directory of the extension's main branch (usually also called "<tvar|1>git master</>").

Enter the new directory (via the command <tvar|1></>).

Now you can look at the code and start editing it.

Prepare to work with Gerrit
Gerrit requires that your commit message must have a "change ID".

They look like <tvar|1> </> starting with an I (capital i). Each time you 1>#Amending_a_change_.28your_own_or_someone_else.27s.29</>|amend a commit to improve an existing patch in Gerrit, this change ID stays the same, so Gerrit understands it as a new "patch set" to address the same code change.

There's a git add-on called <tvar|1>git-review</> that adds a Change-ID line to your commits. Using git-review is recommended. It makes it easier to configure your Git clone, to submit a change or to fetch an existing one.

Installing <tvar|1>git-review</>
Note that Wikimedia Gerrit requires git-review version 1.27 or later.

For more details, please see 1>Special:MyLanguage/Gerrit/git-review#Installation|Gerrit/git-review</>#Installation.

Font Awesome 5 brands linux.svg Linux

 * Use the graphical software package management tool of your Linux distribution to install the <tvar|1> </> package.
 * If git-review has not been packaged by your distribution, check 1>Gerrit/git-review#Linux</>|git-review for other options such as 2>Gerrit/git-review#Install_using_pip_Python_package_installer</>|installing git-review by using the pip Python package installer.
 * If you use FreeBSD, 1>Gerrit/git-review#FreeBSD</>|install git-review through ports.

Font Awesome 5 brands windows.svg Windows

 * Please see 1>Gerrit/git-review#Windows</>|git-review Windows.

Apple logo black.svg macOS

 * For <tvar|1>OS X 10.11 El Capitan</> and later, follow 2>Gerrit/git-review#Method 2</>|Method 2.
 * On versions prior to 10.11, use the pip Python package installer by following 1>Gerrit/git-review#Method 1</>|Method 1.

Configuring <tvar|1>git-review</>
Git's default remote host name is "<tvar|1>origin</>".

This name is also used by Wikimedia projects.

We need to tell <tvar|1>git-review</> to use that host.

Replace <tvar|1></> with your Gerrit username:

Setting up <tvar|1>git-review</>
After 1>#Download code using Git</>|downloading ("cloning") a repository, you need to set it up for <tvar|2>git-review</>.

This will automatically happen the first time you try to submit a commit, but it's generally better to do it right after cloning.

Make sure that you are in the directory of the project that you cloned (otherwise you will get an error "fatal: Not a git repository").

Then run this command:

Towards the end of the output, you should see something like this:

This may ask you for your git username, if it's different from the shell username you're using.

Submit a patch
Make sure that you cloned the code repository that you are interested in (see 1>#Download code using Git</>|here).

Make sure that you are in the directory of the code repository (the command <tvar|1></> tells you where exactly you are).

Update master
Make sure that your master branch (the branch created when you initially cloned the repository) is up to date:

However, note that a few repositories use different terms (for example, the <tvar|1> </> repository has a <tvar|2> </> instead of a <tvar|3> </> branch).

Create a branch
First, create a local branch for your new change. Replace <tvar|1></> below by a short but reasonably descriptive name (e.g. <tvar|2> </> if a corresponding <tvar|3>Phabricator</> task exists for your changes, <tvar|4> </>, or <tvar|5> </>). Other people will also use this name to identify your branch.

This will create a new branch (called <tvar|1>)</> from the latest 'master' and check it out for you. In the example above, we called that new branch <tvar|2> </>.

Make your changes
Make changes to your local code.

Use your preferred text editor and modify a file.

In the example below, we edit the file <tvar|1> </> and add a word.

Then close your text editor and check the changes you have made since the last commit, within the file(s) and within the directory:

<tvar|1> </> displays your changes in unified diff format: Removed lines have a minus (<tvar|2> </>) prefix and added lines have a plus (<tvar|3> </>) prefix. These changes are not yet "staged" (via <tvar|1> </>) for the next commit.

Stage your changes for a commit
Run <tvar|1></> to decide which of your changes should become part of your commit. It will display a list of all file(s) that you have changed within the directory. At this point, the output will display "no changes added to commit" as the last line.

Use <tvar|1> </> to make your changed file(s) become part of your next commit. In the example above we modified the file <tvar|1> </>, so the command would be:

Any files you've changed that you have not passed to <tvar|1> </> will be ignored when running <tvar|2> </> in the next step.

Commit your staged changes
Once you are happy with the list of changes added via, you can turn these changes into a commit in your local repository by using

You will then be asked in your text editor to add a descriptive summary for your commit. You must follow the 1>Gerrit/Commit message guidelines</>|Commit message guidelines. This is what other people will see when looking at the history of changes in the code repository.

Save the commit message and close your text editor.

A summary (the commit ID, your subject line, the files and lines changed) will be displayed.

Prepare to push your commit to Gerrit
Synchronize your changeset with any changes that may have occurred in the master branch while you've been working ("rebasing").

From within your branch, run:

Now you are ready to push your code to Gerrit for review. If you made several related commits, consider 1>#Squash several commits into one single commit via rebase</>|merging them into one single commit for review.

Push your commit to Gerrit
If you followed 1>#Prepare to work with Gerrit</> above and installed <tvar|2> </> and ran <tvar|3> </>, then the command to push changes to Gerrit is:

The <tvar|1> </> option tells git-review not to perform a rebase before submitting the change to Gerrit.

Upon success, you'll get a confirmation and a link to the changeset in Gerrit. In the example above, that link is: <tvar|1>https://gerrit.wikimedia.org/r/#/c/sandbox/+/563720</>

Congratulations! Your patch is in Gerrit and 1>Gerrit/Code review/Getting reviews</>|hopefully will get reviewed soon!

View the Change / Next Steps
Open the link to your Gerrit changeset in a web browser.

Under "Files", after you clicked the down arrow at the very right of any file in the list, you can see a diff of your changes per file: The old lines are shown in red color and your new lines are shown in green color.

If your commit addresses a ticket in <tvar|1>Phabricator</>, a comment will be automatically added in the Phabricator task if you followed the 2>Gerrit/Commit message guidelines</>|Commit message guidelines. If you did not, you could either fix your commit message (by creating an updated patchset), or manually add a comment on that Phabricator ticket which includes a link to your changeset in Gerrit.

Other common situations
Also see 1>Gerrit/Advanced usage</>|Gerrit Advanced usage if your situation is not covered here.

Squash several commits into one single commit via rebase
If you made several related commits to your local repository prior to wanting to submit for review, you should squash (merge) those commits into one single commit.

The <tvar|1> </> or <tvar|2> </> option allows you to change (rewrite) your commit history. For each commit, you can modify and change the commit message, add or remove files, or perform other modifications.

First you need to tell git how far back you want to pull.

To get a list of all changes in your branch:

You can also limit the displayed list of recent changes. <tvar|1> </> means pull the last three commits:

After you type this command, your text editor will display your commits in reverse order and a list of available commands:

Since we only want to send one commit to review, we will squash the last two commits into the first. Hence change all but the first "pick" to "squash":

pick aa8cf1d Adding method customFilterFunctionGetRiskyCountryCodeScore to GatewayAdapter. squash 38828e2 Adding $wgDonationInterfaceCustomFiltersFunctionsRiskyCountries to donationinterface.php squash be33007 Fix a typo

When you finished picking and squashing and saved the file, another file will open in your text editor to allow you get to edit and merge your commit messages. Be careful to only keep one of the Change-Id lines and have it be at bottom of the message after one empty line.

Your messages from your previous commits will automatically be placed in this message:

Remember to put your (updated) summary message in the commit.

In this case the new summary message will be:

(mingle-fr-2012-69) Adding a custom filter for risky countries.

If all goes well, you should see a successful rebase message:

Afterwards, submit your patch for review:

You should see a message like this showing your git review went to Gerrit (in this example, to <tvar|1>https://gerrit.wikimedia.org/r/7187</>):

Amending a change (your own or someone else's)
Sometimes, you might need to amend a submitted change. You can amend a change as long as the change hasn't been merged yet.

You can amend your own changes. To amend changes submitted by someone else, you need to be a member of Gerrit's Trusted-Contributors group. To become a member of Trusted-Contributors, find someone who is a member and ask them to [<tvar|1>https://gerrit.wikimedia.org/r/admin/groups/2021f25e7515187a81d51f8fe14dd6f25617cce0,members</> add you]. The group is viral in that members can add new members, use your powers responsibly.

Rebase to bring your local branch up to date with the remote. It's best to make rebase updates a separate patch, so that your code reviewers have an easy time seeing what changes you've made. Assuming you are using Gerrit, you can do this by clicking the "Rebase Change" button when viewing your patch in Gerrit's web interface.

Hard reset and checkout the change with this command:

(BEWARE: <tvar|1> </> performs a hard reset that destroys all local changes. Stash or commit changes first which you wish to preserve!)

For example:

Note, if you already have the change in a branch on your local repository, you can just check it out instead:

For example:

Next, make some changes with your favorite text editor.

<tvar|1> </> the files as needed, then commit the change (ensuring you are amending the commit):

Push the change:

The <tvar|1> </> is important here. It tells git-review to not rebase your change against master, which clutters diffs between patch set [<tvar|1>https://gerrit.wikimedia.org/r/gitweb?p=test%2Fmediawiki%2Fextensions%2Fexamples.git;a=commit;h=fee9e992a68d285a727e39608cb608e535bcc10a</> 1] and [<tvar|2>https://gerrit.wikimedia.org/r/gitweb?p=test%2Fmediawiki%2Fextensions%2Fexamples.git;a=commit;h=7b7840b470961405bf0560d645fe6b39d848601c</> 2].

Push to a branch different than master
Above, the commit was pushed to the master branch. The branch name only appeared as the topic of the commit in the Gerrit UI. If you really want to push to a different branch than master, you have to push via <tvar|1> </>.

Editing via the web-interface
If you're logged in to Gerrit, you can also create code changes directly within the web interface. This can be useful for making small patches, or for non-developers to contribute small fixes.


 * 1) Go to <tvar|1>https://gerrit.wikimedia.org/r/admin/projects</> and choose the code repository that you want to edit.


 * 1) Select "Commands" in the sidebar


 * 1) Click "Create Change"


 * 1) Set branch to "master" (if you don't want to use master branch you can use the other branches available for that project)


 * 1) Set the topic to something of your choosing (e.g. "copy-edit" - must be all-one-string) (optional)


 * 1) Write a description ("commit summary") in the big text field by following 1>Special:MyLanguage/Gerrit/Commit message guidelines</>|message guidelines. (2>gerrit:#/c/308075/</>|Example)


 * 1) Click "Create"


 * 1) In the upper right corner, click the "Edit" button


 * 1) Under "Files", click "ADD/OPEN/UPLOAD" button


 * 1) Type the folder/file path for the file you wish to edit (e.g. i18n/en.json) and click "Open"


 * 1) Find the line(s) you want to change, and change them.


 * 1) Click "Save"


 * 1) Click "Close"


 * 1) Click "Publish edit"


 * 1) Click the button "Start Review"

Done!

If you need to change the commit message of an existing changeset, you can use these steps:


 * 1) Go to the changeset itself. Example URL: <tvar|1>https://gerrit.wikimedia.org/r/c/1234567890</> (replace the ID at the end)


 * 1) In the "Files" section, click "Commit message"


 * 1) In the upper right corner, click the "Edit" button


 * 1) Make changes to the commit summary.


 * 1) In the upper right corner, click "Save"


 * 1) In the upper right corner, click "Close"


 * 1) In the upper right corner, click "Publish edit"

How code is reviewed in Gerrit
1>Special:MyLanguage/Gerrit/Code review</>|Code review is an essential part of our contribution workflow. The principle is basic: any patch must be reviewed by others before being merged.

This means that your code will need reviewers. Check our 1>Gerrit/Code review/Getting reviews</>|advice for getting reviews.

Review before merge
It's important to us to have a review-before-merge workflow for MediaWiki core and also for any 1>Manual:Extensions</>|extension we deploy. We will also offer that option to any extension author who wants it for their 1>Manual:Extensions</>|extension. The one exception is 1>I18n</>|localisation and internationalisation commits, which will be able to be pushed without review.

Who can review? Gerrit project owners
After 1>#Create a Wikimedia Developer account</>|creating a Developer account, anyone can comment on commits and express criticism and approvals. Anyone can give a nonbinding "+1" to any commit. However, for any given repository ("Gerrit project"), only a small group of people will have the ability to approve code within Gerrit and merge it into the repository. This superapproval is a "<tvar|1>+2</>" even though that's a misleading name, because two +1 approvals DO NOT add up to a +2. These people are "1>Gerrit/Privilege policy</>|Gerrit project owners".

How to comment on, review, and merge code in Gerrit




Anyone can comment on code in Gerrit.

Viewing and commenting on code

 * Make sure that you have a developer account.
 * Log in to Gerrit. If you know the changeset you want to look at (URL will look like https://gerrit.wikimedia.org/r/#/c/23939/ ), go to that. Otherwise, use the search box. You can search by author ("Owner"), Gerrit project, branch, changesets you've starred, etc. The Gerrit search documentation covers all of the different search operators you can use.
 * The changeset has a few fields, links and buttons:
 * Assignee. An optional field to make a single person responsible for handling reviewing the changeset. This should only be set if the assignee has agreed.
 * Reviewers. 'jenkins-bot' is the autoreviewer that auto-verifies anything that passes the Jenkins tests. It will report a red or green mark depending on whether the build passes.
 * The "Add reviewer" button under Reviewers: in the upper left corner manually request review from someone. It'll show up in their Gerrit dashboard.
 * Under Files, Expand All opens the diff for each file below. You can double-click on a line and then press the C key to comment on that line, then click "Save" to save the draft comment. Then, at the top of the page click the "Reply" button to publish your comment.
 * Reply adds your comments to a changeset, including an overall comment and/or inline comments you added (see above).
 * If, upon code review, you approve, use "Code-Review: +1" under "Reply"; otherwise, use "Code-Review: -1" to disapprove. These numbers are nonbinding, won't cause merges or rejections, and have no formal effect on the code review.
 * Abandon (you'll see this if you wrote this diff). This action removes the diff from the list to review, but leaves it in Gerrit for archival purposes.
 * The "Only Comments" switch allows to hide reviews by non-human bots. See https://phabricator.wikimedia.org/T48148#6294913 for an example.

Comparing patch sets
Every time you amend your commit and submit it for review, a new patch set is created. You can compare the different patch sets like this:


 * Under Files, select either Expand All or choose a specific file listed to open that file.
 * On the left side under Patch Set, Base is preselected. On the right of the screen under Patch Set, the latest patch set is preselected. Adjust the selected patch sets to your needs.

Formally reviewing and merging or rejecting code
If you are one of the 1>Special:MyLanguage/Gerrit/Privilege policy</>|Gerrit project owners, you'll also see:


 * Abandon button


 * under Reply, additional Code-Review options to +2 (approve) or -2 (veto) a diff, and a Post button (publish your comment and merge diff into the branch, in 1 step)


 * Submit button (merge -- only useful if you or someone else has already given a +2 approval to the diff, but not merged it)

And once you've merged something into the example Gerrit project you'll see it in <tvar|1>https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/extensions/examples/</>. If you merged a commit that references a task in Phabricator and that commit is supposed to fix that task completely, please go to that task and change its status to "Resolved" (via the Add Action… 🡒 Change Status dropdown). Also reference the merge ID if gerritbot has not already posted it in that task.

Troubleshooting
For problems and how to solve them, see 1>Gerrit/Troubleshooting</>.