Wikimedia Engineering/Report/2014/July

''Note: We're also providing a shorter and translatable version of this report.

Engineering metrics in July:
 * 164 unique committers contributed patchsets of code to MediaWiki.
 * The total number of unresolved commits went from around 1575 to about 1642.
 * About 31 shell requests were processed.

Upcoming events
There are many opportunities for you to get involved and contribute to MediaWiki and technical activities to improve Wikimedia sites, both for coders and contributors with other talents.

For a more complete and up-to-date list, check out the Project:Calendar.

Work with us
Are you looking to work for Wikimedia? We have a lot of hiring coming up, and we really love talking to active community members about these roles.

*

Announcements

 * Arthur Richards is now Team Practices Manager (announcement).
 * Kristen Lans joined the Team Practices Group as Scrum Master (announcement).
 * Joel Sahleen joined the Language Engineering team as Software Engineer (announcement).

Technical Operations
Dallas data center
 * Throughout July, the cabling work of all racked servers and other equipment has nearly completed. We're still awaiting the installation of the first connectivity to the rest of our US network in early August before we can begin installation of servers and services.

San Francisco data center
 * Due to a necessary upgrade to power & cooling infrastructure in our San Francisco data center (which we call ulsfo), our racks have been migrated to a new floor within the same building on the 9th of July. The move completed in a very smooth fashion without user impact, and the site was brought back online serving all user traffic again in less than 24 hours.

PFS enabled
 * Through the help of volunteer work and research, our staff enabled Perfect Forward Secrecy on our SSL infrastructure, significantly increasing the security of encrypted user traffic.

Labs metrics in July:
 * Number of projects: 173
 * Number of instances: 464
 * Amount of RAM in use (in MBs): 1,933,824
 * Amount of allocated storage (in GBs): 20,925
 * Number of virtual CPUs in use: 949
 * Number of users: 3,500

 Wikimedia Labs
 * We've made several minor updates to Wikitech: Added OAuth support; fixed a few user interface issues; purged the obsolete 'local-*' terminology for service groups.


 * OPW Intern Dinu Sandaru has set forms for structured project documentation. This should will help match new volunteers with existing projects, and will make communication with project administrators more straightforward.


 * Sean Pringle is in the process of updating the Tool Labs replica databases to MariaDB version 10.0. This may reduce replag, and should improve performance and reliability.


 * We're setting up new storage hardware for the project dumps. This will resolve our ongoing problems with full drives and out-of-date dumps.

Mobile
Wikipedia Zero (partnerships)


 * We served an estimated 68 million free page views in July through Wikipedia Zero. We continue to bring new partners into the program -- lots in the pipeline, though none launched in July. Adele Vrana met with prospective partners and local Wikimedians in Brazil. We published our operating principles to increase transparency.

Kiwix


The Kiwix project is funded and executed by Wikimedia CH.


 * We have pre-release binaries of the next 0.9 (final) release. Except for OSX everything seems to work file as far.
 * The support of RaspberryPi was finally merged to the kiwix-plug master branch, this offers new perspectives because the price to create a Kiwix-Plug has drop around USD 100.
 * We have started the engineering collaboration with the ebook reader manufacturer Bookeen (in the scope of Malebooks project) to be able propose an offline version of Wikipedia on e-ink devices.
 * We have participated to the Google serve day at Google Zurich, the goal was to meet Google engineers during one day and have them working on our open sources projects. The result were a dozen of bug fixes and feature implemented, mostly on Kiwix for Android, but also in Kiwix for desktop and Mediawiki.
 * 4 developers have had a one week hackathon in Lyon, France to develop an offline version of the Gutenberg library. We currently polish the code and plan a release soon, our partners and sponsors plan the first deployments in Africa during Autumn.
 * The last but not the least, a proof-of-concept of a Kiwix iOS app was done, so we might release a first app before the end of the year.

Wikidata
The Wikidata project is funded and executed by Wikimedia Deutschland.



Future

 * The engineering management team continues to update the Deployments page weekly, providing up-to-date information on the upcoming deployments to Wikimedia sites, as well as the annual goals, listing ongoing and future Wikimedia engineering efforts.