Roadmap

Background: In recent years, Wikimedia Foundation's engineering planning has primarily taken place in a combination of internal goals documents and public project-level documentation. The purpose of this page is to establish a practice of sharing holistic engineering goals, initially primarily with a short term horizon, as a public document with open participation.

See also:
 * Product Whitepaper for Wikimedia Foundation product priority justifications; Strategic Plan for long-term WMF goals, some of which are engineering goals
 * Roadmap/Archive for an earlier effort to c

See also: reate a roadmap more focused on point releases of the MediaWiki software
 * Product Whitepaper for Wikimedia Foundation product priority justifications; Strategic Plan for long-term WMF  goals, some of which are engineering goals
 * Roadmap/Archive for an earlier effort to create a roadmap more focused on point releases of the MediaWiki software
 * Software deployments schedule
 * Software deployments schedule

Previous months:
 * /2011/September
 * /2011/October
 * /2011/November
 * /2011/December
 * /2012/January

Item syntax: Examples:
 * Action item
 * [Needs consensus] Deploy unicorns [Brion/Tim]
 * Deploy unicorns [Brion/Tim] [DONE]

Platform / Dev-Ops

 * MediaWiki 1.19/Roadmap
 * Finish code review
 * Cut 1.19 release branch


 * Git conversion
 * Final conversion on core
 * Final conversion on extensions
 * Finish up specific Git management scripts
 * Deployment scripts
 * CI tests get run when a developer submits a change (or maybe when the change is approved -- this is TBD)
 * Jenkins (Testswarm/PHPUnit tests) on git branches
 * documentation tasks
 * some basic pointers for learning about git
 * document the overall dev process (this is in people's heads right now but not on any wiki page)
 * document how, from a technical perspective, git, Gerrit and Jenkins work together
 * document how to use the tools (git-review, Gerrit, Jenkins)
 * labsconsole has some stuff in this direction but not enough


 * Log collection (udp2log) improvement [Tim]
 * Deployment to locke in January


 * Swift
 * 100% deployment for thumbnails [Aaron/Ben/Mark B]
 * BEFORE 1.19 deployment.
 * Thumbnail response to end-users will work by hitting squids, falling back to swift, falling back to ms5, falling back to image scalers.
 * Thumbnail purging will work as it does now except swift will be purged via a MediaWiki hook.


 * Wikipedia operations history+architecture document [Guillaume]
 * New server error page (currently "Wikimedia Foundation error") [Guillaume]


 * 1.19 deploy (from SVN)
 * Postmortem 1.19 after the 1.19 deployment [RobLa]
 * SVN import, post-release/deployment make read-only switch


 * Begin developing framework for integration testing [Antoine, Chris McMahon]
 * possibly Selenium


 * Search: possible contractor to do search upgrade (diederik's lucene person)


 * Volunteer coordination and outreach
 * Consolidate and integrate the content from the training materials [Sumana, Guillaume] [in progress]

Analytics

 * Mobile Page Views: refactor Nimish's code, incorporate fixes causing discrepancy between Nimish and Erik's code
 * Report card prototype: first release

Features

 * NPP/Article Creation
 * Article Creation Interstitial: deploy first release
 * New Page Triage: Develope initial workflow and designs
 * AFT
 * Decide on "winner": Preliminary discussion with community [1/20]
 * Design and development of first version of Feedback Page, using data from test versions of Feedback Form [Delayed to 1/31]
 * Moodbar/FeedBack Dashboard
 * Feature Evaluation [Dario]
 * Concurrency notification: [1/31]
 * RL2/Gadgets improvements deployed with MW 1.19 (dependent on Rel 1.19 schedule)
 * [in progress; to be deployed with some time after Rel 1.19]
 * Enable chunked uploading support in Upload Wizard
 * TMH deployment (after Rel 1.19 is released)
 * Personal Image Filter development presumed to begin, may be done via vendor development. Support third party block lists instead of categories?
 * I18n
 * Work on universal language selection UI will start in Feb 2012
 * Additional translate extension improvements [2/2012]
 * Visual Editor
 * Editable Surface feature additions ongoing
 * First iteration of minimal round trip functionality [2/2012]
 * Content Editable feature parity with ES feature set [2/2012]
 * IME functionality development and integration [2/2012]

Mobile
(heavy traveling for mobile team)


 * Full screen search to production [holding]
 * Product plan (UI, use cases) for Mobile Uploads: Initial workflow
 * Product plan (UI, use cases) for Mobile Nav: Enumerate use cases, develop first pass of navigational constructs
 * Login, User pref, etc (features TBD)
 * UI mockups for full screen search
 * UI mockups for opt in beta
 * Wikipedia Android V1.1
 * Wikipedia Mobile iOS (PhoneGap) release V3.1/1.1 [Yuvi & Brion]
 * De-Wikimedify Mobile frontend [Arthur]

Operations

 * Squid deployment @ Eqiad
 * Target at least 50% of non-EU traffic
 * EQIAD datacenter new row of racks [ordered, in progress]
 * External storage recompression [Ben/Tim]
 * Thumbnail server replacement - Back-end (ms5) [Ben]
 * http://wikitech.wikimedia.org/view/Swift/Deploy_Plan_-_Thumbnails
 * db refresh (s1 to s7)[Asher]
 * ESAM router replacement (from Foundary to Juniper)
 * /home move to NetApp [Mark] [in progress]
 * Deploy Labs Gluster File storage cluster [Ryan/Sara]
 * Test effectiveness of Flash Drive [Asher]
 * Labs features rollout
 * Build out LVS in Labs [Ryan/Mark]
 * Create squid instance in Labs [Ryan/Sara]
 * Add resilience to Lab Controller service by building redundant Controller services in EQIAD which includes DNS, LDAP, MySQL [Sara]

Platform

 * Interwiki transclusion [Sam(, Roan?)]
 * Swift originals work
 * Prepare IPv6 support for IPv6 day (June 6th) [Aaron,Mark?]
 * rc_ip schema change to be lumped into 1.19 schema changes
 * DB sharding for Disk-backed object cache
 * Git conversion
 * First release from git mainline development branch


 * Superprotection feature (notes to be copied to wiki somewhere by RobLa or Tim) [Sam?]


 * Inline scripting

Mobile / Offline

 * Photo Upload
 * Nav Menu
 * AFT
 * Android/iOS V2.0

Features

 * Continued work on NPP: first deployment of revised workflow for page triage
 * Potential deployment of AFT to broader list of articles on enwp

Features

 * Visual Editor: Small scale production/default deployment of visual editor

May 2012

 * General engineering process checkin (Berlin?)
 * Config backend [Chad]
 * Evaluate WikiFactory from Wikia

Mobile / Offline

 * First MobileFrontend feature related to mobile uploads (e.g. media upload beta).

Platform

 * Prepare IPv6 support for IPv6 day (June 6th)

Mobile / Offline

 * USSD gateway rollout
 * SMS gateway rollout
 * Varnish as default cache for Mobile
 * New article creation
 * Watchlists
 * Diffs
 * Search improvements
 * Kiwix on Android
 * Partner integration (various)
 * Lazy loading articles
 * reduce bandwidth requirements for some users
 * WikipediaZero

Features

 * Affiliation tools for WikiProjects [build on GlobalProfile]
 * Re-energize LiquidThreads (rename it?!) (may need refactoring for notification streams)
 * Photo/media moderation tools; additional patrolling and moderation tooling
 * Help features
 * Mentoring features
 * Other real-time features, chat
 * Dependent on MediaWiki 1.20 deployment date, ResourceLoader 2 -- mostly the Gadgets-extension work which is (as of Feb 2012) in a branch.
 * Gadgets 2.0?

Platform / Dev-Ops

 * Extension management -- depends on config mgmt revamp

Continuous Responsibilities

 * Code review
 * RT review / ops tasks
 * Community extension review and deployment
 * Bug triages and general bug fixes
 * New extension deployment (Review queue)
 * Labs maintenance
 * Test infrastructure maintenance

Parking lot and todos

 * Details of git migration (extension mgmt, permissions, code review tool, Gerrit-Jenkins integration, etc.)
 * More work on product backlogs for features and mobile
 * Ops section
 * Fundraising flesh-out
 * cf Wikimedia Platform Engineering and merge as appropriate
 * Namespace hacks for development of simple language wikipedias in languages other than English without server, database, or major wiki installation provisioning
 * Most popular related articles


 * Database-backed session handling
 * HipHop deployment (deferred because Facebook has a different shiny new thing)
 * Extension:Configure (merge with config management?)
 * Unicode normalization considerations
 * Schema handling improvements (Abstracted database schema description, schema updaters to make the multiple schema variants for MySQL 4.0 and 5/UTF-8 more maintainable)
 * Parallelizable, restartable dump runner (notes; Clean up the currently fragile externaldump process, make our internal backups more reliable
 * OAI cleanup (Clean up OAI exporter and importer, add time-delay features
 * audit users of OAIPMH and check how search indexing uses it
 * Deletion queue system (notes; Human-helpful process improvements
 * Integrated heuristic checks, improved patrolling (human-helpful process improvements)
 * On-wiki namespace manager (Special:Namespaces) (original wikidata branch specs and see notes)
 * Wikidata (WMDE)
 * BlameMaps (WMDE)
 * graphical UI on top of improved backend for configuration management
 * Various HTTPS support fixes