Roadmap

From MediaWiki.org
Jump to: navigation, search

Wikimedia Engineering

Team hubs:

Background: In recent years, Wikimedia Foundation's engineering planning has primarily taken place in a combination of internal goals documents and public project-level documentation. The purpose of this page is to establish a practice of sharing holistic engineering goals, initially primarily with a short term horizon, as a public document with open participation.

See also:

  • Product Whitepaper for Wikimedia Foundation product priority justifications; Strategic Plan for long-term WMF goals, some of which are engineering goals
  • Roadmap/Archive for an earlier effort to create a roadmap more focused on point releases of the MediaWiki software

Previous months:

Item syntax:

* '''[[Project name]]'''
** [Qualifier keyword] Action item [Owner(s)] [Completion keyword]

Examples:

  • New unicorn engagement
    • [Needs consensus] Deploy unicorns [Brion/Tim]
    • Deploy unicorns [Brion/Tim] [DONE]

Contents

[edit] May 2012

[edit] Tech Ops

  • db9/db10 upgrade (db for etherpad, RT, Bugzilla, ..)
    • Servers Bellin & Blondel are being setup for replication & eventual rollout later this month [PY - Blondel is done. Bellin has h/w issue]
  • upgrade & complete all EQIAD db slave replication [Asher/PY ][DONE]
  • Swift
  • Deploy servers for Analytics Cluster [DZ] [DONE]
  • ESAM router replacement (from Foundary to Juniper) [Mark/Leslie]
  • Prep infrastructure stack to be ipv6 ready
    • LVS
    • squid
    • dbschema [Asher] [DONE]
  • Fundraising infrastructure buildup@ EQIAD
    • own firewall
    • provision payment clusters
  • OS (Lucid)/Security patch train
    • Database servers [DONE]
    • ESAM caching center [DONE]
    • Squids (TPA/EQIAD)
    • Apache/Memcached (TPA/EQIAD)
    • Varnish (TPA/EQIAD)

---

  • Wikimedia Labs
    • New compute node for capacity [Ryan] [DONE]
    • Labs features rollout
      • Upgrade GlusterFS [DONE but did not solve performance problem]
      • Create squid instance in Labs [Ryan/Sara]
      • Add resilience to Lab Controller service by building redundant Controller services in EQIAD which includes DNS, LDAP, MySQL [Sara]

[edit] Features

[edit] Editing tools

  • Visual editor
    • Burn up for June release [DONE]
    • Backlog on Data Model/Linear Model [Roan] [DONE]
    • On-boarding James to PM project
    • Transaction Processor [Roan/Trevor] [IN PROCESS]
    • Document Synchronizer [Roan]
    • Finish contentEditable Linear Model integration [Trevor/Rob] (text nodes, serializer, etc.) [DONE]
    • HTMLConverter [Christian] [IN PROCESS]
    • UI: Node Trees [Trevor] [IN PROCESS]
    • Finish UI integration for contentEditable [Rob/Christian/Inez] (Surface Model, menu, etc.) [IN PROCESS]
    • UI: Toolbar [Rob] [IN PROCESS]
    • UI: Link inspector [Rob]
    • mediawiki: in-place editing integration [Rob]
    • [End of May] Sandbox deployment
  • Parsoid
    • Parsoid refactor [DONE]
    • Try to nail down as much of the bugs on the todo in order to get a testing model (template/parser function/table/attribute)[Gabriel] [IN PROCESS]
    • Get VE round-tripping info, source, tracking, RFDa (annotations) [Gabriel] [IN PROCESS]
    • Start Parsoid-VE integration

[edit] Participation and editor engagement

  • Article feedback
    • Deploy of multiple filters on English Wikipedia [DONE]
    • Deploy centralized feedback page (CTA5) [IN PROCESS]
    • Deploy Metrics Stage 4 [IN PROCESS]
    • Final feedback form [IN PROCESS]'
  • Article Creation Workflow
    • Template changes to draft flow [Early-Mid May]
    • Deployment of A/B to x% of new users to English Wikipedia [Late May/Early June]
  • New Pages Feed (fka Page Triage)
    • Prototype deployment on English Wikipedia (in parallel with Special:NewPages) [DONE]
      • Increase visibility of Special:NewPagesFeed (e.g., notice on Special:NewPages) [DONE]
      • Bug Fixes [Ongoing]
    • Work on NO_INDEX
    • Curation toolbar [IN PROCESS]
      • Continue design iterations [DONE] (tweaks expected)
      • Labs deployment [May 22 target]
  • Echo/Flow
    • Prototypes of Echo [IN PROGRESS]
    • Examine hooks into current MW infrastructure for notifications
    • Look into PHP default synchronous notifications
    • Finalize decision on LQT3
  • Misc EE
    • CR on AbuseFilter and Moodbar (Andrew) [IN PROCESS]

[edit] Multimedia tools

  • UploadWizard
    • Deploy copy metadata feature [DONE]
    • Review and deploy round of fixes and improvements
      • First round review [DONE]
      • First round deploy [pending]

[edit] Feature support

  • Fundraising
    • Get recurring GlobalCollect up [DONE]
    • Burn up chart for next round of Fundraising [DONE]
    • Git migration deployment [IN PROCESS]

[edit] MediaWiki infrastructure

  • ResourceLoader
    • Gadgets 2.0 deployed after MW 1.19 (dependent on REL1_19 schedule) [IN PROCESS]
    • [June/Hackathon] Set up a first working setup in WMF labs [Roan, Timo] [IN PROCESS]
  • FlaggedRevs/maintenance
    • Resource allocation to support bugs/features that come from enwiki [Matthias, Aaron, James] [DONE]

[edit] Mobile

[edit] Core

  • Mobile Navigation [Lindsey, Phil, Jon]
    • Initial Main Menu and Action bar prototype [DONE]
    • iOS/Android Mobile Web to complete prototype/beta [DONE]
    • Article Action bar 2nd steps [DONE]
    • Main Menu 2nd steps [DONE]
    • Wireframes for browser and iPhone app variations [DONE]
    • Sliding Article Action bar [DONE]
    • Language Selection [Lindsey, consultation with Pau]
      • Continue drafting long term language selection options
  • Mobile support in MediaWiki core [Arthur, Max, Patrick]
    • Continue work and bugfixes
  • Metrics [Phil, Andre]
    • Finalize Mobile Breakdown [DONE]
    • Publish county level mobile stats [IN PROGRESS]
    • Publish Wikipedia Zero stats [BLOCKED]
  • Mobile Content API

[edit] Mobile Web

  • Contact us [Jon, Arthur, Phil, Philippe]
    • Philippe and the community team assess beta from for feature completeness [DONE]
    • Prod Deployment (21 May, 2012) [DONE]
  • Bug fixes for new intermin nav [DONE]
  • Mobile default for sibling projects [Arthur, Patrick, Asher]
    • Assessment of what needs to be done [DONE]
    • Create reports for sibling mobile traffic [Phil] [DONE]
    • Build out migration calendar [DONE]
    • Code redirector changes [BLOCKED]
  • Improved Mobile Device Detection [Patrick, Diedrik, Tomasz]
    • Deploy JS test for Apache Device Map

[edit] Apps

  • Wiki Loves Monuments [Yuvi, Brion]
    • Basic prototype [DONE]
    • Re-do project page [DONE]
    • Decide on metrics
    • Finalize wireframes
    • Begin implementation [DONE]
  • Wikipedia App [Yuvi]
    • Release v1.2 completing decoupling the app from Mobile Frontend and making it fully API driven
      • beta1
        • iOS [DONE]
        • Android [DONE]
      • beta2
        • iOS [DONE]
        • Android [DONE]
      • Market (Beta) [DONE]
      • Market (Production)
        • iOS
        • Android
    • Begin work on v1.3 to test PhoneGap 1.6.1 [INPROGRES]

[edit] Alternate Access

  • SMS & USSD [Patrick]
    • Pilot test with Jabber [BLOCKED]
  • Wikipedia Zero [Patrick, Dan]
    • Continue partner testing
    • Telenor Launch (DigiMalaysia) [DONE]
  • J2ME App [Tomasz, Patrick, Kul]
    • Legal Review [IN PROGRESS]

[edit] Platform / Dev-Ops

[edit] MediaWiki Core

  • Lua scripting
    • Return value expansion [DONE]
    • Providing access to the frame object to Lua [DONE]
    • Test cases [ongoing]
    • Tutorial [ongoing]
    • Bugfixing and polish [ongoing]
  • MediaWiki 1.20/Roadmap
    • Bi-weekly deployment cycle continues
      • Complete 1.20wmf02 deployment [DONE]
      • Complete 1.20wmf03 deployment [ongoing]
  • Continuous integration
    • Complete beta labs so that it's suitable/trusted for testing (target completion in May) [Antoine, Chris] [ongoing]
    • Continue developing framework for integration testing [Antoine, Chris McMahon]
      • possibly Selenium - see Chris's mail to wikitech-l
    • TestSwarm reintegration with Jenkins [Antoine] (move to June?)
  • Git/Conversion [Chad/Antoine/Sumana]
    • Upgrading to Gerrit 2.3 + Gerrit bugfixing [done]
    • Moving more projects to Git [Chad - ongoing]
  • SwiftMedia
    • Begin deployment work on originals
    • Bugfixing and cleanup on thumbnails [ongoing]
    • Deploy concurrent file operations - rewrite of external CloudFiles library [Aaron]
  • OAuth
    • Continue specification work [Chris Steipp] [ongoing]
  • CentralAuth
    • Bugfixing [Chris Steipp] [ongoing]
  • Memcache client replacement [Tim Starling]
  • IPv6 support
    • Prepare for IPv6 Launch (June 6th) [Aaron, Mark, Chris Steipp]
    • rc_ip schema change [need to investigate if this is needed for June 6] [DONE]
    • other schema changes [DONE]
  • MathJax [Brion/TBD]
      • Site-wide enabling as opt-in preference [Brion/Aaron] [DONE]
      • Fix remaining major bugs [Brion]

[edit] Analytics

  • Report card
    • Automate deployment on labs
    • Pagebreaks when printing
    • Copy permalink per graph
    • Browse graphs
    • Added target for mobile site views

[edit] Engineering Community Team

  • Continuing incoming bug triage [MarkH]


[edit] QA

  • Improve beta labs so that it's suitable/trusted for testing (target completion in June) [Antoine, Chris]
  • Volunteer tester event (with Weekend Testing Americas) [Chris] [DONE] retrospective
  • Volunteer tester event with OpenHatch June 9.

[edit] Internationalization/Localization

- Implementation of iteration 1 of proposed design [i18n team + UI/UX (Pau, Arun)] [DONE] - Review session of ULS prototype on May 10 [i18n team + UI/UX (Pau, Arun)]; [DONE] - UX tests for first prototype [Pau, Siebrand (Dutch), Alolita (Hindi) [DONE] - Integration of feedback from UX tests [IN PROGRESS]

    • Translate extension enhancements

- TranslationNotifications [DONE] - TranslationMemory (TTMServer) improvements [Niklas] [IN PROGRESS]

    • Narayam updates

- Add more languages for onscreen keymaps [Santhosh, Amir] [ONGOING]

    • WebFonts updates

- Add fonts for more languages [Santhosh, Amir] [ONGOING]

    • Language impact assessment/metrics measurement [i18n team]; [IN PROGRESS]
    • i18n Bug Triage (Monthly) [i18n team] [DONE]
    • Office Hours: Scheduled for next week on #wikimedia-office on Wednesday May 23 [DONE]

[edit] Editor Engagement Experimentation (E3)

  • Experiment 1: Timestamp modifications: Requirements completed by product team. Development underway. [IN PROGRESS]
  • Metrics measurement: Dario Tarborelli is leading the discussion to identify analytics requirements for impact measurement for these experiments. The development team (Ori Livneh) is evaluating the clicktracking extension and enhancements that need to be made. [IN PROGRESS]
  • Development team hiring: [IN PROGRESS]

See job listings for the following positions:

(http://hire.jobvite.com/Jobvite/Job.aspx?j=oi7iWfwn&c=qSa9VfwQ)

[edit] June 2012

[edit] Features

[edit] Editing tools

[edit] Participation and editor engagement


  • Echo/Flow
    • [June] Build PHP default synch notifications
    • [June] Look into queue based infrastructure extension
    • [July] Start replacing current MW notifications with common notifications infrastructure


[edit] Multimedia tools

  • TimedMediaHandler
    • [June] Final code review of new changes and deployment onto Wikimedia Foundation sites
    • [June] Release


[edit] Feature support

  • Fundraising

[edit] Mobile

[edit] Core

[edit] Mobile Web

  • Deploy v1 Mobile nav

[edit] App

  • WLM App beta relase

[edit] Participation and editor engagement

  • Article feedback
    • Deploy streamlined version of Option 1 [June 4]
    • [June] Complete development of features for AFTv5
    • [June] Potential deployment of AFT to broader list of articles on enwp
    • [June] Refactoring of code
    • [July] Final features for enwp release: browser support, i18n, mobile …

[edit] Apps

[edit] Alternate Access

[edit] Platform

  • Prepare IPv6 support for IPv6 Launch (June 6th)
  • Revisit Gerrit, git-review, and other code review/workflow tools (3 months after the git switch) to see whether to switch to Phabricator or another code review tool
    • GitHub mirroring (one-way read-only mirror, no pull requests)
  • Replicated session handling [Tim Starling]

[edit] Engineering Community Team

    • blog maintenance [Guillaume]
  • Preparation for Wikimania
    • Helping Wikimedia engineers prepare talks
    • Preparing for hackathon [Sumana, contractors]
  • Assessing/moving wikitech.wikimedia.org content [Guillaume leading]
  • Bug wrangling [Bug wrangler]

[edit] QA

...

[edit] Analytics

  • May
    • Release 0.95 Reportcard (mid-May)
    • First of 4 analytics machines will come operational
    • Configuration / installation of Hadoop-based and Cassandra based Analytics stack
    • Write documentation analytics cluster setup
    • Start of comparing Analytics stacks
    • Deployment Wikipedia Zero filters [May 9]
    • Sanitizing webstatscollector / udp-filters
    • Integration new mobile stats in stats.wikimedia.org
  • June
    • Release 1.0 Reportcard: targeting June Metrics Meeting [June 7]
    • Continuation of comparing Analytics stacks
    • Additional 6 machines become operational
    • Expect delivery of additional hardware
    • Reportcard 1.1 release (Metrics Meeting July)

[edit] Tech Ops

  • Swift
    • Swift replicas @ EQIAD
  • Rebuild Search Cluster@Tampa
  • Fundraising infrastructure buildup@ EQIAD
    • deploy payment clusters
    • deploy applications
  • Deploy Memcached @TAMPA [Mark/Asher]

[edit] July 2012 and later, or unscheduled

[edit] Mobile / Offline

  • Mobile Article Feedback feature definition [Phil]
  • Minor Editing [Phil]
  • Offline saving [Phil]

[edit] Features

  • Affiliation tools for WikiProjects [build on GlobalProfile]
  • Re-energize LiquidThreads (rename it?!) (may need refactoring for notification streams)
  • Photo/media moderation tools; additional patrolling and moderation tooling
  • Help features
  • Mentoring features
  • Other real-time features, chat
  • Dependent on MediaWiki 1.20 deployment date, ResourceLoader 2 -- mostly the Gadgets-extension work which is (as of Feb 2012) in a branch.
    • Gadgets 2.0?

[edit] Platform / Dev-Ops

  • Configuration management overhaul [Chad]
    • Evaluate WikiFactory from Wikia
  • Extension management -- depends on config mgmt revamp

[edit] Continuous Responsibilities

  • Code review
  • RT review / ops tasks
  • Community extension review and deployment
  • Bug triages and general bug fixes
  • New extension deployment (Review queue)
  • Labs maintenance
  • Test infrastructure maintenance

[edit] Parking lot and todos

Personal tools
Namespaces

Variants
Actions
Navigation
Support
Download
Development
Communication
Print/export
Toolbox