Content Transform Team

From mediawiki.org

The Content Transform team is responsible for maintaining the wikitext parsing products and Maps, among other things.

Mission Statement[edit]

In short, the Content Transform Team deals with content formats and transformations between them.

A bit more specifically,

  • We (aim to) provide specifications and guidance for wiki content formats
  • We develop transformations between content formats
  • We build and maintain content rendering and content transformation infrastructure
  • We build tooling to verify content integrity and content migration

History[edit]

Prior to May 2015, the erstwhile mediawiki core team was responsible for the mediawiki core PHP parser and the Parsoid team was responsible for Parsoid. Since May 2015, the erstwhile Parsoid team was rebranded as the Parsing team and the core PHP parser and Parsoid were brought under the purview of the Parsing team - this coincided with Tim Starling joining the group. Kunal joined the team in April 2016. As of April 2017, Tim and Kunal are now part of the Mediawiki Platform team. In August of 2021, the Parsing team welcomed members of Maps and Product Infrastructure and became the Content Transform Team.

Team Norms[edit]

[pending]

Collaboration[edit]

Get involved[edit]

For updates and calls to action, please see and bookmark Parsing/Get involved. We will be using that space to push out community notifications around our work.

Engaging with the Content Transform Team[edit]

Anyone outside of the Wikimedia Foundation can get our attention by opening a ticket in Phabricator tagged with Content-Transform-Team.

Wikimedia Foundation personnel can find us on Slack at #content-transformers.

Code repositories that the Content Transform team is either directly responsible for or shares responsibility with other teams[edit]

  • Parsoid (both JS & PHP versions)
  • Node.js libraries that Parsoid depends on
    • domino HTML5 parser and DOM
    • prfun promises library
    • wikipeg PEG parser (previously a fork of pegjs)
  • MediaWiki-Parser
  • RemexHtml HTML5 parser
  • MediaWiki Extensions
    • ParsoidBatchAPI (this will be retired and undeployed from the Wikimedia cluster now that Parsoid/JS is going to be decomissioned)
    • Linter
    • ParserMigration (this is not currently deployed to the Wikimedia cluster)
  • QA tools
    • TestReduce
    • VisualDiff
    • UprightDiff
  • Maps stack and associated extensions
  • Content services that sit on top of Parsoid to serve mobile apps

See also[edit]