Core Platform Team/Initiative/REST JobExecutor/Initiative Vision

From mediawiki.org

< REST JobExecutor

Vision:
  • WMF JobQueue calls a REST endpoint for job execution
  • JobQueue and AppServer MW cluster setup is unified
Stakeholder(s):
  • PETeam
  • SRE
  • Language team
 Problem:
  • Currently there’s 4 ways of executing a job in MW, which is 3 too many
  • WMF jobqueue uses an RPC endpoint living in mw-config repo, it’s not covered by tests and is hard to maintain
  • Jobrunner and Appserver has different apache config which will be an obstacle to MW on k8s
 Solution:
  • Introduce a REST job execution endpoint (done)
  • Unify Jobrunner and Appserver apache config
  • Drop RPC endpoint from mw-config
 Aligned Goals:
  • Reduce tech debt
  • Make MW on k8s easier
Retrieved from "https://www.mediawiki.org/w/index.php?title=Core_Platform_Team/Initiative/REST_JobExecutor/Initiative_Vision&oldid=6294551"