Jump to content

Developer Satisfaction Survey/2026/Shared test environments

From mediawiki.org

๐Ÿ“– Developer Satisfaction 2026 Report

๐Ÿงช Shared test environments

[edit]

tl;dr


# Beta satisfaction

โ€œIf you have used the Wikimedia beta cluster in the past year, how satisfied are you with the beta cluster?โ€
last year
  • 43% said they were satisfied
  • 36% said they were neither satisfied nor dissatisfied
  • 19% said they were dissatisfied
  • 2% said they were unsure

top


# Beta satisfaction (by role)

top


# Beta for auto vs manual testing

โ€œโ€‹โ€‹In the past year, have you used beta cluster for automated testing of code, content, or infrastructure changes?โ€
"โ€‹โ€‹In the past year, have you used beta cluster for manual testing of code, content, or infrastructure changes?"

Of the 44 who answered this question, 35 (80%) said they used beta cluster for manual testing of code, while 6 (14%) said they used beta cluster for automated testing of code.


top


# Patch Demo satisfaction

โ€If you have used Patch Demo in the past year, how satisfied are you with Patch Demo?โ€
last year
  • 86% said they were satisfied
  • 9% said they were neither satisfied nor dissatisfied
  • 5% said they were unsure
  • 0% said they were dissatisfied

top


# Patch Demo satisfaction (by role)


top


# Patch Demo potential feature ranking

โ€How would you rank the following potential new features of Patch Demo, in order of importance?โ€

We asked respondents to rank potential new Patch Demo features. The top ranked feature was the ability to edit LocalSettings.php, followed by the ability to create โ€œwikifarmsโ€ (i.e., create more than one wiki with shared authentication).


top


# Shared test environment satisfaction

โ€œHow satisfied are you with your ability to test your code in a shared environment (i.e., beta cluster, patchdemo) before merge?โ€
last year

The number of respondents saying they were dissatisfied dropped from 41% last year to 24% this year.

  • 57% said they were satisfied
  • 12% said they were neither satisfied nor dissatisfied
  • 24% said they were dissatisfied
  • 6% said they were unsure


top


# Feedback

โ€œPlease share any other feedback you may have about shared test environmentsโ€
last year

Ownership

21% of responses mention the topic of ownership in two different senses.

Folks are still worried about Beta's ownership:

Beta cluster: still owned only nominally, still broken from time to time unexpectedly, still makes me sad.

But they're happy to see Patch Demo's ownership:

I am very glad that Patch Demo has been getting WMF engineering time put behind it --- long may that continue!!

Please invest more in patch demo.