📖 Developer Satisfaction 2025 Report

🔁 Continuous Integration

tl;dr

↓ Queue time satisfaction – 45% respondents are satisfied with CI queue time, down from 50% in 2024 and 55% in 2023.
- Success cache – After this survey, Release Engineering experimented to lower queue time for CI.
Overall satisfaction – Similar to last year, 64% are satisfied with CI overall (i.e. with features aside from queue times).

# CI use in the past year

“In the past year, have you used Wikimedia’s continuous integration (CI)?”

Of the 127 who opted into answering questions about CI, the majority (69%) of respondents said they used Wikimedia's CI in the past year; 28% said they did not use it in the past year; and 2% were unsure.

top

# CI queue time satisfaction

“How satisfied are you with the Continuous Integration queue time (how long it takes to report test results in Gerrit)?”
last year

Of the 87 survey takers who indicated that they did use Wikimedia's CI in the past year and responded,

Less than half (45%) said they were satisfied with CI queue time
20% said they were neither satisfied nor dissatisfied
33% said they were dissatisfied
2% were unsure

top

# CI overall satisfaction

“How satisfied are you overall with continuous integration?”
last year

Of the survey takers who indicated that they did use Wikimedia's CI in the past year,

a majority (63%) said they were satisfied with CI overall
18% said they were neither satisfied nor dissatisfied
17% said they were dissatisfied
2% were unsure

top

# Feedback

“Please share any other feedback you may have about Wikimedia’s continuous integration”
last year

CI latency

7 out of 39 responses talked about challenges related to CI latency.

“speed, speed, speed. I review and coordinate the merge of several patches everyday and I waste so much time waiting on CI. [...]

Test interpretability

5 out of 39 responses talked about challenges related to test interpretability.

“I wish there was a quick way to jump to the part of why a CI failed, instead of having to find that part manually.”