Developer Satisfaction Survey/2023/Continuous integration

πŸ“–Β Developer Satisfaction 2023

The developer satisfaction survey is an annual survey of the Wikimedia developer community.

πŸ”Β Continuous integration edit

πŸ”— CI use in the past year

We asked survey takers, β€œIn the past year, have you used Wikimedia’s Continuous Integration?”

  • The majority (69%) of respondents said they used Wikimedia's CI in the past year.
  • 25% said they did not use it in the past year
  • 6% were unsure

πŸ”— CI queue time satisfaction

We asked survey takers, β€œHow satisfied are you with the Continuous Integration queue time (how long it takes to report test results in Gerrit)?”

Of the survey takers who indicated that they did use Wikimedia's CI in the past year,

  • The majority (55%) said they were satisfied with CI queue time
  • 14% said they were neither satisfied nor dissatisfied
  • 28% said they were dissatisfied
  • 3% were unsure

πŸ”— CI queue time effects

πŸ’¬ Shouldn't take 20 mins for the test pipeline to run.

We asked survey takers to describe how frequently Continuous Integration queue time effected their work in the past year.

Of the survey takers who indicated that they did use Wikimedia's CI in the past year,

  • 40% said their work was never or very infrequently affected by CI queue times
  • 32% said their work was occasionally affected
  • 22% said their work was somewhat or very frequently affected
  • 6 were unsure

πŸ”— Other CI features satisfaction

πŸ’¬ Hard to setup for every repo because not self-managed

We asked survey takers, β€œHow satisfied are you with all other features of Continuous Integration (aside from queue times)?”

Of the survey takers who indicated that they did use Wikimedia's CI in the past year,

  • The majority (57%) said they were satisfied with CI features aside from queue times
  • 14% said they were neither satisfied nor dissatisfied
  • 26% said they were dissatisfied
  • 3% were unsure