New Developers/Quarterly/2018-07

This is the fourth and final edition of the New Developers Quarterly, a report covering activities, metrics, surveys and lessons learned in the Onboarding New Developers program. This report covers April to July 2018.

Your questions and feedback are welcome on the talk page.

Timeline

edit

Newcomer-focused events, programs, and activities between April–June 2018:

edit

See also Technical Collaboration Metrics - Onboarding New Developers

Volunteers contributing patches for review

edit

167 volunteers contributed between April–June 2018. (Source; number of entries in "Submitters" table due to phab:T184741)

QoQ: +3.1%. YoY: +14.4%.

Data updated on 23 July 2018.

New volunteers attracted

edit

49 new volunteers contributed between April–June 2018. (Source)

QoQ: -9.3%. YoY: -25.8%.

Data updated on 23 July 2018.

New volunteers retained

edit

Percentage of volunteers active one year (±3months) after their first contribution, out of all new volunteers attracted one year ago. (Source: Calculation on data)

QoQ: -45.0%. YoY: 0.0%.

Data updated on 23 July 2018.

Quarterly data (April–June 2018)

edit

Review of changesets by new volunteers

edit

236 changesets were contributed by new volunteers. (Source: Calculation on data[1]. Changeset status data as of 23 July 2018.)

Projects with most new volunteers

edit

49 new volunteers contributed to XXX repositories. (Source: "Repos by New Authors")

Outreach events

edit
  • Wikimedia Hackathon 2017 (May 2017):
    • Attracted 37 new volunteers.
    • Retained 1 new developer who was active three quarters after the event (April–June 2018). (Source)
  • Wikimania Hackathon 2017 (August 2017):
    • Attracted 47 new volunteers.
    • Retained 2 new volunteers who were active two quarter after the event (April–June 2018). (Source)

Outreach programs

edit

New developers survey analysis

edit

Read through below for a quick summary:

We sent a survey to 48 new developers who submitted code for the first time between April–June 2018 with a goal to understand more clearly demographics and background, motivations, challenges and needs of our new developers.

Out of the 48 new developers to whom we reached out, 13 (27%) completed the survey.

Demographics and background information

edit
  • Respondents of the survey were from United States (3), India (2), Germany (2), Israel (2), China, Italy, Netherlands, Turkey
  • Almost near half (~46%) of the respondents said they belong to the working professional category
  • ~85% identified themselves as male, ~15% as female

Motivations

edit

Respondents indicated different venues through which they learned about Wikimedia and felt encouraged to contribute to the projects: use of a Wikimedia project at their workplace, Google Summer of Code, mailing list, etc. A few of them also mentioned that they are already part of the movement.

Challenges

edit

Challenges that new developers experience is as follows: learning the process to contribute and committing changes, testing the code especially in Wikisource projects, waiting for a review on code contributions, understanding Gerrit code review tool, poor documentation, and lack of response or help.

Experience contributing to Wikimedia

edit

~54.4% (n=5) respondents said they are likely to recommend Wikimedia for code contribution to friends and colleagues. ~64% (n=7) respondents said they are satisfied with their experience contributing to Wikimedia.

Suggestions for improvement

edit

Here are some suggestions made by new developers (responses below have been only slightly edited):

  • Provide a faster out-of-the-box dev environment. The Vagrant machine is very slow, and installing everything from scratch is too much time consuming.
  • There should be a way to forward reviewers attention to a specific code change.
  • Bring the code review process into Phabricator as well, instead of relying on a third party tool, Gerrit.
  • Have cloud instances where an individual can deploy their code; that way support a temporary, automated way to test commits with smaller changes quickly.
  • Help newcomers to participate effectively instead of making them feel unprofessional. Everyone needs some time to find your way around in a new system.

Former developers survey analysis

edit

We also sent a survey to 30 developers who were last active in July-September 2017 with a goal to understand more clearly what made them stop contributing.

Out of the 30 developers to whom we reached out, 1 (3.3%) completed the survey. Though from the low response rate, there isn't much to conclude, however one of the responses that we received from a developer is eye-opening:

"A bug is found and reported; a patch is submitted; nothing happens for a year and a half; the patch gets out of date, then gets updated and submitted by another programmer; many months later nothing has happened... You need to prioritize going through ALL the patches that have been submitted and either accept or reject them. Currently you're neglecting them, and that stinks. Maybe you should stop allowing any new bugs to be filed until you deal with the old ones."

Footnotes

edit
  1. Steps: After extracting the list of "New Authors", use that list to filter on authors on Gerrit and its "Status" section.