Growth/Growth team updates/2023

Growth team updates: 2024, 2023, 2022, 2021, 2020, 2019, 2018.




Update 2023-12-15: Flow talk page beta feature removal & Community Configuration designs

edit
  • StructuredDiscussions (Flow) deprecation
    • Starting on December 19th, we will remove the beta option that allows editors to enable Flow on their user talk page (T248309). This work is being completed because we will need to either make updates to Flow or move users away from using Flow in order to meet IP Masking requirements (T342831). The Growth team wants to limit engineering investment in Flow because long term, we plan to move away from long-term support of Flow (T332022).
  • Community Configuration 2.0
    • The Growth team’s UX designer is exploring some further refinements to the Community Configuration designs. We are exploring designs for how Community Configuration will scale by designing a landing page that lists all features and extensions that are configurable (T350201). We are designing an improvement to saving a configuration change so that admins are reminded to add an edit summary if they leave the edit summary field blank (T352924).  
    • Engineering work on Community Configuration is reduced as engineers focus on the work needed to support dynamic defaults for user properties (T321527). Although this work was not part of our annual roadmap, it's a high priority because if it is ignored indefinitely it may result in database malfunctioning in the wikis with the most registered users.
  • Bug fixes
    • We fixed an issue with the section-level “add an image” task that was causing placeholder display issues for editors completing the task (T352208).  
    • We fixed an impact module graph display issue (T352349).
    • We fixed a production error with Special:EditGrowthConfig, and improved related tests (T351603).  

Update 2023-12-08: Donor Thank You Page & Flow deprecation

edit
  • Donor Thank You page
    • The English donor Thank You page now includes a “Try editing Wikipedia” call to action. This expands a Newcomer Experience Pilot Project that was previously released on several other wikis, but this is the first time testing it on English Wikipedia.
    • In the first week of the English banner campaign, this “Try editing Wikipedia” call to action on the donor Thank You page has resulted in:
      • 1,421 new account creations
      • 147 of these new accounts immediately went on to edit T352116
      • Looking across all edits from these new accounts, the revert rate is 7.1% out of <300 edits. The rate is lower on desktop (5.1% out of <150 edits) than on mobile web (8.9% out of <150 edits).
      • 61.5% out of <300 edits were Suggested Edits.
  • StructuredDiscussions (Flow) deprecation
    • We are removing the beta option that allows editors to enable Flow on their user talk page (T248309). This work is being completed because we will need to either make updates to Flow or move users away from using Flow in order to meet IP Masking requirements (T342831). The Growth team wants to limit engineering investment in Flow because long term, we hope to move away from long-term support of Flow: T332022: [Epic] Undeploying StructuredDiscussions (Flow).
  • User Properties table bloat
    • Growth engineers are tackling a task to support dynamic defaults for user properties (T321527). Although this work was not part of our annual roadmap, it's a high priority because if it is ignored indefinitely it may result in database malfunctioning in the wikis with the most registered users.
  • New Editor User Research
    • We have temporarily enabled a checkbox on the Welcome Survey allowing new account holders to consent to being contacted for design research (T351266). This opt-in checkbox is only visible on English, Spanish, and Arabic Wikipedias for a period of 5 days.  This work will help facilitate two research projects:
edit
  • Community Configuration 2.0
    • We are exploring designs for how we should present all available Community Configuration options (T350201). Our current designs focus on the existing Growth configuration options, but we need to ensure we focus on a more scalable design as more features utilize Community Configuration.  
    • Based on feedback from the MediaWiki Platform team, we updated the CommunityConfiguration Proof of Concept extension so that it does not require extension.json schema changes (T351227).  
    • This sprint, software engineers are working on:
      • Investigating form generation options for community configuration (T332849)
      • Writing specifications for the configuration form (T342752)
      • Create a list of configuration option needs for Community configuration 2.0 (T351545)  
  • Positive Reinforcement
    • We’ve made some improvements to how Impact Module queries are handled (T351898). Unfortunately this work created an Impact Module bug that wasn’t caught prior to release (T352349).  We will have a fix released ASAP, and also plan to improve test coverage to ensure this doesn’t happen again (T352031).

Update 2023-11-17: Community Configuration progress, IP masking update, & Mentorship script confusion

edit
  • Community Configuration 2.0
  • IP Editing: Privacy Enhancement and Abuse Mitigation
    • We have completed several tasks necessary to accommodate IP Masking, including support for Recent Changes (T343322) and expiration of temporary accounts (T344695).
  • Positive Reinforcement
  • Mentorship
    • Starting a script to clean up Mentorship resulted in community confusion (T330071). The script was meant to ensure all mentees were assigned to an active Mentor, however the fact that the script provided Mentors for blocked users created some confusion, along with the the way the script logged the changes.  We will postpone resuming the script until we can work on several improvements:
      • Remove blocked users from Mentorship (T351234).
      • Update the copy (T351241).
      • Generate only one log entry when a mentor is removed from the list (T345016).
      • Merge claimmentee and setmentor filters in GrowthExperiments log (T349434).
  • Add a Link
    • We are preparing the backend to release “add a link” to 35 more Wikipedias (T308142 & T308143). This Structured task will be released soon at the following Wikipedias:
      • Samoan Wikipedia - sm
      • Somali Wikipedia - so
      • Albanian Wikipedia - sq
      • Serbian Wikipedia - sr
      • Sranan Tongo Wikipedia - srn
      • Swati Wikipedia - ss
      • Southern Sotho Wikipedia - st
      • Saterland Frisian Wikipedia - stq
      • Sundanese Wikipedia - su
      • Silesian Wikipedia - szl
      • Tamil Wikipedia - ta
      • Tulu Wikipedia - tcy
      • Telugu Wikipedia - te
      • Tetum Wikipedia - tet
      • Tajik Wikipedia - tg
      • Thai Wikipedia - th
      • Turkmen Wikipedia - tk
      • Tagalog Wikipedia - tl
      • Tswana Wikipedia - tn
      • Tongan Wikipedia - to
      • Tok Pisin Wikipedia - tpi
      • Turkish Wikipedia - tr
      • Tsonga Wikipedia - ts
      • Tatar Wikipedia - tt
      • Twi Wikipedia - tw
      • Tahitian Wikipedia - ty
      • Tuvinian Wikipedia - tyv
      • Udmurt Wikipedia - udm
      • Uyghur Wikipedia - ug
      • Uzbek Wikipedia - uz
      • Venda Wikipedia - ve
      • Venetian Wikipedia - vec
      • Veps Wikipedia - vep
      • West Flemish Wikipedia - vls
      • Volapük Wikipedia - vo

Update 2023-11-03: New Impact Module released to all Wikipedias! 🎉

edit
  • Positive Reinforcement
    • New Impact Module
      • The Growth team has deployed the new Impact module to all Wikipedias! New editors now have access to engaging graphs and metrics showcasing their wiki impact from their personal Homepage. More experienced editors can always enable the Homepage and other Growth features by enabling “Newcomer editor features” in Preferences.
      • The A/B testing of the new Impact module on Growth pilot wikis revealed that while it may not singlehandedly impact new editor retention, it does contribute to significant new editor productivity gains when paired with other Positive Reinforcement features (experiment results).
    • Leveling Up
      • Based on experiment analysis we decided to complete several follow-up improvements. Once complete improvements to the “Try suggested edits” dialog (T348205) we will scale the A/B test to more wikis (T348085).
    • Personalized Praise
      • We are finishing experiment analysis: T341387. If there are any concerning findings, we will want to resolve those, or consider further improvements. Then we will scale Personalized Praise features all Wikipedias (T350291).
  • Mentorship

Update 2023-10-27: Impact Module release & Leveling up experiment results

edit
  •  
    Impact module update
    Positive Reinforcement
    • Impact Module: After resolving a few tasks that blocked scaling (T344428 & T344143), we are ready to release the new Impact Module to all Wikipedias on November 1st (T336203).  This new Impact module includes the same article view count data as previously, but now with more data visualizations and metrics to provide some automated “positive feedback” to new editors. This work was completed in tandem with the Personalized praise features that encourage Mentors to provide new editors with encouragement and positive reinforcement. The Leveling Up and Personalized praise features will be scaled to more Wikipedias soon!
    • Leveling Up: We have published Leveling up Experiment results. The Leveling Up experiment included two notifications and two post-edit dialogs that were triggered by specific user behaviors. In general, we see healthy engagement with these features, and some positive results, notably:
      • The "Get started" notification leads to a significant increase in newcomer activity in the week following the notifications being sent. Newcomers are more likely to return and make an edit, which also increases the average number of edits made during that week.
      • The "Keep going" notification, we again find a significant increase in newcomer activity in the week following notifications being sent for those who registered on the desktop platform. For users who registered on mobile web, we find that it does not increase their probability of returning to edit but does increase the average number of edits made.
      • The "Try new task" dialogue, which is shown to users who complete five suggested edits of a given task type, leads to a high click-through rate (81.9%) and a reasonably high rate of completed edits. Our analysis of subsequent edits shows that 33.3% of desktop users and 20.0% of mobile web users go through and complete a suggested edit of the new task type. Read further details in the Leveling up experiment results report.
  •  
    Morten Warncke-Wang presenting at CSCW
    Newcomer homepage
  • Community Configuration 2.0
    • This week we’ve kicked off a legal and security review for the Community Configuration 2.0 project, and asked for community feedback from technical stakeholders by posting this Wikitech-l message.

Update 2023-10-20: Community Configuration planning & Positive Reinforcement improvements

edit

Update 2023-10-13: scaling Growth features & Community Configuration progress

edit

Update 2023-10-06: “Add a link” scaling & “Add an image” documentation

edit
  • Add a link
    • On Wednesday, Oct 11, 2023, the “add a link” task will be released to another set of wikis (T308139). The following Wikipedias will receive the task:
      • Swahili Wikipedia (sw)
      • Walloon Wikipedia (wa)
      • Waray Wikipedia (war)
      • Wolof Wikipedia (wo)
      • Kalmyk Wikipedia (xal)
      • Xhosa Wikipedia (xh)
      • Mingrelian Wikipedia (xmf)
      • Yiddish Wikipedia (yi)
      • Yoruba Wikipedia (yo)
      • Zhuang Wikipedia (za)
      • Zeelandic Wikipedia (zea)
      • Min Nan Wikipedia (zh-min-nan)
      • Zulu Wikipedia (zu)
    • Newly created accounts and accounts with Newcomer editor features enabed in their preferences will receive access to the task. This task has been shown to increase the probability that a newly created account will try editing for the first time, and also helps with newcomer retention (Add a link Experiment Analysis).
  • Add an image
  • Mentorship
    • We have increased the percentage of newcomers who receive mentorship to 50% at English Wikipedia T341399.
    • Community volunteer, User:Func86, has helped resolve a tricky Mentorship bug that made Pages transcluding Special:ManageMentors render in the default skin.  Thank you, Func86!  

Update 2023-09-29: Community Configuration progress & "Add a link" scaling

edit
  • Community configuration 2.0
    • All known high-level engineering tasks are documented under Community Configuration 2.0 Epic.
    • The Growth team reviewed the Editing team’s Edit Check configuration code. The current Edit Check approach should be compatible with Community configuration 2.0. (T330112).
    • We are working to prepare proof of concept code for the Community Configuration schema provider. The initial code shows how validation would work, but it doesn't include the actual validation logic (T342575 & T332847).
    • Initial design prototypes are drafted for two different design styles that we will soon demo to interested admins, stewards, and experienced editors (T346109). Please let us know if you want to provide feedback on designs!
  • Add a link
    • We are preparing the “add a link” task for another set of wikis (T308139).
  • Up Next:
    • IP Masking: The Growth team plans to initiate a community consultation with the goal of migrating communities from Flow to DiscussionTools. This move aims to minimize the necessity for additional engineering work to make Flow compatible with IP Masking(T346108).

Update 2023-09-22: IP Masking updates & Mentorship improvements

edit
  • IP Masking
    • The Growth team is updating Recent Changes to be compatible with IP Masking (T343322). Once Temporary accounts are available on a wiki, patrollers will be able to filter Recent Changes or their Watchlist to “Unregistered” users, which will include edits made by Temporary accounts.
    • We have completed the work needed to update Echo notifications to work with IP Masking, and documented the default notification preferences for temporary accounts (T333531).
    • We have also made sure the Mentorship features are compatible with IP Masking (T341390). Temporary accounts will not be assigned to Mentors or surfaced to Mentors as part of Growth's Positive Reinforcement features.
    • The Growth team still needs to evaluate instrumentation around IP Masking work (T341651), and start a community conversation around Flow (T346108), but most of the other currently defined IP Masking tasks that the Growth team is responsible for have been completed.  
  • Mentorship:
    • We released a minor improvement to make the edit summary more readable for MediaWiki:GrowthMentors.json (T322115).

Update 2023-09-15: IP Masking updates & Mentorship improvements

edit
  • IP Masking
    • The Growth team will start and initial community discussion (T346108) to gather feedback on:
      1. Community interest in moving from Flow to DiscussionTools.
      2. Community input on a limited version IP Masking support for Flow.
    • We gathered initial data about Flow usage to help guide the community consultation (T345484). Some initial insights:
      • French Wikipedia is by far the largest Flow user. It has twice as many Flow posts than Mediawiki.org (the second largest user). French Wikipedia combined with Mediawiki.org has more Flow edits than all of the other wikis together. Further data on Flow usage is available here.
      • In August 2023, on average:
    • We are finishing up the work needed to make the Thanks extension compatible with IP Masking (T345679).
  • Mentorship:
    • Next week we will release a minor improvement to make the edit summary readable for MediaWiki:GrowthMentors.json (T322115). Thank you, Iniquity, for always providing feedback on Growth team features!
  • Add an image
    • We have re-enabled the Article-level “Add an image” task (T345188). It was disabled after a failure in the image suggestions pipeline was discovered (T345141). We are adding better monitoring in an attempt to ensure this doesn’t happen again (T345204) and later this month we will set official Service-Level Agreements to ensure a certain level of uptime.

Update 2023-09-08: Section-level “add an image” analysis

edit
  • Add an image
    • We have completed initial analysis of the Section-Level Image suggestion task. The analysis showed that editors are completing the task successfully: the task completion rate for section-level image suggestions is high. The revert rate for the section-level task is higher than the article-level task, however we don't think this difference is cause for concern for two reasons. First, it might be harder to agree that an article is clearly improved by adding a section-level image compared to adding an article-level image. Secondly, articles suggested for section-level images already have a lead image, which might mean that they're also longer articles and have more contributors scrutinizing the edit.
    • Next week we plan to re-enabled the Article-level “Add an image” task (T345188). It was disabled after a failure in the image suggestions pipeline was discovered (T345141). We are adding better monitoring in an attempt to ensure this doesn’t happen again (T345204) and later this month we will set official Service-Level Agreements to ensure a certain level of uptime.
  • Positive reinforcement
    • We plan to scale the new Impact Module to all Wikipedias soon, but first we are investigating a bug with the job that refreshes the Impact Module data (T344428).
  • Add a link
edit
  • Add a link
  • Add an image
    • We disabled the “Add an image” task temporarily (T345188) because there was a failure in the image suggestions pipeline (T345141). This should be resolved soon, and the Growth team will enable the task on wikis where it was previously enabled.
  • IP Masking
    • The Growth team has completed most of the actionable IP Masking work that relates to Growth features.  There is more work to be done to update Flow (T342831), and Recent Changes filters (T343322), and Thanks (T327420#9132354), but some of this work is blocked until decisions about how to proceed are made.
  • Community configuration 2.0
    • As the Growth team wraps up IP Masking work, Community configuration will be our next focus.  We are in the planning phase of this project and we are collaborating with internal stakeholders to write up a technical approach to share with the community for feedback (T344144). 

Update 2023-08-24: Wikimania, Mentorship, and Newcomer Homepage publication

edit
  • Mentorship
    • The Growth team made an exploratory analysis of mentorship in English and Spanish Wikipedia in August 2023. We find that about 2.5% of newcomers ask their mentor a question, with variation in English Wikipedia between desktop and mobile web users. Those who ask their mentor a question tend to do so only once. If the mentor question is a newcomer's first edit, it tends to happen quickly after registration (i.e. within minutes), while for those who have made edits before it can happen later in their journey. We also examine mentorship's effect on key Growth metrics and find increases on activation, often driven by mentor questions, as well as other impacts.
  • Newcomer Homepage Publication
  • Add a link
  • IP Masking
    • The Growth team is continuing work on IP Masking. There are some further decisions and code changes needed in order to wrap up the Growth team side of this effort, but we will soon complete this work and shift our focus to the technical planning and efforts needed for the Community configuration 2.0 project.

Update 2023-08-11: Wikimania, Image API, & IP Masking work

edit

Update 2023-08-04: Donor "thank you page" experiment discussed with English Wikipedia

edit

Update 2023-07-28: Positive Reinforcement improvement & "Add a link" scaling to more Wikipedias

edit
  • Positive reinforcement
  • Add a link
    • Another round of Wikipedias will receive the "Add a link" structured task on August 1st (T308135 T308136 T308137):
      • Georgian Wikipedia, Kara-Kalpak Wikipedia, Kabyle Wikipedia, Kabardian Wikipedia, Kabiyè Wikipedia, Kikuyu Wikipedia, Kazakh Wikipedia, Khmer Wikipedia, Kannada Wikipedia, Kashmiri Wikipedia, Colognian Wikipedia, Kurdish Wikipedia, Cornish Wikipedia, Cornish Wikipedia.
    • Communities can configure how this feature works locally, and evaluate usage and reverts associated with the “add a link” task.
    • "Add a link" experiment analysis finds that this structured task leads to increases in newcomer participation, particularly by making constructive (non-reverted) article edits:
      • The probability that newcomers make their first article edit (+16.6% over baseline, +10.1% over the unstructured add links task)
      • The probability that they are retained as newcomers (+16.2% over baseline, +5.7% over the unstructured link task)
      • The number of edits they make during their first couple of weeks on the wiki (+18.7% over baseline, +13.5% over the unstructured link task)
  • IP Masking

Update 2023-07-21: IP Masking usability tests

edit

Update 2023-07-14: Mentorship increase at Enwiki, Suggested Edits improvement, & Community Configuration 2.0 planning

edit
  • Mentorship
    • English Wikipedia has so many new accounts created each day, that when we enabled Mentorship at English Wikipedia we needed to limit it to only 10% of new accounts created so that the new group of mentors didn’t get overwhelmed with newcomer questions.  With a recent drive to encourage more experienced editors to serve as mentors, we have recruited enough new mentors to rollout Mentorship to more newcomers (T323045). Now 25% of new accounts created at English Wikipedia are assigned a mentor (T341399).
    • A WMF data scientist will be looking at the impact of Mentorship on Spanish and English Wikipedia in the coming month (T341387).  
  • Suggested Edits
    • Suggested Edits, sometimes known as Newcomer tasks, are now receiving topic predictions via the new Language-Agnostic Topic Classification (sometimes referred to as “Outlinks”).  This update will allow newcomers to receive a greater diversity of task recommendations if they have topics selected in non-English Wikipedias. There will be about an estimated 60% increase in article coverage on non-English Wikipedias [1]. The change is gradual as incoming edits propagate the new topics, and the Research team will evaluate the impact in a few months (T328276).
  • Community Configuration 2.0
    • The Growth team designer is investigating design improvements (T334312) & conducting competitor analysis T338386.
    • We are starting to gather internal WMF team requirements and starting community discussions (T336608).

Update 2023-07-07: Mentorship updates & upcoming IP Masking project

edit
  • Mentorship
    • After a community discussion with English Wikipedia mentors, we will move forward with a plan to increase the number of new accounts that receive Mentorship (T341399).
    • A data scientist will investigate the impact of Mentorship on newcomer activation, retention, and productivity at Spanish and English Wikipedia (T341387).  
    • A Growth team member will lead a session at this year’s Wikimania: Mentoring new editors on Wikipedia. Workshop attendees will help brainstorm improvements to Growth’s mentorship features.  
  • IP Masking
    • The Growth team is shifting focus to work on a project that touches many different WMF teams: IP Editing: Privacy Enhancement and Abuse Mitigation. This project will ensure the IP addresses of unregistered editors on Wikimedia projects remain private from everyone except those who need access to fight spam, vandalism, harassment and disinformation. The Growth team will focus mainly on the logged out user to temporary account holder user experience, as well as ensuring that Growth owned extensions and features work as expected with this new temporary account type (T326877).

Update 2023-06-30: Feature improvements and Growth team changes

edit
  • Section-level “add an image” structured task
  • Positive reinforcement
    • We released a minor improvement for the Personalize praise feature T338525.  We will no longer suggest any newcomer accounts for praise if they have been blocked.
  • Growth team: engineering changes
    • In the upcoming fiscal year, our technical lead, Kosta Harlan, is shifting into a new role in which he will work more closely with the Trust & Safety team and the Anti-Harassment Tools team.
    • Next week, Martin Urbanec is joining the Growth team as a full time software engineer.  Martin has served as an Ambassador on the Growth team for many years, while also working as a part-time contractor primarily focused on software engineering work related to Mentorship and Community configuration. Martin is a Czech Wikipedia administrator, bureaucrat and checkuser, a Wikidata administrator, a board member of Wikimedia Czech Republic, and a Wikimedia Steward. We are thrilled to have Martin’s engineering expertise and general Wikimedia expertise on the Growth team full time!

Update 2023-06-23: New “add an image” task released to Growth Pilot wikis!

edit
  •  
    "Add an image" onboarding
    Section-level “add an image” structured task
    • The new section-level “add an image” structured task has been released to Growth pilot wikis (Arabic, Bengali, Czech, and Spanish)!
    • This task is meant to help increase the number of images used on Wikipedia articles while also providing new editors with a structured and attainable way to contribute. The API that supports this task was created as part of the Structured Data Across Wikipedia project.
    • Communities can customize how this feature works on their wiki by making updates to Special:EditGrowthConfig.
    • Communities can track the overall usage of the section-level “add an image” task in Growth’s Grafana dashboard. Task completion rates will be low initially as this is a task that users “level up” to as they are successful with other Suggested edits.
    • Communities and patrollers can also easily track this task by filtering Recent changes to the edit tag: #Suggested: add images to sections (eswiki example).  
  • Positive Reinforcement
    • The initial leading indicators for the Personalized praise project have been published. Although this is still a relatively small sample, results seem healthy and show that Mentors are indeed receiving notifications and clicking through to view their praise-worthy mentees. Based on this data and feedback from Mentors, the Growth team will pursue the following tasks to help improve this feature:
      • Add revert scorecard to Personalized praise module on Mentor dashboard (T337510)
      • Exclude blocked accounts from the Personalized praise suggestions (T338525)

Update 2023-06-16: Section-level “add an image” release & What Growth is working on next

edit

Update 2023-06-09 Newsletter, Annual planning, & Section-level “add an image” release date set

edit
  • Growth team Newsletter
  • Growth team Annual planning
    • The Growth team completed an initial community consultation about one of hypothesis we are considering as part of the Growth team Annual Plan: If we provide more guidance and guardrails in the article creation process, then patrollers will need to review fewer low-quality articles. You can read a summary of the main points made by community members here.  If you have feedback that isn’t represented, please share your feedback here.
    • We will start a more targeted community consultation about our Community configuration hypothesis soon. This hypothesis relates to moving the Community configuration feature from the GrowthExperiments extension to MediaWiki core: If editors with extended rights can transparently and easily configure important on-wiki functionality for all users, communities will have control over how features function on their wikis, and WMF teams will be able to ship new functionality quickly.
  • Section-level “add an image” structured task
    • The new section-level “add an image” structured task is now available by default on beta wikis in English, Arabic, Bengali, Czech, and Spanish. We are in the final phase of testing and fixing minor issues before release; in the last week Growth team engineers merged 44 patches! We are currently on track for a June 20th release date to Growth pilot wikis. This feature will be Community configurable via Special:EditGrowthConfig.

Update 2023-06-02: Scaling the Impact module & beta testing the Section-level "add an image" structured task

edit
  • Positive reinforcement
    • The Growth team scaled the first part of the Positive reinforcement project, the new Impact module, to 10 more wikis on Wednesday, May 31, 2023 (T336203). Feedback from newcomers and experienced users regarding the new impact module has been positive. We have also gathered initial impact module experiment data from an A/B test on the Growth pilot wikis, and we want to gather further experiment data from a larger set of wikis before we scale further. The following wikis received the new Impact module this week:
       
      • Greek Wikipedia (el)
      • Persian Wikipedia (fa)
      • French Wikipedia (fr)
      • French Wiktionary (frwikt)
      • Indonesian Wikipedia (id)
      • Polish Wikipedia (pl)
      • Portuguese Wikipedia (pt)
      • Romanian Wikipedia (ro)
      • Turkish Wikipedia (tr)
      • Vietnamese Wikipedia (vi)
         
        Section-level "add an image" task
  • Section-level “add an image” structured task
    • We have released an initial version of the section-level “add an image” structured task to several beta wikis this week (en, ar, bn, cs, es). The new task is set as an A/B test, so it will not appear to all users, but we will release the task as a default on these beta wikis soon.  Once this task has been thoroughly tested internally and by Growth Ambassadors, we hope to release the new task to Growth pilot wikis: Arabic Wikipedia, Bengali Wikipedia, Czech Wikipedia, and Spanish Wikipedia (T335715). The feature will be Community configurable via Special:EditGrowthConfig.

Update 2023-05-26: Personalized praise

edit
 
The Personalized praise feature on the Mentor dashboard
  • Positive reinforcement
    • The final part of the Growth team's Positive reinforcement project has been released to Growth's pilot wikis: Personalized praise is now available on Arabic, Bengali, Czech and Spanish Wikipedias. Personalized praise is a new module featured on the Mentor dashboard, which is available to mentors. The module allows mentors to identify, praise and work more closely with prospective newcomers with high-quality contributions. By default, mentors receive up to one notification per week if there is a praiseworthy newcomer (mentors can increase or decrease the notification frequency, or fully disable such notifications).
    • The feature was created because research shows that receiving praise and encouragement from other users increases editor retention. We hope that the newly released feature enables mentors to work more closely with newcomers assigned to them and help to increase newcomer retention
  • Section-level “add an image” structured task
    • The Growth team is busy working on a new section-level variation of the “add an image” task. This task is designed to augment the number of images in Wikipedia articles, while simultaneously offering newcomers a structured task to progress to after they have successfully completed the article-level "add an image" task (T321754).
    • We recently concluded a community consultation with Growth pilot wikis to evaluate the localized designs and plans for this new section-level "add an image" task (T332530). Given the similarity of this task to the existing article-level "add an image" task, the feedback received was not extensive. However, the primary community discussions centered on the issues of offensive images and caption writing:
      • There were concerns within some communities about the possibility of offensive or "not safe for work" images being presented to new editors. There are some basic safeguards in place: only images available on Commons that are used on other wikis or linked to Wikidata items are suggested, and communities will have the ability to modify Community configuration to exclude articles from suggestions if they contain certain templates or categories. Additionally, we have added a task to delve deeper into this issue: T336825  
      • We have also received several suggestions for additional enhancements to the caption stage. Following the MVP release, we will consider two other tasks aimed at further refining the caption writing stage of this task: T298119 & T322925

Update 2023-05-19: Scaling “add a link” & Personalized praise release

edit
  • Positive reinforcement
    • Further improvements for the new Personalized praise Mentor dashboard module will be released to Growth pilot wikis Wednesday, May 24, 2023 (T317817 & T334630). Starting Wednesday, mentors at Growth Pilot wikis will start to receive notifications weekly when they have “praise-worthy” mentees. Mentors can configure their notification preferences or disable these notifications.

Update 2023-05-12: Scaling “add a link” and WikiConference India

edit
  • Add a link
    • Another round of Wikipedias will receive the "Add a link" task on Wednesday, May 17th (T308134). The Wikipedia language versions that will receive this newcomer structured task include: Gorontalo Wikipedia, Hausa Wikipedia, Hakka Chinese Wikipedia, Hawaiian Wikipedia, Fiji Hindi Wikipedia, Croatian Wikipedia, Upper Sorbian Wikipedia, Haitian Creole Wikipedia, Interlingua Wikipedia, Interlingue Wikipedia, Igbo Wikipedia, Iloko Wikipedia, Ingush Wikipedia, Ido Wikipedia, Icelandic Wikipedia, Inuktitut Wikipedia, Jamaican Patois Wikipedia, Javanese Wikipedia). This is part of the progressive deployment of this tool to more Wikipedias. Communities can configure how this feature works locally.
  • WikiConference India 2023
    • Our Growth team Bengali Ambassador, Ankan, participated in WikiConference India. One of the major takeaways from this conference is the fact that many community members don't have a clear understanding of Growth features. The Growth team hopes to conduct more community outreach in the coming fiscal year. A summary of Growth team outreach is available on Growth’s Community events report page.

Update 2023-05-05: Annual planning, Personalized praise release, and Section-level image evaluation

edit
  • Growth team annual planning
    • Read about current Growth team annual planning ideas here: Growth/Annual_Plan_2023-2024. This is still a draft, and we will start to engage more with communities to get feedback on these ideas. The first quarter of the fiscal year will likely be focused on committed work (IP Masking project) and moving Community configuration out of the GrowthExperiments extension so it can be extended and used by other WMF teams and community developers, but plans for the remainder of the year are still to be determined.
    • The Growth team participated in a focus group call on Thursday: Moderators conversation. Several ideas were discussed that relate to Growth team work, notes are available here.
  • Positive reinforcement
    • The new Mentor dashboard module is now released at Arabic Wikipedia, Bengali Wikipedia, and Czech Wikipedia (T317817 & T334630). We will release the feature to Spanish Wikipedia soon.
    • This is the “beta” release of the new mentor dashboard module (T334630). For the "beta" release, the new Mentor dashboard module will be available to all mentors at these wikis, but notifications are disabled. This approach should allow us to collect some initial feedback before we start surfacing the feature to mentors via notifications.
    • There are a few improvements already planned based on feedback from mentors (T333036 & T333035).
  • Section-level “add an image” structured task
    • The Growth team is partnering with the Structured Data team to work on a new section-level variation of the “add an image” task. Growth team Ambassadors completed a second round of evaluation of Section-level image suggestions, and results are posted in the associated task (T330784). Suggestions improved considerably since the first round of evaluation (T316151), this is due to several improvements made to filter out sections and suggestions that are likely not a good fit. As expected the level of accuracy varies considerably by language and by the type of suggestion. The structured data team plans to ramp up the confidence threshold for suggestions, which will result in a smaller number of more reliable suggestions.
    • The Growth team is conducting a community consultation with Growth pilot wikis to review the localized designs and plans (T332530).
    • This section-level “add an image” task is one aspect of the Structured Data Across Wikipedia project, so the Growth team will need to release this task to at least one wiki by the end of June to meet grant deadlines.
  • Growth feature scaling:
    • On Monday, May 1st, German Wikipedia scaled Growth features to 100% of newcomers. Wikimedia Deutschland was conducting their own analysis of Growth features and Mentorship, so they had requested to keep a control group of 20% to conduct their own analysis of features. They reviewed data and requested to scale Growth features to all newcomers.

Update 2023-04-28: Progress on new “add an image” task & beta release of Personalized praise

edit

Update 2023-04-21: Positive Reinforcement updates & Mentorship on English Wikipedia

edit
  • Positive Reinforcement
    • Leveling up leading indicators and plans have been posted. Full results will be posted soon (T328055). So far results seem positive:
      • Newcomers who complete 5 edits of a given Suggested edit task type are asked to try a different task so they can gain experience with other types of tasks.  So far, almost 70% of newcomers opt to try the new task type!
      • Newcomers who completed a regular article edit will be prompted to try Suggested Edits in the post-edit dialogue on their 3rd and 7th edit. Currently about 20% of newcomers click through to try a Suggested edit.  We will track the actual completion rates and retention rates in future experiment analysis (T328057).
      • We are looking into mobile activation rates further, as we are seeing a slight difference in activation, where there should be none (T334411). Before a user edits for the first time (activates) the A/B tests should be essentially the same, so we shouldn’t see any differences in activation. We plan to follow up and investigate a few issues (T335125 & T335005) and re-run the mobile experiment.
    • Personalized praise:
      • Growth team Ambassadors and our QA engineer are testing these features and we hope to set a release date next week.  We’ve decided on a very low impact way to release these features to mentors in an incremental way (T334630).  
  • Mentorship
    • English Wikipedia is recruiting Mentors via a Watchlist message that will display through the end of April. Since the message was added, the number of mentors at English Wikipedia has grown by 55%! This will allow English Wikipedia to increase the number of newcomers who receive Mentorship when they create accounts (T323045).

Update 2023-04-14: Mentorship recruitment & Community configuration

edit
  • Mentorship
    • English Wikipedia is trying to recruit more volunteers to help newcomers via Growth’s Mentorship features. For the rest of April, the following message will display on the Watchlist on English Wikipedia:
      • A portion of new users are automatically matched with mentors to help guide and support them; experienced editors are invited to sign up to be a mentor.
    • Growth team representatives participated in a Let’s Connect Learning Clinic to share Growth tools with campaign organizers. A summary of what was shared and learned is available on our Community events report page.

Update 2023-04-07: Newcomer tools for campaigns and scaling “Add a link”

edit
  • Newcomer tools for campaign organizers
    • Growth team representatives will participate in a Let’s Connect Learning Clinic. The focus of the session will be to share effective strategies for retaining and re-engaging new editors during and after the Wiki for Human Rights campaign. The session will be held on Apr 11, 2023 and is open to all Wiki for Human Rights campaign organizers in the Central and Eastern Europe region and in other regions who are participating in this year's campaign. Learn more here
    • We added a new help page about Mentorship for workshop or campaign organizers.
  • Add a link
    • Over 30 more Wikipedias will receive the "Add a link" task on Wednesday, April 12 (T304551 & T308133). The Wikipedia language editions that will receive this newcomer structured task include:
      • Arpitan Wikipedia frp
      • Basque Wikipedia eu
      • Danish Wikipedia da
      • Darija Wikipedia ary
      • Dinka Wikipedia din
      • Emiliano-Romagnolo Wikipedia eml
      • Esperanto Wikipedia eo
      • Estonian Wikipedia et
      • Ewe Wikipedia ee
      • Extremaduran Wikipedia ext
      • Faroese Wikipedia fo
      • Fijian Wikipedia fj
      • Finnish Wikipedia fi
      • Friulian Wikipedia fur
      • Fulah Wikipedia ff
      • Gagauz Wikipedia gag
      • Galician Wikipedia gl
      • Gilaki Wikipedia glk
      • Goan Konkani Wikipedia gom
      • Gothic Wikipedia got
      • Greek Wikipedia el
      • Guarani Wikipedia gn
      • Guianan Creole Wikipedia gcr
      • Gujarati Wikipedia gu
      • Irish Wikipedia ga
      • Lower Sorbian Wikipedia dsb
      • Manx Wikipedia gv
      • Northern Frisian Wikipedia frr
      • Scottish Gaelic Wikipedia gd
      • Tumbuka Wikipedia tum
      • Võro Wikipedia fiu-vro
    • Another group of almost 20 wikis will receive “add a link” soon (T308134).  

Update 2023-03-31: Positive reinforcement and what’s next for the Growth team

edit
  • Positive reinforcement
    • There are three main parts to this project, and soon all three parts will be released to Growth pilot wikis:
      1. The new Impact module was released to Growth pilot wikis in December 2022. We’ve reported on initial leading indicators, and plan to follow up with full experiment analysis soon (T327581).  
      2. Leveling up features were released as an A/B test on Growth pilot wikis. We will report on initial leading indicators soon (T328055).  
      3. The Personalized praise project involves some improvements to the Mentor dashboard. The new dashboard module will surface “praiseworthy” new editors to Mentors, and encourage Mentors to send them encouragement. The new Personalized praise Mentor dashboard module was deployed to Beta wiki this week. After a few more improvements and further testing it will be ready for deployment to Growth pilot wikis (T322443).  
  • Mentorship
    • On English Wikipedia and Spanish Wikipedia, so many new accounts are created that there aren't enough mentors to adequately support all newcomers; so currently not all newcomers are assigned to a mentor. The number of mentors on Spanish Wikipedia has increased enough that we were able to increase the percentage of newcomers that receive a mentor to 50% (T332737).
  • What’s next for the Growth team?
    • Add an image
      • We have started work on a new section-level “add an image” task, that will suggest images to new editors that likely fit within a specific section in an article (T321754).
      • We will work on improvements to the “add an image” feature based on user feedback and funnel analysis (T293711).
    • IP Masking
      • The Growth team will soon start engineering work on the product improvements needed to support the IP Masking project (T326877 ).
      • We have already been working on initial designs (T300273), preparing translated designs for user testing (T328616), and conducting user research to help refine designs (T328368).  
    • Annual planning
      • The Growth team will soon set objectives and key results that align with the overall Product and Technology Annual Plan. We’ll discuss potential ideas with community members, and schedule a focus group discussion. If you are interested in participating, please just let us know on the Growth talk page.

Update 2023-03-24: Thanks usage analysis, Leveling up release

edit
  • Positive Reinforcement
    • We completed a quick analysis of Thanks, which is now available on Commons: Thanks usage (T332441). Our quick analysis does not find a clear signal that the wider availability of the feature resulted in more edits being thanked. Patterns of usage are different between wikis, both in the sense of what proportion of edits are thanked as well as whether we see differences in January and February compared to December. There are clear differences when it comes to Thanks given by editor tenure.
    • As of Wednesday, March 22, 2023, Leveling up features have been released as part of the Positive Reinforcement A/B test on Arabic Wikipedia, Bengali Wikipedia, Czech Wikipedia, and Spanish Wikipedia (T330358)! We will carefully monitor interactions with these new notifications and features. We will share initial data soon (T328055) and more detailed experiment analysis once we’ve gathered enough data (T328057).
    • Growth team Ambassadors completed a second community consultation about Personalized praise. There were requests for additional functionality, and those ideas have been added to Phabricator.  Thank you to all community members who offered feedback on these designs!
edit

Update 2023-03-10: Leveling up release & upcoming shift in focus to “add an image”  

edit
  • Positive Reinforcement
    • Growth team engineers are hard at work finishing up Leveling up tasks and testing the new features. Leveling up features will be released as part of the Positive Reinforcement A/B test on Arabic Wikipedia, Bengali Wikipedia, Czech Wikipedia, and Spanish Wikipedia on Monday, March 20th (T330358).
    • We will quickly check some of the experiment leading indicators to make sure initial results look promising (T328055) and then we will follow up with a full experiment analysis report once we’ve gathered enough data to have significant newcomer retention data (T328057).  
  • Add an image
    • In the month of February 2023, over 5,000 images were added to Wikipedia articles via the newcomer “add an image” feature. Since “add an image” was launched, over 36,000 images have been added to articles via this newcomer task.
    • After the Growth team wraps up Positive Reinforcement work, we will re-focus on “add an image” work. We will work on improvements to the feature based on user feedback and funnel analysis (T293711).
    • We will also start work on a new section-level “add an image” task (T321754). In other words: the current “add an image” task suggests images that illustrate the article as a whole, while this new task will suggest images to articles that already have an article-level image, but could use an image to illustrate a specific section within the article.
  • Mentorship
    • We fulfilled a community request from Spanish Wikipedia to add a talk page link for each mentee in the “Your mentees” module on the Mentor dashboard (T322750).
  • Add a link
    • Growth pilot wikis have been testing a new “add a link” prioritization formula that prioritizes articles that are more likely to be underlinked. This new prioritization formula seems to be working well for newcomers and possibly even decreasing the ratio of edits that end up reverted. We are now scaling this change to all wikis (T330535).
  • Newcomer Experience Projects
    • The Thank you page experiment proved that inviting Wikipedia donors to create accounts through the Thank you page is a sustainable and low-impact way to grow the number of new editors on Wikipedia. We are continuing to expand this work to more languages and regions.  Next Thursday this new “Try editing Wikipedia” call to action will be added to the donor thank you page on Swedish Wikipedia, Italian Wikipedia, French Wikipedia, Dutch Wikipedia, and Japanese Wikipedia (T321370). We will follow up with a quick analysis (T331495) and evaluate the funnel (thank you page visitors > account registrations > constructive activation) once we have enough data.    
edit
edit
  • Leveling Up  
    • We completed a community consultation in which we reviewed the most recent Leveling up designs with the Growth Pilot wikis. This consultation was completed in English on Mediawiki, and at Arabic Wikipedia, Bengali Wikipedia, Czech Wikipedia, and Spanish Wikipedia (T328356). In general, feedback was quite positive. These two tasks help address the only critical feedback mentioned by those that provided feedback:
      • Leveling up: Community configuration (T328386)
      • Leveling up: Second design iteration of "Try a new task" dialog (T330543)
    • The Growth team is wrapping up a few remaining tasks that are necessary for the initial release of Leveling Up features.  After testing is complete and translations are in place, we will release these new features in an A/B test to Arabic, Bengali, Czech, and Spanish Wikipedias.  
  • Add a Link
    • We looked at edit and revert data on Growth pilot wikis before and after the release of T301096. It appears that the new prioritization formula may result in more newcomers completing "add a link" tasks and also result in a lower revert rate (although this was not a true A/B test, and revert rates are low enough that it is difficult to draw a conclusion with confidence). Given these results combined with a prior manual evaluation by Growth Ambassadors, and positive reception from Pilot communities, we plan to move forward with releasing this new prioritization formula to all wikis that currently have the "add a link" structured task (T330535).

Update 2023-02-17: Leveling up community consultation & evaluation of section-level image suggestions

edit
  • Leveling Up community consultation
  • Add an image: section-level image suggestions
    • The current “add an image” tool only suggests images to entirely unillustrated articles. The "add an image" feature suggests article-level image suggestions; images meant to illustrate the article as a whole. The WMF Structured Data team is working on the backend needed to provide image suggestions for specific sections in an article. These section-level image suggestions will power a new Growth team structured task for section-level image suggestions. We are starting design work on this task (T321756), and Growth team Ambassadors helped with a first evaluation of these section-level image suggestions (T316151).

Update 2023-02-10: Positive reinforcement community discussions & Suggested edits topic filtering

edit

Update 2023-02-03: Positive reinforcement, Mentorship for workshop attendees, & "Try editing" prompt for donors

edit
  • Positive Reinforcement
    • Impact Module
      • The new Impact module is released as an A/B test to Growth pilot wikis and we’ve released several minor improvements and bug fixes (T327849, T324675, T327824). Next up we will complete experiment analysis to determine how this change has affected newcomers (T327581).    
    • Leveling Up
      • We are wrapping up some analysis to better understand where we should set baseline Leveling Up prompts (T322433)
      • Engineering work has started on improving the post-edit dialog when a newcomer has topics or tasks selected that result in no suggestions (T324177).
      • The main purpose of Leveling up work is to encourage newcomers to try new and more difficult types of tasks, and our initial work on that effort has started (T322386).  
    • Personalized Praise
      • The backend work needed to support the new “personalized praise” module on the Mentor dashboard has been completed (T322444).  
  • Mentorship
  • Newcomer experience projects
    • Special account creation pages for donors are now available on SV, IT, JA, FR, and NL Wikipedias (T321370). This work expands the Thank you page experiment in which we encouraged donors in certain languages / on certain wikis to try editing Wikipedia.
  • Welcome Survey
    • Vietnamese Wikipedia now has a newcomer welcome survey (T325376).

Update 2023-01-27: Positive reinforcement, SpecialPages, PageTriage, & Mentorship

edit

Update 2023-01-19: Newcomer experience projects & Positive reinforcement update

edit
  • Newcomer experience projects
    • The Growth team has been partnering with other WMF teams to conduct several experiments aimed at increasing new editor activation and retention. An overview of the four main projects completed are available here: Newcomer experience projects
  • Positive reinforcement
    • There are three parts to the Positive reinforcement project, and we are nearly complete with the first. The work needed to complete the new Impact module is almost complete (T222310). The Growth team is now shifting to focus on Leveling Up (T317813) and Personalized Praise (T317817).  
  • Welcome survey
    • On January 30th, we will deploy the welcome survey to Vietnamese Wikipedia (T325376). After this update, all language editions of Wikipedia with Growth tools enabled will receive the Welcome survey.
  • Newcomer experience + New article creation
    • A few Growth team members are meeting with New Pages Patrol representatives and other English wikipedia community members to discuss improvements for newcomers who come to the wikis primarily interested in article creation (meeting details). The Growth team hopes to learn more about current NPP challenges and consider how a project around Article Creation for Newcomers fits into the plans of the Growth team. If this project is prioritized we will spend more time gathering feedback from other wikis and especially focus on feedback from new editors.

Update 2023-01-13: Positive reinforcement updates and Mentorship improvement

edit
  • Positive Reinforcement
    • We released several Impact module improvements including a change to the logic of how we are displaying “Total edits” (T325216).
    • The new Impact module is still being A/B tested on Pilot wikis. We will conduct a thorough analysis once the experiment has run long enough to gather retention metrics, but in the meantime the impact module leading indicators appear healthy.
    • Thanks has been added to Watchlists, Contributions, and Recent Changes (T51541, T90404). We will soon work on design ideas for improvements to the confirmation step (T315859).  
  • Mentorship
    • We have worked on a few changes recently to help ensure that when a Mentor is blocked locally or globally they don’t continue to receive questions from mentees (T325087, T318819).
  • Add a Link
    • Newcomers at Growth pilot wikis will now receive “add a link” suggestions for articles that are more clearly "underlinked" (T301096). After discussing this change with Pilot communities and looking at “add a link” metrics we will decide if this change should be released to more wikis.