Growth/Newcomer Homepage Translation task
This page describes the Growth team’s work adding a Content translation module to the newcomer homepage. The Content translation module will link to the Content translation interface (Special:ContentTranslation
) for editors interested in exploring this feature. It will be Community Configurable.
Homepage Content Translation task
Integrate Content Translation into the Newcomer Homepage in a Community Configurable way
|
Current Status
edit- : Initial project page created
- Up next: Growth Pilot wiki community discussion
Summary
editThe Growth team will experiment with adding a new Content translation module to the Newcomer homepage, and A/B test the impact of exposing this feature on the Newcomer homepage.
As new editors progress in their involvement on the wikis, the Newcomer homepage should evolve and offer more complex tasks that also encourage new editors to engage in more meaningful ways. This new task can be used to help bring attention to content gaps on high-impact topics, which aligns with the 2030 Movement strategy’s “Topics for Impact” recommendation.
Hypothesis
editIf we present Newcomer homepage editors with Content translation tasks that are filtered to high-impact topics, then more articles that address knowledge gaps will be created.
To evaluate this hypothesis, we'll examine several key questions and track corresponding metrics:
- Do users interact with this new module?
- Metric: The click through rate of Newcomer homepage visitors in the experiment group (that receives this new module).
- Is this task suitable for newer editors who find the suggested task on their Newcomer homepage?
- Metric: The task completion rate for editors who start a Content translation task (from the Newcomer homepage call to action).
- Did this task actually lead to more Content translation tasks being completed?
- Metric: When A/B tested, editors that receive the Content translation task on their Newcomer homepage complete more Content translation tasks than the control group that doesn’t receive the module.
- Are there any drawbacks, negative patterns, or anti-patterns that arise from using this module?
- Quality guardrail:
- Metric: Article quality & deletion stats.
- Task suitability guardrail:
- Metric: The number of wikis that remove this module from the Newcomer homepage via Community Configuration.
- High-impact topics guardrail:
- Metric: The percentage of new articles created that relate to high-impact topics.
- Bias guardrail:
- Metric: The percentage of new articles created that may contribute to systemic-bias.
- Quality guardrail:
- Does this module help fill knowledge gaps?
- Metric: A 1 percentage point increase (Year-of-Year) in the portion of newly created or improved articles on high-impact topics with acceptable quality, per the “global quality score”, that are created or edited on Wikipedia, starting with underrepresented geographic regions and gender. (This is the WikiExperiences 1.3 Key Result from the WMF Product & Technology department's Objectives and Key Results.)
Target Audience
editThis project will primarily target Learners: registered editors whose experience falls between Newcomers (fewer than 10 edits or 4 days of activity) and Experienced Editors (500+ edits, >30 days of activity).
We will target both mobile and desktop Newcomer homepage visitors.
Our primary wiki audience is mid-sized Wikipedias, but the feature will be Community Configurable so that it can be adjusted to work well for all Wikipedia language editions.
Research
editThe project is guided by many previous research projects and experiments:
- Research:Wikipedia Knowledge Graph with DeepDive (2015)
- Research:Wikipedia Knowledge Integrity Risk observatory (2021)
- Research:Prioritization of Wikipedia Articles (2020)
- Research:Cross-lingual article quality assessment (2022)
- Research:Automatically labeling low quality content (2020)
- Research:Knowledge Gaps Index/Taxonomy (2020)
- Thinking about the impact of the Wikimedia movement
- Wikimap: A map of Wikipedia
Community Discussion
editThe Growth team will initiate a discussion on our current Pilot wikis (Arabic Wikipedia and Spanish Wikipedia), along with a conversation in English on the associated MediaWiki talk page. Questions for Community Discussion:
- Do you have any feedback or concerns about this project idea?
- Do you have any suggestions for making this feature more impactful or meaningful to your community?
Design
editThe following are initial design mockups of the mobile layout of the newcomer Homepage, including two new modules: the Content Translation task and the Community Updates module.
-
English mockup
-
Spanish mockup
-
Arabic mockup
Measurement and Results
editThis section is currently a draft. Material may not yet be complete, information may presently be omitted, and certain parts of the content may be subject to radical, rapid alteration. More information pertaining to this may be available on the talk page. |
Ideas for further improvements
editThe Growth team aims to release experiments quickly, so the first version of this feature may have more limited functionality. After initial experimentation, if this feature proves valuable, then we should consider the following improvements:
- Improved targeting.
- Consider integrating translation tasks into Suggested Edits, when Content translation articles can be filtered by the editor’s self-selected topical interest.