Wikimedia Research/Goals
About
editOur departmental goals are captured on a quarterly basis for each fiscal year (Q1: July-September; Q2: October-December; Q3: January-March; Q4: April-June). This is an overview of our goals by quarter for each team. For our goals in the Wikimedia Foundation's annual plan, see this phabricator board.
FY 2017-18
editOctober - December 2017 (Q2)
editGoal setting process owner: Dario Taraborelli [ Wikimedia Research goals overview ] [Wikimedia Research annual plan overview]
Annual Program/Outcome | Quarterly Objective | Tech Goal | Team Goal | Dependencies | Team Members | ETA | Status |
---|---|---|---|---|---|---|---|
Program 4: Technical community building.
Outcome 2: The adoption of Wikimedia technology can be reliably measured Objective 1: Design a set of formal KPIs (key performance indicators) to measure the growth and diversity of our technology audience (task T171220) Outcome 4: The collaboration with research in industry and academics is further scaled and supported. Objective 1: Organize and host the annual Wiki Research Workshop. (task T171118) |
|
|
|
EOQ | In progress | ||
Program 9: Growing Wikipedia Across Languages.
Outcome 1: Surface relevant information about the articles to editors at the time of editing with the goal of helping editathon organizers Objective 1: Build, improve, and expand algorithms that can provide more detailed recommendations to editors about how an article could be expanded. (task T171224) Objective 2: Develop and gather design requirements for how the algorithms’ results should be exposed to the editors. (task T171225) |
|
|
|
EOQ | In progress | ||
Program 11: Improving citations across Wikimedia projects.
Outcome 1: Quantitative research is available to help Wikipedia and Wikidata contributors focus and prioritize their sourcing efforts. Objective 1: Estimate what proportion of content in Wikipedia or Wikidata is unsourced and in need of citations. Outcome 3: Outreach activities continue to ensure community and technical efforts are aligned Objective 1: Fundraise for, and host the 3rd annual meeting in the WikiCite series |
|
|
|
EOQ | In progress | ||
Cross Departmental: Structured Data on Commons. (Segment 4: Programs) Outcome 2: Develop a better understanding of existing needs for Structured Commons (task T152248) |
|
|
|
EOQ | In progress | ||
Cross Departmental: Community Health. (Segment 3: Research) Outcome 1: We aim to understand and model the characteristics of harassment in Wikimedia projects. Objective 1: Conduct research to characterize and model wikihounding. (task T171249) Objective 2: Prototype new models to facilitate sockpuppet detection and the classification of toxic discussions. (task T171251) |
|
|
|
EOQ | In progress |
July - September 2017 (Q1)
editGoal setting process owner: Dario Taraborelli [ Wikimedia Research goals overview ] [Wikimedia Research annual plan overview]
Annual Program/Outcome | Quarterly Objective | Tech Goal | Team Goal | Dependencies | Team Members | ETA | Status |
---|---|---|---|---|---|---|---|
Program 12: Grow contributor diversity.
Outcome 1: We improve Wikipedia’s contributor diversity after designing and testing potential intervention(s). Objective 1: Identify the underlying (potential) causes of lack of representative contribution from certain demographics task T166083 Objective 2: Design frameworks to change the current socio-technical infrastructure to address at least one of the underlying causes of lack of representativeness |
|
|
|
EOQ | Done
The second stretch goal is under review and may move to the next quarter depending on its engineering needs. This latter goal is a nice-to-have that we can afford to drop if needed. | ||
Program 9: Growing Wikipedia across languages via recommendations.
Outcome 1: Surface relevant information about the articles to editors at the time of editing with the goal of helping editathon organizers Objective 1: Build, improve, and expand algorithms the can provide more detailed recommendations to editors and editathon organizers on how to expand articles/family-of-articles |
|
|
|
Done | |||
Cross Departmental: Structured Data on Commons. Segment 4: Programs.
Outcome 2: Develop a better understanding of existing needs for Structured Commons (task T152248) |
|
|
EOQ | In progress |
FY 2016-17
editApril - June 2017 (Q4)
editResearch & Data
editGoal setting process owner: Dario Taraborelli [ Wikimedia Research goals overview ]
Objective | Key result | Dependency | ETA | Status |
---|---|---|---|---|
FOCUS
AI as a service |
|
|
EOQ | Done |
STRENGHTEN
Research discoverability |
|
|
EOQ | In progress |
STRENGTHEN
Annual workshops and outreach |
|
|
EOQ | Done |
Design Research
editGoal setting process owner: Abbey Ripstra [ Wikimedia Research goals overview ]
Objective | Key result | Dependency | ETA | Status |
---|---|---|---|---|
FOCUS
Generative research |
|
|
EOQ | In progress |
FOCUS
Evaluative research |
|
|
EOQ | In progress |
STRENGTHEN
Research communication |
|
|
EOQ | In progress |
January - March 2017 (Q3)
editResearch & Data
editGoal setting process owner: Dario Taraborelli [ Wikimedia Research goals overview ]
Objective | Key result | Dependency | ETA | Status |
---|---|---|---|---|
FOCUS |
|
|
EOQ | In progress |
FOCUS
Stub recommendations |
|
|
EOQ | In progress |
EXPERIMENT
Recommender system evaluation |
|
|
EOQ | In progress |
STRENGTHEN
Annual workshops and outreach |
|
|
EOQ | In progress |
Design Research
editGoal setting process owner: Abbey Ripstra [ Wikimedia Research goals overview ]
Objective | Key result | Dependency | ETA | Status |
---|---|---|---|---|
FOCUS
Generative research |
New Readers next steps
Audience project
|
|
EOQ | Done |
STRENGTHEN
Participant outreach |
|
|
EOQ | In progress |
FOCUS
Understanding editing culture |
|
|
EOQ | In progress |
EXPERIMENT
Recommender Evaluation |
|
EOQ | In progress |
October - December 2016 (Q2)
editResearch & Data
editGoal setting process owner: Dario Taraborelli [ Wikimedia Research goals overview ]
Objective | Key result | Dependency | ETA | Status |
---|---|---|---|---|
FOCUS |
|
EOQ | In progress | |
FOCUS |
|
|
EOQ | In progress |
FOCUS |
|
|
EOQ | In progress |
FOCUS |
|
|
EOQ | In progress |
EXPERIMENT
Stub recommendation |
|
|
EOQ | In progress |
Design Research
editGoal setting process owner: Abbey Ripstra [ Wikimedia Research goals overview ]
Objective | Key result | Dependency | ETA | Status |
---|---|---|---|---|
FOCUS
New Reader research |
|
|
end of Q2 | Done |
FOCUS
New editor support |
|
end of Q2 | In progress | |
STRENGTHEN
Design Research policy updates |
|
mid Q2 | Done | |
EXPERIMENT
Persona development |
|
|
end of Q2 | Done |
July - September 2016 (Q1)
editResearch & Data
editGoal setting process owner: Dario Taraborelli [ Wikimedia Research goals overview ]
Objective | Key result | Dependency | ETA | Status |
---|---|---|---|---|
FOCUS
Revscoring in production |
|
EOQ | Done | |
EXPERIMENT
Open Notebooks Infrastructure (T140430) |
|
|
EOQ | In progress |
FOCUS
Discussion modeling |
|
EOQ | In progress | |
FOCUS
Productize the article recommendation API |
|
|
EOQ | In progress |
STRENGTHEN
Research landing page (stretch) |
|
|
EOQ | In progress |
Design Research
editGoal setting process owner: Abbey Ripstra [ Wikimedia Research goals overview ]
Objective | Key result | Dependency | ETA | Status |
---|---|---|---|---|
FOCUS
Product Research |
|
|
end of Q1 | Done |
FOCUS
Generative Research |
|
|
mid Q1 | Done |
STRENGTHEN
Research capacity building |
|
|
end of Q1 | Done |
EXPERIMENT
Research data mapping (stretch) |
|
|
end of Q1 | Done |
FY 2015-16
editApril - June 2016 (Q4)
editResearch & Data
editGoal setting process owner: Dario Taraborelli [ Wikimedia Research goals overview ]
Objective | Key result | Dependency | ETA | Status |
---|---|---|---|---|
EXPERIMENT
revscoring in production |
|
|
EOQ | Done |
EXPERIMENT
Discussion modeling |
|
|
EOQ | In progress |
FOCUS
Research outreach |
|
None
|
May 2016 | Done |
FOCUS
Reader segmentation research |
|
|
May 2016 | In progress |
Design Research
editGoal setting process owner: Abbey Ripstra [ Wikimedia Research goals overview ]
Objective | Key result | Dependency | ETA | Status |
---|---|---|---|---|
Personas -
Use them in product development, and iterate pragmatic personas. |
|
EOQ | not completed | |
Maintain evaluative design research projects with Editing, Reading, Search and Community Engagement teams |
|
|
EOQ | In progress |
Deep dive / contextual inquiry in Nigeria and India |
|
Collaboration with Communications, Partnerships and Reading team and Reboot (external consultant). | EOQ | Done |
Continue, Complete Collaboration with UW on Survey |
|
|
EOQ | done |
Create a project plan and understand dependencies and resource needs for benchmarking. |
|
|
EOQ | Done |
January - March 2016 (Q3)
editResearch & Data
editGoal setting process owner: Dario Taraborelli [ Wikimedia Research goals overview ]
Objective | Key result | Dependency | ETA | Status |
---|---|---|---|---|
STRENGTHEN
Extend revision scoring to support new models and languages |
|
|
EOQ | In progress |
EXPERIMENT
Run and analyze a content creation campaign |
|
None | EOQ | Not done |
FOCUS
Reader segmentation research |
|
|
EOQ | Done |
Design Research
editGoal setting process owner: Abbey Ripstra [ Wikimedia Research goals overview ]
Objective | Key result | Dependency | ETA | Status | |
---|---|---|---|---|---|
FOCUS
Production Work |
|
Being able to collaborate with product teams.
Budget from Reading team for contextual inquiry in Mexico. |
EOQ |
| |
STRENGTHEN
Persona Iteration |
|
Participants showing up to interviews. | EOQ | In progress | |
STRENGTHEN
Mentoring non design researchers |
|
Willing and able mentees. | EOQ |
| |
EXPERIMENT
External Collaborations |
|
Collaboration with Professor and students at UW. | EOQ | In progress |
October - December 2015 (Q2)
editResearch & Data
editGoal setting process owner: Dario Taraborelli [ Wikimedia Research goals overview ]
Objective | Key results | Dependencies | ETA | Status |
---|---|---|---|---|
FOCUS
Streamline ownership of research / data-related work |
Publish a map for internal use of who is responsible for specific requests around research and analytics. (T112317) |
|
10/1-10/31 | In progress |
STRENGTHEN
Revscoring integration |
Bring revscoring to fruition to our users as a Beta Feature (score integration into RC feed) (T112856) |
|
EOQ | In progress |
STRENGTHEN
Productize article and link recommender systems |
Article creation (T112321) and link (T112322) recommendation productized as services so they can be integrated with products and community tools. |
|
EOQ | In progress |
EXPERIMENT
Value-added research |
Deliver research on historical data to quantify who adds value to English Wikipedia (T99172) |
|
EOQ | In progress |
EXPERIMENT
Reader segmentation research (stretch) |
Deliver research on reader segments and behavioral patterns (T112326) |
|
EOQ | In progress |
Design Research
editGoal setting process owner: Abbey Ripstra [ Wikimedia Research goals overview ]
Objective | Key result | Dependencies | ETA | Status |
---|---|---|---|---|
STRENGTHEN
Mentor people to do quality design research (those not on DR team). |
One person outside the design research team does a complete design research project to DR team standards, expanding the number of people who do design research well. |
|
EOQ | Done |
STRENGTHEN
Design Research workshop to build collaboration capacity with product teams. |
Workshop happens, and product teams learn more about collaboration with Design Research and vice versa. |
|
MidQ | Done |
STRENGTHEN
Improve participant recruitment process |
Implement changes to reduce steps in recruitment (of design research participants) process to make recruiting more efficient. |
|
EOQ | Done |
FOCUS
Collaborate with product teams to implement design research projects. |
Design Research has done design research projects in collaboration with product teams to inform human centered product development. |
|
EOQ | Done |
EXPERIMENT
Persona interviews |
12 persona interviews completed |
|
EOQ | Partially done |
July - September 2015 (Q1)
editResearch & Data
editOur focus in Q1 will be on scaling up and evaluating data-intensive services the team has been designing: an edit and article quality classification API and recommender systems for article creation. Time permitting, we will kick off a project to measure who adds value to Wikipedia and iterate on article creation recommendations, as stretch goals.
Goal setting process owner: Dario Taraborelli [ Wikimedia Research goals overview ]
Objective | Key result | Dependency | ETA | Status |
---|---|---|---|---|
Productize revscoring and wiki labels |
|
|
End of Q1 | Done |
Run controlled tests of article translation recommendations |
|
|
End of Q1 | Done |
Measuring value added (stretch) |
|
none |
End of Q1 | In progress (moved to next Q) |
Re-train and productize article translation recommendations (stretch) |
|
|
End of Q1 | In progress (moved to next Q) |
Design Research
editOur focus in Q1 will be to coordinate and implement both evaluative and generative design research for the prioritized product track projects as well as iterating our pragmatic personas toward being fully researched Personas. Time permitting, we will mentor and collaborate with designers and prototypers toward doing usability testing for thier track teams, and we will grow our participant database.
Goal setting process owner: Abbey Ripstra [ Wikimedia Research goals overview ]
Objective | Key result | Dependency | ETA | Status | |
---|---|---|---|---|---|
Support prioritized user facing product projects with track teams by doing generative research (exploring and better understanding user needs, context and pain points) and evaluative research (evaluating concepts and functionality with specific users for usability and how they support needs.) |
|
|
end of Q1 | Done | |
Iterate the set of pragmatic personas developed in Q4 FY15 toward fully researched personas. |
|
|
end of Q1 | Partially done | |
Teach and mentor more designers and protoypers to do evaluative research (usability testing) to support user friendly, intuitive product development within the track teams. (Stretch) |
|
Collaboration and willingness from designers and prototypers on track teams. | Done | ||
Grow our participant database. (Stretch) |
|
|
Done |