Wikimedia Search Platform
The Search Platform team (part of Wikimedia Technology) is responsible for maintaining and enhancing the various Search features and APIs for MediaWiki. This includes the CirrusSearch extension which relies on Elasticsearch, the search backend used at the Wikimedia Foundation to support Wikimedia projects.
The public Search Analytics Dashboard monitors and analyze the impact of our efforts, as well as the External Search Traffic dashboard that very broadly looks at where our requests are coming from. Please note that these boards are no longer being updated as of September 2019 and are only for historical purposes.
- Pages of historical note:
- 1 Goals
- 2 Other projects
- 3 The team
- 4 Communications
- 5 Process
- 6 Conferences, gatherings, and other events
- 7 Data Analysis Archive
- 8 Deployers
- 9 Code
The Search Platform team's goals for FY 2019/20 are part of the entire Technology Department's goals here.
Wikidata Query Service (WDQS)Edit
Searching structured data on Wikidata is an integral part of Discovery in building the Wikidata query service. It provides a API through which tools can access Wikidata. Learn more about the Wikidata query service. Our current work is tracked on this Phabricator workboard and weekly deployments of WDQS are documented on wikitech:Deployments; while a public WDQS Analytics Dashboard is used to monitor and analyze the impact of our efforts.
Application Programming Interfaces (APIs) provide developers ways to interact with the MediaWiki software.
This list was last updated on November 21st, 2019.
Weekly status updatesEdit
Search Platform - A public mailing list about the Wikimedia Search Platform team and projects (formerly Discovery Department). Examples of topics would include:
- Announcements, including major upcoming initiatives, completed major releases, quarterly or annual plans, requests for feedback or input
- Technical discussions and brainstorming regarding our work:
- Search, Elastic, Cirrus, the Relevance Forge, and other relevant subjects
- Our dashboards or related analysis
- Other team news, such as changes to team structure, significant changes to processes, changes in how we use phabricator or other tools like gerrit
- San Francisco
- Directly relevant
- Indirectly related (these sorts of meetup groups attract smart/enthusiastic people who like to spend their free time learning and solving problems)
The Search Platform team uses a "scrumban" process, which is a hybrid of Scrum and Kanban. It is described here: Search Platform Process.
Conferences, gatherings, and other eventsEdit
- Late January / early February 2020, All-Hands, San Francisco
- May 2020, Hackathon, Tirana, Albania
- All Hands - January 2018
- Hackathon 2018 - 18 – 20 May 2018
- Wikimania 2018 - July 18-22, 2018
- 17th International Semantic Web Conference (ISWC 2018) - October 8-12, 2018
- October 22 - 25, 2018, Wikimedia Technical Conference (WMTechConf, formerly known as DevSummit) in Portland, Oregon
- Late January / early February 2019, All-Hands, San Francisco
- May 2019, Hackathon, Prague
Data Analysis ArchiveEdit
- Search Analytics Dashboard
- Wikidata Query Service Analytics Dashboard
- API Analytics Dashboard
- External Traffic Analytics Dashboard
The data access and analysis guidelines used by the Search Platform team around data sources, or by other teams around Search Platform data sources, are documented on Meta. Please note that these boards are no longer being updated as of September 2019 and are only for historical purposes.
Useful reference for who can deploy code. It's nice to know whom to bug if you need something:
Discovery team supports the following code:
|Wikidata Query Service||https://phabricator.wikimedia.org/diffusion/WDQR/|
|Wikidata Query Service GUI||https://phabricator.wikimedia.org/diffusion/WDQG/|
|WDQS GUI deployment|
|Lucene Explain Parser||https://phabricator.wikimedia.org/diffusion/WLEP/|