跨wiki搜索结果改进

This page is a translated version of the page Cross-wiki Search Result Improvements and the translation is 20% complete.

新的目标

探索部门正在调查提供来自同一语言其他维基媒体项目搜索结果的能力(一般称作“跨wiki搜索”或“跨维基搜索”)。

For example, if you were on the French Wikivoyage and searched for "milk" you would be presented with the expected matching articles from the French Wikipedia and results from other French Wikimedia projects (i.e.: fr.wiktionary and fr.wikiquote).

This page is an attempt to summarize some of our thoughts and we invite all contributors to openly discuss this potential change on the talk page.

This idea is different, but related to, a new feature that the Discovery Search team enabled in 2016. That new feature shows results from select other language Wikipedia's when it's been determined that the user might have used a different language to type in their query, because their local results are less than 2 matches. The topic of this page - a new display of search results across the same language wiki projects - will be in addition to the new feature of language detection, not replacing it.

原理

The way search currently works for all Wikimedia projects is this: each language project has its own separate index to search in. This means that there is currently no way to search across all wiki projects for relevant results at the same time. However, on the backend, the language is the same for a search (regardless of project) and visitors may be interested in information that could be in a sister project in their language.

Providing search results across projects (within the same language) provides more information to visitors, easier visibility into other projects, and increases the value Wikimedia visitors receive out of searching on-wiki, which includes the potential for less zero result searches.

Displaying additional search results across projects will not only increase visibility to those other sister projects but it could also increase discovery into more articles of interest and possibly even encouraging additional contributions.

为什么还没有完成?

 
英语维基百科的现有搜索结果页面

Why not have one giant index to search across all projects in all languages?

  • Technical complexity is one reason: the size of the resulting index would be in the hundreds of gigabytes.

For example, the English Wikipedia database index of all article pages is around 200 gigabytes. Providing search results quickly would be negatively impacted if having just one very large database index.

  • Another reason for this 'one language' search results approach is that it probably wouldn't be very useful to search for a topic across all languages.

Searching for "Paris, France" and seeing generally the same article in French, German, and English wouldn't help very much in discovering new information.

The English language wiki projects are quite large:

  • English Wikipedia index for all English article pages is approximately 200 GB
  • 英语维基新闻大约15 GB
  • English Wikisource is approximately 6 GB

This might impact various existing wiki workflows by displaying additional search results.

  • This could possibly affect bots, contributors, researchers, readers, etc.

计划

In the first quarter (July - September 2016) the engineering team will continue to work on the following four main steps:

  • Combine indexes within the same languages.

(工單T139498)   部分完成

  • Ask for the help from the community - which includes the discussion on this page.

(工單T137312)   完成

  • The Search and Design teams at WMF will create mockups of how these new search results might be displayed.

  完成

By the end of the next quarter (October - December 2016) the team will compare search satisfaction. This will be done:

  • after the cross-wiki index is ready for several pre-selected languages

(工單T121541)   完成

  • after running A/B tests to collect real time data with which to analyze

(工單T121546)  N 未完成

  • and get the UI mocks finalized for front end testing here:

Cross-wiki Search Result Improvements/Testing   完成

  • while also creating a Labs instance for early testing.

(工單T151344)   完成

In the this quarter (January - March 2017), we will:

  • begin A/B testing for the front end of this new feature for analysis and feedback from the community.

(工單T145917)   进行中

  • continue to refine and enhance the back end for this feature

  进行中

  • First A/B/C test was run and found to be not very conclusive

(工單T149806)   完成

  • Second A/B test will be run, after fixing a minor UI bug and adding four more Wikipedias to test on, for a total of eight.

(工單T160004)   部分完成

2017年4月~6月:

  • wrap up analysis of the second A/B test for the sister projects snippets in the search results page

(工單T160008)   部分完成

  • release translated note to Village Pumps announcing the production deployment

(工單T162276)   进行中

  • release blog post about search
  • release into production on all Wikipedias

目前搜索示例

There are already a few community-led solutions to provide additional discovery of other Wikimedia projects and articles in the same language. Here is a small collection of examples:

Current search results pages for a few language wikis:

External Search Gadget:

这些额外的搜索结果如何显示?

The appearance of search results is open for discussion and we have some rough drafts for you to look at below with more design possibilities on Design. Here are a few examples of what a new search results page could look like based on existing solutions on other language wikis:

帮助我们选择解决方案

Please provide your feedback now!

  • Two quarters are needed, at a minimum, to architect and design the technical implementation.
  • The team would like to have something to test and to show to the community sometime in late 2016.

问题

The team has many questions and this is what we'd like to request feedback on from the community:

    1. Should the results from whatever wiki you're on to be shown first and then have an option to show more from other wikis?
    1. Should the additional results be inter-mixed with the local wiki results?
    1. Should the additional results be displayed off to the side (or maybe the bottom) of the results page?
    1. Should we have the option to turn off these other relevant search results (a user and/or project opt-out)?
      • This could be a keyword search term or maybe a button for a visitor to click
      • This could also be similar to the local: keyword that will only search for images on the local wiki and not Commons files, for instance.
    1. Would the additional results be best displayed as a list or a grid design?
    1. Should we include relevant metadata (images and/or a short description) with the search results?
    1. Do the results need to have the size of the article (i.e.: 848 bytes (104 words)) and the date it was created/modified?
    1. Should we indicate that clicking on a result will take you to another wiki project?
    1. How many results from other wikis should we show - 1, 2, 3, or more?
    1. Should we limit the existing method of displaying results from the wiki that you searched on?
      • We currently show up to 10,000 results in a paginated manner, but testing shows that generally only the first 3 results are ever acted upon.
  1. Do we want these new search results to work across all Wikimedia projects?
    1. For example, if I'm on Wikiquote, do I want to also see relevant search results from Wikivoyage, Wikipedia or Wikinews?
    2. Or, if I'm on Wikipedia, just show me results from other projects?
  2. Would these other relevant search results be useful and encourage deeper exploration into various topics?
    1. Is it annoying to see the other wiki search results?
    2. Conversely, does it encourage a user to discover more knowledge?
    3. How much weight do we give results from other wiki projects in the results?
  1. Will the display of the additional search results from other wikis encourage contributions from editors?
    1. i.e.: if you search for Piazza del Duomo and don't see a Wikivoyage article about it (while I'm searching on Wikiquote), would that encourage you to start an article for it?
  1. Should we limit the amount of languages we search in?
    1. i.e.: only use the top 50 languages to implement this in?
    2. Or, only use the languages that we are detecting queries in an other language than the wiki the user is on?

See also: Explore similar, Wiktionary widget, thumbnail icons in search results

Phabricator请求:

讨论注释:

After taking into account community feedback and design team recommendations, we'll start A/B testing soon. View this page for more information.

This page was created to encourage users to do their own testing, via a self-guided testing page with examples for those not-so-technical and those that have a Wikipedia account and are a little more experienced.