Verbesserungen der wikiübergreifenden Suchergebnisse

This page is a translated version of the page Cross-wiki Search Result Improvements and the translation is 16% complete.

Ein neues Ziel

The Discovery department is looking into the ability to provide search results from other Wikimedia projects within the same language (commonly named cross-wiki or inter-wiki searches).

For example, if you were on the French Wikivoyage and searched for "milk" you would be presented with the expected matching articles from the French Wikipedia and results from other French Wikimedia projects (i.e.: fr.wiktionary and fr.wikiquote).

This page is an attempt to summarize some of our thoughts and we invite all contributors to openly discuss this potential change on the talk page.

This idea is different, but related to, a new feature that the Discovery Search team enabled in 2016. That new feature shows results from select other language Wikipedia's when it's been determined that the user might have used a different language to type in their query, because their local results are less than 2 matches. The topic of this page - a new display of search results across the same language wiki projects - will be in addition to the new feature of language detection, not replacing it.

Die Grundidee

The way search currently works for all Wikimedia projects is this: each language project has its own separate index to search in. This means that there is currently no way to search across all wiki projects for relevant results at the same time. However, on the backend, the language is the same for a search (regardless of project) and visitors may be interested in information that could be in a sister project in their language.

Providing search results across projects (within the same language) provides more information to visitors, easier visibility into other projects, and increases the value Wikimedia visitors receive out of searching on-wiki, which includes the potential for less zero result searches.

Displaying additional search results across projects will not only increase visibility to those other sister projects but it could also increase discovery into more articles of interest and possibly even encouraging additional contributions.

Warum wir das nicht schon gemacht haben?

 
Vorhandene Seite mit Suchergebnissen im enwiki

Why not have one giant index to search across all projects in all languages?

  • Technical complexity is one reason: the size of the resulting index would be in the hundreds of gigabytes.

Zum Beispiel ist der Datenbankindex aller Artikel der englischsprachigen Wikipedia ungefähr 200 Gigabytes groß. Providing search results quickly would be negatively impacted if having just one very large database index.

  • Another reason for this 'one language' search results approach is that it probably wouldn't be very useful to search for a topic across all languages.

Searching for "Paris, France" and seeing generally the same article in French, German, and English wouldn't help very much in discovering new information.

Die englischsprachigen Wiki-Projekte sind recht umfangreich:

  • English Wikipedia index for all English article pages is approximately 200 GB
  • Die englische Wikinews ist ungefähr 15GB groß
  • Die englische Wikinews ist ungefähr 6GB groß

This might impact various existing wiki workflows by displaying additional search results.

  • This could possibly affect bots, contributors, researchers, readers, etc.

Der Plan

In the first quarter (July - September 2016) the engineering team will continue to work on the following four main steps:

First

  • Combine indexes within the same languages.

(task T139498)   Teilweise abgeschlossen

  • Ask for the help from the community - which includes the discussion on this page.

(task T137312)   Erledigt

  • The Search and Design teams at WMF will create mockups of how these new search results might be displayed.

  Erledigt

Second

By the end of the next quarter (October - December 2016) the team will compare search satisfaction. This will be done:

  • after the cross-wiki index is ready for several pre-selected languages

(task T121541)   Erledigt

  • after running A/B tests to collect real time data with which to analyze

(task T121546)  N Noch zu erledigen

  • and get the UI mocks finalized for front end testing here:

Cross-wiki Search Result Improvements/Testing   Erledigt

  • while also creating a Labs instance for early testing.

(task T151344)   Erledigt

Third

In the this quarter (January - March 2017), we will:

  • begin A/B testing for the front end of this new feature for analysis and feedback from the community.

(task T145917)   In Arbeit

  • continue to refine and enhance the back end for this feature

  In Arbeit

  • First A/B/C test was run and found to be not very conclusive

(task T149806)   Erledigt

  • Second A/B test will be run, after fixing a minor UI bug and adding four more Wikipedias to test on, for a total of eight.

(task T160004)   Teilweise abgeschlossen

Fourth

April - June 2017:

  • wrap up analysis of the second A/B test for the sister projects snippets in the search results page

(task T160008)   Teilweise abgeschlossen

  • release translated note to Village Pumps announcing the production deployment

(task T162276)   In Arbeit

  • release blog post about search
  • release into production on all Wikipedias

Aktuelle Suchbeispiele

There are already a few community-led solutions to provide additional discovery of other Wikimedia projects and articles in the same language. Hier ist eine kleine Sammlung an Beispielen:

Current search results pages for a few language wikis:

External Search Gadget:

Wie könnten diese zusätzlichen Suchergebnisse angezeigt werden?

The appearance of search results is open for discussion and we have some rough drafts for you to look at below with more design possibilities on Design. Here are a few examples of what a new search results page could look like based on existing solutions on other language wikis:

Help us choose the solution

Please provide your feedback now!

  • Two quarters are needed, at a minimum, to architect and design the technical implementation.
  • The team would like to have something to test and to show to the community sometime in late 2016.

Die Fragen

The team has many questions and this is what we'd like to request feedback on from the community:

    1. Should the results from whatever wiki you're on to be shown first and then have an option to show more from other wikis?
    1. Should the additional results be inter-mixed with the local wiki results?
    1. Should the additional results be displayed off to the side (or maybe the bottom) of the results page?
    1. Should we have the option to turn off these other relevant search results (a user and/or project opt-out)?
      • This could be a keyword search term or maybe a button for a visitor to click
      • This could also be similar to the local: keyword that will only search for images on the local wiki and not Commons files, for instance.
    1. Would the additional results be best displayed as a list or a grid design?
    1. Should we include relevant metadata (images and/or a short description) with the search results?
    1. Do the results need to have the size of the article (i.e.: 848 bytes (104 words)) and the date it was created/modified?
    1. Should we indicate that clicking on a result will take you to another wiki project?
    1. How many results from other wikis should we show - 1, 2, 3, or more?
    1. Should we limit the existing method of displaying results from the wiki that you searched on?
      • We currently show up to 10,000 results in a paginated manner, but testing shows that generally only the first 3 results are ever acted upon.
  1. Do we want these new search results to work across all Wikimedia projects?
    1. For example, if I'm on Wikiquote, do I want to also see relevant search results from Wikivoyage, Wikipedia or Wikinews?
    2. Or, if I'm on Wikipedia, just show me results from other projects?
  2. Would these other relevant search results be useful and encourage deeper exploration into various topics?
    1. Is it annoying to see the other wiki search results?
    2. Conversely, does it encourage a user to discover more knowledge?
    3. How much weight do we give results from other wiki projects in the results?
  1. Will the display of the additional search results from other wikis encourage contributions from editors?
    1. i.e.: if you search for Piazza del Duomo and don't see a Wikivoyage article about it (while I'm searching on Wikiquote), would that encourage you to start an article for it?
  1. Should we limit the amount of languages we search in?
    1. i.e.: only use the top 50 languages to implement this in?
    2. Or, only use the languages that we are detecting queries in an other language than the wiki the user is on?

See also: Explore similar, Wiktionary widget, thumbnail icons in search results

Phabricator-Tickets:

Discussion notes:

After taking into account community feedback and design team recommendations, we'll start A/B testing soon. View this page for more information.

This page was created to encourage users to do their own testing, via a self-guided testing page with examples for those not-so-technical and those that have a Wikipedia account and are a little more experienced.