Help:CirrusSearch

From MediaWiki.org
Jump to: navigation, search
This page is a translated version of the page Help:CirrusSearch and the translation is 17% complete.

Other languages:
العربية • ‎বাংলা • ‎català • ‎čeština • ‎Deutsch • ‎Zazaki • ‎Ελληνικά • ‎English • ‎Esperanto • ‎español • ‎فارسی • ‎suomi • ‎français • ‎עברית • ‎magyar • ‎Bahasa Indonesia • ‎italiano • ‎日本語 • ‎한국어 • ‎Lëtzebuergesch • ‎македонски • ‎Nederlands • ‎occitan • ‎polski • ‎پښتو • ‎português • ‎português do Brasil • ‎русский • ‎shqip • ‎Basa Sunda • ‎svenska • ‎தமிழ் • ‎Türkçe • ‎ئۇيغۇرچە • ‎українська • ‎ייִדיש • ‎中文

Самый быстрый способ найти информацию в проектах Викимедиа — поискать её напрямую. На каждой странице есть поле «поиск».

CirrusSearch — это расширение MediaWiki, использующее Elasticsearch для предоставления расширенных возможностей поиска по сравнению с базовой функциональностью поиска в MediaWiki. Фонд Викимедиа использует CirrusSearch во всех проектах Викимедиа. Эта страница описывает возможности CirrusSearch. Если вашего вопроса здесь нет, не стесняйтесь задать его на странице обсуждения, и кто-нибудь обязательно ответит вам.

Информацию о расширении MediaWiki можно найти по ссылке Extension:CirrusSearch.

Как это работает[edit]

Enter key words and phrases and press Enter or Return on your keyboard. Or click the magnifying glass icon, Search, or Go button. If a page has the same title as what you entered (or you use the Go button) you will be directed to that page. Otherwise, it searches all pages on the wiki, and presents a list of articles that matched your search terms, or a message informing you that no page has all the key words and phrases.

If you click the "Найти" button without filling in anything, you will be taken to "Special:Search" which gives you extra searching options (also available from any search results list)

You may find it useful to restrict a search to pages within a particular namespace e.g., only search within the User pages. Check the namespaces you require for this search.

By default only the namespaces specified in your preferences will be searched. Logged-in users can change their preferences to specify the namespaces they want to search by default. This can be done by selecting and deselecting boxes in the ”search” section of user preferences.

Что улучшено?[edit]

Поисковой движок CirrusSearch включает три главных улучшения по сравнению с базовой функциональностью MediaWiki:

  • Лучшая поддержка поиска на разных языках.
  • Более быстрые обновления поискового индекса, что означает, что изменения в статьях будут отображаться в поиске намного скорее.
  • Раскрывающиеся шаблоны: всё содержание, подставляемое из шаблона, будет отображено в результатах поиска.

Как часто обновляется поисковый индекс?[edit]

Обновления поискового индекса происходят практически в реальном времени. Изменения в страницах должны попадать в поисковый индекс сразу же после их внесения. Правки шаблонов должны отражаться в статьях, куда эти шаблоны включены, уже спустя несколько минут. Однако обработка изменений в шаблонах связана с длиной очереди задач, производительность которой может варьироваться. Нулевая правка в статье позволяет обойти очередь, но в ней нет необходимости, если всё работает нормально.

Поисковые подсказки[edit]

Вводя запрос в окно поиска, вы видите выпадающий список «поисковых подсказок» — статей, названия которых начинаются с введённой вами фразы; список отсортирован, исходя из грубой оценки качества этих статей. При этом учитывается количество вики-ссылок и перенаправлений, ссылающихся на статью, размер страницы, количество внешних ссылок, количество заголовков. Поисковые подсказки можно пропустить, и запросы будут отправляться непосредственно на страницу результатов поиска. Добавьте тильду ~ перед запросом. Пример — «~Фрида Кало». Поисковые подсказки по-прежнему появятся, но в любой момент нажатие клавиши «Ввод» приведёт вас к странице результатов поиска. Символы ASCII, надстрочные и подстрочные знаки для английского текста включены, однако при этом возможны проблемы с форматированием результатов поиска (см. задача T54656).

Полнотекстовый поиск[edit]

«Полнотекстовый поиск» (тот, что приводит на страницу результатов) осуществляется на основании т.н. «поискового индекса». Все вики-страницы хранятся в базе данных вики-сайта, и все слова в них включены в специальную поисковую базу данных, содержащую указатели на полные тексты статей. Каждое видимое слово индексируется в список страниц, где оно встречается, поэтому поиск по слову в тексте происходит так же быстро, как поиск конкретного названия страницы.[1] Furthermore, for any changes in wording, the search index is updated within seconds.

There are many indexes of the "full text" of the wiki to facilitate the many types of searches needed. The full wikitext is indexed many times into many special-purpose indexes, each parsing the wikitext in whatever way optimizes their use. Example indexes include:

  • "auxiliary" text, includes hatnotes, captions, ToC, and any wikitext classed by an HTML attribute class=searchaux.
  • "Lead-in" text is the wikitext between the top of the page and the first heading.
  • The "category" text indexes the listings at the bottom.
  • Templates are indexed. If the transcluded words of a template change, then all the pages that transclude it are updated. (This can take a long time depending on a job queue.) If the subtemplates used by a template change, the index is updated.
  • Document contents that are stored in the File/Media namespace are now indexed. Thousands of formats are recognized.

Реализована поддержка для десятков языков, но желательна поддержка всех языков. Список поддерживаемых языков: elasticsearch.org; чтобы отправить запрос или правку, смотрите документацию о вкладе в проект.

CirrusSearch will optimize your query, and run it. The resulting titles are weighted by relevance, and heavily post-processed, 20 at a time, for the search results page. For example snippets are garnered from the article, and search terms are highlighted in bold text.

Search results will often be accompanied by various preliminary reports. These include Did you mean (spelling correction), and, when no results would otherwise be found it will say Showing results for (query correction) and search instead for (your query).

Ещё некоторые возможности страницы поиска:

  • sorting navigation suggestions by the number of incoming links.
  • Starting with the tilde character ~ to disable navigation and suggestions in such a way that also preserves page ranking.
  • Smart-matching characters by normalizing (or "folding") non-keyboard characters into keyboard characters.* Words and phrases that match are highlighted in bold on the search results page. The highlighter is a cosmetic analyzer, while the search-indexing analyzer actually finds the page, and these may not be 100% in sync, especially for regex. The highlighter can match more or less accurately than the indexer.

Слова, фразы и поисковые модификаторы[edit]

The basic search term is a word or a "phrase in quotes". Search recognizes a "word" to be:

  • a string of digits
  • a string of letters
  • subwords between letters/digit transitions, such as in txt2regex
  • subwords inside a compoundName using camelCase

A "stop word" is a word that is ignored (because it is common, or for other reasons).[2] A given search term matches against content (rendered on the page). To match against wikitext instead, use the insource search parameter (See section below). Each search parameter has its own index, and interpret its given term in its own way.[3]

Spacing between words, phrases, parameters, and input to parameters, can include generous instances of whitespace and greyspace characters. "Greyspace characters" are all the non-alphanumeric characters ~!@#$%^&*()_+-={}|[]\:";'<>?,./. A mixed string of greyspace characters and whitespace characters, is "greyspace", and is treated as one big word boundary. Greyspace is how indexes are made and queries are interpreted.[4]

Two exceptions are where 1) an embedded:colon is one word (it being treated as a letter), and 2) an embedded comma , such as in 1,2,3, is treated as a number. Greyspace characters are otherwise ignored unless, due to query syntax, they can be interpreted as modifier characters.

The modifiers are ~ * \? - " ! . Depending on their placement in the syntax they can apply to a term, a parameter, or to an entire query. Word and phrase modifiers are the wildcard, proximity, and fuzzy searches. Each parameter can have their own modifiers, but in general:

  • A fuzzy-word or fuzzy-phrase search can suffix a tilde ~ character (and a number telling the degree).
  • A tilde ~ character prefixed to the first term of a query guarantees search results instead of any possible navigation.
  • A wildcard character inside a word can be a (escaped) question \? mark for one character or an asterisk * character for more.
  • Truth-logic can interpret AND and OR, but parameters cannot.
  • Truth-logic understands - or ! prefixed to a term to invert the usual meaning of the term from "match" to "exclude".
  • Quotes around words mark an "exact phrase" search. For parameters they are also needed to delimit multi-word input.
  • Stemming is automatic but can be turned off using an "exact phrase".
The two wildcard characters are the star and the (escaped) question mark, and both can come in the middle or end of a word. The escaped question mark \? stands for one character and the star * stands for any number of characters. Because many users, instead of writing a query, will ask a question, any question mark is ignored unless purposefully escaped \? into its wildcard meaning.

A phrase search can be initiated by various hints to the search engine. Each method of hinting has a side-effect of how tolerant the matching of the word sequence will be. For greyspace, camelCase, or txt2number hints:

  • given words-joined_by_greyspace(characters) or wordsJoinedByCamelCaseCharacters it finds words joined by ... characters, in their bare forms or greyspace forms.
  • txt2number will match txt 2 number or txt-2.number.
  • Stop words are enabled for the edge cases (in the periphery) of a grey_space or camelCase phrase. An example using the, of, and a is that the_invisible_hand_of_a matches meetings invisible hand shake.

A "search instead" report is triggered when a universally unknown word is ignored in a phrase.

Each one of the following types of phrase-matching contains and widens the match-tolerances of the previous one:

  • An "exact phrase" "in quotes" will tolerate (match with) greyspace. Given "exact_phrase" or "exact phrase" it matches "exact]phrase".
  • A greyspace_phrase initiates stemming and stop word checks.
  • Given CamelCase it will additionally match camelcase, in all lowercase, because CirrusSearch is not case sensitive in matching.

Page ranking saves you from typing quotes for a two-word search. With no quotes a word-pair index is used in page-ranking, plus it finds the two words anywhere on the page.

Some parameters interpret greyspace phrases, but other parameters, like insource only interpret the usual "phrase in quotes".

In search terminology, support for "stemming" means that a search for "swim" will also include "swimming" and "swimmed", but not "swam".
Search phrase parserfunction parserFunction parser function parser-function parser:function parSer:funcTion
parserfunction N N N N
"parser function" N N N N
parser_function N N N
parserFunction N N
"parser:function" N N N N
"parser_function" N N N N
"parSer_funcTion" N N N N
parSer_FuncTion N N

Note that all stemming is case insensitive.

Note how the "exact phrase" search interpreted the embedded:colon character as a letter, but not the embedded_underscore character. A similar event occurs with the comma , character inside a number.

Given in:this:word, CirrusSearch, when in an "exact phrase" context, (which includes the insource parameter context), will not match in, this, or word, but will then only match in:this:word.

Otherwise, remember that for CirrusSearch words are letters, numbers, or a combination of the two, and case does not matter.

The common word search employs the space character and is aggressive with stemming, and when the same words are joined by greyspace characters or camelCase they are aggressive with phrases and subwords.

When common words like "of" or "the" are included in a greyspace-phrase, they are ignored, so as to match more aggressively.

A greyspace_phrase search term, or a camelCase, or a txt2number term, match the signified words interchangeably. You can use any of those three forms.[5] Now camelcase matches camelCase because Search is not case sensitive, but camelCase matches camelcase because camelCase is more aggressive. Like the rest of Search, subword "words" are not case-sensitive. By comparison the "exact phrase" is greyspace oriented and ignores numeric or letter-case transitions, and stemming. "Quoted phrases" are not case sensitive.

From the table we can surmise that the basic search parser_function -"parser function" is the sum of the basic searches parserFunction and parse<stems> function<stems>.

Making inquiries with numbers, we would find that:

  • Plan9 or Plan_9 matches any of: plan9, plans 9, planned 9th, (planned) 9.2, "plans" (9:24)
  • "plan9" only matches plan9 (case insensitive)
  • Plan*9 matches plan9 or planet4589.

The star * wildcard matches a string of letters and digits within a rendered word, but never the beginning character. One or more characters, a percentage of the word, must precede the * character.

  • If the leading part is only letters then it will limit a match to a string of (zero of more) letters.
  • If only numbers, then it will limit a match to a sequence of (zero or more) numbers, including also ordinal letters (st, nd, rd), capital letters, or time abbreviations (am or pm); and it will match the entirety of (both sides of) a decimal numbers.
  • Otherwise the comma is considered part of one number, but the decimal point is considered a greyspace character, and will delimit two numbers.
  • Inside an "exact phrase" it matches stemming plus compounding.

The \? wildcard represents one letter or number; The *\? is also accepted, but \?* is not recognized.

The wildcards are for basic word, phrase, and insource searches, and may also be an alternative to (some) advanced regex searches (covered later).

Putting a tilde ~ character after a word or phrase activates a fuzzy search.

  • For a phrase it is termed a proximity search, because proximal words are tolerated to an approximate rather than exact phrase.
  • For example, "exact one two phrase"~2 matches exact phrase.
  • For a word it means extra characters or changed characters.
  • For a phrase a fuzzy search requires a whole number telling it how many extra words to fit in, but for a word a fuzzy search can have a decimal fraction, defaulting to word~0.5 (word~.5), where at most two letters can be found swapped, changed, or added, but never the first two letters.
  • For a proximity phrase, a large number can be used, but that is an "expensive" (slow) search.
  • For a word word~.1 is most fuzzy, and word~.9 is least fuzzy, and word~1 is not fuzzy at all.
flowers algernon Flowers for Algernon flowers are for Algernon Flowers a1 2b 3c 4f 5j 6l 7j 8p q9 z10 for Algernon
"flowers algernon" YesY N N N
"flowers algernon"~0 YesY N N N
"flowers algernon"~1 YesY YesY N N
"flowers algernon"~2 YesY YesY YesY N
"flowers algernon"~11 YesY YesY YesY YesY
"algernon flowers"~1 N N N N
"algernon flowers"~2 YesY N N N
"algernon flowers"~3 YesY YesY N N
"algernon flowers"~4 YesY YesY YesY N
"algernon flowers"~13 YesY YesY YesY YesY

For the closeness value necessary to match in reverse (right to left) order, count and discard all the extra words, then add twice the total count of remaining words minus one. (In other words, add twice the number of segments). For the full proximity algorithm, see Elasticsearch slop. An explicit AND is required between two phrases because otherwise the two "inner" "quotation marks" are confused. Кавычки предполагают точное соответствие запросу (то есть отключают дополнение по словоформам - т.н. «стемминг»); добавление тильды ("but appending"~) включает стемминг снова.

flowers flower Flowers for Algernon flower for Algernon
flowers YesY YesY YesY YesY Stemming is in effect.
"flowers" YesY N YesY N Proximity search turns off stemming.
"flowers"~ YesY YesY YesY YesY Proximity plus stemming by suffixing a tilde.
"flowers for algernon" N N YesY N Proximity search turns off stemming.
flowers for algernon"~ N N YesY YesY Proximity plus stemming by suffixing a tilde.
"flowers algernon"~1 N N YesY N Proximity search turns off stemming.
"flowers algernon"~1~ N N YesY YesY Proximity plus stemming by suffixing a tilde.

Insource[edit]

1.24
Gerrit change 137733

Insource searches can be used to find any one word rendered on a page, but it's made for finding any phrase you might find - including MediaWiki markup. This phrase completely ignores greyspace: insource: "state state autocollapse" matches |state={{{state|autocollapse}}}.

insource: word
insource: "word1 word2"

Greyspace characters are ignored, just as they are with word searches and exact-phrase searches.

insource:/regexp/
insource:/regexp/i

These are regular expressions. They aren't efficient, so we can only allow a few at a time on the search cluster, but they are very powerful. The version with the extra i runs the expression case-insensitive, and is even less efficient.

Insource complements itself. On the one hand it has full text search for any word in the wikitext, instantly. On the other hand it can process a regexp search for any string of characters.[6] Regex scan all the textual characters in a given list of pages; they don't have a word index to speed things up, and the process is interrupted if it must run more than twenty seconds. Regex run last, so to limit needless character-level scanning, you advance it a list of pages (a search domain) selected by an indexed search added to the query as a "clause", and you do this to every single regex query.[7]. Insource can play both roles, and the best candidate for insource:/arg/ is often insource: arg, where arg is the same.

The syntax for the regexp is insource: no space, and then /regexp/. (No other parameter disallows a space. All the parameters except insource:/regexp/ generously accept space after their colon.)

Insource indexed-search and regexp-search roles are similar in many respects:

  • Both search wikitext only.
  • Neither finds things "sourced" by a transclusion.
  • Neither does stemmed, fuzzy, or proximity searches.
  • Both want the fewest results, and both work faster when accompanied by another clause.

But indexed searches all ignore greyspace; wildcards searches do not match greyspace, so regex are the only way to find an exact string of any and all characters, for example a sequence of two spaces. Regex are an entirely different class of search tool that make matching a literal string easy (basic, beginner use), and make matching by metacharacter expressions possible (advanced use) on the wiki. See #Regular expression searches below.

The insource parameter treats words with embedded colons as one word. This affects search queries for templates, parser functions, URLs, wikilinks, HTML tags, and comments.
When possible, please avoid running a bare regexp search. See how this is always possible at #Regular expression searches, below.

Префикс и пространство имён[edit]

For Search, a namespace term functions to specify the initial search domain. Instead of searching the entire wiki, the default is the main namespace (mainspace).

Only one namespace name can be set from the search box query. It is either the first term or in the last term, in a prefix parameter.

Two or more namespaces may be searched from the Advanced pane of the search bar found on the top of every search results page, Special:Search. Your search domain, as a profile of namespaces, can be set here (without going to the user preferences page). The namespaces list will then present itself on the first page of future search results to indicate the search domain of the search results. To unset this, select the default namespace (shown in parentheses), select "Remember", and press Search.

The search bar graphically sets and indicates a search domain. "Content pages" (mainspace), "Multimedia" (File), "Everything" (all plus File), "Translations", etc., are hyperlinks that can activate the query in that domain, and then indicate this by going inactive (dark). But the query will override the search bar. When a namespace or prefix is used in the query the search bar activations and indications may be misleading, so the search bar and the search box are mutually exclusive (not complementary) ways to set the search domain.

A namespace term overrides the search bar, and a prefix term overrides a namespace.

Enter a namespace name, or enter all:, or enter a : colon for mainspace. All does not include the File namespace. File includes media content held at Commons such as PDF, which are all indexed and searchable. When File is involved, a namespace modifier local: has an effect, otherwise it is ignored. Namespace aliases are accepted.

talk: "Wind clock" Find pages in the Talk namespace whose title or text contains the phrase "wind clock".
file: "Wind clock" Find pages in File namespace, whose title, text, or media content contains the phrase "wind clock".
file: local: "Wind clock" Filter out results from Commons wiki.
local: "Wind clock" Ignored. Searches mainspace. Local is ignored unless File is involved.

As with search parameters, local and all must be lowercase. Namespaces names are case insensitive.

The prefix: parameter matches any number of first-characters of all pagenames in one namespace.[8] When the first letters match a namespace name and colon, the search domain changes. Given a namespace only, prefix will match all its pagenames. Given one character only, it cannot be - dash or ' quote or " double quote. The last character cannot be a colon. For pagenames that match, their subpage titles match by definition. The prefix parameter does not allow a space before a namespace, but allows whitespace before a pagename.

prefix:cow Find pages in mainspace whose title starts with the three letters c o w.
domestic   prefix:cow Find pages in mainspace whose title starts with the three letters c o w, and that contain the word "domestic".
domestic   prefix:cow List any existing subpages of Cow but only if they contain the word "domestic". This is a very common search and is frequently built using a special URL parameter called prefix=.
domestic   prefix:Talk:cow/ List any subpages of Talk:cow, but only if they contain the word "domestic".
1967   prefix:Pink Floyd/ List any subpages of Pink Floyd, but only if it also contains the word "1967".

The prefix parameter goes at the end so that pagename characters may contain " quotation marks.

The Translate extension creates a sort of "language namespace", of translated versions of a page. But unlike namespace or prefix, which create the initial search domain, the inlanguage parameter is a filter of it. (See the next section.)

Исключение материалов из поискового индекса[edit]

Content can be excluded from the search index by adding class="navigation-not-searchable". This will instruct CirrusSearch to ignore this content from the search index (see задача T162905 for more context).

Additionally content can be marked as auxiliary information by adding class="searchaux". This will instruct CirrusSearch to move the content from the main text to an auxiliary field which has lower importance for search and snippet highlighting. This distinction is used for items such as image thumbnail descriptions, 'see also' sections, etc.

Фильтры[edit]

A filter can have multiple instances, and negated instances, and it can run as a standalone filtering a search domain. A query is formed as terms that filter a search domain. A namespace or a prefix term is not a filter because a namespace will not run standalone, and a prefix will not negate.

Adding another word, phrase, or parameter filters more. A highly refined search result may have very many Y/N filters when every page in the results will be addressed. (In this case ranking is largely irrelevant.) Filtering applies critically to adding a regex term; you want as few pages as possible before adding a regex (because it can never have a prepared index for its search).

The search parameters below are filters.

Insource (covered above) is also a filter, but insource:/regexp/ is not a filter. Filters and all other search parameters are lowercase. (Namespaces are an exception, being case insensitive.)

«Intitle» и «incategory»[edit]

Word and phrase searches match in a title and match in the category box on bottom of the page. But with these parameters you can select titles only or category only.

  • cow*
    • Find articles whose title or text contains words that start with cow
  • intitle:foo
    • Находит страницы, заголовок которых содержит "foo" (с учётом производных).
  • intitle:"fine line"
    • Находит страницы, заголовок которых содержит "fine line" (без учёта производных).
  • intitle:foo bar
    • Находит страницы, заголовок которых содержит "foo" и при этом заголовок или текст содержат "bar".
  • -intitle:foo bar
    • Находит страницы, заголовок которых не содержит "foo" и заголовок или текст содержит "bar".
  • incategory:Music
    • Находит страницы, входящие в категорию Category:Music
  • incategory:"music history"
    • Находит страницы, входящие в категорию Category:Music_history
  • incategory:"musicals" incategory:"1920"
    • Находит страницы, входящие одновременно в категории Category:Musicals и Category:1920
  • -incategory:"musicals" incategory:"1920"
    • Находит страницы, которые входят в категорию Category:1920, но не входят в Category:Musicals

Intitle and incategory are old search parameters. Incategory no longer searches any subcategory automatically, but you can now add multiple category pagenames manually. To get the search parameter deepcat, to automatically add up to 70 subcategories onto an incategory parameter, incategory:category1|category2|...|category70,  you can add a line to your Custom JavaScript.[9]

Linksto[edit]

Linksto finds wikilinks to a given name, not links to content. The input is the canonical, case sensitive, page name. It must match the title line of the content page, exactly, before any title modifications of the letter-case. (It must match its {{FULLPAGENAME}}, e.g. Help:CirrusSearch/ru.)

Linksto does not find redirects. It only finds [[wikilinks]], even when they are made by a template. It does not find a link made by a URL, even if that URL is an internal wiki link.

To find all wikilinks to a "Help:Cirrus Search", if "Help:Searching" and "H:S" are redirects to it:

  1. linksto: "Help:Cirrus Search"
  2. linksto: Help:Searching
  3. linksto: H:S

CirrusSearch -linksto: Help:CirrusSearch finds articles that mention "CirrusSearch" but not in a wikilink.

Hastemplate[edit]

You can specify template usage with hastemplate: template. Input the canonical pagename to find all usage of the template, but use any of its redirect pagenames finds just that naming. Namespace aliases are accepted, capitalization is entirely ignored, and redirects are found, all in one name-search. (Compare boost-template no default namespace; linksto no namespace aliases, case-sensitive, no redirects; intitle no redirects.)

Hastemplate finds secondary (or meta-template) usage on a page: it searches the post-expansion inclusion. This is the same philosophy as for words and phrases from a template, but here it's for templates from a template. The page will be listed as having that content even though that content is not seen in the wikitext.

  • hastemplate: "quality image", finds "Template:Quality image" usage in your default search domain (namespaces).
  • : hastemplate: portal:contents/tocnavbar, finds mainspace usage of a "Contents/TOCnavbar" template in the Portal namespace.

For installations with the Translate extension, hastemplate searches get interference wherever Template:Translatable template name wraps the template name of a translatable template. Use insource instead.

Inlanguage[edit]

For installations with the Translate extension, inlanguage is important for highly refined searches and page counts.

inlanguage: language code

will produce search results in that language only.

For example

  • to count all Japanese pages on the wiki
all: inlanguage: ja
  • to filter out German and Spanish pages in the Help namespace
help: -inlanguage: de -inlanguage: es
  • to ignore Translate, and where English is the base language, add
inlanguage:en

Contentmodel[edit]

The contentmodel: keyword allows to limit the search to pages of a specific content model. For possible models cf. Content handlers. E.g.:

  • To see only JSON pages:
contentmodel:json

Вес страниц[edit]

Weighting determines snippet, suggestions, and page relevance. The normal weight is one. Additional weighting is given through multipliers.

If the query is just words, pages that match them in order are given a boost. If you add any explicit phrases to your search, or for certain other additions, this "prefer phrase" feature is not applied.

Morelike[edit]

  • morelike:page name 1|page name 2|...|page name n
    • Ищет статьи, текст которых содержит слова, похожие на текст заданных статей.
  • morelike:wasp|bee|ant
    • Find articles about stinging insects.
  • morelike:template:search|template:regex|template:usage
    • Find templates about regex searching for template usage on the wiki.

The morelike: query works by choosing a set of words in the input articles and run a query with the chosen words. You can tune the way it works by adding the following parameters to the search results URL:

  • cirrusMltMinDocFreq: Minimum number of documents (per shard) that need a term for it to be considered.
  • cirrusMltMaxDocFreq: Maximum number of documents (per shard) that have a term for it to be considered.
  • cirrusMltMaxQueryTerms: Maximum number of terms to be considered.
  • cirrusMltMinTermFreq: Minimum number of times the term appears in the input to doc to be considered. For small fields (title) this value should be 1.
  • cirrusMltMinWordLength: Minimal length of a term to be considered. Defaults to 0.
  • cirrusMltMaxWordLength: The maximum word length above which words will be ignored. Defaults to unbounded (0).
  • cirrusMltFields (comma separated list of values): These are the fields to use. Allowed fields are title, text, auxiliary_text, opening_text, headings and all.
  • cirrusMltUseFields (true|false): use only the field data. Defaults to false: the system will extract the content of the text field to build the query.
  • cirrusMltPercentTermsToMatch: The percentage of terms to match on. Defaults to 0.3 (30 percent).
  • Example: &cirrusMtlUseFields=yes&cirrusMltFields=title&cirrusMltMinTermFreq=1&cirrusMltMinDocFreq=1&cirrusMltMinWordLength=2

These settings can be made persistent by overriding cirrussearch-morelikethis-settings in Special:MyLanguage/Help:System message.

Prefer-recent[edit]

Adding prefer-recent: anywhere in the query gives recently edited articles a slightly larger than normal boost in the page-ranking rules.

It defaults to boost only 60% of the score, in a large, 160 day window of time, which can be entered in the query as prefer-recent:0.6,160. This plays well with other page ranking rules, and is intended for most searches.

You can manipulate the rules: prefer-recent:boost,recent Technically "boost" is the proportion of score to scale, and "recent" is the half life in days. The boost is more than the usual multiplier, it is an exponential boost. The factor used in the exponent is the time since the last edit.

For example

prefer-recent:,7

Pages older than 7 days are boosted half as much, and pages older than 14 days are boosted half as much again, and so on.

For a simple "sort by date" in highly refined search results, where page ranking and boosting are largely meaningless, just boost the entire score:

  • prefer-recent:1,7 (weeks)
  • prefer-recent:1,1 (days)
  • prefer-recent:1,0.0007 (minutes)
  • prefer-recent:1,0.0001 (8.64 seconds)
  • prefer-recent:1,0.00001 (seconds)

Boost-templates[edit]

Можно увеличить поисковую оценку страниц в зависимости от того, какие шаблоны они содержат. Это можно сделать прямо в поисковом запросе при помощи boost-templates:"" или установив умолчание для всех запросов через новое сообщение cirrussearch-boost-templates. boost-templates:"" заменяет содержимое cirrussearch-boost-templates, если оно было указано. Синтаксис слегка специфический, но выбран для наглядности. Несколько примеров:

File:boost-templates:"Template:Quality Image|200%" incategory:china
Ищет файлы в категории "Китай", сортируя качественные изображения в начало.
File:boost-templates:"Template:Quality Image|200% Template:Low Quality|50%" incategory:china
Ищет файлы в категории "Китай", сортируя высококачественные изображения в начало, а низкокачественные - в конец.
File:boost-templates:"Template:Quality Image|200% Template:Low Quality|50%" popcorn
Find files about popcorn sorting quality images first and low quality images last. Remember that through the use of the cirrussearch-boost-templates message this can be reduced to just popcorn.

Не пытайтесь добавлять десятичные дроби к процентным числам. Они не работают, а кроме того, поисковая оценка страниц устроена так, что они вряд ли на что-то повлияют.

A word of warning about cirrussearch-boost-templates: if you add really really big or small percentages they can poison the full text scoring. Think, for example, if enwiki boosted featured articles by a million percent. Then searches for terms mentioned in featured articles would find the featured articles before exact title matches of the terms. Phrase matching would be similarly blown away so a search like brave new world would find a featured article with those words scattered throughout it instead of the article for Brave New World.

Регулярные выражения для поиска[edit]

A basic indexed-search finds words rendered visible on a page. Hyphenation and punctuation marks and bracketing, slash and other math and computing symbols, are merely boundaries for the words. It is not possible to include them in an indexed search.

These return much much faster when you limit the regexp search-domain to the results of one or more index-based searches.

Warning: Do not run a bare insource:/regexp/ search. It will probably timeout after 20 seconds anyway, while blocking responsible users.

An "exact string" regexp search is a basic search; it will simply "quote" the entire regexp, or "backslash-escape" all non-alphanumeric characters in the string. All regexp searches also require that the user develop a simple filter to generate the search domain for the regex engine to search:

  • insource:"debian.reproducible.net" insource:/debian\.reproducible\.net/
  • insource:"c:\program files (x86)" insource:/C\:\\Program Files \(x86\)/i
  • insource:"<tag>{{template}}<tag>" insource:/"<tag>{{template}}<\/tag>"/
  • insource:"[[title|link label]]'s" insource:/"[[title|link label]]'s"/
  • insource:/regexp/ prefix:{{FULLPAGENAME}}

The last example works from a link on a page, but {{FULLPAGENAME}} doesn't function in the search box.

For example: [[Special:Search/insource:/regex/ prefix:{{FULLPAGENAME}}]] finds the term regex on this page.

A query with no namespace specified and no prefix specified searches your default search domain, (settable on any search-results page, i.e. at Special:Search). Some users keep their default search domain at "all namespaces", i.e. the entire wiki. On a large wiki if this user does a bare regexp search it will probably fail, incurring an HTML timeout, before completing the search.

A regex search actually scours each page in the search domain character-by character. By contrast, an indexed search actually queries a few records from a database separately maintained from the wiki database, and provides nearly instant results. So when using using an insource:// (a regexp of any kind), consider creating one the other search terms that will limit the regex search domain as much as possible. There are many search terms that use an index and so instantly provide a more refined search domain for the /regexp/. In order of general effectiveness:

  • insource:"" with quotation marks, duplicating the regexp except without the slashes or escape characters, is ideal.
  • intitle, incategory, and linksto are excellent filters.
  • hastemplate: is a very good filter.
  • "word1 word2 word3", with or without the quotation marks, are good.
  • namespace: is practically useless, but may enable a slow regexp search to complete.

To test a bare regexp query you can create a page with test patterns, and then use the prefix parameter with that fullpagename. The match will be highlighted. It searches that page (in the database) and its subpages.

Search terms that do not increase the efficiency of a regexp search are the page-scoring operators: morelike, boost-template, and prefer-recent.

Мета-символы[edit]

This section covers how to escape metacharacters used in rexexp searches For the actual meaning of the metacharacters see the explanation of the syntax. [10]

The use of an exact string requires a regexp, but the regexp term obligates the search to limit itself. Add a regexp term, never search a bare regexp. Start by noting the number of pages in a previous search before committing an exact string search. Querying with an exact string requires a filtered search domain.

Например:

  • to search a namespace, gauge the number of pages with a single term that is a namespace. This will list the number of pages in that namespace.
  • starting out to find again what you may have seen, like "wiki-link" or "(trans[in]clusion)" start with namespace and insource filters.

Refining with an exact string[edit]

  • refinining an ongoing search process with what you want to see, like "2 + 2 = 4", or "site.org" This is ideally the best use of regex, because it adds it as a single regexp term while refining a search, the limited number of pages the regexp must crawl is can be seen.

You can start out intending an exact string search, but keep in mind:

  • regex only search the wikitext not the rendered text, so there are some differences around the markup, and even the number of space characters must match precisely.
  • You are obligated to supply an accompanying filter.
  • You must learn how to escape regex metacharacters.

There are two ways to escape metacharacters. They are both useful at times, and sometimes concatenated side-by-side in the escaping of a string.

  • Backslash-escape one of them \char. The insource:/regexp/ uses slashes to delimit the regexp. Giving /reg/exp/ is ambiguous, so you must write /reg\/exp/.
  • Put a string of them in double quotes "string". Because escaping a character can't hurt, you can escape any character along with any possible metacharacters in there. Escaping with quotes is cleaner.
  • You can't mix methods, but you can concatenate them.

Double-quotes escaping using insource:/"regexp"/ is an easy way to search for many kinds of strings, but you can't backslash-escape anything inside a double-quoted escape.

  • /"[[page/name|{{temp-late"/ instead of /\[\[page\/name\|\{\{temp\-late/
  • /"literal back\slash"/ is as good as /literal back\/slash/
  • But /"This \" fails"/ always.
  • And /"This \/ depends"/. It finds the \/ literally, which is not the / you probably wanted.

Backslash-escape using insource:/regexp/ allows escaping the " and / delimiters, but requires taking into account metacharacters, and escaping any:

  • To match a / delimiter character use \/.
  • To match a " delimiter character use \".
  • The escaped metacharacters would be \~\@\#\&\*\(\)\-\+\{\}\[\]\|\<\>\?\.\\.
  • The equivalent expression escaped with double-quotes is "~@#&*()-+{}[]|\<>?.\".

The simplest algorithm to create the basic string-finding expression using insource:/"regexp"/, need not take metacharacters into account except for the " and / characters:

  1. Write the/str"ing out. (The /" delimiters "/ are not shown.)
  2. Replace " with "\"" (previous double-quote: stop, concatenate, quote restart).
  3. Replace / with "\/" (stop, concatenate, start).
  4. You get insource:/"the"\/"str"\""ing"/, showing concatenation of the two methods.
While refining a regexp on a search results page, keep in mind that the snippet "wikitext" has modified spacing. Regex are sensitive to space characters, so copying from snippets is dangerous.

The square-bracket notation for creating your own character-class also escapes its metacharacters. To target a literal right square bracket in your character-class pattern, it must be backslash escaped, otherwise it can be interpreted as the closing delimiter of the character-class pattern definition. The first position of a character class will also escape the right square bracket. Inside the delimiting square brackets of a character class, the dash character also has special meaning (range) but it too can be included literally in the class the same way as the right square bracket can. For example both of these patterns target a character that is either a dash or a right square bracket or a dot: [-.\]] or [].\-].

For general examples using metacharacters:

  • insource:"2+2=4" insource:/"2+2=4"/ matches "2 + 2 = 4", with zero spaces between the characters.
  • insource:"2 + 2 = 4" insource:/2 ?\+ ?2 ?= ?4\./ match with zero or one space in between. The equals = sign is not a metacharacter, but the plus + sign is.
  • insource:"<tag>[[link|2\3?]]\</tag>" insource:/"<tag>[[link|2\3?]]<"\/"tag>"/.

There are some notable differences from standard regex metacharacters:

  • The \n or \r\n are not reserved for matching a newline.
  • The dot . metacharacter stands for any character including a newline, so .* matches across lines.
  • The number # sign means something, and must be escaped.
  • The ^ and $ are not needed. Like "grep" (global per line, regular expression, print each line), each insource:// is a "global per document, regular expression, search-results-list each document" per document.
  • < and > support a multi-digit numeric range like [0-9] does, but without regard to the number of character positions, or the range in each position, so <9-10> works, and even <1-111> works.

Advanced example[edit]

For example, using metacharacters to find the usage of a template called Val having, inside the template call, an unnamed parameter containing a possibly signed, three to four digit number, possibly surrounded by space characters, AND on the same page, inside a template Val call, a named argumentfmt=commas having any allowable spaces around it, (it could be the same template call, or a separate one):

hastemplate:val insource:"fmt commas" insource:/\{\{val\|[^}]*fmt *= *commas/ insource:/\{val\| *[-+]?[0-9]{3,4} *[|}]/

Note that the = sign in "fmt commas" is not needed but that adding it would not change the search results. It is fast because it uses two filters so that every page the regexp crawls has the highest possible potential.

Гео-поиск[edit]

bounded[edit]

You can limit search to pages identified as being near some specified geographic coordinates. The coordinates can either be specified as a <lat>,<lon> pair, or by providing a page title from which to source the coordinates. A distance to limit the search to can be prepended if desired. Examples:

  • neartitle:"San Francisco"
  • neartitle:"100km,San Francisco"
  • nearcoord:37.77666667,-122.39
  • nearcoord:42km,37.77666667,-122.39

boosted[edit]

You can alternatively increase the score of pages within a specified geographic area. The syntax is the same as bounded search, but with boost- prepended to the keyword. This effectively doubles the score for pages within the search range, giving a better chance for nearby search results to be near the top.

  • boost-neartitle:"San Francisco"
  • boost-neartitle:"100km,San Francisco"
  • boost-nearcoord:37.77666667,-122.39
  • boost-nearcoord:42km,37.77666667,-122.39

Поиск свойств файлов[edit]

1.28
Gerrit change 311061

Since MediaWiki 1.28, CirrusSearch supports indexing and searching of properties of files in the File: namespace. This includes:

  • file media type
  • MIME type
  • size
  • width & height
  • resolution
  • bit depth for files that support these
While these predicates are useful only for files, they by themselves do not limit search to File: namespace. It is recommended to include this namespace in a search or restrict the search to only this namespace when using these conditionals.

filetype[edit]

Searching for file type allows to retrieve files according to their classification, such as office documents, videos, raster images, vector images, etc. The following types currently exist:

  • UNKNOWN
  • BITMAP
  • DRAWING
  • AUDIO
  • VIDEO
  • MULTIMEDIA
  • OFFICE
  • TEXT
  • EXECUTABLE
  • ARCHIVE

This list may be extended in the future. See also MEDIATYPE_* constants in Defines.php.

The syntax of the search is: filetype:{type}. Example:

filetype:video - looks for all videos

The filetype search is not case-sensitive.

filemime[edit]

Matches file MIME type. The syntax is:

filemime:{MIMEtype} - look for files of this MIME type

The argument can be quoted to specify exact match. Without quotes, partial matches to components of MIME type will be accepted too.

Examples:

filemime:"image/png" - look for files with MIME type exactly image/png

filemime:pdf - look for all PDF documents

The MIME type search is not case sensitive.

filesize[edit]

Search for file of given size, in kilobytes (kilobyte means 1024 bytes). The syntax is:

filesize:{number} or filesize:>{number} - file with size at least given number

filesize:<{number} - file with size no more than given number

filesize:{number},{number} - file with size between given numbers

Examples:

filesize:>20 or filesize:20 - files 20KB and bigger

filesize:<1024 - files smaller than 1MB

filesize:100,500 - files with sizes between 100KB and 500KB

Параметры файлов[edit]

It is possible to search for specific file measures: width, height, resolution (which is defined as square root of height × width), and bit depth. Not all files may have these properties. The syntax is:

{measure}:{number} - file with measure that equals to given number

{measure}:>{number} - file with measure that is at least given number

{measure}:<{number} - file with measure that is no more than given number

{measure}:{number},{number} - file with measure that is between given numbers

Where measure can be:

filew or filewidth - file width

fileh or fileheight - file height

fileres - file resolution (see above)

filebits - file bit depth

Examples:

filew:>800 fileh:>600 - files that are at least 800x600 pixels in size

filebits:16 - files with 16-bit color depth

fileheight:100,500 - file between 100 and 500 pixels high

Результаты поиска в других вики-проектах («кросс-вики»)[edit]

The search on Wikimedia projects includes improved cross-wiki search results (also known as interwiki search results, sister projects search results).

См. также[edit]

Внешние ссылки[edit]

Примечания и комментарии[edit]

  1. Note that the tagline is not part of the actual content. To see the searchable content for a page append ?action=cirrusdump to the URL.
  2. Stop words are rarely called for in CirrusSearch, except for when they are in certain kinds of phrases, as explained below.
  3. CirrusSearch parameters do not use a consistent way to handle these search terms.
  4. The same analyzer used to index the wikitext is also used to interpret the query.
  5. For example, common terms on this wiki, MediaWiki.org, are, redundantly, (searched):
    • udp2log OR udp2log2
    • html2wt OR wt2html
    • log2ip OR ip2log
    There's test2wiki, wiki2xml, wiki2dict, apache2handler, apache2ctl, etc.
  6. CirrusSearch regex do not address the newline character directly, but a dot . will match a newline.
  7. A wallowing regex search cannot disable Search, but can disable another's regex search.
  8. Prefix does not match on first-characters of fullpagenames, so you cannot search two namespaces at once just because they start with the same letters, such as both namespace and namespace talk in one query.
  9. Edit your Custom JavaScript, and add
    mw.loader.load( "//de.wikipedia.org/wiki/MediaWiki:Gadget-DeepCat.js&action=raw&ctype=text/javascript" );
    See задача T37402.
  10. For the formal definition see the Lucene grammar for regular expressions.