Manual:Robot policy

Robot policy is used to tell web crawlers and other tools what to exclude.

Configuration settings

 * $wgArticleRobotPolicies - Allow customisation of robot policies on a per-article basis.
 * $wgDefaultRobotPolicy - Default robot exclusion policy for the wiki.
 * $wgExemptFromUserRobotsControl - An array of namespace keys in which the __INDEX__/__NOINDEX__ magic words will not function.
 * $wgNamespaceRobotPolicies - Allow customisation of robot policies on a per-namespace basis.