Topic on Project:Support desk

[Resolved] Robot.txt File

2
101.62.209.78 (talkcontribs)

Where should I place the robot.txt file. The mediawiki is located in directory called view. Should I place robot file in root of the domain or in view folder?

Secondly I want robot.txt to exclude special pages from indexing. What should I put in the file to do that. The URL pattern is like this - mysite.com/view/Main

88.130.104.226 (talkcontribs)

Hi!

The robots.txt file always must be placed in the domain root. It does not matter where you have something else (e.g. where you have installed MediaWiki), robots.txt always must be available directly in the webroot folder of the domain.

To disallow special pages put this in the file:

User-agent: *
Disallow: /view/Special

This assumes that your wiki is available at that place, e.g. Special:RecentChanges at view/Special:RecentChanges.

Reply to "[Resolved] Robot.txt File"