Translations:Manual:Robots.txt/13/en

If you are not using, restricting robots is a bit harder. If you are running PHP as CGI and you have not beautified URLs, so that articles are accessible through $query: