Translations:Manual:Robots.txt/28/en

An alternative or complementary strategy is to deploy a spider trap.