Thread:User talk:^demon/Gerrit crawling/reply (5)

(Much later, but hey it's an update). After ditching gitweb for gitblit, blocking some badly behaving spiders, and generally improving this architecture, bots should be able to crawl gerrit.wm.o and git.wm.o now. Only exception is tars/zips of extensions, which make the gitblit server cry when you crawl them ;-)