Mercurial > hg-website

view static/robots.txt @ 415:b40d4f1881cf

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
say that the editor opens on commit and note how to avoid that.
author drak@kaverne
date Thu, 18 Sep 2014 10:55:08 +0200
parents 4dfad479ee98
children
line wrap: on
line source

User-agent: *
Crawl-delay: 100
Disallow: /hg
Disallow: /repo
Disallow: /bts/issue?

User-agent: geniebot
Disallow: /

User-agent: ShopWiki
Disallow: /

User-agent: DotBot
Disallow: /