Mercurial > hg-website

view static/robots.txt @ 423:f64038540cc9 martin-devision-bg/link-to-quick-start-in-the-easy-to-use-s-1425244320970

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Link to "Quick Start" in the "Easy to use" section does not work with the trailing slash :]
author Martin Georgiev <martin@devision.bg>
date Sun, 01 Mar 2015 21:12:03 +0000
parents 4dfad479ee98
children
line wrap: on
line source

User-agent: *
Crawl-delay: 100
Disallow: /hg
Disallow: /repo
Disallow: /bts/issue?

User-agent: geniebot
Disallow: /

User-agent: ShopWiki
Disallow: /

User-agent: DotBot
Disallow: /