Mercurial > hg-website

view static/robots.txt @ 493:5284da57c604 default tip

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
display needed flag option to send patch for the website
author "Stephane" <stephane@yaal.fr>
date Mon, 26 Oct 2020 14:55:33 +0100
parents 4dfad479ee98
children
line wrap: on
line source

User-agent: *
Crawl-delay: 100
Disallow: /hg
Disallow: /repo
Disallow: /bts/issue?

User-agent: geniebot
Disallow: /

User-agent: ShopWiki
Disallow: /

User-agent: DotBot
Disallow: /