Mercurial > p > roundup > code

annotate website/www/robots.txt @ 7134:7109cdf8fef4

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Do not hyperlink some exampe url's. The example url's should not be hyperlinked. They show up as dead links in ahrefs etc. Make linkcheck report them if they show up again.
author John Rouillard <rouilj@ieee.org>
date Wed, 15 Feb 2023 10:44:14 -0500
parents 5855a6a26bdd
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
6667
5855a6a26bdd Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
1 User-agent: *
5855a6a26bdd Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
2
5855a6a26bdd Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
3 Sitemap: https://www.roundup-tracker.org/sitemap.xml
5855a6a26bdd Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
4
Roundup Issue Tracker: http://roundup-tracker.org/