Mercurial > p > roundup > code

annotate website/www/robots.txt @ 8351:e775cd258763

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
docs: fix canonical link for www.roundup-tracker.org index page the index page canonical link was: https://www...org/index.html change the template so the canonical is set to https://www...org/ as that is how it's listed by crawlers.
author John Rouillard <rouilj@ieee.org>
date Wed, 02 Jul 2025 12:26:21 -0400
parents 5855a6a26bdd
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
6667
5855a6a26bdd Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
1 User-agent: *
5855a6a26bdd Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
2
5855a6a26bdd Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
3 Sitemap: https://www.roundup-tracker.org/sitemap.xml
5855a6a26bdd Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
4
Roundup Issue Tracker: http://roundup-tracker.org/