Mercurial > p > roundup > code
annotate website/www/robots.txt @ 7701:5a35cfee727a
doc: use 'TEST-NET' IPv4 or IPv6 IP address ranges from RFC 6890
Replace ip examples with test doc ip addresses for any address not in
127.0.0.1 or 0.0.0.0.
| author | John Rouillard <rouilj@ieee.org> |
|---|---|
| date | Tue, 14 Nov 2023 16:53:56 -0500 |
| parents | 5855a6a26bdd |
| children |
| rev | line source |
|---|---|
|
6667
5855a6a26bdd
Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
1 User-agent: * |
|
5855a6a26bdd
Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
2 |
|
5855a6a26bdd
Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
3 Sitemap: https://www.roundup-tracker.org/sitemap.xml |
|
5855a6a26bdd
Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff
changeset
|
4 |
