annotate website/www/robots.txt @ 7131:efb2aa271256

Prefer use of real (gnu) tar apparently extractall() doesn't strip leading / etc from tarball. Even though the tarball should be in good form, use the safer alternative first.
author John Rouillard <rouilj@ieee.org>
date Mon, 30 Jan 2023 12:23:02 -0500
parents 5855a6a26bdd
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
6667
5855a6a26bdd Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
1 User-agent: *
5855a6a26bdd Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
2
5855a6a26bdd Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
3 Sitemap: https://www.roundup-tracker.org/sitemap.xml
5855a6a26bdd Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
4

Roundup Issue Tracker: http://roundup-tracker.org/