annotate website/www/robots.txt @ 7962:828f79ae965b

doc: update links and docs on checking links Add timeout for link checking so make linkcheck completes. Document grep command to use to filter broken links to external links. Fix PostgreSQL links to point to current pages. Fix pyreadline3 link. Fix vim po file plugin link Use wayback machine for zpi internationalization link.
author John Rouillard <rouilj@ieee.org>
date Mon, 13 May 2024 18:42:26 -0400
parents 5855a6a26bdd
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
6667
5855a6a26bdd Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
1 User-agent: *
5855a6a26bdd Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
2
5855a6a26bdd Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
3 Sitemap: https://www.roundup-tracker.org/sitemap.xml
5855a6a26bdd Add sitemap to docs. Also add robots.txt to advertize sitemap.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
4

Roundup Issue Tracker: http://roundup-tracker.org/