view website/www/robots.txt @ 7859:9a74dfeb8620

feat: can use escaped tokens inside quotes including quotes. Change tokenizer to support: cmd with arg "string with embedded \" double quote" works for single quotes too. Mixed quotes can skip the \" or \' escaping. Also: quoted cmds args "can include \n newline, \t tab and \r return" Added a doc example, also tests for new feature.
author John Rouillard <rouilj@ieee.org>
date Sat, 06 Apr 2024 20:37:45 -0400
parents 5855a6a26bdd
children
line wrap: on
line source

User-agent: *

Sitemap: https://www.roundup-tracker.org/sitemap.xml


Roundup Issue Tracker: http://roundup-tracker.org/