Skip to content

Commit 9368f26

Browse files
jshasyphar
authored andcommitted
robots: also disallow %5E (urlencoded caret)
1 parent c1be79c commit 9368f26

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

static/robots.txt

+3
Original file line numberDiff line numberDiff line change
@@ -4,4 +4,7 @@ Sitemap: https://docs.rs/sitemap.xml
44
# https://docs.rs/about/redirections
55
User-Agent: *
66
Disallow: */^
7+
# %5E is '^', URL-encoded. Based on the Search Console, Google
8+
# may be encoding '^' before checking against robots.txt.
9+
Disallow: */%5E
710
Disallow: */~

0 commit comments

Comments
 (0)