Disallow /raw in robots.txt

for good measure. Not sure you can reach it other than from /source (which is already disallowed).
metacpan · Feb 12, 2015 · a327e0c · a327e0c
1 parent 66ad31d
commit a327e0c
Showing 1 changed file with 1 addition and 0 deletions.
diff --git a/root/robots.txt b/root/robots.txt
@@ -4,6 +4,7 @@ User-agent: *
 Disallow: /login/
 Disallow: /diff/
 Disallow: /source/
+Disallow: /raw/
 
 Sitemap: https://metacpan.org/static/sitemaps/authors.xml.gz
 Sitemap: https://metacpan.org/static/sitemaps/releases.xml.gz