Skip to content

Commit

Permalink
Browse files Browse the repository at this point in the history
block robots from searching based on size of results, they should jus…
…t use defaults
  • Loading branch information
ranguard committed Nov 19, 2016
1 parent 1f25d3a commit 91f635f
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions root/robots.txt
Expand Up @@ -6,5 +6,8 @@ Disallow: /diff/
Disallow: /source/
Disallow: /raw/

# Do not allow changing the default per page as is not useful
Disallow: /*?*size=*

Sitemap: https://metacpan.org/static/sitemaps/authors.xml.gz
Sitemap: https://metacpan.org/static/sitemaps/releases.xml.gz

0 comments on commit 91f635f

Please sign in to comment.