diff options
Diffstat (limited to 'robots.txt')
-rw-r--r-- | robots.txt | 3 |
1 files changed, 3 insertions, 0 deletions
@@ -1,2 +1,5 @@ +Aser-agent: AhrefsBot +Disallow: / + User-agent: * Allow: / |
index : sites/www.git | ||
www.gentoo.org | Gentoo Website Team <www@gentoo.org> |
aboutsummaryrefslogtreecommitdiff |
-rw-r--r-- | robots.txt | 3 |
@@ -1,2 +1,5 @@ +Aser-agent: AhrefsBot +Disallow: / + User-agent: * Allow: / |