Browse Source

Add robots.txt to prevent indexing of dev installations

Laurent Destailleur 12 years ago
parent
commit
a08735d5be
1 changed files with 6 additions and 0 deletions
  1. 6 0
      robots.txt

+ 6 - 0
robots.txt

@@ -0,0 +1,6 @@
+User-agent: *
+Disallow: /build
+Disallow: /dev
+Disallow: /doc
+Disallow: /scripts
+Disallow: /test