Added non-standard but desirable robots.txt

cc-ru · Dec 16, 2011 · 14a2338 · 14a2338
1 parent 44f7ab3
commit 14a2338
Showing 1 changed file with 3 additions and 2 deletions.
diff --git a/static/robots.txt b/static/robots.txt
@@ -1,3 +1,4 @@
 User-agent: *
-Allow: /about
-Disallow: /
+Disallow: /*
+Allow: /?okparam=
+Allow: /$