Update robots.txt to allow only google bot by default

Allow only google bot by default.
deco-sites · May 16, 2024 · 0d7bb2f · 0d7bb2f
2 parents 3866219 + 11f428c
commit 0d7bb2f
Showing 1 changed file with 4 additions and 1 deletion.
diff --git a/static/robots.txt b/static/robots.txt
@@ -1,2 +1,5 @@
+User-agent: Googlebot
+Allow: /
+
 User-agent: *
-Allow: *
+Disallow: /