Twitter robots.txt fix
This commit is contained in:
@@ -1,3 +1,6 @@
|
||||
User-Agent: *
|
||||
Disallow: /
|
||||
Allow: /$
|
||||
|
||||
User-Agent: Twitterbot
|
||||
Allow: /
|
||||
|
||||
Reference in New Issue
Block a user