Twitter robots.txt fix
This commit is contained in:
@@ -1,3 +1,6 @@
|
|||||||
User-Agent: *
|
User-Agent: *
|
||||||
Disallow: /
|
Disallow: /
|
||||||
Allow: /$
|
Allow: /$
|
||||||
|
|
||||||
|
User-Agent: Twitterbot
|
||||||
|
Allow: /
|
||||||
|
|||||||
Reference in New Issue
Block a user