chore(robots): add ChatGPT-User + OAI-SearchBot + Applebot-Extended
All checks were successful
deploy / deploy (push) Successful in 1m18s
All checks were successful
deploy / deploy (push) Successful in 1m18s
This commit is contained in:
@@ -13,9 +13,18 @@ Host: https://anotherreflections.ru
|
|||||||
User-agent: GPTBot
|
User-agent: GPTBot
|
||||||
Allow: /
|
Allow: /
|
||||||
|
|
||||||
|
User-agent: ChatGPT-User
|
||||||
|
Allow: /
|
||||||
|
|
||||||
|
User-agent: OAI-SearchBot
|
||||||
|
Allow: /
|
||||||
|
|
||||||
User-agent: ClaudeBot
|
User-agent: ClaudeBot
|
||||||
Allow: /
|
Allow: /
|
||||||
|
|
||||||
|
User-agent: Applebot-Extended
|
||||||
|
Allow: /
|
||||||
|
|
||||||
User-agent: Google-Extended
|
User-agent: Google-Extended
|
||||||
Allow: /
|
Allow: /
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user