Initial commit

This commit is contained in:
2025-04-17 11:56:15 +03:00
commit 92a528b03b
28 changed files with 767 additions and 0 deletions

14
content/common/robots.txt Normal file
View File

@@ -0,0 +1,14 @@
User-agent: *
Allow: /
User-agent: GPTBot
Disallow: /
User-agent: ChatGPT-User
Disallow: /
User-agent: anthropic-ai
Disallow: /
User-agent: Google-Extended
Disallow: /