1
0
Fork 0
mirror of https://github.com/seanmorley15/AdventureLog.git synced 2025-07-22 14:29:36 +02:00
AdventureLog/frontend/static/robots.txt
Sean Morley eddbda5443 robots
2024-07-15 19:41:58 -04:00

10 lines
No EOL
153 B
Text

User-agent: *
Allow: /
# Google adsbot ignores robots.txt unless specifically named!
User-agent: AdsBot-Google
Allow: /
User-agent: GPTBot
Disallow: /