1
0
Fork 0
mirror of https://github.com/seanmorley15/AdventureLog.git synced 2025-08-04 20:55:19 +02:00

SEO Optimization

This commit is contained in:
Sean Morley 2024-04-20 01:17:34 +00:00
parent 348c545419
commit 7086877ba3
11 changed files with 232 additions and 148 deletions

10
static/robots.txt Normal file
View file

@ -0,0 +1,10 @@
User-agent: *
Allow: /
# Google adsbot ignores robots.txt unless specifically named!
User-agent: AdsBot-Google
Allow: /
User-agent: GPTBot
Disallow: /