jp/www.byjp.me
1
0
Fork 0
mirror of https://github.com/by-jp/www.byjp.me.git synced 2025-08-09 22:16:07 +01:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

Use robots.txt template

Browse source
This commit is contained in:
JP Hastings-Spital 2023-08-19 19:52:30 +01:00
parent ce5d50539e
commit b7e9b3cf17
2 changed files with 4 additions and 7 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
layouts/robots.txt Normal file
View file

@ -0,0 +1,4 @@
Sitemap: {{"/sitemap.xml" | absURL}}
User-agent: GPTBot
Disallow: /

7
static/robots.txt
View file

@ -1,7 +0,0 @@
Sitemap: /sitemap.xml
User-agent: GPTBot
Disallow: /
User-Agent: DuckDuckBot
Allow: /