Exclude Apple’s AI training in robots.txt

See: https://support.apple.com/en-us/119829#datausage
This commit is contained in:
JP Hastings-Edrei 2024-06-25 08:40:27 +01:00 committed by GitHub
parent 2c41e09eeb
commit 098d40be14
No known key found for this signature in database
GPG key ID: B5690EEEBB952194

View file

@ -6,7 +6,7 @@ Disallow:
User-agent: AdsBot-Google
User-agent: Amazonbot
User-agent: anthropic-ai
User-agent: Applebot
User-agent: Applebot-Extended
User-agent: AwarioRssBot
User-agent: AwarioSmartBot
User-agent: Bytespider