Filip W on Nostr: important info if you have a blog/content website etc which you would not want to be ...

important info if you have a blog/content website etc which you would not want to be used by OpenAI for their data vacuuming

➡️ add this to robots.txt
User-agent: GPTBot
Disallow: /

➡️ or block these IP ranges
20.15.240.64/28
20.15.240.80/28
20.15.240.96/28
20.15.240.176/28
20.15.241.0/28
20.15.242.128/28
20.15.242.144/28
20.15.242.192/28
40.83.2.64/28

🔗 https://platform.openai.com/docs/gptbot