Gus on Nostr: Got inspired/sniped by this 404 media article about AI scraper user agents to finally ...
Got inspired/sniped by this 404 media article about AI scraper user agents to finally exclude them from my personal site: https://www.404media.co/websites-are-blocking-the-wrong-ai-scrapers-because-ai-companies-keep-making-new-ones/
Popped up the quick script I used here, in case it saves anyone some time: https://gist.github.com/projectgus/5a495c94f70ac3b3783e89c74a1fc07a
Popped up the quick script I used here, in case it saves anyone some time: https://gist.github.com/projectgus/5a495c94f70ac3b3783e89c74a1fc07a