Eric on Nostr: I don't want to spin up a whole blog post about it, but the whole Perplexity debacle ...

I don't want to spin up a whole blog post about it, but the whole Perplexity debacle is proof for some of my reluctance to block AI scrapers via robots.txt.

I'm paranoid enough to think that placing some of the more popular blocks on your site in of itself could be used as a strong signal for bad actors. They've already demonstrated the rules are made up and the points don't matter.

I hate that I have to think this way now, I'm so tired.