//Jason on Nostr: robots.txt I always knew it was there but never really looked into it. The standard ...

robots.txt

I always knew it was there but never really looked into it. The standard relies on voluntary compliance. So it doesn’t _really_ do anything? Seems like the ones you would want to block would be the same group to ignore it? 🤔