What is Nostr?
Lex Plt :vim: /
npub1j0z…2u0v
2024-10-30 14:17:53

Lex Plt :vim: on Nostr: If you have a blog (or any website really), block meta-externalagent via robots.txt ...

If you have a blog (or any website really), block meta-externalagent via robots.txt (or even better via fail2ban filters).

This thing crawls everything to enhance their AI

https://developers.facebook.com/docs/sharing/webmasters/web-crawlers
Author Public Key
npub1j0zca5fj945zl8a45e3n2tefkst3n0hzelc69g6x4ld707kc5qjsy22u0v