Ben Zanin on Nostr: If you want to block large language models, don't reach for your robots.txt - that's ...
If you want to block large language models, don't reach for your robots.txt - that's just a place to state your hopes and dreams.
You need force. Reach for your firewall configuration.
Published at
2024-06-20 03:03:05Event JSON
{
"id": "694b2da22ac44a5652567da67f9a5e35982b90ca1b629a4aee5c38e059852578",
"pubkey": "50df4f61fbb667f2d09ea7557e2424e30f9f3b256008ab4a765095a1df93f715",
"created_at": 1718852585,
"kind": 1,
"tags": [
[
"proxy",
"https://mastodon.social/@gnomon/112646723053347590",
"web"
],
[
"proxy",
"https://mastodon.social/users/gnomon/statuses/112646723053347590",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://mastodon.social/users/gnomon/statuses/112646723053347590",
"pink.momostr"
]
],
"content": "If you want to block large language models, don't reach for your robots.txt - that's just a place to state your hopes and dreams.\n\nYou need force. Reach for your firewall configuration.",
"sig": "d5a982dd17b9cf4ab1d63a9d64e5b655f35124fcaf0e654a078aa1d098b411b4b8765a3f1357f2226f9a07cfaa746c88ca75ed7e8d00846b605c842118553c80"
}