Ellie Huxtable on Nostr: I now block several known LLM crawlers from my site ...
Published at
2024-05-06 15:45:22Event JSON
{
"id": "2374682488ca09e7ecacfc31cff09c4dadc83a639251c063f3356d73889c8a6f",
"pubkey": "f0cd1db2f2f049dc67adb3cab8e76847fce6c25c8401c56647a69801d58bbd86",
"created_at": 1715010322,
"kind": 1,
"tags": [
[
"proxy",
"https://hachyderm.io/users/ellie/statuses/112394916506778039",
"activitypub"
]
],
"content": "I now block several known LLM crawlers from my site\n\nhttps://ellie.wtf/notes/blocking-ai-crawlers\n\nIf you'd like to do the same, feel free to take my robots.txt",
"sig": "4b051407307e89d4f3699cad17e107e1b6f70ebdb2952f92178c1d6b77f664e27253160b1cda269c5b30e973596a41f23095c59312c49d14fc709e65a91d9d02"
}
