Ed Summers on Nostr: 🔖 ai-robots-txt/ai.robots.txt: A list of AI agents and robots to block. ...
🔖 ai-robots-txt/ai.robots.txt: A list of AI agents and robots to block.
https://github.com/ai-robots-txt/ai.robots.txt "This is an open list of web crawlers associated with AI companies and the training of LLMs to block. We encourage you to contribute to and implement this list on your own site. See information about the listed crawlers."
Published at
2024-07-30 22:22:02Event JSON
{
"id": "b3386eb7abc70fa1475adb112da67b56a038f6ae2b6165f0d4bce549d8d3a957",
"pubkey": "02b82140c344de6e1ced44237eca488cecec57453c22206e52b15d812b93042e",
"created_at": 1722378122,
"kind": 1,
"tags": [
[
"proxy",
"https://social.coop/@edsu/112877772626338849",
"web"
],
[
"proxy",
"https://social.coop/users/edsu/statuses/112877772626338849",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://social.coop/users/edsu/statuses/112877772626338849",
"pink.momostr"
],
[
"-"
]
],
"content": "🔖 ai-robots-txt/ai.robots.txt: A list of AI agents and robots to block. https://github.com/ai-robots-txt/ai.robots.txt \n\n\"This is an open list of web crawlers associated with AI companies and the training of LLMs to block. We encourage you to contribute to and implement this list on your own site. See information about the listed crawlers.\"",
"sig": "1b383c6841dc2135c8d652176abe6653e8d242635b7f48e05b0e4dc479492648a44ca04e71140855257fcd04cf86ca89034ff1c4cd767a8a95dae0f8f8acbd31"
}
