Algorights on Nostr: «For decades, robots.txt governed the behavior of web crawlers. But as unscrupulous ...
Published at
2024-04-15 14:00:15Event JSON
{
"id": "6f393a2ce6a2eb6849ae9c6e17efb59cb15275d0909827100e9b6b10986182d5",
"pubkey": "39a11ac5b8ab1b345475ed7334353c0064acad21281a6c858d13eb6940b63ff8",
"created_at": 1713189615,
"kind": 1,
"tags": [
[
"t",
"ai"
],
[
"proxy",
"https://mastodon.social/users/algorights/statuses/112275594670031473",
"activitypub"
]
],
"content": "«For decades, robots.txt governed the behavior of web crawlers. But as unscrupulous #AI companies seek out more and more data, the basic social contract of the web is falling apart». https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders",
"sig": "335fafa1df1d6fd112375b6929a391f6d1a45c8770c8161914d4254b8397c87513fa931b7fa02edebb7c37705f280ae0ec7d97730685dfff23ea69415771a600"
}
