kim_harding ✅ on Nostr: OpenAI and Anthropic are ignoring an established rule that prevents bots scraping ...
Published at
2024-07-24 11:19:24Event JSON
{
"id": "19bcda4fa2e9fe5bc6469a8a937df5086b1a1d820c9416f192335aef4d85690b",
"pubkey": "063d3cd639a3769aed87e06dcf14ba545e7e03e89c988090c835b89b26b6a17a",
"created_at": 1721819964,
"kind": 1,
"tags": [
[
"proxy",
"https://mastodon.scot/users/kim_harding/statuses/112841193189180724",
"activitypub"
]
],
"content": "OpenAI and Anthropic are ignoring an established rule that prevents bots scraping online content https://www.businessinsider.com/openai-anthropic-ai-ignore-rule-scraping-web-contect-robotstxt",
"sig": "36aa3d40ecde68a8e2f8ac6d3ad76b99976b14ad37eb8c938ecc7a5d3445677b308267cabefc522c9882b9c366baf67bd039864ccadbbc7215388e006d2b58de"
}
