Leah on Nostr: Reading all these articles about the high traffic from AI bots, here is my experience ...
Reading all these articles about the high traffic from AI bots, here is my experience from a small German hoster: It's a huge problem, and it is getting worse very fast. There are bots like claudebot from Antrophic which are so aggressive that they block whole systems, outranking actual attacks for example against WordPress. And they change their AWS cloud IPs so often that blocking doesn't help for long and they also ignore robots.txt. Our on-call is regularly alerted for such issues.
Published at
2024-07-29 20:30:16Event JSON
{
"id": "13cfbf821ea4f273bc97dc7f0cd39634316420e05a7dfaf81acf544496c1cdf6",
"pubkey": "9b62738b9c58709839f1c484a97cf4eea9198689eebd7b4c0ecd5060c31b405a",
"created_at": 1722285016,
"kind": 1,
"tags": [
[
"proxy",
"https://chaos.social/users/leah/statuses/112871670828981320",
"activitypub"
]
],
"content": "Reading all these articles about the high traffic from AI bots, here is my experience from a small German hoster: It's a huge problem, and it is getting worse very fast. There are bots like claudebot from Antrophic which are so aggressive that they block whole systems, outranking actual attacks for example against WordPress. And they change their AWS cloud IPs so often that blocking doesn't help for long and they also ignore robots.txt. Our on-call is regularly alerted for such issues.",
"sig": "19322e52addf4265212cf33998b5f2cf698aeef7e9009c9e12d4a7aea3a2d790749fe456995317829c8182503c39ae753af484ec46a7af20e5a5a6d452ef9176"
}