Salastil on Nostr: pistolero You seem like a clever guy that may know of this web technique. I'm getting ...
pistolero (npub1ch8…sw60) You seem like a clever guy that may know of this web technique. I'm getting my Nitter instanced scraped by a botnet that appears to be 100k IP large, they get fed in as fast as I ban them, but I don't believe they assign more than 100 IP to scraping at a time as to not DDOS the site, one IP never doing a scrape under 7 seconds so rate limiting wont nab them. Banning doesn't seem to be working, what I want to do is something I read about 10+ years ago, a sticky trap. I want to ensnare the bot into a perpetually open http request so that it never completes its loop, I figure that it the botnet notices when its banned and starts getting 403'd, but if the loop never completes it may just seize up that load balancer.
Happen to know what this technique is called or of any reading material?
Published at
2023-09-30 17:07:41Event JSON
{
"id": "a09540341f7d30dfd96bd353198879aa5ed9b6a2475fcd847d8e3e23d04e8f0d",
"pubkey": "192068fdc9629be317158fea8bbe16622bbf3f39b354caf84c31cacea79fcede",
"created_at": 1696093661,
"kind": 1,
"tags": [
[
"p",
"c5cf39149caebda4cdd61771c51f6ba91ef5645919004e5c4998a4ea69f00512",
"wss://relay.mostr.pub"
],
[
"proxy",
"https://pleroma.salastil.com/objects/151aa43e-4628-495f-8499-619713641d9a",
"activitypub"
]
],
"content": "nostr:npub1ch8nj9yu4676fnwkzacu28mt4y002ezeryqyuhzfnzjw560sq5fqaysw60 You seem like a clever guy that may know of this web technique. I'm getting my Nitter instanced scraped by a botnet that appears to be 100k IP large, they get fed in as fast as I ban them, but I don't believe they assign more than 100 IP to scraping at a time as to not DDOS the site, one IP never doing a scrape under 7 seconds so rate limiting wont nab them. Banning doesn't seem to be working, what I want to do is something I read about 10+ years ago, a sticky trap. I want to ensnare the bot into a perpetually open http request so that it never completes its loop, I figure that it the botnet notices when its banned and starts getting 403'd, but if the loop never completes it may just seize up that load balancer.\n\nHappen to know what this technique is called or of any reading material?",
"sig": "1389d305b256d96a63aa33b251f677399cd0a60bb5059577a01f1d816eef5ed1571dae48b8e28a28712391ec7abe37d5750bf656bec00d17da791f025f0d07a5"
}
