James Cridland on Nostr: So, Podnews fell over again overnight. Pretty clear to see why - a scraper at a ...
So, Podnews fell over again overnight.
Pretty clear to see why - a scraper at a Google IP address of 35.195.28.108 with a useragent of Mozilla/5.0%20(Windows%20NT%2010.0;%20Win64;%20x64)%20AppleWebKit/537.36%20(KHTML,%20like%20Gecko)%20Chrome/120.0.0.0%20Safari/537.36 (doesn't look like Google) seems to be caning the website. 154 requests a second. Sigh.
It was blocked by AWS's WAF after 767 requests in less than three minutes.
At a loss as to what to do now.
Pretty clear to see why - a scraper at a Google IP address of 35.195.28.108 with a useragent of Mozilla/5.0%20(Windows%20NT%2010.0;%20Win64;%20x64)%20AppleWebKit/537.36%20(KHTML,%20like%20Gecko)%20Chrome/120.0.0.0%20Safari/537.36 (doesn't look like Google) seems to be caning the website. 154 requests a second. Sigh.
It was blocked by AWS's WAF after 767 requests in less than three minutes.
At a loss as to what to do now.