Codeberg.org on Nostr: We investigated performance degradation due to excessive crawling of Codeberg. We ...
We investigated performance degradation due to excessive crawling of Codeberg.
We often trace back such things to company websites that proudly list their key investors - but don't actually explain what they are doing (or why they need to crawl Codeberg more excessively than the crawlers of the major search engines combined).
It's probably not a use case we believe in anyway, so we blocked several large IP ranges today.
We often trace back such things to company websites that proudly list their key investors - but don't actually explain what they are doing (or why they need to crawl Codeberg more excessively than the crawlers of the major search engines combined).
It's probably not a use case we believe in anyway, so we blocked several large IP ranges today.