LWN.net (RSS Feed) on Nostr: [$] Fighting the AI scraperbot scourge There are many challenges involved with ...
[$] Fighting the AI scraperbot scourge
There are many challenges involved with running a web site like LWN. Some
of them, such as finding the courage to write for people who know more
about the subject matter than we do, simply come with the territory we have
chosen. But others show up as an unwelcome surprise; the ongoing task of
fending off bots determined to scrape the entire Internet to (seemingly)
feed into the insatiable meat grinder of AI training is certainly one of
those. Readers have, at times, expressed curiosity about that fight and
how we are handling it; read on for a description of a modern-day plague.
https://lwn.net/Articles/1008897/
There are many challenges involved with running a web site like LWN. Some
of them, such as finding the courage to write for people who know more
about the subject matter than we do, simply come with the territory we have
chosen. But others show up as an unwelcome surprise; the ongoing task of
fending off bots determined to scrape the entire Internet to (seemingly)
feed into the insatiable meat grinder of AI training is certainly one of
those. Readers have, at times, expressed curiosity about that fight and
how we are handling it; read on for a description of a modern-day plague.
https://lwn.net/Articles/1008897/