Nadia :neocat_flag_trans: on Nostr: Thinking about building a spider trap for AI scrapers. Like, 1. Train a markov chain ...
Thinking about building a spider trap for AI scrapers. Like,
1. Train a markov chain on an export from https://en.uncyclopedia.co/.
2. Build a service that dynamically generates an article-like shitty html based on whatever you make up as the URL slug.
3. Randomly generate three more slugs and include them in said article.
And then I can switch-case on user agents and redirect ai crawlers there.
1. Train a markov chain on an export from https://en.uncyclopedia.co/.
2. Build a service that dynamically generates an article-like shitty html based on whatever you make up as the URL slug.
3. Randomly generate three more slugs and include them in said article.
And then I can switch-case on user agents and redirect ai crawlers there.