Cory :prami_pride_demi: on Nostr: Dark Visitors has added an API to programmatically fetch and generate robots.txt ...
Dark Visitors has added an API to programmatically fetch and generate robots.txt files intended to block #AI crawlers https://darkvisitors.com/docs/robots-txts-api