Dan Gillmor on Nostr: I asked Perplexity if it was ignoring robots.txt instructions when crawling the web, ...

I asked Perplexity if it was ignoring robots.txt instructions when crawling the web, and the response was quite detailed -- and revealing.

It basically confessed.

https://www.perplexity.ai/page/Does-Perplexity-Ignore-v4ZEwKKCRme6wOo6PvEuzg