myrmepropagandist on Nostr: Data poisoning is a fascinating and exciting topic in this age of indiscriminate, ...

Data poisoning is a fascinating and exciting topic in this age of indiscriminate, consent-ignorant and often plain desperate slurping of data from the web and from users of services.

Poisoning attacks are crafted by inserting training data designed to degrade a model’s performance when deployed. Sophisticated attacks can induce unintended behaviors and even be activated by special triggers. One must have a extensive understanding of the model to do this-- but from there it's simple.