What is Nostr?
Marks
npub136j…jnxf
2025-03-18 14:51:58

Marks on Nostr: I will read the rest of this, but I paused at AI CSAM to comment. We make a private, ...

I will read the rest of this, but I paused at AI CSAM to comment. We make a private, encrypted AI chat called mapleai (nprofile…0867). Highly requested from users is for us to add image generation. I believe the request is benevolent but it’s the fact that we would unlock the ability to generate AI CSAM type content that holds me back.

Yes the technology is out there to do it. Those who want to generate that will find a way. I’m a builder of privacy tools that are agnostic to moral codes. A tool in the hand of one person may be used differently in the hand of another.

I won’t sacrifice on privacy and encryption, so for the time being, we aren’t building image generation. I’d like to bring that capability to our users, as it is a powerful tool for so many productive things.

Do you have suggestions or things you can point me to that could help us figure out how to build a feature like image generation that preserves privacy and also reduces likelihood of AI CSAM? At the moment I see no path forward.
Author Public Key
npub136jg2fnty2z5vwcnh7p4jpckrs3tk0dpueftgs7mznuuaenjpfps6tjnxf