Julf on Nostr: "You will want to trust it. It will use your mannerisms and cultural references. It ...

"You will want to trust it. It will use your mannerisms and cultural references. It will have a convincing voice, a confident tone, and an authoritative manner. Its personality will be optimized to exactly what you like and respond to.

It will act trustworthy, but it will not be trustworthy. We won’t know how they are trained. We won’t know their secret instructions. We won’t know their biases, either accidental or deliberate."

https://www.schneier.com/blog/archives/2023/12/ai-and-trust.html