Fabio Manganiello on Nostr: #AI is an amazing technology that has the potential to change people’s life for ...
#AI is an amazing technology that has the potential to change people’s life for better. And we have a duty of keeping it open, accoutable and out of corporate greed if we don’t it to turn into a Black Mirror episode.
Take the example of those with debilitating muscular diseases who slowly lose control over their limbs and voices.
At the current stage a good AI model only needs a few seconds of someone’s voice in audio format to realistically replicate that voice.
That’s awful from the perspective of fake news generation (you can easily generate videos of Obama or Modi saying anything you want them to say and share them on social media), but amazing when it comes to giving back a voice to those who lost it.
#ElevenLabs is one of the companies that sells such technologies. And just like they can give you back your voice, they can take it away from you at any moment. All it takes is for you to use your voice clone to send an audio clip to your spouse saying “come on hun, get your arse in gear!”
The company has access to everything you say, it applies the dullest and dumbest moderation rules to it, and it’ll ban you if you speak any profanity - even if it’s an innocent nudge to your spouse.
It’s important to raise awareness about these faceless and privacy-invasive companies so everyone steers away from them.
And it’s important that such models are released in the open so competition can naturally trim out the bad weeds - if a company that “owns” your new voice invades your privacy or applies stupid moderation rules to your everyday interactions, then you should be able to walk away to a comparable competitor, or, if you have the skills, also host the model yourself.
https://www.technologyreview.com/2025/02/14/1111900/ai-voice-clone-say-arse-then-banned/
Take the example of those with debilitating muscular diseases who slowly lose control over their limbs and voices.
At the current stage a good AI model only needs a few seconds of someone’s voice in audio format to realistically replicate that voice.
That’s awful from the perspective of fake news generation (you can easily generate videos of Obama or Modi saying anything you want them to say and share them on social media), but amazing when it comes to giving back a voice to those who lost it.
#ElevenLabs is one of the companies that sells such technologies. And just like they can give you back your voice, they can take it away from you at any moment. All it takes is for you to use your voice clone to send an audio clip to your spouse saying “come on hun, get your arse in gear!”
The company has access to everything you say, it applies the dullest and dumbest moderation rules to it, and it’ll ban you if you speak any profanity - even if it’s an innocent nudge to your spouse.
It’s important to raise awareness about these faceless and privacy-invasive companies so everyone steers away from them.
And it’s important that such models are released in the open so competition can naturally trim out the bad weeds - if a company that “owns” your new voice invades your privacy or applies stupid moderation rules to your everyday interactions, then you should be able to walk away to a comparable competitor, or, if you have the skills, also host the model yourself.
https://www.technologyreview.com/2025/02/14/1111900/ai-voice-clone-say-arse-then-banned/