Per Axbom on Nostr: The fact that the Whisper transcription service from OpenAI just fills out gaps and ...
The fact that the Whisper transcription service from OpenAI just fills out gaps and silence with nonsense, demographic stereotyping, perpetuation of violence and sexal innuendo should get it recalled.
But no, as long as OpenAI say they are continually working to improve the tool, everything is apparently good to go.
One example:
What the person said: “Someone had to run and call the fire department to rescue both the father and the cat.”
What Whisper transcribed: “Someone had to run and call the fire department to rescue both the father and the cat. All he had was a smelly old ol’ head on top of a socked, blood-soaked stroller.”
Reporting in the Verge: https://www.theverge.com/2024/10/27/24281170/open-ai-whisper-hospitals-transcription-hallucinations-studies
The research paper:
https://facctconference.org/static/papers24/facct24-111.pdf (check out the table of examples!)
My March 2023 article on AI responsibility:
https://axbom.com/ai-responsibility/
But no, as long as OpenAI say they are continually working to improve the tool, everything is apparently good to go.
One example:
What the person said: “Someone had to run and call the fire department to rescue both the father and the cat.”
What Whisper transcribed: “Someone had to run and call the fire department to rescue both the father and the cat. All he had was a smelly old ol’ head on top of a socked, blood-soaked stroller.”
Reporting in the Verge: https://www.theverge.com/2024/10/27/24281170/open-ai-whisper-hospitals-transcription-hallucinations-studies
The research paper:
https://facctconference.org/static/papers24/facct24-111.pdf (check out the table of examples!)
My March 2023 article on AI responsibility:
https://axbom.com/ai-responsibility/