AI Voices Indistinguishable From Humans – Experts Say
- The rapid advancement of artificial intelligence (AI) has unlocked remarkable capabilities, but also introduced new avenues for fraud.
- The study found that 52% of participants were unable to distinguish between a real voice and an AI-generated clone, even when prompted to consider "unique circumstances."
- For banks and wealth managers, this PLoS One study exposes a growing operational and reputational risk.
AI-Powered Voice Cloning Poses Growing Threat to Financial Institutions
The rapid advancement of artificial intelligence (AI) has unlocked remarkable capabilities, but also introduced new avenues for fraud. A recent study published in PLoS One demonstrates that AI can now convincingly clone voices with minimal audio samples – sometimes as little as three seconds - raising significant concerns for the financial sector.
The study found that 52% of participants were unable to distinguish between a real voice and an AI-generated clone, even when prompted to consider “unique circumstances.”
For banks and wealth managers, this PLoS One study exposes a growing operational and reputational risk. A voice call that sounds authentic can lead to unauthorized transfers, approval of false instructions, or exposure of sensitive information.
“As scammers continue to refine their tactics, [financial institutions] must invest in advanced analytics and behavioral monitoring to stay ahead of these tailored threats,” the PYMNTS Intelligence report said.
The Collapse of Auditory Trust
Regulators have begun to respond.
The Federal Trade Commission said in August that there has been a more than fourfold increase in impersonation scams since 2020, with losses in the hundreds of millions of dollars.
In 2024, the FTC held a Voice Cloning Challenge to address the harms of AI-enabled voice cloning technologies. The goal was to “foster breakthrough ideas on preventing,monitoring and evaluating malicious voice cloning.”
“A strong approach to AI-enabled voice cloning ensures that AI companies releasing tools that have the potential for misuse may be held liable for assisting and facilitating illegal activity in certain circumstances if they do not implement guardrails to prevent it,” the FTC said in an April 2024 press release.
The Federal communications Commission ruled in Febuary 2024 that AI-generated voices in robocalls violate the Telephone Consumer Protection Act.
Meanwhile,Consumer Reports Advocacy documented in August rising consumer concern, with more than 75,000 signing a petition urging stricter enforcement against voice-cloning scams.
the World Economic Forum identified in July deepfake speech and identity impersonation as emerging risks to digital financial infrastructure.
A June arXiv preprint highlighted inconsistencies in AI voice systems across languages and accents, underscoring uneven exposure for global institutions.
For all PYMNTS AI coverage, subscribe to the daily AI Newsletter.