AI-Generated Voice Impersonation in Financial Fraud: A Narrative Review and Proposed Payment Verification Protocol

Authors

DOI:

https://doi.org/10.63084/algora.v3i1.119

Keywords:

voice cloning, deep fake audio, payment fraud, business email compromise, verification, synthetic speech detection

Abstract

Objective: This narrative review examines how organisations can verify urgent payment requests when a familiar-sounding voice can no longer be treated as reliable evidence of the caller's identity. Methods: This is a structured narrative review. The literature search was run on 28 December 2025 and included only sources published on or before 30 November 2025, a cut-off set by the commissioned brief for this work (Section 2.1). Scholarly databases, technical repositories and primary guidance from law-enforcement and financial-regulatory agencies were consulted. Results: Two frequently cited incidents (the 2019 UK energy-firm case and the 2024 Arup case) are reported in the media as voice- or deepfake-enabled fraud, but neither has public forensic confirmation of synthetic voice; the Arup case additionally involved a video call rather than a voice-only channel. In laboratory experiments on human detection, Mai et al. (2023) found single-clip accuracy of about 73% for deepfake clips and 67.78% for genuine clips, above chance but well below the level required to authenticate a payment request; the clips came from one older text-to-speech system, and brief training raised confidence-weighted accuracy by only 3.84%. Barrington et al. (2025), using commercial ElevenLabs clones of 220 speakers, found that listeners judged a clone to be the same identity as the real speaker about 80% of the time and identified AI-generated voices correctly only about 60% of the time. Müller, Pizzi, et al. (2022) found that players and a detection model struggled with the same attacks, and Warren et al. (2024), with 1,212 participants, reported average accuracy of about 73%, with deepfakes accepted as human more often than genuine clips were rejected. None of these experiments tested listeners known to be familiar with the speaker. Automated detection systems achieve EER below 2% on the ASVspoof 2019 LA benchmark, but Müller, Czempin, et al. (2022) summarise the deterioration on in-the-wild audio as about 200–1,000%, with EERs of 34% to 91% across the configurations they tested (50% is chance). Models trained on clean ASVspoof 2019 data lost 10.7 to 20.5 EER points on telephony-encoded versions of the same attacks (Müller et al., 2024), although the best ASVspoof 2021 system, trained without matched data, still reached an EER of 1.32% on its telephony track (Yamagishi et al., 2021). These findings do not prove that every detector fails in every payment call, but they do argue against relying on detection or human listening alone. Conclusion: On the available evidence, voice similarity is not a reliable authentication factor for high-risk payment requests. The author proposes a four-step procedural protocol (pause the payment, call back on a pre-existing verified number, confirm any new bank details through a genuinely independent channel, and require a second approver above a risk-based threshold) as guidance drawn mainly from established anti-fraud principles and law-enforcement advice, informed by the detection evidence reviewed. The protocol has not been empirically tested as a combined intervention and no specific reduction in fraud is claimed.

References

ACFE. (2024). Occupational fraud 2024: A report to the nations. Association of Certified Fraud Examiners. https://www.acfe.com/en-us/-/media/files/acfe/pdfs/rttn/2024/2024-report-to-the-nations.pdf

Almutairi, Z., & Elgibreen, H. (2022). A review of modern audio deepfake detection methods: Challenges and future directions. Algorithms, 15(5), 155. https://doi.org/10.3390/a15050155

Barrington, S., Cooper, E. A., & Farid, H. (2025). People are poorly equipped to detect AI-powered voice clones. Scientific Reports, 15, 11004. https://doi.org/10.1038/s41598-025-94170-3

CNN. (2024, May 16). Arup revealed as victim of $25 million deepfake scam involving Hong Kong employee. CNN Business. https://www.cnn.com/2024/05/16/tech/arup-deepfake-scam-loss-hong-kong-intl-hnk

Damiani, J. (2019, September 3). A voice deepfake was used to scam a CEO out of $243,000. Forbes. https://www.forbes.com/sites/jessedamiani/2019/09/03/a-voice-deepfake-was-used-to-scam-a-ceo-out-of-243000/

FBI IC3. (2024, December 3). Criminals use generative artificial intelligence to facilitate financial fraud (PSA I-120324-PSA). Federal Bureau of Investigation, Internet Crime Complaint Center. https://www.ic3.gov/PSA/2024/PSA241203

FBI IC3. (2025a). 2024 Internet crime report. Federal Bureau of Investigation, Internet Crime Complaint Center. https://www.ic3.gov/AnnualReport/Reports/2024_IC3Report.pdf

FBI IC3. (2025b, May 15). Senior US officials impersonated in malicious messaging campaign (PSA I-051525-PSA). Federal Bureau of Investigation, Internet Crime Complaint Center. https://www.ic3.gov/PSA/2025/PSA250515

FinCEN. (2024, November 13). FinCEN alert on fraud schemes involving deepfake media targeting financial institutions (FIN-2024-Alert004). U.S. Department of the Treasury, Financial Crimes Enforcement Network. https://www.fincen.gov/sites/default/files/shared/FinCEN-Alert-DeepFakes-Alert508FINAL.pdf

FTC. (2023, March 20). Scammers use AI to enhance their family emergency schemes. Federal Trade Commission, Consumer Advice. https://consumer.ftc.gov/consumer-alerts/2023/03/scammers-use-ai-enhance-their-family-emergency-schemes

FTC. (2024, April 8). FTC announces winners of Voice Cloning Challenge. Federal Trade Commission. https://www.ftc.gov/news-events/news/press-releases/2024/04/ftc-announces-winners-voice-cloning-challenge

Khanjani, Z., Watson, G., & Janeja, V. P. (2023). Audio deepfakes: A survey. Frontiers in Big Data, 5, 1001063. https://doi.org/10.3389/fdata.2022.1001063

Mai, K. T., Bray, S., Davies, T., & Griffin, L. D. (2023). Warning: Humans cannot reliably detect speech deepfakes. PLOS ONE, 18(8), e0285333. https://doi.org/10.1371/journal.pone.0285333

Müller, N. M., Czempin, P., Diekmann, F., Froghyar, A., & Böttinger, K. (2022). Does audio deepfake detection generalize? In Proceedings of Interspeech 2022 (pp. 2783–2787). ISCA. https://doi.org/10.21437/Interspeech.2022-108

Müller, N. M., Evans, N., Tak, H., Sperl, P., & Böttinger, K. (2024). Harder or different? Understanding generalization of audio deepfake detection. In Proceedings of Interspeech 2024 (pp. 2705–2709). ISCA. https://doi.org/10.21437/Interspeech.2024-247

Müller, N. M., Pizzi, K., & Williams, J. (2022). Human perception of audio deepfakes. In Proceedings of the 1st International Workshop on Deepfake Detection for Audio Multimedia (DDAM ’22) (pp. 85–91). ACM. https://doi.org/10.1145/3552466.3556531

Stupp, C. (2019, August 30). Fraudsters used AI to mimic CEO’s voice in unusual cybercrime case. The Wall Street Journal. https://www.wsj.com/articles/fraudsters-use-ai-to-mimic-ceos-voice-in-unusual-cybercrime-case-11567157402

Warren, K., Tucker, T., Crowder, A., Olszewski, D., Lu, A., Fedele, C., Pasternak, M., Layton, S., Butler, K., Gates, C., & Traynor, P. (2024). “Better be computer or I’m dumb”: A large-scale evaluation of humans as audio deepfake detectors. In Proceedings of the 2024 ACM SIGSAC Conference on Computer and Communications Security (CCS ’24) (pp. 2696–2710). ACM. https://doi.org/10.1145/3658644.3670325

Yamagishi, J., Wang, X., Todisco, M., Sahidullah, M., Patino, J., Nautsch, A., Liu, X., Lee, K. A., Kinnunen, T., Evans, N., & Delgado, H. (2021). ASVspoof 2021: Accelerating progress in spoofed and deepfake speech detection. In 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge (pp. 47–54). ISCA. https://doi.org/10.21437/ASVSPOOF.2021-8

Downloads

Published

2026-06-30

How to Cite

Mary A. Olugbemi-Bello, Ubakaeze Victor Chiagozie, Fatimah Yesuf, & Babajide J. Sunmonu. (2026). AI-Generated Voice Impersonation in Financial Fraud: A Narrative Review and Proposed Payment Verification Protocol. Algora, 3(1), 247–272. https://doi.org/10.63084/algora.v3i1.119