TL;DR: Deepfake impersonation, synthetic identities, AI-enabled phishing and document forgery are making fraud faster and harder to challenge, with similar scams driving $12.3 billion in losses in 2023 and one finance staffer tricked into a $25 million transfer, according to Seamfix. Identity verification now has to treat liveness, document authenticity and account recovery as linked controls, not separate checks.
Editorial analysis by NHI Mgmt Group, based on content published by Seamfix: “Common Types of Generative AI Fraud”.
By the numbers:
- One finance staffer was tricked into transferring $25 million after a deepfake impersonation on a video call.
- Losses from similar scams reached $12.3 billion in 2023 across various industries.
- Credential stuffing accounted for over one-third of online login attempts in 2020.
Key questions
Q: How should organisations handle identity verification when deepfakes can mimic real users?
A: Organisations should stop treating visual similarity as proof of identity and move high-risk workflows toward cryptographic verification, issuer trust, and device-bound proof of possession.
Q: Why do synthetic identities bypass many verification processes?
A: Synthetic identities blend real and fabricated details in ways that satisfy shallow checks while hiding fraud intent.
Q: What are the signs that an account recovery process is being abused in a cyber attack?
A: Common signs include unusual reset requests, repeated help desk contact from the same identity, requests made through new channels, and recovery actions tied to recently researched employees.
Practitioner guidance
- Strengthen liveness and channel binding Require verification steps that link the person, the device and the transaction context so a convincing face or voice alone cannot complete approval.
- Harden account recovery as a privileged path Apply stronger controls to reset and escalation flows than to routine sign-in, including step-up verification and fraud review for unusual recovery requests.
- Correlate document and identity evidence Check that identity documents, account attributes and behavioural signals align across authoritative sources before granting access or approving high-risk actions.
Bottom line: Generative AI is making fraud faster, more scalable and harder to detect because it can mimic people, documents and trusted channels at the same time.
Explore further
View Full Forum → | NHI Foundation Course → | Our Services → | Read the full analysis →
Generative AI has turned identity proof into an evidence problem, not just an authentication problem. The core risk is no longer whether a face matches a document, but whether the entire evidence chain can be trusted end to end. That shifts identity governance toward provenance, correlation and recovery assurance. Practitioners should treat verification as a continuous trust model, not a single check.
A few things that frame the scale:
- According to Gartner, worldwide spending on generative AI is set to reach $644 billion in 2025, a nearly 77% year-over-year increase.
A question worth separating out:
Q: What should IAM and fraud teams do together when impersonation attempts rise?
A: They should share telemetry, escalation rules and review ownership so impersonation signals are not trapped in separate queues. The goal is a common response path that can block a suspicious recovery, pause a payment or force independent verification before trust is granted.
👉 Read our full editorial: Generative AI fraud is widening identity verification risk