TL;DR: AI-generated scams are harder to spot because they can mimic trusted communication cheaply and convincingly, Alloy says. Fraud controls need device, identity, and behavioural signals together to catch pressured transfers before they complete.
Editorial analysis by NHI Mgmt Group, based on content published by Alloy: “In the age of AI, financial institutions and fintechs must do more to protect their customers from social engineering fraud”.
By the numbers:
- 85% of Americans worry that advances in AI technology are making scams harder to detect.
- 27% of Americans have experienced an AI-generated scam personally, or know someone who has.
- Per month, Americans received an average of 63 spam texts each.
Key questions
Q: Why do AI-generated scams still succeed even when users know about phishing?
A: Because awareness alone does not stop pressure, familiarity, and speed from shaping decisions.
Q: What are the signs that scam detection is too dependent on static rules?
A: Common signs include missed deepfake lures, repeated false negatives on unusual transfers, and alerts that only fire after account data has already changed.
Q: What breaks when a real customer is manipulated by an AI-enabled scam?
A: The failure is assuming that authenticated access equals legitimate intent.
Practitioner guidance
- Implement behaviour-aware transaction gating Block or step up high-risk transfers and profile changes when device, location, contact data, or login timing diverge from the customer’s normal pattern.
- Correlate identity and behavioural signals Join onboarding, login, and transaction telemetry so a legitimate authentication event can be weighed against contextual fraud indicators before approval.
- Add friction at the point of urgency Use step-up verification, callback checks, or out-of-band confirmation when requests involve unusual payment instructions or account recovery.
Bottom line: AI has made scam content cheaper to produce and harder to distinguish from legitimate communication, which shifts fraud defence toward context and timing.
Glossary terms: Social Engineering, Deepfake-based impersonation, Behavioural Risk Signal, Step-Up Verification
Explore further
View Full Forum → | NHI Foundation Course → | Our Services → | Read the full analysis →
AI has turned social engineering into a workflow problem, not just a messaging problem. The article shows that attackers now use automation, deepfakes, and generative text to scale persuasion across channels. That means the defensive unit of analysis is no longer the email or call, but the full trust journey from first contact to authorised action. Practitioners should govern scam risk as an identity and decisioning problem, not as a pure communications-filtering issue.
A few things that frame the scale:
- U.S. fraud losses are projected to reach $40 billion by 2027.
A question worth separating out:
Q: Should financial institutions use step-up verification or behavioural scoring first?
A: They should use both, but for different purposes. Behavioural scoring identifies when a request looks inconsistent with prior activity, while step-up verification interrupts the transaction and forces the customer to re-confirm the action. The best programmes combine early risk detection with friction at the point of execution.
👉 Read our full editorial: Behavior-linked fraud controls are needed as AI scams evade review