Join our Newsletter — 33% off our NHI Course

GenAI help desk attacks: are your identity checks keeping up?

 

(@nhi-mgmt-group)
Member Moderator
Joined: 1 year ago
Posts: 17435
Topic starter  

TL;DR: Generative AI is making help desk social engineering far more convincing by combining voice cloning, deepfake video, and personalised scripts that can bypass manual verification and pressure staff into reset or enrolment actions, according to Trusona. Legacy identity proofing and training assumptions break when attackers can generate believable human-like responses at scale.

Editorial analysis by NHI Mgmt Group, based on content published by Trusona: “Why GenAI Makes Help Desk Attacks 10× More Dangerous”.

Key questions

Q: What breaks when identity programmes rely on help desk knowledge checks alone?

A: Knowledge checks often use data that is exposed, guessable, or already assembled through OSINT.

Q: Why do voice cloning and deepfake calls increase account recovery risk?

A: They raise risk because they supply the exact cues help desk staff use to decide whether a requester sounds legitimate.

Q: What do security teams get wrong about help desk social engineering?

A: Many teams treat the help desk as a service function rather than a security boundary.

Practitioner guidance

  • Replace KBA in reset workflows Remove knowledge-based questions from account recovery and MFA reset processes where the action can affect privileged access or enrolment.
  • Bind sensitive recovery to pre-registered channels Require callbacks to numbers on file, device-bound approval, or other pre-established channels before any password reset or device enrolment for high-risk accounts.
  • Remove discretionary override for privileged resets Script the help desk path so agents cannot bypass multi-party approval or additional verification for administrators, finance users, or other high-impact roles.

Bottom line: GenAI-driven help desk attacks succeed by exploiting the trust mechanics of recovery workflows, not by breaking authentication directly.

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 6 months ago
Posts: 17367
 

GenAI help desk attacks are a verification problem, not a training problem. Awareness still matters, but these attacks succeed because the help desk is asked to judge authenticity from cues GenAI can now imitate cheaply and repeatedly. The underlying failure is reliance on human recognition as a control surface. Practitioners should treat support workflows as identity enforcement paths, not conversational triage.

A few things that frame the scale:

  • Generative AI use specifically increased from 33% in 2023 to 79% in 2025, according to McKinsey’s Global Surveys on the State of AI.

A question worth separating out:

Q: How should organisations govern high-risk resets when GenAI can imitate users?

A: They should make the highest-risk actions require pre-bound verification, not live conversation. Callback controls, liveness checks, multi-party approval and hardware-bound authentication reduce the chance that a synthetic request becomes an account takeover. Governance should also define which roles can never be recovered through a single human approval path.

👉 Read our full editorial: GenAI help desk attacks are outpacing legacy identity checks



   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.