Join our Newsletter — 33% off our NHI Course

Did 98.4% of leaders prove AI-generated phishing now beats old cues?

 

(@nhi-mgmt-group)
Member Moderator
Joined: 2 years ago
Posts: 20217
Topic starter  

TL;DR: 98.4% of security leaders say attackers are already using AI, showing how AI-generated phishing is eroding the old cues employees once relied on, per Abnormal AI's survey. Security training now has to judge requests by context and channel, not by grammar or polish.

Editorial analysis by NHI Mgmt Group, based on content published by Abnormal AI: “Training Your Employees to Recognize Malicious AI”.

By the numbers:

  • 98.4% of security leaders report AI is already being widely used by attackers against their organizations.
  • 40% of organizations had a security incident tied to an avoidable user action in the past year.

Key questions

Q: Why do generic phishing simulations fail against clean, contextual lures?

A: They overfit to outdated tells such as bad grammar, odd formatting, and obvious spelling mistakes.

Q: What are the best practices for phishing awareness in high-risk roles?

A: Segment training by workflow exposure, not by the organisation as a whole.

Q: How should security teams train users when phishing emails are AI-generated?

A: Train users to validate the request, not the writing style.

Practitioner guidance

  • Replace annual awareness cycles Move from once-a-year phishing training to continuous reinforcement tied to day-to-day email behaviour, especially for users exposed to vendor, payment, or executive workflows.
  • Build role-specific simulations Create simulation tracks that reflect the employee’s actual responsibilities, such as invoice approval, vendor contact, or executive support, so the exercise mirrors real decision pressure.
  • Add in-the-moment coaching Trigger immediate coaching when a user opens, replies to, or acts on a suspicious message so the learning happens while the decision is still fresh.

Bottom line: AI-generated phishing reduces the usefulness of old fraud cues, so human judgement now depends on context and timing rather than spotting obvious mistakes.

Glossary terms: AI-generated phishing, Business email compromise, Role-based phishing risk

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →


This topic was modified 3 days ago by NHI Mgmt Group

   
Quote
(@mr-nhi)
Member Moderator
Joined: 6 months ago
Posts: 20707
 

AI phishing has turned the human verification layer into a contextual judgment problem, not a grammar problem. The old model of awareness training assumed obvious defects would reveal fraud. Generative AI removes those defects, which means human detection now depends on context, timing, and behavioural suspicion instead of surface errors. That shifts the control question from recognition of bad writing to recognition of abnormal intent, and practitioners should treat that as a human identity governance issue.

A question worth separating out:

Q: When does phishing awareness become a governance problem instead of a training problem?

A: When the organisation relies on static content that no longer matches how attacks actually arrive. At that point the issue is not knowledge transfer alone. It is whether identity and security governance can adapt to the pace at which contextual deception changes the human decision surface.

👉 Read our full editorial: AI phishing training must adapt to clean, contextual deception



   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.