TL;DR: 99% of organisations saw preventable user-action incidents in 2024, showing why security awareness training needs a different yardstick, from Abnormal AI’s survey. Security awareness training has to be measured against behaviour change and threat recognition, not attendance alone.
Editorial analysis by NHI Mgmt Group, based on content published by Abnormal AI: “From Compliance to Culture: What CISOs Need to Know About Evolving SAT”.
Key questions
Q: Why do compliance-based training programmes fail against phishing and social engineering?
A: They fail because users can game completion and because annual content does not reach the moment of decision.
Q: What are the best ways to reduce preventable user-action incidents?
A: Use timely, role-specific feedback tied to real user exposure, then reinforce it with repeated measurement of response quality.
Q: How do security teams know if security awareness training is actually working?
A: Look for reductions in susceptibility over time, improved reporting behaviour, and fewer successful phish-to-access events.
Practitioner guidance
- Shift success metrics to behaviour change Track whether users recognise, report, and avoid risky interactions over time, rather than treating completion rates as proof of security improvement.
- Deliver feedback at the point of risk Use inbox-level or workflow-adjacent prompts so training arrives when the employee is actually deciding whether to trust a message or action.
- Segment training by role and exposure Tailor scenarios and guidance to the message types, business processes, and fraud patterns that different employee groups actually encounter.
Bottom line: Legacy security awareness training fails when it rewards completion more than safer decisions under pressure.
Glossary terms: Security Awareness Training, Behavioral Change, Human element, Role-Specific Feedback
Explore further
View Full Forum → | NHI Foundation Course → | Our Services → | Read the full analysis →
Human-risk training fails when the control measures attendance instead of decision quality: Security awareness programmes that reward completion assume the user has changed behaviour, but the article shows that employees can share answers, skip content, and still look compliant. That means the programme is optimising for audit traceability, not reduced susceptibility. The practitioner conclusion is that SAT must be judged by whether it changes actions under pressure.
A question worth separating out:
Q: How do security teams keep awareness programmes relevant as threats change?
A: Refresh training based on the tactics users actually encounter, not on an annual plan. When lures evolve, the programme should adapt its examples, timing, and feedback so employees see the current attack pattern and the correct response while it still matters.
👉 Read our full editorial: Behaviour-based SAT matters more than completion metrics