Subscribe to the Non-Human & AI Identity Journal

What breaks when phishing training focuses mainly on grammar and bad spelling?

It breaks when the attacker can produce polished, role-specific messages at scale. Grammar-based training assumes phishing will look sloppy, but AI removes that clue almost entirely. Organisations then overestimate user detection capability and underinvest in controls that protect credentials, sessions, and downstream access if the message gets through.

Why Grammar-Based Phishing Training Fails Security Teams

Phishing awareness that focuses on spelling mistakes and awkward phrasing trains users to spot the oldest kind of scam, not the attacks they actually face. AI-generated lures now arrive with clean grammar, plausible tone, and role-specific context, which means the old “spot the typo” heuristic no longer signals risk. That gap matters because the real objective is not message quality, but credential capture, session theft, and downstream access abuse. NIST Cybersecurity Framework 2.0 emphasises resilient detection and response, not confidence in human pattern matching, and that distinction is central here.

NHIMG research on the LLMjacking threat vector shows how quickly attacker behaviour shifts once identity and access are exposed. The same logic applies to phishing: once a message looks credible, the training control has already failed and the defensive burden moves to authentication, session protection, and access containment. Organisations that still score employees on spotting bad grammar often mistake a narrow test for a broad defence. In practice, many security teams encounter credential compromise only after a polished lure has already bypassed awareness training and reached production access.

How AI-Generated Phishing Changes the Defensive Model

Modern phishing is increasingly a workload problem, not a writing quality problem. Attackers can use AI to tailor messages to finance, HR, engineering, or executives, and they can do it at volume. That means static, role-based awareness rules age poorly because the attacker’s content is dynamic, context-aware, and often sourced from public information. The better defensive model is to assume that message realism is no longer a reliable indicator and to harden the identity path that follows the click.

That shift aligns with guidance from NIST Cybersecurity Framework 2.0 and with NHIMG research on the DeepSeek breach, which illustrates how exposed secrets and credentials quickly become an attacker’s entry point. Practical controls now matter more than message aesthetics:

  • Use phishing-resistant authentication so a stolen password alone is insufficient.
  • Limit session lifetime and require re-authentication for sensitive actions.
  • Apply conditional access based on device, location, and risk signals.
  • Monitor for impossible travel, token replay, and suspicious inbox rule creation.
  • Train users to verify requests through out-of-band channels, not grammar cues.

This guidance breaks down in high-velocity environments where teams rely on legacy email security, shared accounts, and weak session governance because a convincing lure can turn one successful click into broad access before any human review occurs.

Where Grammar-Focused Training Still Helps, and Where It Misleads

Tighter phishing controls often increase training and operational overhead, requiring organisations to balance user education against the limits of human judgment. Grammar-based examples can still help new users recognise obvious commodity spam, but current guidance suggests they should be treated as a baseline, not the primary defence. The risk is that a narrow curriculum creates false confidence and underfunds controls that actually stop compromise.

Best practice is evolving toward scenario-based training that reflects how attacks really work: polished lures, brand impersonation, callback scams, QR code phishing, and multi-step credential theft. The strongest programs connect awareness to technical guardrails, including MFA, device trust, least privilege, and rapid revocation. Where the state of secrets in AppSec is most relevant is in showing how exposed secrets remain exploitable long after a phishing email is deleted. That makes the lesson clear: teach users to report suspicious requests, but design security so one convincing message does not become persistent access. The model weakens in organisations that still measure success by click-rate alone because that metric says little about whether credentials, sessions, or secrets were actually protected.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

OWASP Agentic AI Top 10 address the attack and risk surface, while NIST CSF 2.0 and NIST AI RMF set the governance and control requirements practitioners need to meet.

Framework Control / Reference Relevance
OWASP Agentic AI Top 10 A03 AI-generated phishing scales polished social engineering and bypasses human grammar cues.
NIST CSF 2.0 PR.AA-1 Strong authentication is the real control when phishing bypasses awareness training.
NIST AI RMF AI RMF addresses governance when AI changes attacker capability and risk assumptions.

Treat message realism as untrusted and verify requests with runtime controls, not user intuition.