Subscribe to the Non-Human & AI Identity Journal

How should security teams respond when AI makes business email compromise harder to spot?

Teams should move beyond message inspection and verify the requester, the channel, and the business context before allowing action. AI makes tone and wording unreliable signals, so the control point becomes workflow validation, out-of-band confirmation, and monitoring for abnormal approval patterns across finance, executive, and supplier interactions.

Why This Matters for Security Teams

AI-assisted business email compromise is not just a better phishing problem. It weakens the old assumption that suspicious grammar, awkward tone, or obvious urgency will expose fraud. Attackers can now produce convincing messages at scale, mimic executive writing styles, and adapt content to the target’s role, supplier history, and approval habits. That shifts defense from message quality to transaction integrity and requester verification.

The practical impact is that finance, procurement, and executive support teams need controls that validate the business event, not just the inbox artifact. NIST Cybersecurity Framework 2.0 emphasizes governance and risk outcomes, while recent NHIMG research shows how identity and access gaps remain a major weakness in real-world environments. The 52 NHI Breaches Analysis shows how compromised identities and weak controls can turn routine workflows into breach paths, and the Anthropic report on AI-orchestrated cyber espionage illustrates how AI lowers the effort required to scale convincing social engineering. In practice, many security teams encounter fraudulent approvals only after funds move or supplier records change, rather than through intentional detection.

How It Works in Practice

The response should be a workflow control strategy built around verification, not a content-filtering strategy built around language patterns. Security teams should require out-of-band confirmation for high-risk requests, separate the request channel from the approval channel, and validate that the requester, the requested action, and the business context all match expected patterns. That means checking whether the request aligns with known supplier details, invoice history, payment timing, and prior escalation paths.

Operationally, teams should combine several controls:

  • Use approved call-back or ticketing workflows for payment changes, bank detail updates, and urgent wire requests.
  • Apply step-up approval for unusual amounts, new beneficiaries, or requests outside normal business hours.
  • Monitor for abnormal approval chains across finance, executive assistants, and shared inboxes.
  • Log and review failed verification attempts, not just successful transactions.
  • Treat executive impersonation as an identity risk, not a mail hygiene issue.

For broader identity context, the Ultimate Guide to NHIs explains why identity trust must be enforced at the control point, and the NIST Cybersecurity Framework 2.0 provides a useful structure for mapping governance, detection, and response. Teams should also measure how quickly unusual requests are challenged and whether approvers consistently use the required verification path. These controls tend to break down when approval pressure is high and business units are allowed to bypass the alternate channel for speed.

Common Variations and Edge Cases

Tighter verification often increases friction, so organisations have to balance fraud prevention against operational delay. That tradeoff becomes sharper for executive teams, M&A activity, payroll exceptions, and supplier onboarding, where legitimate urgency is common and attackers try to exploit it. Current guidance suggests risk-tiered controls rather than a single approval rule for every request.

Some environments also need special handling. Shared mailboxes can obscure accountability, outsourced finance teams may rely on different escalation norms, and global organisations may face time zone gaps that make callback verification slower. In those cases, the best practice is evolving toward pre-registered approvers, known-good contact methods, and policy-based exceptions that expire automatically. Security teams should be cautious about relying on AI detectors to identify fraudulent language, because there is no universal standard for that yet and false confidence can be dangerous. Instead, they should focus on process integrity, identity assurance, and anomaly monitoring. The Schneider Electric credentials breach is a reminder that real incidents often begin with trust placed in the wrong identity signal, not with obviously malicious text.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

OWASP Non-Human Identity Top 10 address the attack and risk surface, while NIST CSF 2.0 and NIST AI RMF set the governance and control requirements practitioners need to meet.

Framework Control / Reference Relevance
NIST CSF 2.0 PR.AC-1 Verifies requester identity before allowing high-risk business actions.
OWASP Non-Human Identity Top 10 NHI-02 Fraud often succeeds by abusing trusted identities and weak verification paths.
NIST AI RMF AI-driven impersonation changes how risk is assessed in business workflows.

Tie approvals to verified identities and require stronger checks for sensitive workflow changes.