AI phishing and agent governance: what should teams do now?

TL;DR: AI is now amplifying two dominant cybersecurity problems, phishing and AI agent misuse, as personalized social engineering, deepfake-assisted lures, and over-extended agent access raise the cost of weak training and weak governance, according to Jamf. The practical shift is from annual awareness and ad hoc controls to continuous education, threat hunting, and governed AI use.

Editorial analysis by NHI Mgmt Group, based on content published by Jamf: “Cybersecurity awareness month: a practitioner's view”.

Key questions

Q: How should security teams reduce phishing risk when AI makes scam messages more convincing?

A: Teams should stop relying on obvious spelling mistakes and train people to verify the sender, destination, and request through a separate channel.

Q: Why do overly permissive AI agents create governance risk?

A: Overly permissive agents expand the identity blast radius.

Q: What are the signs that an awareness programme is failing?

A: The clearest signs are repeated user interaction with suspicious messages, weak reporting rates, low follow-through on simulations, and recurring incidents that begin with the same social engineering pattern.

Practitioner guidance

• Run continuous phishing simulations Move beyond annual awareness modules and schedule recurring simulations that cover email, SMS, voice, and deepfake-style lures so employees experience evolving attack patterns.
• Classify AI agents as governed access subjects Inventory copilots, coding agents, and other tool-using systems, then define ownership, approval paths, and revocation rules for the access each one receives.
• Tighten approval paths for high-risk actions Require step-up review for data export, code execution, and destructive operations when those requests originate from AI-assisted workflows or unusual user behaviour.

Bottom line: AI has made phishing more believable, which reduces the value of training that depends on obvious warning signs.

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →