TL;DR: Phishing is harder to spot by eye because generative AI makes scam messages more convincing and less detectable, according to Valimail research. Email workflows now need sender proof before automation acts on a message.
Editorial analysis by NHI Mgmt Group, based on content published by Valimail: “Generative AI in cybersecurity: The new trust problem”.
Key questions
Q: Why does agentic AI make email authentication more important than content filtering?
A: Because an agent can act on what it reads, while a filter only evaluates what it sees.
Q: What breaks when an AI agent can process email without human review?
A: The human checkpoint breaks first, followed by the assumption that someone will notice a suspicious request before it has an effect.
Q: How should security teams reduce phishing risk when AI makes scam messages more convincing?
A: Teams should stop relying on obvious spelling mistakes and train people to verify the sender, destination, and request through a separate channel.
Practitioner guidance
- Move to DMARC enforcement for all domains Treat p=reject as the baseline for domains that send business mail, because monitoring alone leaves exact-domain spoofing available to attackers.
- Classify autonomous agent actions by approval boundary List which agent actions remain human-approved and which are permitted to execute without review, then remove financial, credential, and data changes from the autonomous set.
- Separate email ingestion from agent execution Ensure that inbound mail can be evaluated by policy before it can trigger routing, payment, or access workflows in an agentic system.
Bottom line: Generative AI has made phishing more convincing and less detectable by eye, so content quality is no longer a reliable trust signal.
Glossary terms: Cryptographic verification, Agentic AI, Prompt Injection (Agentic), DMARC
Explore further
View Full Forum → | NHI Foundation Course → | Our Services → | Read the full analysis →
Content is no longer a trustworthy security signal: Generative AI has reduced the cost of producing convincing email below the threshold where human pattern recognition remains dependable. Security programmes that still rely on visual tells are treating an attacker-controlled variable as a defensive control. The practitioner takeaway is that sender proof, not prose quality, has become the meaningful trust boundary.
A few things that frame the scale:
- 67% of organisations still rely heavily on static credentials despite the risks they pose to agentic AI deployments, according to the 2026 Infrastructure Identity Survey.
- 69% of security leaders agree identity management must fundamentally shift to address agentic AI systems, according to the 2026 Infrastructure Identity Survey.
A question worth separating out:
Q: What should organisations do when a message could trigger payment, credential, or access actions?
A: They should require authenticated sender identity, separate ingestion from execution, and keep high-risk actions behind explicit approval. If the message can influence money, credentials, or sensitive access, it should not be allowed to move straight from inbox to action. That applies whether the recipient is a person or an autonomous system.
👉 Read our full editorial: Cryptographic verification is now the baseline for AI-driven email trust