Join our Newsletter — 33% off our NHI Course

Could AI-powered social engineering now slip past old controls?

 

(@nhi-mgmt-group)
Member Moderator
Joined: 2 years ago
Posts: 19717
Topic starter  

TL;DR: Social engineering now targets both humans and AI agents, expanding the trust boundary beyond classic phishing awareness, according to Doppel. Identity checks and intent checks need to happen earlier in the workflow before agents turn manipulation into action.

Editorial analysis by NHI Mgmt Group, based on content published by Doppel: “Building a Social Engineering Defense Platform to Protect Both Humans and AI Agents”.

Key questions

Q: Why do AI copilots and agents increase social engineering risk in enterprise workflows?

A: They compress trust into a faster decision path.

Q: What are the signs that an AI-assisted social engineering campaign is becoming dangerous?

A: Warning signs include prolonged back and forth contact, highly tailored references to a person’s hobbies or professional life, and a gradual shift from casual conversation to requests for information or action.

Q: How should security teams stop AI-powered social engineering from leading to privileged access?

A: Security teams should harden the approval path, not just the inbox.

Practitioner guidance

  • Harden support-channel identity verification Require strong verification before any support interaction can trigger reset, escalation, or data-release actions, especially when an AI agent is involved in the conversation.
  • Treat LLM-facing surfaces as a phishing domain Scan search, summarisation, and content-generation inputs for impersonation, malicious links, and credential-lure language, then block or warn before those surfaces are consumed by users or agents.
  • Add pre-action controls for low-latency agents Insert policy checks before an assistant agent can process email, forward messages, or invoke downstream actions that may create fraud or credential-theft exposure.

Bottom line: Social engineering now targets both humans and AI agents, so the trust boundary has expanded beyond classic phishing awareness.

Glossary terms: Agent-Directed Social Engineering, Trust Surface, Content Layer Poisoning, Low-Latency Assistant Risk

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →


This topic was modified 3 days ago by NHI Mgmt Group

   
Quote
(@mr-nhi)
Member Moderator
Joined: 6 months ago
Posts: 20207
 

Social engineering has become a cross-identity control problem, not a human awareness problem. The article shows that the manipulative objective stays the same whether the target is a person or an agent: induce trust and trigger action. That means awareness training alone cannot carry the programme, because machine-driven workflows can be manipulated without human hesitation ever entering the loop. Practitioners should treat social engineering as an identity governance issue across human and non-human actors.

A few things that frame the scale:

A question worth separating out:

Q: What should teams do when an agent can act faster than human review?

A: Move the control point earlier. If the assistant can read and act before review completes, enforce filtering, approval, and logging before the agent sees the message or reaches the action stage, because post-delivery review will be too late to stop the impact.

👉 Read our full editorial: Social engineering defense must now cover humans and agents


This post was modified 3 days ago by NHI Mgmt Group

   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.