Subscribe to the Non-Human & AI Identity Journal

What do security teams get wrong about DLP and AI assistants?

They assume DLP will catch unsafe sharing even when the assistant is acting inside a trusted workflow. In practice, the failure is often contextual: the wrong record is summarised, the wrong recipient is served, or policy labels are ignored without a classic exfiltration event. Behaviour monitoring is the missing layer.

Why Security Teams Misread DLP in AI Assistant Workflows

DLP is designed to spot policy violations at the moment data leaves a boundary, but AI assistants often operate inside an approved workflow and never look like classic exfiltration. The real risk is contextual misuse: a summariser pulls the wrong case file, an assistant drafts a reply to the wrong recipient, or a policy label is silently ignored during tool use. That is why behaviour and intent matter as much as content inspection.

Security teams often overestimate the protection value of a control that was built for file movement, email gateways, and endpoint copy events. In AI-assisted workflows, the assistant may have legitimate access to sensitive records, while the unsafe action is the decision it makes with that access. NIST’s NIST SP 800-53 Rev 5 Security and Privacy Controls is useful here because it reinforces that monitoring, auditability, and access control need to work together, not in isolation.

The practical lesson is that DLP remains necessary, but it is not sufficient for AI assistants that can read, infer, transform, and route data on a user’s behalf. NHI Management Group’s analysis of the State of Non-Human Identity Security shows why teams keep missing this class of problem: the control gap is usually visibility and governance, not just credential theft. In practice, many security teams encounter the failure only after a sensitive response has already been generated, rather than through intentional policy testing.

How DLP Has to Change for AI Assistants

AI assistants are not passive conduits. They can chain prompts, query tools, retrieve records, and compose output across systems, which means the security decision must happen at runtime with context about the request, the data source, the user, and the model’s tool scope. Current guidance suggests treating the assistant as an active policy participant, not just another endpoint to inspect.

That shifts the control model in three ways. First, authorisation needs to be intent-aware: can this assistant summarise this record for this user, in this channel, right now? Second, access needs to be ephemeral, with just-in-time credentials and short-lived tokens rather than standing access that persists after the task is done. Third, monitoring must focus on behaviour signals, such as unusual retrieval patterns, repeated fallback requests, or unexpected recipient selection, because the harmful event may be a bad decision rather than a blocked transfer.

  • Bind the assistant to a workload identity so the platform can prove what the agent is, not only what credentials it holds.
  • Use policy-as-code so authorisation is evaluated on each request, not only at provisioning time.
  • Log prompt, tool, and output events together so review can reconstruct the chain of action.
  • Revoke access immediately after task completion to reduce the blast radius of misuse.

For implementation thinking, the LLMjacking research is a useful reminder that AI systems are attractive targets precisely because their credentials and tool paths can be abused quickly once exposed. The relevant external model is the NIST control family approach to logging, access enforcement, and continuous monitoring, which maps well to assistant telemetry. These controls tend to break down when the assistant spans SaaS apps, chat surfaces, and custom tools because policy context is fragmented across systems.

Where DLP Still Helps, and Where It Breaks Down

Tighter DLP often increases false positives and user friction, requiring organisations to balance leakage prevention against workflow speed and analyst fatigue. That tradeoff matters because AI assistants amplify both sides: they can prevent unsafe sharing, but they can also generate constant borderline events that traditional DLP was never tuned to interpret.

There is no universal standard for this yet, but best practice is evolving toward layered controls. DLP should still inspect obvious high-risk outputs such as regulated identifiers, customer records, and secrets, while behavioural monitoring decides whether the assistant is acting outside expected use. That matters most when the assistant is embedded in a trusted business process, because the biggest risk is not obvious theft but silent misuse of authorised data.

The NHI security confidence gap highlights the broader governance problem: organisations often trust the system boundary more than the identity and behaviour inside it. Security teams should therefore test scenarios such as wrong-record retrieval, incorrect routing, and label suppression, not just blocked file uploads. DLP remains a useful layer, but it cannot be the only layer when an assistant can decide what data means and where it goes.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

OWASP Agentic AI Top 10, CSA MAESTRO and OWASP Non-Human Identity Top 10 address the attack and risk surface, while NIST AI RMF and NIST CSF 2.0 set the governance and control requirements practitioners need to meet.

Framework Control / Reference Relevance
OWASP Agentic AI Top 10 A2 Addresses unsafe tool use and autonomous actions that bypass classic DLP assumptions.
CSA MAESTRO GOV-02 Covers governance for agent behaviour, which DLP alone does not control.
NIST AI RMF Supports measuring and managing AI risk beyond static data loss controls.
OWASP Non-Human Identity Top 10 NHI-01 Relevant because assistant misuse often starts with over-scoped machine identity.
NIST CSF 2.0 DE.CM-08 Behaviour monitoring and logging are central to detecting AI assistant misuse.

Add policy and oversight for every assistant workflow that can read, transform, or route data.