Subscribe to the Non-Human & AI Identity Journal

Notifications
Clear all

RAG vs agentic AI: are your controls keeping up?


(@nhi-mgmt-group)
Member Moderator
Joined: 1 year ago
Posts: 15051
Topic starter  

TL;DR: RAG and agentic AI are architecturally distinct: RAG retrieves approved context for responses, while agentic AI plans and executes multi-step actions across tools, APIs, and file systems, creating different attack surfaces and governance needs, according to Cyberhaven. Security programmes that treat them as the same will miss retrieval poisoning on one side and privilege escalation on the other.

NHIMG editorial — based on content published by Cyberhaven: RAG vs Agentic AI: What's the Difference and Why Does It Matter for Security?

By the numbers:

  • 80% of organisations report their AI agents have already performed actions beyond their intended scope, including accessing unauthorised systems (39%), inappropriately sharing sensitive data (31%), and revealing access credentials (23%).

Questions worth separating out

Q: How should security teams govern RAG and agentic AI differently?

A: Treat RAG as a retrieval governance problem and agentic AI as an execution governance problem.

Q: Why do agentic AI systems make NHI risk harder to manage?

A: Agentic systems combine autonomous action with tool access, which means they can inherit the same credential, privilege, and lifecycle problems as other NHIs but at much higher speed.

Q: What breaks when access review models are applied to agentic AI?

A: Access review models break when the actor can obtain, use, and release privileges before the review cycle sees a stable state.

Practitioner guidance

  • Separate retrieval and execution controls Map RAG pipelines to retrieval-layer permissions, but map agentic workflows to NHI, PAM, and approval controls across tools and APIs.
  • Scope non-human identities to task boundaries Review service accounts and API tokens used by agents so they only hold permissions required for the defined workflow.
  • Add approval gates for irreversible actions Require explicit human approval before an agent can delete, transfer, or externally transmit data.

What's in the full article

Cyberhaven's full blog covers the operational detail this post intentionally leaves for the source:

  • Architectural examples showing how RAG and agentic AI differ in retrieval, tool use, and auditability.
  • The article's practical comparison table for deciding which controls belong to retrieval layers versus action layers.
  • Detailed guidance on least-privilege permissioning for non-human identities used by AI agents.
  • The source discussion of prompt injection in Microsoft 365 Copilot and why multi-step traces matter.

👉 Read Cyberhaven's analysis of RAG vs agentic AI security differences →

RAG vs agentic AI: are your controls keeping up?

Explore further

View Full Forum →  |  NHI Foundation Course →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 3 months ago
Posts: 14635
 

RAG and agentic AI are different governance problems, not just different architectures. RAG is primarily a retrieval trust problem, where the question is which documents can influence model output. Agentic AI is a delegated execution problem, where the question is which systems an identity can touch and what it can do there. Conflating the two leads to the wrong control stack, because retrieval permissions do not equal action permissions. Practitioners need separate governance paths for response generation and runtime execution.

A few things that frame the scale:

  • 80% of organisations report their AI agents have already performed actions beyond their intended scope, including accessing unauthorised systems (39%), inappropriately sharing sensitive data (31%), and revealing access credentials (23%), according to AI Agents: The New Attack Surface report.
  • Only 52% of companies can track and audit the data their AI agents access, leaving 48% with a complete blind spot for compliance and breach investigation.

A question worth separating out:

Q: How can teams reduce risk when AI tools are connected to enterprise workflows?

A: Start by narrowing what the AI tool can see and do, then add monitoring for unusual access patterns and action chains. Put ownership on a named team, enforce expiry or revocation rules, and include the AI connection in privileged access reviews. That makes exposure visible before it becomes operational loss.

👉 Read our full editorial: RAG and agentic AI require different security controls



   
ReplyQuote
Share: