Because they make decisions about what to do next, not just what to run. That extra judgement creates a new attack surface where deceptive files, webpages, or instructions can steer behaviour before a traditional control ever triggers. Teams need policy, provenance, and session governance, not just sandboxing.
Why This Matters for Security Teams
Agentic systems change the security problem because they do not just execute a fixed workflow. They interpret instructions, choose actions, call tools, and often persist across multiple steps or sessions. That means a malicious prompt, poisoned document, or deceptive web page can influence decisions before conventional perimeter controls see anything abnormal. The risk is not limited to model output quality; it extends to authorisation, data handling, and action execution. Guidance from the NIST AI Risk Management Framework is useful here because it treats AI risk as a governance and lifecycle issue, not a single technical control.
Security teams often underestimate how quickly an agent’s tool access turns a content problem into an operational one. If the system can open tickets, send messages, query internal data, or trigger code, then a small manipulation can cascade into business impact. Current best practice is evolving, but most mature programmes already separate prompt exposure, tool permission, and downstream action approval. In practice, many security teams encounter agent misuse only after an external instruction has already been followed, rather than through intentional control design.
How It Works in Practice
Stricter control for agentic systems means governing the full decision loop, not just the application boundary. A practical baseline is to constrain what the agent can see, what it can do, and when a human must approve the next step. That usually includes scoped tool permissions, short-lived credentials, session boundaries, logging of prompts and tool calls, and validation of outputs before any irreversible action.
The most useful control patterns align with the OWASP Agentic AI Top 10 and the MITRE ATLAS adversarial AI threat matrix, because both help teams think in terms of prompt injection, tool abuse, model manipulation, and chained exploitation. In operational terms, the security owner should ask four questions:
- What instruction sources can influence the agent, including emails, web pages, files, and retrieved context?
- Which tools can the agent call, and what limits apply to each action?
- Which steps require human approval, dual control, or a second policy check?
- How are provenance, audit logs, and rollback handled if the agent behaves unexpectedly?
For higher-risk deployments, threat modelling should also include agent memory, hidden state, and cross-session persistence, because those are common places where control assumptions fail. The CSA MAESTRO agentic AI threat modeling framework is useful for mapping these control points to real attack paths, and recent incident reporting from Anthropic shows why autonomous action chains deserve special scrutiny. These controls tend to break down when agents have broad internal network access and reuse long-lived credentials, because one compromised decision can propagate across many systems.
Common Variations and Edge Cases
Tighter control often increases friction, latency, and integration cost, so organisations must balance autonomy against containment. That tradeoff is especially visible when the agent supports customer operations, software engineering, or security operations, where too much gating can make the tool useless. There is no universal standard for this yet, but current guidance suggests using stronger controls as the agent gains authority, persistence, or access to sensitive data.
Some environments also need different treatment depending on the task. A read-only research assistant may only need content filtering, source validation, and output review, while an agent that can modify records or execute code needs step-up approval, policy enforcement, and stronger secrets governance. Where the agent uses APIs or service accounts, this intersects with non-human identity governance and privileged access management, because the agent’s identity becomes the control plane for its actions.
Edge cases often appear in retriever-heavy systems, browser-using agents, and multi-agent workflows. In those designs, a single compromised input can be passed between components, so provenance checks and trust boundaries matter more than model choice alone. Teams should also treat sandboxing as necessary but not sufficient, because a safe runtime does not prevent unsafe authorisation. The NIST AI Risk Management Framework and OWASP Top 10 for Agentic Applications 2026 both reinforce that the right control set depends on use case, impact, and autonomy level.
Standards & Framework Alignment
This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.
OWASP Agentic AI Top 10, MITRE ATLAS and CSA MAESTRO address the attack and risk surface, while NIST AI RMF and NIST AI 600-1 set the governance and control requirements practitioners need to meet.
| Framework | Control / Reference | Relevance |
|---|---|---|
| OWASP Agentic AI Top 10 | A1 | Agentic systems are exposed to prompt and tool abuse risks covered by the top 10. |
| NIST AI RMF | GOVERN | AI risk governance is needed because agents make discretionary decisions. |
| MITRE ATLAS | TEMPLATE | Agent misuse often follows adversarial AI patterns like prompt injection and manipulation. |
| CSA MAESTRO | MAESTRO helps threat model autonomy, memory, and control boundaries in agentic systems. | |
| NIST AI 600-1 | GenAI profiles help translate risk guidance into practical guardrails for deployed systems. |
Map every tool-calling path to the agentic top risks and add policy checks before action.