AI agents create more risk when controls end at development because the highest-impact failures often appear only during execution. Runtime behaviour can diverge from design, revealing prompt injection, data exposure, anomalous actions, or unintended access. Without continuous enforcement, teams may approve safe-looking workflows that later operate outside intended policy and governance boundaries.
Why policy stops at development but risk does not
AI agents are not static code paths. Once they move into production, they interpret prompts, call tools, and make context-dependent decisions that can change from one run to the next. That means a policy that only governs training, testing, or pre-release approval leaves the highest-risk phase unchecked: execution. In practice, the issue is not whether the workflow looked safe in review, but whether the agent can still be steered, over-privileged, or induced to act outside intent after deployment.
This is why runtime enforcement matters for agentic systems. A development-time gate can confirm design intent, but it cannot reliably contain prompt injection, data leakage, unauthorized tool use, or emergent behavior once the agent is interacting with live systems and live data. Current guidance from the OWASP Top 10 for Agentic Applications 2026 and the NIST AI Risk Management Framework both reflect the need to manage AI risk across the full lifecycle, not only at build time.
In practice, teams discover the mismatch only after an agent has already interacted with production systems, not when the approval checklist was signed off.
How runtime policy changes the security model
Effective agent governance treats policy enforcement as a live control, not a release artifact. The security objective is to constrain what the agent may do at the moment it acts: what data it can read, which tools it can invoke, which systems it can touch, and what conditions trigger human review or denial. That usually requires short-lived permissions, continuous evaluation, and observability that ties each action back to a policy decision.
Static development controls fail because they assume the agent will behave exactly as tested. Agentic systems break that assumption by design: they process dynamic inputs, adapt to new context, and can chain multiple actions across services. A safe code review therefore does not guarantee safe execution. This is especially important where the agent can browse internal documents, execute transactions, trigger workflows, or generate follow-on requests that another system will trust.
Practitioners usually need three layers working together: pre-deployment approval for baseline intent, runtime policy enforcement for every sensitive action, and post-action logging for audit and investigation. The distinction matters because policy at development time can approve the existence of a capability, while runtime policy decides whether the capability should be used right now. For agents with tool access, that difference is the whole control boundary.
The practical lesson is reinforced by the AI Agents: The New Attack Surface report, which shows many organisations already see agents operating beyond intended scope and often lack complete audit visibility. Runtime controls need to be designed for that reality, not for an idealised lab environment.
- Use session-scoped access instead of standing permissions where the agent can complete a task without persistent authority.
- Evaluate each tool call against current context, not just against the original approval of the workflow.
- Log prompts, tool outputs, decisions, and downstream effects so a later review can reconstruct the execution chain.
These controls tend to break down when agents can trigger other automations or inherit trust from downstream systems, because the policy boundary becomes indirect and harder to enforce consistently.
Where development-only governance breaks down in real deployments
A development-only model creates a false sense of assurance because it optimises for what can be reviewed before launch, not what can happen during operation. That tradeoff is especially costly in environments where agents have access to customer data, internal knowledge stores, finance workflows, or administrative tools. The more valuable the action, the more damaging it is if policy is not rechecked at execution time.
There is also a governance gap between teams. Engineering may approve the agent as implemented, but security, legal, and compliance often need proof of what it actually accessed and why. The State of Secrets in AppSec highlights how sensitive material already escapes normal controls when oversight is weak, and agentic systems can amplify that problem because they operate at machine speed and across multiple systems.
Best practice is evolving, but the current consensus is clear: if the agent can make consequential decisions after deployment, the policy must follow those decisions. A pre-release test is useful; it is not a substitute for runtime denial, constraint, and audit. Organisationally, the biggest failure is treating agent approval as a one-time event instead of an ongoing security condition.
For a concise, practitioner-focused view of agent control patterns, the OWASP NHI Top 10 resource is also useful because it connects machine-identity and agent governance to real operational failure modes.
Standards & Framework Alignment
This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.
OWASP Agentic AI Top 10 and CSA MAESTRO address the attack and risk surface, while NIST AI RMF, NIST CSF 2.0 and CIS Controls v8 set the governance and control requirements practitioners need to meet.
| Framework | Control / Reference | Relevance |
|---|---|---|
| OWASP Agentic AI Top 10 | A1 — Agentic Access Control | Agent misuse and overreach are core agentic security concerns. |
| Recommendation — Enforce runtime access limits for every agent tool call and decision. | ||
| CSA MAESTRO | GOV-02 — Runtime Governance and Oversight | The issue is governance that continues after deployment. |
| Recommendation — Apply runtime oversight so approvals do not stop at release. | ||
| NIST AI RMF | GOVERN — Govern, map, and measure AI risks | The question concerns lifecycle AI risk governance beyond build time. |
| Recommendation — Govern AI risks across deployment, monitoring, and response phases. | ||
| NIST CSF 2.0 | PR.AC-4 — Access Permissions Management | Runtime policy must constrain what the agent can access and use. |
| Recommendation — Limit agent permissions to the minimum needed for each execution. | ||
| CIS Controls v8 | 6.2 — Establish an Asset Inventory and Authorization Process | Agent tool access must be inventoried and authorised as it changes. |
| Recommendation — Track agent-exposed tools and reauthorise access as scope changes. | ||
Practitioner Guidance
What to prioritise: Put runtime authorization, tool-call gating, and session-scoped credentialing ahead of broader feature expansion. If an agent can touch live systems, the first question is not whether the workflow was approved, but whether each execution is still valid under current context.
What to verify: Confirm that the agent’s permissions expire, narrow as tasks complete, and are observable end to end. Verify that every sensitive action produces an auditable record of input, decision, tool use, and outcome; without that chain, post-incident review becomes guesswork.
Decision rule: If a control only exists in development or pre-release testing, treat it as design assurance, not operational enforcement. If the same agent can still read, transform, or transmit sensitive data in production, the residual risk remains active until runtime controls are in place.
Common mistake: Teams often overestimate the safety of prompt review and underweight the risk of tool execution. The prompt may be harmless; the chained action it triggers may not be.
Practitioner takeaway: The security boundary for AI agents is the moment of action, not the moment of approval, so governance must be enforced where the agent can still fail, adapt, or overreach.
Related resources from NHI Mgmt Group
- Why do read-only AI agents still create serious security risk?
- Why do AI development environments create more security risk than traditional dev environments?
- Why do AI agents create a larger security risk than ordinary web applications?
- Why do AI agents with long-term memory create more security risk than stateless chatbots?