Security teams should keep humans in the approval path for any write action, including restarts, rollbacks, policy changes, and ticketed changes that can affect production. The safer pattern is to let agents collect context, propose actions, and package evidence, while explicit approval gates control execution. That preserves speed without surrendering accountability or auditability.
Why This Matters for Security Teams
Approval flows become fragile when AI agents can move from observation to action across telemetry, ticketing, and code. A workflow that is safe for humans can become unsafe for agents because the agent can chain tools, generate persuasive evidence, and request changes at machine speed. Current guidance suggests treating these agents as autonomous workloads, not as enhanced users, which means approvals must be designed around runtime intent and not just job title or ticket status.
The risk is not limited to malicious behavior. Well-meaning agents can still propose changes that are syntactically valid, operationally plausible, and strategically wrong for the environment. That is why security teams should anchor approval decisions in context, scope, and explicit execution authority, not just in who requested the change. Research from AI Agents: The New Attack Surface report shows that 80% of organisations report AI agents have already performed actions beyond their intended scope, which makes governance failures a practical reality rather than a theoretical concern.
For agentic workflows, the core issue is accountability: if a proposal can be assembled from logs, tickets, and code suggestions, the approval path must prove what was reviewed, what was authorised, and what was executed. In practice, many security teams encounter unsafe autonomy only after an agent has already created an approval-ready change request, rather than through intentional design of the workflow.
How It Works in Practice
The safest pattern is to split the agent workflow into three distinct stages: collect, propose, and execute. The agent may read telemetry, summarize incidents, draft a ticket, or prepare a rollback plan, but it should not be able to commit the write action without a human gate. That gate should verify the proposed scope, the blast radius, and the operational evidence before any production-affecting change is released.
Approval should be tied to the specific action, not the conversational thread. A ticket can capture the rationale, but it should not become an implicit grant of privilege. For write operations, use short-lived, task-scoped credentials and prefer workload identity over shared secrets so the system can prove what the agent is and what it is allowed to do at that moment. Standards such as the NIST AI Risk Management Framework and OWASP Agentic AI Top 10 both reinforce the need for explicit controls around autonomy, traceability, and misuse resistance.
- Let the agent gather logs, correlate alerts, and draft the change package.
- Require human approval for restarts, rollbacks, policy edits, and ticket transitions that trigger execution.
- Issue JIT credentials only after approval, with tight TTLs and automatic revocation.
- Log the proposal, approver, runtime context, and resulting action as separate audit records.
- Block agents from self-approving their own work, even if they can produce all supporting evidence.
NHIMG research on the OWASP NHI Top 10 and the Analysis of Claude Code Security shows why this separation matters: once an agent can influence code, tools, and operational state in one flow, the approval process must assume prompt injection, tool chaining, and privilege escalation are all in play. These controls tend to break down in environments where tickets automatically trigger deploy hooks or where chatops integrations can execute changes without a separate authorization boundary because the system confuses request generation with request approval.
Common Variations and Edge Cases
Tighter approval gates often increase operational latency, so organisations have to balance speed against blast-radius reduction. That tradeoff is real, especially in incident response, but best practice is evolving toward risk-based approvals rather than blanket trust. For low-risk actions, teams may allow agent-generated changes to queue automatically for review; for production writes, the human-in-the-loop requirement should remain non-negotiable.
There is no universal standard for this yet, but current guidance suggests several exceptions need explicit handling. Some environments will use dual approval for high-impact changes, while others will require only one approver if the agent is acting inside a pre-approved playbook. The important point is that the playbook must be bounded, time-limited, and observable. Where tickets, telemetry, and code all feed the same orchestration layer, the approval step should validate the runtime context, not merely the ticket metadata.
Edge cases appear when agents operate across multiple systems with different trust levels. For example, a benign telemetry insight can become a code patch, which then becomes a production deployment request. Security teams should break that chain with separate policy checks and separate credentials for each stage. As OWASP Top 10 for Agentic Applications 2026 and the CSA MAESTRO agentic AI threat modeling framework both imply, governance fails when the system treats a proposal as equivalent to an authorised change.
Standards & Framework Alignment
This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.
OWASP Agentic AI Top 10, CSA MAESTRO and OWASP Non-Human Identity Top 10 address the attack and risk surface, while NIST AI RMF and NIST CSF 2.0 set the governance and control requirements practitioners need to meet.
| Framework | Control / Reference | Relevance |
|---|---|---|
| OWASP Agentic AI Top 10 | A2 | Agent approval flows must resist unsafe autonomy and tool misuse. |
| CSA MAESTRO | T1 | MAESTRO models agent workflow risk across planning, tools, and execution. |
| NIST AI RMF | GOVERN | AI RMF governance supports accountability for autonomous decision-making. |
| OWASP Non-Human Identity Top 10 | NHI-03 | Ephemeral credentials reduce exposure when agents request operational changes. |
| NIST CSF 2.0 | PR.AC-4 | Least-privilege access limits the blast radius of agent-driven change requests. |
Issue short-lived, task-scoped credentials only after approval and revoke them on completion.
Related resources from NHI Mgmt Group
- How should security teams govern access across on-prem, cloud, code, and ticketing systems without creating siloed decisions?
- How should security teams govern autonomous remediation when AI agents can move from investigation to action?
- How should security teams govern API keys used for generative AI access?
- How should security teams inventory AI agents across SaaS, cloud, and low-code platforms?