Subscribe to the Non-Human & AI Identity Journal

Who is accountable when an AI agent causes a security incident?

Accountability should sit with the business owner, the system owner, and the security function together, because agent behaviour crosses operational boundaries. Organisations need a defined owner for approval, monitoring, and retirement, plus audit evidence that shows what the agent accessed and why.

Why This Matters for Security Teams

When an AI agent triggers an incident, the question is not whether the model “meant” to do it, but who approved the agent, who constrained its tool access, and who is responsible for the operational outcome. That is why accountability must be explicit before deployment, not assigned after the fact. Current guidance from NIST AI Risk Management Framework treats governance as a lifecycle duty, while OWASP Agentic AI Top 10 and NHIMG research both point to the same operational reality: autonomous systems can exceed intended scope quickly.

That matters because agentic behaviour is not bounded like a normal application request. An agent can chain tools, reuse tokens, call APIs in loops, and take actions that no static approval matrix anticipated. If the business owner, system owner, and security function do not share a clear decision trail, incident response becomes argument, not containment. The right question is therefore who owns approval, monitoring, and retirement of the agent, and who can prove what it accessed and why using audit evidence. In practice, many security teams encounter this only after the agent has already accessed something sensitive, rather than through intentional control design.

How It Works in Practice

Accountability works best when it is attached to the agent’s operating model, not just to a department chart. The business owner should own the use case and the acceptable task boundary. The system owner should own technical implementation, runtime controls, and logging. The security function should own policy, exception handling, and review. That split is consistent with CSA MAESTRO agentic AI threat modeling framework and the governance model in NIST AI Risk Management Framework.

In practice, the controls should reflect the autonomous and goal-driven nature of the workload:

  • Use workload identity for the agent, so every action is tied to a cryptographic identity, not a shared service account.
  • Issue JIT credentials and short-lived secrets per task, then revoke them automatically when the task completes.
  • Evaluate intent-based authorisation at runtime, so access depends on what the agent is trying to do, not just what role it has.
  • Log tool calls, data access, and policy decisions in a form that supports audit and incident review.

NHIMG research shows why this matters. The OWASP NHI Top 10 highlights the risks of over-privileged non-human identities, while the 52 NHI breaches Report shows how identity weakness becomes breach material. The SailPoint report on AI agents found that 80% of organisations saw agents act beyond intended scope and only 52% could track and audit the data those agents accessed. These controls tend to break down when the agent must operate across multiple tools and shared data domains because policy gaps appear between systems.

Common Variations and Edge Cases

Tighter control often increases operational overhead, requiring organisations to balance safety against speed, especially where agents support production workflows. There is no universal standard for liability allocation yet, so current guidance suggests documenting accountability in policy, contracts, and change records rather than assuming the technology stack will settle it. That is especially important when vendors host the model, a platform team runs the orchestration layer, and a business unit owns the use case.

Edge cases usually involve unclear boundaries. If the agent is embedded in a customer-facing product, the product owner may carry first-line accountability, but the security team still owns control design. If the agent uses MCP-style tooling or can call internal systems directly, the blast radius is larger and the audit standard must be stricter. If the agent receives long-lived secrets or broad RBAC access, incident attribution becomes harder because the system can no longer distinguish expected from excessive behaviour. NHIMG’s analysis of AI LLM hijack breach and vendor research on credential abuse show how quickly exposed secrets become operational compromise. For that reason, governance should be built around Ultimate Guide to NHIs — Why NHI Security Matters Now and aligned with OWASP-AGENTIC, NIST-AIRMF, and CSA-MAESTRO, but treated as living control design rather than a one-time approval.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

OWASP Agentic AI Top 10 and CSA MAESTRO address the attack and risk surface, while NIST AI RMF set the governance and control requirements practitioners need to meet.

Framework Control / Reference Relevance
OWASP Agentic AI Top 10 A2 Agentic overreach and tool misuse drive incident accountability needs.
CSA MAESTRO MAESTRO maps governance, monitoring, and response for agentic systems.
NIST AI RMF GOVERN AI RMF governance sets ownership and lifecycle accountability for AI systems.

Constrain agent tools to approved tasks and review every high-risk action at runtime.