Join our Newsletter — 33% off our NHI Course

Who is accountable when an AI system using MCP accesses the wrong tool or data set?

Accountability sits with the organisation that defined the scopes, approvals, and monitoring around the MCP server, not with the protocol itself. Security, platform, and identity teams need explicit ownership for authorization design, logging, and revocation so the delegation chain is clear when misuse occurs.

Why This Matters for Security Teams

When an AI system reaches through MCP to the wrong tool or dataset, the issue is not a protocol defect so much as a control failure across identity, authorization, and monitoring. MCP can standardise how tools are exposed, but it does not decide what an agent should be allowed to do. That means accountability sits with the organisation that set the scopes, approvals, and revocation logic, not with the protocol itself.

This is exactly where AI governance gets misread as an integration problem. Current guidance from the OWASP Agentic AI Top 10 and the AI Agents: The New Attack Surface report points to a common reality: once agents are allowed to chain tools, a single overbroad scope can become a data exposure event. NHIMG research also shows that only 52% of companies can track and audit what their AI agents access, leaving nearly half operating with no reliable investigation path.

Security teams should treat MCP as a control plane boundary, not an accountability shield. In practice, many teams discover broken delegation only after an agent has already queried sensitive data, not through deliberate design review.

How It Works in Practice

Accountability works best when it is assigned across the full delegation chain. The organisation owns the policy, the platform team owns the MCP server configuration, the identity team owns workload identity and token issuance, and the security team owns logging, detection, and revocation. That division matters because autonomous systems do not behave like fixed-service accounts. Their access patterns change with prompts, context, and tool chaining.

Practically, the safest model is runtime authorisation rather than static role assignment. An AI agent should present workload identity, such as an OIDC token or SPIFFE-based identity, and receive just-in-time access that is scoped to the specific task. That scope should be short-lived, context-aware, and automatically revoked when the task ends. Static, long-lived credentials are poor fit for goal-driven systems because the agent can use them in ways no human reviewer anticipated. The emerging pattern is policy-as-code with real-time evaluation, using approaches aligned with NIST SP 800-53 Rev. 5 control expectations and the operational guidance in Ultimate Guide to NHIs.

  • Define which team approves MCP tool scopes and who can override them.
  • Log every tool call, dataset request, and policy decision with immutable timestamps.
  • Issue short-lived credentials per workflow, not per agent lifetime.
  • Bind each agent session to workload identity so access can be traced and revoked.
  • Test for lateral movement across chained tools, not just single-tool misuse.

NHIMG guidance on OWASP Agentic Applications Top 10 reinforces that the practical control is not “trust the agent less,” but “make every action independently authorisable.” These controls tend to break down in loosely governed sandbox environments where MCP servers inherit broad backend privileges and no one team owns end-to-end revocation.

Common Variations and Edge Cases

Tighter MCP control often increases operational overhead, requiring organisations to balance faster agent productivity against stronger approval and logging discipline. That tradeoff becomes sharper in environments with many tools, nested data stores, or multiple model vendors, because the delegation chain can cross several teams before a single request is executed.

There is no universal standard for MCP accountability yet, so current guidance suggests documenting ownership explicitly rather than assuming the protocol layer settles the question. In mature environments, the accountable party is usually the system owner or business owner, while implementation responsibility is shared across platform, security, and identity functions. In regulated settings, legal and compliance teams may also need visibility into the policy used to approve access, especially when sensitive data is involved.

Edge cases appear when an agent acts on behalf of a human but with delegated privileges, or when an MCP server brokers access to multiple downstream systems. In those cases, the organisation should preserve a clear audit trail from user intent to agent action to tool result. NHIMG analysis of agent behaviour and 52 NHI Breaches Analysis both show that ambiguity in ownership usually becomes visible only after a misuse event. Best practice is evolving, but the accountable answer remains the same: if the organisation defined the access path, it owns the consequences when that path is misused.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

OWASP Agentic AI Top 10, CSA MAESTRO and OWASP Non-Human Identity Top 10 address the attack and risk surface, while NIST AI RMF and NIST CSF 2.0 set the governance and control requirements practitioners need to meet.

Framework Control / Reference Relevance
OWASP Agentic AI Top 10 A2 Covers excessive tool and data access by autonomous agents.
CSA MAESTRO G1 Addresses governance and accountability across agentic workflows.
NIST AI RMF Frames accountability, traceability, and risk management for AI systems.
OWASP Non-Human Identity Top 10 NHI-04 Relevant to non-human identity authorization and credential scope control.
NIST CSF 2.0 PR.AC-4 Access permissions and identity management apply to MCP-backed workloads.

Assign clear owners for policy, approval, monitoring, and revocation across the MCP chain.