Join our Newsletter — 33% off our NHI Course

How should teams govern AI agents across model, tools, and environment?

 

(@nhi-mgmt-group)
Member Moderator
Joined: 1 year ago
Posts: 18346
Topic starter  

TL;DR: Anthropic’s proposed four-layer model for AI agent security divides responsibility across model, harness, tools, and environment, according to Backslash Security, while noting that 93% of permission prompts were approved without reading and clarification on complex tasks occurred only 16.4% of the time. Approval-based oversight is already brittle, and governance now has to move from prompts to persistent control of agent permissions, tool drift, and deployment context.

Editorial analysis by NHI Mgmt Group, based on content published by Backslash Security: “Anthropic's Shared Responsibility Security Model for AI Agents, Explained”.

By the numbers:

  • Anthropic reports that 93% of permission prompts were approved without reading.
  • Anthropic says the clarification rate on complex tasks was just 16.4%.

Key questions

Q: What breaks when AI governance relies only on approval workflows?

A: Approval-only governance breaks when usage shifts outside sanctioned channels.

Q: Why do AI agents need centralized governance when they access multiple tools and models?

A: AI agents increase risk because they can invoke tools, move across systems, and act without direct human supervision.

Q: What are the signs that an AI agent permission model is failing in practice?

A: Common signs include agents requesting access beyond their role, attempting sensitive actions without clear approval, or operating with no audit trail for who approved what.

Practitioner guidance

  • Map agents to the four responsibility layers Document which risks belong to the model provider and which belong to your organisation across harness, tools, and environment.
  • Move approval logic out of the action path Design policy at harness level so the agent is authorised by rules and boundaries before execution begins, rather than waiting for a human to review each prompt or tool call.
  • Inventory and revalidate connected tools Track every MCP server, API, and plugin an agent can use, then review any tool change as a governance event because post-approval drift changes the effective permission set.

Bottom line: AI agent security is not solved by model behaviour alone because the harness, tools, and environment carry most of the operational risk.

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 6 months ago
Posts: 17926
 

Agent governance is a shared responsibility problem, not a model-safety problem. Anthropic’s four-layer framing is useful because it separates what the model provider can control from what the deploying organisation must own. The critical insight is that most security failure modes emerge in the harness, tools, and environment layers after the model decision is made. Practitioners should stop treating the model as the boundary of accountability.

A few things that frame the scale:

A question worth separating out:

Q: How should teams decide between model safety controls and agent governance controls?

A: Use model safety controls for the behaviour the model provider owns, but use agent governance controls for everything that happens after the model is connected to tools and data. The practical boundary is simple: if the risk comes from instructions, tool access, memory, or environment, the deploying organisation owns it and should govern it accordingly.

👉 Read our full editorial: Anthropic's shared responsibility model reframes AI agent governance



   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.