That design breaks separation of duties. An agent that can both assess risk and act on it can overreach, leak sensitive data, or approve actions it should only recommend. The safer pattern is to give agents tightly scoped read access, require independent approval for changes, and enforce hard authorization checks in the environment rather than trusting the model’s own judgment.
Why the Separation Breaks the Moment the Agent Can Both Judge and Act
The core problem is that evaluation and execution stop being independent. Once an agent can inspect a vendor assessment and also reach customer records or modify access, it can turn a recommendation into a direct action path. That collapses separation of duties, expands blast radius, and makes a flawed model decision materially more dangerous than a flawed human review.
Read access to assessment data is not the same as authority over production data or permissions. The control failure appears when the same automated entity can move from analysis to impact without an independent gate. That is where overreach, privilege abuse, and unintended disclosure become practical risks rather than theoretical ones.
What Good Design Looks Like in Practice
A safer pattern is to split the workflow so the agent can gather context, summarize findings, and flag exceptions, but cannot directly perform sensitive actions. If it must propose access changes, those changes should be approved by a separate control path and enforced by the environment, not by the model’s own confidence or chain-of-thought. For vendor reviews, keep the agent on the evidence-gathering side unless the downstream action is narrowly bounded and explicitly authorized.
What to verify: Confirm that the agent’s read scope is narrower than the data it could affect, and that any action path requires an independent policy decision outside the model runtime. If the same tool session can both inspect customer data and call privileged APIs, the design is already too broad.
What to prioritise: Minimise standing authority first, then add step-up approval or human confirmation for any permission change, record access, or data retrieval beyond the review task. Tight scoping matters more than making the agent “smarter” because judgment does not compensate for excessive authority.
Practitioner takeaway: Treat the agent as an analyst, not an adjudicator or operator, unless you can prove that every sensitive action remains independently authorized, bounded, and reversible.
Risk and Threat Considerations
When an agent can review risk and then immediately act on the systems involved, a mistaken or manipulated assessment can become direct exposure. The main threats are data leakage, unauthorized permission changes, and policy bypass through tool access that was granted too broadly for the task.
Failure mechanism: The agent crosses from advisory work into execution with no hard separation, so a bad prompt, poisoned input, or overbroad tool scope can convert analysis into unauthorized access or modification.
Impact: Sensitive customer records may be exposed, permissions may be expanded incorrectly, and the organisation may lose the ability to prove who authorized the change or why it happened.
Standards & Framework Alignment
This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.
OWASP Agentic AI Top 10 and OWASP Non-Human Identity Top 10 address the attack and risk surface, while NIST CSF 2.0 and CIS Controls v8 set the governance and control requirements practitioners need to meet.
| Framework | Control / Reference | Relevance |
|---|---|---|
| OWASP Agentic AI Top 10 | A2 — Agentic Access Control | Covers limiting agent authority to prevent tool misuse and privilege overreach. |
| A5 — Agent Identity and Authentication | Applies where the agent's own identity and credentials gate access to customer records or admin actions. | |
| Recommendation — Enforce hard authorization checks before any agent can read sensitive data or change permissions. Bind agent actions to strong identity controls and separate credentials from review-only access. | ||
| OWASP Non-Human Identity Top 10 | NHI-03 — Overprivileged Non-Human Identities | Directly addresses the risk of an automated identity holding more access than its review task needs. |
| NHI-06 — Secrets and Token Exposure | Relevant because the same overbroad agent often reaches data or actions through exposed tokens or keys. | |
| Recommendation — Reduce agent privileges to the minimum required for assessment and deny write access by default. Protect and scope the credentials the agent uses so review access cannot become admin access. | ||
| NIST CSF 2.0 | PR.AC — Access Control | Fits the need to separate read access from action authority in AI-assisted workflows. |
| PR.PS — Platform Security | Applies when environment-enforced controls must constrain what the agent can do regardless of model output. | |
| Recommendation — Apply access control policies that separate assessment permissions from operational change permissions. Enforce platform-level controls so the environment, not the model, determines permitted actions. | ||
| CIS Controls v8 | 6 — Access Control Management | Directly supports least privilege and approval boundaries for agents touching records or permissions. |
| 8 — Audit Log Management | Relevant because independent logging is needed to reconstruct agent-initiated reviews and changes. | |
| Recommendation — Restrict and review agent access so it cannot both inspect sensitive records and alter entitlements. Log agent reads, recommendations, and changes so reviewers can separate analysis from execution. | ||
Practitioner Guidance
Decision rule: If an agent can touch regulated, customer, or privileged data, require an explicit control boundary between read-only analysis and any action that changes state. Do not allow the same runtime to both recommend and execute unless the action is low impact, pre-approved, and tightly constrained.
What to measure: Track how many agent workflows can reach production data, how many can mutate permissions, and how many of those mutations require a separate approval event. A healthy design shows a clear drop-off from observation to action authority.
Common mistake: Treating the model’s internal confidence as a substitute for authorization. The safer choice is to constrain tool permissions first and let the approval process, not the model, decide when a change is allowed.
Practitioner takeaway: The key question is not whether the agent can reason correctly, but whether it can ever convert a reasoning error into an unauthorized change.
Related resources from NHI Mgmt Group
- What breaks when AI-driven DevOps permissions can change an agent's goal?
- What breaks when AI access to customer records is not logged per record?
- What breaks when Unity Catalog permissions are the only control on AI agent access?
- What breaks when organisations review AI agent access only at the prompt or workflow level?