Join our Newsletter — 33% off our NHI Course
Home› FAQ› Agentic AI & Autonomous Identity› What breaks in threat models when an AI…
Agentic AI & Autonomous Identity

What breaks in threat models when an AI agent can act as both a user and a service?

← Back to all FAQ
By NHI Mgmt Group Editorial Team Updated October 12, 2026 Domain: Agentic AI & Autonomous Identity

A fixed-role threat model breaks when a single AI runtime can move between actor, process, data store and dataflow roles. That role fluidity makes spoofing, tampering and privilege escalation easier to miss because controls are usually designed around one stable identity and one stable function. The practical response is to map role transitions explicitly and attach authorization checks to each one.

Why fixed-role threat models fail when an AI agent can switch roles

The core problem is that many threat models assume a stable subject: one user, one service, one trust boundary, one set of permissions. An AI agent can collapse those distinctions by acting on behalf of a person, invoking services, storing state, and passing data between systems in the same runtime. That means the security question is no longer only “who is it?”, but “which role is it exercising right now?”

Once you treat the agent as a role-switching runtime, the analysis changes. The same execution path may be benign in one moment and high-risk in the next because the agent can inherit user context, use service credentials, or shuttle data into places that were not part of the original user journey. A fixed model misses that transition, so it underestimates spoofing, tampering, and privilege escalation.

That is why AI agent threat modelling needs an identity map and explicit trust boundaries, as laid out in Threat Modelling AI Agents. For a broader conceptual frame on how identity, access, and risk shift as autonomy increases, AI Agents vs Agentic AI is a useful companion.

What role fluidity changes in the attack surface

Role fluidity changes how trust is established, how provenance is preserved, and where control breaks should be expected. A single runtime may start by receiving a human instruction, then authenticate to an API, then write to storage, then hand data to another workflow. Each hop can alter the effective principal, the authorization context, and the data handling obligations.

This creates classic confused-deputy conditions. The agent may be technically authorised to perform an action, but not to perform it in the context or for the data scope now attached to that action. It also weakens the usefulness of assumptions like “the service is trusted” or “the user approved this request”, because the agent may have mixed those trust sources inside one execution path.

That is the reason per-action policy checks matter. NHIMG’s AI Agent Authorisation Guide focuses on task-scoped access, just-in-time permissions, and delegated authority, which are the right controls when one runtime can traverse several roles. The same issue is visible in agent and browser session abuse, where an agent can operate through an already-authenticated user context, as discussed in Browser and Computer-Use Agent Security Guide.

For concrete attack patterns, the agentic threat framing in MITRE ATLAS adversarial AI threat matrix helps map prompt injection, tool misuse, memory manipulation, and agent hijacking to the places role confusion can be exploited.

How to model role transitions so controls actually work

The practical fix is to model the transitions, not just the endpoints. Identify where the agent is acting as a user, where it is acting as a service, where it is merely transporting data, and where it is making an autonomous tool call. Each transition should have an explicit authorization rule, a bounded credential, and a clear audit trail.

That also means separating identity from capability. Do not assume a single agent identity can safely cover every function just because the runtime is the same. Break out the actions that need user delegation, the actions that need service privilege, and the actions that should never share credentials or state.

For practitioners, the best starting point is to align controls to the agent’s real operating modes. Agentic AI Identity Guide is strongest when you need to reason about delegation, registration, authentication, and retirement across those modes. If you need operational visibility, AI Agent Observability, Audit and Incident Response Guide shows why attribution, kill switches, and credential revocation matter once an agent can traverse multiple roles in one session.

Risk and Threat Considerations

Role-switching agents expand the blast radius of a single compromise because the same runtime may expose user context, service access, and stored data in one chain. The most likely failure mode is not a dramatic break in one control, but a control mismatch, where the agent’s current role no longer matches the assumptions behind the authorization or monitoring layer.

Failure mechanism: An attacker, poisoned input, or misrouted tool call causes the agent to reuse a trusted context in a different role, letting a benign user action inherit service-level power or let a service action masquerade as user-approved behaviour.

Impact: Defenders miss spoofing, tampering, and privilege escalation because logs, policies, and reviews were built for one stable principal instead of a role-fluid runtime, so abuse can persist across tools and workflows before it is noticed.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

OWASP Agentic AI Top 10 and CSA MAESTRO address the attack and risk surface, while NIST SP 800-53 Rev 5 and NIST Zero Trust (SP 800-207) set the governance and control requirements practitioners need to meet.

FrameworkControl / ReferenceRelevance
OWASP Agentic AI Top 10ASI03 — Identity & Privilege AbuseRole switching creates identity and privilege confusion in agent workflows.
Recommendation — Bind each agent role transition to a separate authorization decision and bounded privilege.
CSA MAESTROAIS — Autonomy, Identity and SecurityThe question centers on autonomy changing trust boundaries and identities in agent workflows.
Recommendation — Model autonomous role changes as distinct trust boundaries and enforce checks at each hop.
NIST SP 800-53 Rev 5AC-6 — Least PrivilegeSeparate user and service behaviours need privilege minimization to limit abuse paths.
AU-2 — Event LoggingRole-fluid agents require logs that preserve which role executed each action.
Recommendation — Minimize each agent action to the least privilege required for that specific role. Log role transitions and action context so each decision is attributable after the fact.
NIST Zero Trust (SP 800-207)Zero Trust ArchitectureContinuous verification is needed when an agent changes context and authority.
Recommendation — Verify every request at the point of use instead of trusting the outer session.

Practitioner Guidance

What to prioritise: Model every role transition explicitly, then decide which ones need separate credentials, separate policy checks, or separate approval paths. The highest-risk transitions are those that cross from user context into service authority, or from read-only analysis into write or act capabilities.

What to verify: Confirm that audit records can attribute each meaningful action to the role actually exercised at that moment, not just to the outer session or the original human request. If you cannot reconstruct that chain, you do not have a reliable control plane for the agent.

Decision rule: If an AI runtime can both carry user intent and execute service-side actions, treat it as at least two security subjects for authorization purposes. Do not trust a single allow rule to cover both behaviours.

Practitioner takeaway: The security mistake is to model the agent as one thing when it is behaving like several principals in sequence, so the control objective is role-by-role containment, not just identity assignment.

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.

NHIMG Editorial Note
Reviewed and updated by the NHIMG editorial team on October 12, 2026.
NHI Mgmt Group — the #1 independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org