Most organisations approve AI agents as if they were one kind of thing, when the real risk depends on how much the agent decides and does without a person. A drafting assistant that suggests replies and an agent that wakes up on a cloud alert and changes firewall rules can run on the same model, yet they need very different identities, permissions, approval gates and monitoring. An autonomy level gives security, risk and engineering teams a shared label for that difference, so controls scale with it instead of being argued case by case. This guide compares the published autonomy schemes, sets out a working scheme NHI Mgmt Group uses for control mapping, and shows which controls belong at each level, how to assign and test a level, and how to move an agent up or down safely. It is written for security architects, IAM and NHI teams, AI platform owners and risk functions who sign off agent deployments.
Key takeaways
- Autonomy is a design choice, not a model property. The same capable model can be deployed to suggest only or to act alone; the level is set by approvals, triggers and permissions around it.
- Separate autonomy from agency. Agency is what the agent can touch (tools, scopes, systems); autonomy is how much it decides without a person. Both must be bounded, and a low autonomy level does not excuse broad permissions.
- Controls should step up with the level. Read-only agents need least privilege and logging; agents acting without per-action approval need budgets, behavioural baselines, a tested kill switch and their own identity.
- Assign the level to a deployment, not a product. Record it per agent, per environment and per action class in the inventory, and re-assess when tools, prompts, model or data access change.
- Move up on evidence and down automatically. Promotion should follow a measured period at the lower level; demotion to an approval-gated level should be automatic when anomalies or security events occur.
Why autonomy levels, and what they are not
An autonomy level answers one question: for a given class of action, who decides and who acts, the agent or a person? It is useful because most agent controls are only proportionate once that is known. EU AI Act Article 14(3) makes the same point for high-risk systems, requiring human oversight measures commensurate with the risks, the level of autonomy and the context of use.
- Not capability: Feng, McDonald and Zhang treat autonomy as separate from capability (how well an agent performs on tasks). A highly capable agent can still be designed to seek approval for every action.
- Not agency: the AWS Agentic AI Security Scoping Matrix defines agency as the scope of actions the system can take and autonomy as how much it decides and acts without human intervention. Feng and colleagues similarly note that tools mainly change agency, while approval-seeking behaviour mainly changes autonomy.
- Not one number per agent: an agent can act alone on reads, draft writes for approval, and be blocked entirely from payments. Record the level per action class.
- Not a risk score: a low-autonomy agent with a production database credential can still cause severe harm if its approval gate is a rubber stamp. Autonomy is one input to risk, alongside data sensitivity, reversibility and blast radius.
For the terminology itself, see AI Agents vs Agentic AI and the Agentic AI Glossary.
Published autonomy schemes compared
There is no single standard scale for AI agent autonomy. The schemes below are the ones read for this guide; each is attributed to its authors. Driving-automation scales are often cited by analogy, but they describe vehicles, not software agents, and are not used here.
| Scheme (author) | Levels | Defining question | Most useful for |
|---|---|---|---|
| Levels of Autonomy for AI Agents (K. J. Kevin Feng, David W. McDonald, Amy X. Zhang, 2025) | L1 Operator, L2 Collaborator, L3 Consultant, L4 Approver, L5 Observer | What role does the user play? | Product and interaction design; describing what the human can still do at each level |
| Agentic AI Security Scoping Matrix (Aaron Brown and Matt Saner, AWS, 2025) | Scope 1 No agency, Scope 2 Prescribed agency, Scope 3 Supervised agency, Scope 4 Full agency | How much can it change, and does it need approval or self-initiate? | Security control selection across six dimensions per scope |
| Practices for Governing Agentic AI Systems (Shavit and colleagues, OpenAI) | No levels; seven practices | Which governance practices apply to any agent? | Baseline practices: approval, legibility, monitoring, attributability, interruptibility |
Feng, McDonald and Zhang: the user's role
- L1 Operator: the user stays in charge of the workflow; the agent may suggest actions but does not execute them without approval.
- L2 Collaborator: user and agent plan and execute together, and the user can take over at any time. The authors place OpenAI's Operator here.
- L3 Consultant: the agent leads planning and execution over longer periods and consults the user for feedback; the user can pause it or request changes but does not directly control it.
- L4 Approver: the agent works independently and involves the user only at blockers, such as a failure, a missing credential or a consequential action that needs sign-off. The user can specify in advance which actions require approval.
- L5 Observer: the agent plans and decides over long horizons; the user can monitor logs and use an emergency off-switch. The authors suggest L5 may be justified mainly in closed or sandboxed environments.
The paper also proposes "AI autonomy certificates": a third-party body would set the maximum level an agent may operate at, based on its technical specification (model, prompts, tools) and operating environment, with renewal when either changes. No such scheme is in operation that we are aware of, but the idea of a maximum level that is renewed on change translates directly into internal governance.
AWS Scoping Matrix: agency and autonomy together
The AWS matrix combines both axes. At Scope 2 a human starts the agent and approves each consequential action, and autonomous actions are limited to read-only tasks. At Scope 3 a human sets the objective and the agent acts across connected systems without approval. At Scope 4 the agent initiates its own activity from environmental triggers and runs continuously. It recommends starting deployments at Scope 1 or 2 and reducing autonomy gracefully when security events occur.
A working scheme for control mapping (NHI Mgmt Group)
The scheme below is NHI Mgmt Group's own working scheme, not a published standard. It is deliberately security-centred: each level is defined by who triggers the agent and what happens between the agent's decision and the effect on a system, because that is where controls attach. The mapping columns are our reading of how the published schemes line up, not the authors' own mapping.
| Level | Name | Trigger | Between decision and effect | Typical examples | Closest published level |
|---|---|---|---|---|---|
| A0 | Advise | Human | No effect: read and suggest only | Summarising tickets, drafting replies a person sends | Feng L1; AWS Scope 1 |
| A1 | Act on approval | Human | Every write or external action needs explicit approval | Coding agent that asks before each change; agent that prepares a refund for sign-off | Feng L1 to L2; AWS Scope 2 |
| A2 | Act within bounds | Human | Pre-approved low-impact actions run alone; consequential actions go to approval | Agent that files and updates tickets itself but asks before closing incidents or spending | Feng L3 to L4; between AWS Scope 2 and 3 |
| A3 | Supervised autonomy | Human sets goal | Agent plans and acts; humans review after the fact and can interrupt | Remediation agent fixing misconfigurations against a defined policy | Feng L4; AWS Scope 3 |
| A4 | Self-initiating | Events or schedules | Agent starts and runs work continuously; humans oversee strategy and exceptions | Agent watching alerts and containing hosts; continuous cost optimisation | Feng L5; AWS Scope 4 |
Two rules make the scheme usable. First, levels apply per action class: a deployment record might read "A3 for ticket updates, A1 for user account changes, prohibited for payments". Second, an action that is irreversible, moves money, changes privileges or sends data outside the organisation defaults to A1 unless a named risk owner signs off a higher level. For how approval gates themselves should be designed, see the Human-in-the-Loop for AI Agents Guide.
Controls by level
Controls are cumulative: each level keeps those below it. Control names follow NIST SP 800-53 Rev. 5 where one fits. The scope-specific items reflect the AWS matrix recommendations, which list, for example, multi-factor authentication for approvers and time-limited approval tokens at Scope 2, and automated kill switches and behavioural baselines at Scope 3.
| Control area | A0 Advise | A1 Act on approval | A2 Act within bounds | A3 Supervised autonomy | A4 Self-initiating |
|---|---|---|---|---|---|
| Identity | Runs as the user or a read-only service identity | Delegated user context; approver identity verified with MFA | Distinct agent identity with delegation to the user recorded | Own workload identity, short-lived credentials, owner on record | As A3 plus attestation of agent build and configuration |
| Permissions (AC-6) | Read-only, minimum data | Write scopes exist but are only exercised after approval | Allow-list of low-impact actions; others gated | Just-in-time elevation per task; no standing admin | Tight per-trigger scopes; deny by default outside the mission |
| Approvals | Not needed | Every consequential action, bound to its exact parameters | Consequential actions only, with thresholds | Exceptions and high-impact classes; most actions reviewed after | Strategic and exception review; hard prohibitions |
| Limits and budgets | Query and token quotas | Per-action caps | Per-session and daily caps on actions and spend | Cumulative budgets, velocity limits, change windows | As A3, with automatic demotion on breach |
| Logging (AU-2, AU-12) | Prompts and outputs | Proposals, approvals and denials with approver identity | Every tool call with parameters and outcome | Plan, reasoning summary, tool calls and objective check | Continuous behavioural logging and correlation |
| Monitoring (SI-4) | Usage anomalies | Approval rate and time-to-approve | Gated vs ungated action mix | Behavioural baseline, drift from objective | Automated detection and containment |
| Interruption | Disable access | Deny pending approvals | Revoke tokens; pause queue | Tested kill switch, including spawned sub-agents | Tamper-resistant override; fail safe when confidence or signals drop |
| Isolation | Standard | Standard | Separate non-production and production credentials | Sandboxed tool execution; network egress controls | As A3 plus blast-radius limits per trigger |
- Complete mediation: at every level, authorisation must be enforced in the downstream system or a policy enforcement point, not by the model deciding whether an action is allowed. OWASP LLM06:2025 Excessive Agency lists this as a mitigation alongside requiring user approval for high-impact actions. See the AI Agent Authorisation Guide.
- Interruptibility: OpenAI's governance paper stresses that a graceful shutdown should always be available and that sub-agents an agent spawns must also be terminable. See the AI Agent Kill Switch and Containment Guide.
- Spend and action limits: from A2 upwards, budgets carry more of the safety load than approvals do. See the AI Agent Action Approvals and Spending Limits Guide.
Where identity fits
Autonomy level changes which identity an agent should act under. At A0 and A1 the agent can usually act in the user's context, because a person sees and approves each effect; OWASP LLM06 recommends executing extensions in the user's context with minimum privileges. From A2 upwards the agent takes actions no person reviewed at the time, so it needs its own identity that records the delegating user, a named owner and a purpose, otherwise actions cannot be attributed. OpenAI's governance paper makes the same argument for attributability: an agent identifier linked to a responsible human.
- A2 and above: register the agent as a non-human identity with owner, purpose, autonomy level and environment, and issue short-lived credentials. See the Agentic AI Identity Maturity Model.
- A4: self-initiating agents are effectively scheduled service accounts with reasoning. Trigger sources (queues, webhooks, alert feeds) become part of the attack surface, because whoever can write to them can start the agent.
- Commerce: agents that buy on a user's behalf need delegated payment credentials with their own limits. See the Agentic Commerce Identity Guide.
Assigning a level: decision guidance
Choose the lowest level that still delivers the business value, then justify each step up. These questions decide where an action class sits.
| Question | If yes | If no |
|---|---|---|
| Is the action irreversible or hard to undo (deletes, payments, external messages)? | A1 by default; higher only with risk owner sign-off and tested recovery | A2 or A3 possible |
| Can untrusted content (email, web pages, tickets, tool output) reach the agent's context? | Treat as prompt-injection exposed: gate consequential actions, lower the cap | Higher levels are easier to justify |
| Is there a reliable, tested rollback (versioned data, snapshots, revert)? | A2 or A3 acceptable for that action | Stay at A1 |
| Would a mistake be noticed within minutes by monitoring? | A3 possible | Stay at A2 or below |
| Does the agent run in a sandbox or closed environment with no production credentials? | A3 or A4 can be reasonable | Apply full control set for the level |
| Is approval volume likely to exceed what reviewers can genuinely read? | Redesign: narrow the gated set, add limits, do not keep a rubber stamp | Approvals remain meaningful |
- Small organisations: keep most agents at A0 to A2, use the approval and permission features built into agent platforms, and rely on platform spend limits. Avoid A4 unless the agent runs only in a sandbox.
- Large organisations: make the autonomy level a mandatory field in the agent registry and the architecture review, tie each level to a control baseline, and have an AI risk committee approve anything at A3 or A4 in production.
- Security operations: autonomous triage and response is a common early A3 and A4 use case. See the AI SOC Guide for SOC-specific patterns rather than repeating them here.
How to implement autonomy levels
- Inventory: list every agent in use, including those embedded in SaaS products and developer tools, with its tools, credentials, triggers and data access.
- Classify actions: for each agent, group its tools into action classes (read, reversible write, irreversible or destructive, financial, privilege change, external communication).
- Assign levels: set the level per action class using the decision table, record a named risk owner, and note the maximum level the deployment is approved for, an internal version of the autonomy certificate idea.
- Apply the baseline: implement the control set for each level. Enforce gates and prohibitions outside the model, in the tool layer, API gateway or downstream authorisation.
- Pilot one level down: run a new agent first at one level below its target (for example A2 before A3) and in a non-production environment, capturing what it would have done.
- Test: run prompt-injection and misuse tests against each gate and limit; confirm the kill switch stops the agent and any sub-agents within the target time. See the AI Agent Threat Modelling Guide.
- Promote on evidence: move up only after a defined period with acceptable error and override rates, and record the decision with the evidence.
- Roll back: define demotion triggers (anomaly alert, failed control test, security incident, model or tool change) that drop the agent to A1 automatically, and re-assess before restoring.
Detection and measurement
Log enough to reconstruct who decided what: the agent identity, delegating user, autonomy level in force, the action class, parameters, whether an approval was required and who gave it. See the AI Agent Observability and Incident Response Guide.
- Level coverage: percentage of production agents with a recorded autonomy level and risk owner (target 100%).
- Level drift: number of agents observed performing actions above their approved level (for example an ungated write by an A1 agent). Any non-zero value is a finding.
- Override and reversal rate: share of agent actions a human later reversed or corrected, per level. Rising rates argue for demotion.
- Approval quality: approval rate, median time-to-approve and denials per approver. Near-100% approvals in a few seconds suggest rubber-stamping.
- Kill switch time: measured time from decision to full stop in the last test, including sub-agents.
- Re-assessment lag: days between a model, prompt or tool change and the autonomy re-assessment.
Framework mapping
| Framework | Reference | How it relates to autonomy levels |
|---|---|---|
| NIST CSF 2.0 | GV.RM-02, GV.RR-02 | Risk tolerance sets the maximum level allowed; roles name who approves a level and who approves actions |
| NIST CSF 2.0 | PR.AA-05, DE.CM-09 | Permissions per level, least privilege; monitoring of agent runtime behaviour |
| NIST SP 800-53 Rev. 5 | AC-3, AC-5, AC-6 | Enforcement outside the model; separation between agent and approver; least privilege per action class |
| NIST SP 800-53 Rev. 5 | AU-2, AU-12, SI-4, IR-4, CM-3 | Logging and monitoring scaled to level; demotion as incident handling; level re-assessment on configuration change |
| OWASP Top 10 for LLM Applications 2025 | LLM06:2025 Excessive Agency | Names excessive autonomy as a root cause alongside excessive functionality and permissions |
| MITRE ATLAS | AML.T0051 LLM Prompt Injection; AML.T0053 AI Agent Tool Invocation | The main ways an autonomous agent is turned against its owner; exposure rises with level |
| EU AI Act | Article 14 | For high-risk systems, oversight commensurate with autonomy; overseers must be able to override and halt the system |
Common failure patterns
- Instructions instead of controls: telling an agent in its prompt not to change production is not an A1 gate. In the Replit AI agent database deletion the agent ran destructive database commands during a declared code freeze despite repeated instructions; Replit's response included separating development and production databases and a planning-only mode, both controls outside the model.
- One level per agent: labelling a whole agent "supervised" hides the one tool that can delete data or move money at the same autonomy as harmless reads.
- Rubber-stamp approvals: an A1 agent whose approvals are clicked through in seconds is effectively A3 without A3 controls. OpenAI's governance paper warns that frequent or context-poor approvals invite this.
- Silent promotion: users grant "always allow" or persistent permissions for convenience, moving the agent up a level with no review. Anthropic notes Claude Code lets users grant persistent permissions for routine tasks; those grants need the same governance as a level change.
- Autonomy without identity: A3 and A4 agents running under a shared service account or a human's token, so actions cannot be attributed or revoked separately.
- Untested off switch: a kill switch that stops the main process but not scheduled triggers or spawned sub-agents.
Practitioner checklist
- Adopt one autonomy scheme internally, state its source, and label any in-house scheme as your own.
- Record the autonomy level per agent and per action class in the agent inventory, with a named risk owner.
- Default irreversible, financial, privilege-changing and external-communication actions to approval-gated.
- Enforce gates, prohibitions and limits outside the model, at the tool layer or downstream authorisation.
- Give every agent at A2 or above its own identity, owner and short-lived credentials.
- Attach a control baseline to each level and check it at architecture review.
- Pilot new agents one level below target and promote only on recorded evidence.
- Define automatic demotion triggers and test them alongside the kill switch, including sub-agents.
- Re-assess the level whenever the model, prompts, tools, data access or environment change.
- Track level drift, override rate, approval quality and kill switch time monthly.
Standards and references
- EU AI Act: Article 14, Human Oversight
- OWASP: Top 10 for LLM Applications 2025 (LLM06 Excessive Agency)
- NIST: SP 800-53 Rev. 5
- NIST: Cybersecurity Framework 2.0
- arXiv (Feng, McDonald, Zhang): Levels of Autonomy for AI Agents
- AWS Security Blog: The Agentic AI Security Scoping Matrix
- OpenAI: Practices for Governing Agentic AI Systems
- Anthropic: Our Framework for Developing Safe and Trustworthy Agents
Related NHI Mgmt Group resources: Human-in-the-Loop for AI Agents Guide · AI Agent Kill Switch and Containment Guide · AI Agent Authorisation Guide · Agentic Commerce Identity Guide · AI SOC Guide