What breaks when organisations cannot distinguish human from AI agent activity?

Why This Matters for Security Teams

When organisations cannot reliably separate human activity from AI agent activity, every downstream control starts to lose meaning. Access reviews no longer show who actually used a permission, incident timelines become ambiguous, and policy exceptions can be attributed to the wrong actor. That is especially dangerous in agentic environments because an agent can chain tools, retry actions, and expand scope faster than a human operator typically would.

This is why current guidance from the OWASP Agentic AI Top 10 and the NIST AI Risk Management Framework treats identity, traceability, and accountability as first-order requirements rather than logging hygiene. NHIMG research on the AI Agents: The New Attack Surface report shows that 80% of organisations report AI agents have already acted beyond intended scope, while only 52% can track and audit the data those agents access. In practice, many security teams discover the actor mismatch only after an investigation has already become a reconstruction exercise instead of a clean control failure analysis.

How It Works in Practice

The practical failure starts with event data. If telemetry only captures the application account, API token, or shared service identity, it hides whether a human initiated the request, delegated it to an agent, or whether the agent autonomously selected the tool path. That makes RBAC and traditional certification workflows too coarse for agentic systems. The more reliable pattern is to bind actions to workload identity, then layer runtime context on top so policy can decide whether the actor is human, agent, or both.

In mature designs, the agent is treated as a distinct workload identity with cryptographic proof of what it is, not merely a reusable secret. That identity is then paired with intent-based authorization and short-lived credentials. A task might be approved once, then issued a Non-Human Identity boundary, a scoped token, or a per-task credential that expires automatically after the action completes. This is consistent with emerging implementation guidance in CSA MAESTRO agentic AI threat modeling framework and with the operational model described by NIST AI Risk Management Framework.

• Use separate identities for humans, agents, and automation pipelines.
• Require per-request policy evaluation so access depends on current intent, data sensitivity, and execution context.
• Issue ephemeral secrets or tokens only for the task window, then revoke them automatically.
• Log the initiating human, the agent identity, the tool called, and the downstream object touched.

NHIMG’s OWASP NHI Top 10 discussion is explicit that agent activity becomes hard to govern once an organisation treats autonomous execution like ordinary user activity. These controls tend to break down when the same identity is reused across multiple agents because attribution collapses and least-privilege scope can no longer be proven per actor.

Common Variations and Edge Cases

Tighter identity separation often increases operational overhead, requiring organisations to balance stronger attribution against faster automation delivery. That tradeoff is real, especially where agents support high-volume workflows, but current guidance suggests the overhead is still preferable to losing actor-level traceability entirely.

One common edge case is delegated human-in-the-loop operation, where a person approves a step but the agent executes it later. In that model, the audit trail must preserve both identities and the delegation chain. Another is shared model infrastructure, where several agents call the same endpoint or orchestration layer. Best practice is evolving here, and there is no universal standard for how to label every intermediary hop, but the minimum is to preserve the originating workload identity and the policy decision context.

Another blind spot appears in environments with long-lived credentials or broad platform tokens. Those patterns are fragile because an autonomous system can reuse access in ways the original approver never intended. NHIMG’s The State of Secrets in AppSec underscores how hard secrets become to remediate once exposed, and the same problem applies when an agent can reveal or replay them. In practice, teams using shared secrets or flat service accounts usually lose the ability to answer a simple question: did a person do this, or did the agent decide to do it on its own?

Related resources from NHI Mgmt Group

• How do organisations keep human review in AI-assisted cloud operations?
• Why is single-provider AI agent governance not enough for enterprise security?
• How can organisations reduce the blast radius of compromised agent identities?
• When should organisations require human approval for an AI agent action?