Subscribe to the Non-Human & AI Identity Journal

Why does observability matter more when humans and agents both change software?

Because the operating model becomes harder to infer from code alone. When humans and agents both shape the release path, observability provides the evidence needed to answer who changed what, what executed, and whether the outcome stayed inside policy. Without that evidence, accountability becomes ambiguous.

Why This Matters for Security Teams

When humans and agents both change software, observability becomes the control plane for trust. Code reviews and ticket trails show intent, but they do not reliably show what an autonomous workflow actually executed, which tools it used, or whether it stayed within policy after a prompt, retry, or chained action. That gap matters because agents can mutate the release path in ways traditional change management was never designed to capture.

Current guidance suggests pairing runtime evidence with identity and policy controls, especially for high-risk workflows. NHIMG research shows that only 5.7% of organisations have full visibility into their service accounts, which is a warning sign for software delivery environments where both human and machine actors can push changes. That lack of visibility is why incidents often remain ambiguous until after impact is visible. For background on agent risk patterns, see the OWASP NHI Top 10 and the OWASP Agentic AI Top 10.

In practice, many security teams discover they cannot reconstruct a release until after a failed deployment, an unauthorized secret use, or a production incident has already spread across systems.

How It Works in Practice

Effective observability for mixed human and agentic change needs to answer four questions: who initiated the change, what identity executed it, what action was taken, and what policy context applied at that moment. That means collecting logs from CI/CD, source control, orchestration layers, secret access, model/tool calls, and runtime enforcement points, then correlating them with workload identity and session context. NIST AI guidance and the NIST AI Risk Management Framework both reinforce that governance depends on traceability, not just permissions.

In agentic workflows, observability should include request-level evidence rather than only batch summaries. A useful baseline is:

  • Immutable audit logs for human approvals and agent actions
  • Tool-call traces that show prompts, inputs, outputs, and downstream executions
  • Workload identity assertions for the agent runtime, not just a shared service account
  • Policy decisions captured at decision time, including denials and overrides
  • Secret access telemetry with TTL, rotation, and revocation events

This is where NHI visibility and agent governance meet. NHIMG’s Ultimate Guide to NHIs is useful because it frames visibility as a lifecycle control, not a reporting feature. For agent-specific threat patterns, the CSA MAESTRO agentic AI threat modeling framework is a practical reference.

These controls tend to break down when teams route agent activity through shared credentials, skip tool-level telemetry, or let ephemeral changes overwrite logs before they can be correlated.

Common Variations and Edge Cases

Tighter observability often increases storage, correlation, and review overhead, so organisations have to balance forensic depth against operational cost. That tradeoff is especially real in fast-moving delivery pipelines, where humans want speed and agents introduce more execution paths than a normal release process.

Best practice is evolving for multi-agent systems, but current guidance suggests treating the agent as a separate accountable actor rather than folding it into a human developer’s identity. If multiple agents collaborate, log each agent’s workload identity, prompt boundaries, and tool permissions separately. That approach aligns with the AI LLM hijack breach and similar cases where lateral tool use made root-cause analysis harder than expected.

Edge cases include ephemeral preview environments, autonomous remediation jobs, and delegated release bots. In those environments, observability must survive short lifetimes and high change rates, which means exporting evidence to a durable system outside the workload itself. Where agents can modify code, secrets, and deployment manifests in one chain, the question is not whether a change was approved but whether the entire sequence remained bounded by policy. That is why practitioners should not rely on code diff alone when a runtime actor may have already altered the path before the diff is created.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

OWASP Agentic AI Top 10 and CSA MAESTRO address the attack and risk surface, while NIST AI RMF set the governance and control requirements practitioners need to meet.

Framework Control / Reference Relevance
OWASP Agentic AI Top 10 A3 Agent tool use and runtime actions need traceable evidence to detect abuse.
CSA MAESTRO M1 MAESTRO emphasizes agent threat modeling and observability across execution paths.
NIST AI RMF GOVERN AI RMF governance depends on traceability, accountability, and documented oversight.

Log every agent tool call and link it to workload identity, inputs, outputs, and policy decisions.