By NHI Mgmt Group Editorial TeamBased on Bindplane: “Claude Code Observability at Scale: How We Did It With Bindplane” (June 4, 2026)

TL;DR: AI coding agents need telemetry, redaction, and audit trails because prompts, tool calls, and outputs create security, compliance, and cost questions that standard developer workflows do not answer, especially when agents can act directly on environment changes, according to Bindplane. The governance problem is not the model itself but the lack of durable evidence and least-privilege control over agent action.


At a glance

What this is: This is Bindplane's analysis of why Claude Code needs telemetry, redaction and audit trails, with the key finding that approved tool calls are the highest-risk surface because they can change the environment.

Why it matters: It matters because AI coding agents are now part of operational change paths, so IAM, security and compliance teams need durable evidence, permission boundaries and reviewable agent actions rather than assuming normal developer controls are enough.


Context

AI coding agents create a governance gap when they can act on systems faster than teams can explain, review or reconstruct what happened. Traditional developer workflows capture source control changes and human approvals, but they often miss the agent's prompt, tool use, output and side effects. In an environment where the agent can touch infrastructure or code directly, that missing evidence becomes an access and accountability problem, not just an observability issue.

The identity angle is real here because Claude Code is acting under human-granted organisational access, yet the effective actor is a software system making decisions and tool calls in session. That pushes this topic into NHI and agentic AI governance: teams need to know what the agent was allowed to do, what it actually did, and how those actions are bounded by policy. The starting position described here is increasingly typical, not exceptional, for teams adopting AI coding assistants.


Key questions

Q: What breaks when local AI tools are not captured in a central audit trail?

A: When local tool use is invisible, investigators lose the chain of custody for actions taken by coding assistants and other agentic clients. That makes it harder to prove what happened, which user initiated it, and whether a tool call was authorized. It also weakens policy enforcement because teams cannot distinguish benign usage from risky or blocked activity.

Q: Why do approved tool calls create more risk than agent chat output?

A: Because output is informational, while approved tool calls let the agent change code, move data or touch connected systems. The risk increases when those actions happen under human-granted permissions that are broader than any single task needs. That is where least privilege and runtime accountability matter most.

Q: How do you know if joined AI telemetry is actually working?

A: Look for stable identifiers, reproducible joins, and analysis that answers cost, latency, and business outcome questions without manual stitching. If analysts still export spreadsheets or reconcile mismatched timestamps, the warehouse model is not yet reliable enough to support governance or operational decisions.

Q: Should organisations keep full-fidelity agent logs in the same place as operational telemetry?

A: No. Operational telemetry should be redacted and optimised for daily monitoring, while full-fidelity records belong in a restricted audit store for investigations and compliance. Mixing the two increases exposure without improving routine oversight. The better pattern is split retention with clear access controls.


Technical breakdown

Why telemetry is the control surface for AI coding agents

AI coding agents are not governed well by source code alone because the security-relevant behaviour often happens outside the commit diff. Telemetry captures prompts, tool calls, rejections, responses and data flow so teams can reconstruct intent, action and impact. In OpenTelemetry terms, traces and logs become the evidence layer for an agent's runtime decisions. That matters because an agent can read context, call tools, and modify code or systems in a way that leaves little forensic residue if telemetry is not collected at the point of action.

Practical implication: Treat agent telemetry as part of the control plane, not a nice-to-have dashboard input.

Why approved tool calls are the highest-risk agent event

The article draws a clear line between observation and action. Prompts and responses matter, but approved tool calls are where the agent actually touches the environment. That is the moment where privilege becomes operational and where least privilege, anomaly detection and incident review all need to converge. If a coding agent can call tools broadly, the trust model shifts from human review of code to machine execution of actions, which is much harder to govern after the fact.

Practical implication: Scope and log tool permissions at the action layer, not only at the session or user layer.

How redaction and retention shape auditability

Telemetry only helps if it is usable for both security and compliance. That means sensitive fields need redaction before broad ingestion, while a separate full-fidelity trail can retain the evidence needed for investigations. This creates a practical split between operational monitoring and audit recovery. Without that separation, teams either lose forensic value or overexpose sensitive content. For agentic systems, that trade-off is central because prompts and outputs can contain secrets, personal data or operational instructions.

Practical implication: Separate redacted operational telemetry from protected audit storage so investigations remain possible without expanding exposure.


Threat narrative

Attacker objective: The objective is to use the agent's trusted execution path to make unauthorized or unreviewed changes while avoiding durable evidence of what happened.

  1. Entry occurs when an AI coding agent is granted organisational access to developer tooling and begins operating with real-world permissions.
  2. Credential and permission abuse happens when approved tool calls let the agent act on files, code or connected services beyond what a human would review in real time.
  3. Impact appears when teams cannot reconstruct what the agent changed, whether sensitive data was exposed, or whether a malicious prompt altered code or environment state.
  • Nx s1ngularity attack 2025: Attackers stole Nx's npm token via a GitHub Actions flaw and shipped malware that stole 2,349 secrets and abused developers' AI CLIs.
  • Sentry MCP Agentjacking 2026: Researchers showed a fake Sentry error, posted with a public DSN, could make AI coding agents run attacker code with developers' credentials.

Read and download The State of NHI & AI Agent Breach Report 2026, covering 200+ breaches impacting Non-Human Identities including AI Agents.


NHI Mgmt Group analysis

AI coding agent governance now depends on runtime evidence, not just developer intent. Source control tells you what was committed, but not what an agent saw, tried, or attempted to send. Once an agent can call tools and operate under organisational credentials, auditability becomes a first-class security control, not a reporting extra. Practitioners should treat telemetry capture as part of identity and access governance for agentic systems.

Claude Code telemetry exposes a broader identity shift: the software actor is now inside the access boundary. The article's strongest insight is that the highest-risk event is not model output, but approved action. That is the point where a human-approved session turns into machine-executed change, which means permission scope and evidence retention have to be governed together. The practitioner conclusion is simple: agent identity needs controls that match its runtime authority.

Agent action evidence gap: the failure mode is not a missing dashboard, it is a missing record of delegated action. When teams cannot reconstruct prompts, tool calls and outputs, they cannot explain whether an agent behaved as intended or under adversarial influence. That creates governance debt across incident response, compliance and change management. Security teams should treat durable telemetry as the proof that agent permissions were exercised within policy.

Redaction and split-retention are the practical compromise for agent telemetry. Full-fidelity logs are valuable for investigations, but broad operational pipelines should not ingest raw secrets or personal data. The stronger pattern is to redact at collection time, preserve protected audit copies for incident work, and keep day-to-day telemetry lean enough for routine use. Practitioners should design for both evidence and exposure control.

From our research library:

What this signals

Agent action evidence is becoming a governance requirement, not a monitoring preference. When AI coding agents can operate with organisational credentials, the control question shifts from what the model said to what the agent was permitted to do. Teams that cannot reconstruct prompts, tool calls and outputs will struggle to defend incident decisions or prove least-privilege enforcement.

Claude Code telemetry should be treated as an NHI-style control problem for agentic systems. The agent is not a human user, but it still needs scoped permissions, durable logging and offboarding logic when tools or access paths change. That is why the issue sits at the intersection of IAM, audit and AI governance, not just developer productivity.

Claude Code-assisted commits leaked secrets at a rate of 3.2%, more than double the human-only baseline of 1.5%, with peaks reaching 31 secrets per 1,000 commits in August 2025. That figure shows why teams need controls at collection time and action time, not just after code lands.


For practitioners

  • Instrument agent tool calls and prompts Capture prompts, tool invocations, responses and rejections for every AI coding agent session so security, compliance and incident teams can reconstruct what happened.
  • Separate operational telemetry from audit evidence Redact sensitive fields before broad ingestion, then retain a protected full-fidelity audit trail for investigations and compliance review.
  • Constrain approved tool permissions Limit the commands, repositories and connected services an agent can touch, because approved tool calls are the point where runtime authority turns into action.
  • Measure agent value against spend and adoption Track token usage, tool calls and workflow impact together so you can see whether the agent improves developer experience enough to justify its cost.

Key takeaways

  • AI coding agents create a governance gap because their meaningful actions happen at runtime, not in the final code diff.
  • Telemetry, redaction and protected audit storage are the controls that turn agent activity into something security and compliance teams can review.
  • Approved tool calls are the critical boundary, because that is where organisational permission becomes real-world system action.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

OWASP Agentic AI Top 10 and MITRE ATT&CK address the attack and risk surface, while NIST AI RMF and NIST SP 800-53 Rev 5 set the governance and control requirements practitioners need to meet.

FrameworkControl / ReferenceRelevance
NIST AI RMFGOVERN — AI Governance and AccountabilityTelemetry, retention and auditability are governance mechanisms for agentic AI use.
Recommendation — Establish governance roles for logging, review and escalation before deploying agentic coding tools.
OWASP Agentic AI Top 10ASI03 — Identity & Privilege AbuseThe article focuses on an agent acting through granted permissions and the need to constrain that authority.
Recommendation — Constrain agent identity and privilege so approved tool calls cannot exceed their intended scope.
MITRE ATT&CKTA0006;TA0008 — Credential Access; Lateral MovementThe article and related incidents involve credential reuse, secret theft and action across developer workflows.
Recommendation — Map agent misuse scenarios to credential access and lateral movement to prioritise detection and containment.
NIST SP 800-53 Rev 5AU-2 — Event LoggingThe article is fundamentally about collecting and preserving agent activity records for audit and response.
Recommendation — Implement AU-2 to ensure agent prompts, tool calls and outputs are logged at the point of action.

Key terms

  • Agent telemetry: Operational data describing what an AI agent did, which tools it called, how much it consumed, and what resources it touched. Telemetry is essential for audit, incident response, and behavioural governance because agent decisions are otherwise difficult to reconstruct.
  • Audit Trail: An audit trail is a record of who accessed a system, what they did, and when they did it. For PHI environments, it provides the evidence needed to investigate incidents, support breach determinations, and demonstrate that access was attributable to a specific identity or workflow.
  • Delegated tool privilege: Delegated tool privilege is the effective authority an AI agent inherits from the systems it can call, even when it is not the owner of those systems. It is the practical blast radius created by connectors, credentials, and runtime permissions. This is often the real control boundary in agentic environments.
  • Redaction Pipeline: A redaction pipeline removes sensitive data before logs or traces are widely stored or shared. For AI coding agents, it is the practical control that lets teams preserve observability while reducing the chance that prompts, secrets or personal data spread into routine telemetry systems.

Deepen your knowledge

NHI Mgmt Group covers identity security, NHI governance, and agentic AI through independent research, practitioner guides, and the NHI Foundation Level course. It helps security and IAM teams translate runtime identity risk into controls they can actually operate.
NHIMG Editorial Note
Published by the NHIMG editorial team on August 18, 2026.
Updated on October 12, 2026.
NHI Mgmt Group, the independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org