Join our Newsletter — 33% off our NHI Course

What do security teams get wrong about telemetry for AI agents?

They often treat telemetry as a troubleshooting tool instead of a governance control. For agentic systems, telemetry is also the record of what was requested, approved, and executed, so it must support audit, redaction, and investigation rather than just dashboarding.

Why This Matters for Security Teams

Telemetry for AI agents is not just observability plumbing. It is the evidence trail for prompts, tool calls, approvals, model outputs, policy decisions, and downstream actions. If teams treat it like a standard troubleshooting stream, they miss the governance value: proving who or what initiated action, whether the action was permitted, and whether the output was safe enough to trust. Guidance from the NIST AI Risk Management Framework makes clear that trust in AI systems depends on traceability, accountability, and ongoing monitoring, not just system uptime.

The common mistake is assuming logs are useful only after an incident. For agentic systems, the more important question is whether telemetry can support preventative control: catching unsafe tool use, policy drift, prompt injection, and unauthorized chaining before data leaves the boundary. Security teams also underestimate how quickly agent telemetry becomes sensitive itself, because it can expose secrets, personal data, and internal decision logic. That means collection, retention, masking, and access control all matter as much as detection.

In practice, many security teams encounter telemetry failure only after an agent has already executed an unsafe action, rather than through intentional governance design.

How It Works in Practice

Effective agent telemetry should capture the full lifecycle of activity, from user intent to model reasoning cues, tool selection, execution result, and post-action review. The aim is not to record everything forever, but to record enough to reconstruct what happened without leaking unnecessary data. Current guidance suggests structuring telemetry around control points, not raw noise, so that each event can answer a simple question: was this action requested, approved, constrained, and completed in a defensible way?

That usually means separating telemetry into operational and governance layers. Operational telemetry supports debugging latency, failures, and routing. Governance telemetry supports audit, investigation, and policy enforcement. The two are related, but they are not interchangeable. Agentic systems also need records for tool invocation and state transitions, because a dangerous action may look harmless at the prompt level while becoming risky at execution time. This is where the OWASP Top 10 for Agentic Applications 2026 and the MITRE ATLAS adversarial AI threat matrix are especially useful, because they push teams to think about abuse paths, not just runtime health.

  • Log the actor, the agent identity, the model version, and the policy context for each decision.
  • Record tool calls with parameters, outputs, and approval state, while redacting secrets and sensitive content.
  • Preserve enough lineage to link prompt, retrieval, and action results without exposing full conversation history to every operator.
  • Feed high-risk events into SIEM or SOAR workflows so that suspicious agent behaviour can be triaged quickly.

Telemetry should also be designed with incident response in mind. If an agent interacts with external systems, the record must show which connector was used, what scope it had, and whether the action was reversible. That is especially important when agents can write tickets, change cloud configuration, trigger payments, or query internal knowledge bases. These controls tend to break down when agents are allowed to call unmanaged tools or when logs are stored in systems that cannot mask secrets consistently.

Common Variations and Edge Cases

Tighter telemetry often increases storage, privacy, and engineering overhead, requiring organisations to balance forensic detail against data minimisation. That tradeoff becomes sharper when agents handle regulated data, customer content, or proprietary source material. Best practice is evolving here, and there is no universal standard for how much chain-of-thought, intermediate reasoning, or retrieval context should be retained. The safer pattern is to preserve decision evidence and execution metadata, not unrestricted model internals.

Edge cases arise when multiple agents collaborate, when one agent delegates to another, or when tools execute asynchronously. In those environments, a single event stream is rarely enough. Teams need correlation identifiers across sessions, services, and identities so that an auditor can follow the chain of custody. The CSA MAESTRO agentic AI threat modeling framework is useful here because it encourages teams to map trust boundaries and decision points across the whole agent workflow.

Telemetry also becomes more complex when security teams must support legal holds, privacy deletion, or cross-border data transfer controls. In those cases, retention and redaction policy must be explicit, versioned, and testable. The right answer is not to log less by default, but to make sure the logging model matches the risk model. That means telemetry for agents should be treated as a governed control surface, not a convenience feature.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

OWASP Agentic AI Top 10, MITRE ATLAS and CSA MAESTRO address the attack and risk surface, while NIST AI RMF and NIST CSF 2.0 set the governance and control requirements practitioners need to meet.

Framework Control / Reference Relevance
NIST AI RMF AI RMF centers traceability, accountability, and ongoing monitoring for AI systems.
OWASP Agentic AI Top 10 Agentic AI risks include tool abuse, prompt injection, and unsafe delegation.
MITRE ATLAS T1589 ATLAS helps model adversarial AI abuse paths and telemetry gaps.
NIST CSF 2.0 DE.CM-01 Continuous monitoring supports detection and response for AI agent activity.
CSA MAESTRO MAESTRO covers trust boundaries and orchestration across agent workflows.

Treat agent telemetry as a monitored control and route high-risk events into detection workflows.