By NHI Mgmt Group Editorial TeamBased on WorkOS: “What is Agnost AI? An MCP server analytics platform” (November 10, 2025)

TL;DR: MCP servers connect AI clients to tools and data, but their asynchronous calls, cross-client journeys, and hidden error patterns make usage and latency hard to govern without dedicated observability, according to WorkOS. That visibility gap matters because tool-level monitoring is now part of identity and access control for AI-mediated workflows.


At a glance

What this is: This is an analysis of MCP server analytics and how observability turns tool calls, latency, errors, and user journeys into governable signals for AI-mediated workflows.

Why it matters: It matters because AI clients increasingly depend on MCP servers for tool access, so identity and access teams need visibility into what is being invoked, by whom, and under what conditions.

By the numbers:

  • Agnost's dashboard example shows 6,026 total invocations, a 97.34% average success rate, and latency percentiles of p50, p90, and p99.

Context

Model Context Protocol servers sit between AI clients and the tools or data they need to use, so they are now part of the identity and access path for AI-mediated work. When those servers move into production, the governance gap is not whether the tool call succeeds, but whether anyone can explain what happened across clients, sessions, and tools.

Observability becomes the missing control layer because MCP calls are asynchronous, user journeys span multiple AI clients, and failures can be buried inside model context. Without telemetry, teams cannot separate a genuine service issue from a policy, routing, or client-behaviour problem, which leaves both reliability and access governance partially blind.

The article frames Agnost AI as one way to make those flows visible, but the real issue is broader: once AI tools depend on MCP, monitoring is no longer just an engineering concern. It becomes part of NHI governance for tool execution, usage analysis, and operational accountability.


Key questions

Q: What breaks when MCP observability is missing?

A: Root cause analysis breaks first, followed by cost attribution, policy enforcement, and safe incident response. Teams lose the ability to distinguish model drift from tool failure, and they cannot tell whether sensitive data moved through a tool parameter even if the output looked harmless.

Q: Why do MCP tool calls need more than ordinary application logs?

A: Because MCP calls are asynchronous and often span multiple clients and sessions, ordinary logs usually miss the relationship between the user journey, the tool selected, and the end result. Tool-level context is what lets teams separate a model-driven workflow issue from a backend service issue.

Q: How should security teams govern MCP servers used by AI coding assistants?

A: Treat MCP servers as privileged trust boundaries, not simple data sources. Security teams should classify each server by the authority it can influence, sanitize any user-generated or third-party content before delivery, and limit the agent’s tool access so malicious context cannot easily become destructive action.

Q: What is the difference between traditional observability and MCP observability?

A: Traditional observability asks what happened: a request was made, it took a certain time, and it returned a status. MCP observability must answer whether the call should have happened at all. That means linking the initiating user or service, the executing agent, the session history, and the tool semantics so teams can evaluate intent, not just transport behavior.


Technical breakdown

Why MCP server telemetry changes governance

MCP servers mediate between an AI client and external tools, so every invocation is both an application event and an access event. If the server is not instrumented, teams lose the ability to reconstruct which tool was called, which client initiated the action, how long the call took, and whether it failed before completion. That matters because asynchronous tool execution breaks simple request-response monitoring. You are no longer watching a single session in one interface, but a chain of model-driven calls that can cross apps, users, and back-end systems. In that environment, analytics is not just performance reporting. It is the evidence layer for governance.

Practical implication: Treat MCP telemetry as part of the access control evidence set, not as optional engineering metrics.

How latency, errors, and user journeys expose control gaps

Latency percentiles, error captures, and user-story reconstruction are useful because they reveal where tool execution diverges from expected behaviour. A slow database query, a failed filesystem call, or a repeated tool invocation can indicate a client integration issue, a backend bottleneck, or a mis-scoped workflow. The important point is that these signals are only visible when the MCP server records tool-level context. General observability tools often miss the relationship between the AI client, the selected tool, and the end-user journey. Purpose-built MCP analytics closes that gap by preserving the sequence and semantics of each call.

Practical implication: Use tool-level latency and error data to distinguish access-flow problems from ordinary application slowdowns.

What one-line instrumentation does and does not solve

A lightweight wrapper can capture telemetry without changing server logic, which makes adoption easier for teams already running MCP in production. But the presence of telemetry does not by itself enforce least privilege, validate tool authorization, or prove that the right client is using the right tool. It simply makes those questions answerable. That distinction matters in identity programmes because visibility and control are not the same thing. Instrumentation can reveal client distribution, active users, and tool invocation patterns, but governance still depends on policy, review, and response processes that act on those signals.

Practical implication: Pair MCP observability with explicit authorization and review controls rather than treating dashboards as governance.


NHI Mgmt Group analysis

MCP observability is becoming an access-control dependency, not just an engineering convenience. Once AI clients rely on MCP servers to reach tools and data, the server sits inside the execution path that identity teams need to govern. Without tool-level telemetry, access decisions become partially unverifiable because the organisation cannot reconstruct who invoked what, through which client, and in what sequence. The practitioner conclusion is simple: visibility now sits on the critical path for AI tool governance.

The central governance gap is not missing logs, but missing semantic context. A generic log line may show that something happened, but it does not tell you whether a filesystem read, database query, or API call was triggered by a user journey, a repeated model action, or a failed tool sequence. That context is what makes MCP distinct from ordinary application telemetry. The implication is that identity and platform teams need evidence about tool intent and tool outcome, not only platform health.

Tool analytics is becoming the control plane for AI-mediated workflows. As more work moves through AI clients, the practical control point shifts from the model prompt to the tool invocation layer where execution, latency, and error patterns can be observed. That is where the organisation can see whether AI use is contained, efficient, and attributable. The practitioner takeaway is to govern the invocation layer as a first-class part of NHI and AI operations.

Named concept: MCP control plane visibility. This is the point at which analytics, latency, and user-journey reconstruction become the operational record for AI tool execution. It matters because teams cannot govern what they cannot reconstruct, and MCP servers increasingly carry the evidence needed for access review, incident triage, and workflow accountability. Practitioners should treat this visibility as a governance prerequisite, not an optional dashboard.

From our research library:

  • 24,008 unique secrets were exposed in MCP configuration files in 2025 alone, the protocol's first year of widespread adoption, according to the State of Secrets Sprawl 2026.
  • AI-related credential leaks surged 81.5% year-over-year in 2025, with the surrounding AI infrastructure leaking 5x faster than core LLM providers, according to the State of Secrets Sprawl 2026.
  • Read next: MCP Security Guide

What this signals

MCP control plane visibility: Teams that deploy AI clients through MCP need the server to preserve enough context for governance, not just enough data for debugging. Once tool invocations become asynchronous and cross-client, access review depends on reconstructing the execution path after the fact.

Observability should be evaluated as an identity control adjacency. If the organisation cannot see which tool was called, from which client, and with what outcome, it cannot reliably separate permitted usage from abnormal behaviour.

The strongest programme response is to align telemetry with the control objective: prove who invoked what, how the invocation behaved, and whether the surrounding workflow remained within policy.


For practitioners

  • Instrument MCP servers at the tool layer Capture tool invocation, latency, error, and user-journey data where the MCP server mediates access, not only in downstream application logs.
  • Separate client behaviour from backend performance Use per-client and per-tool telemetry to identify whether slow or failing workflows come from the AI client, the MCP server, or the target system.
  • Define reviewable ownership for MCP telemetry Assign responsibility for monitoring, alerting, and investigation so tool execution data can support governance and incident triage.
  • Validate observability against real user journeys Reconstruct representative sessions across Claude Desktop, VS Code, and other clients to confirm that telemetry preserves the full execution path.

Key takeaways

  • MCP servers now sit on the AI tool execution path, so their telemetry has direct governance value for identity and access programmes.
  • Tool-level visibility is what turns opaque client journeys into reviewable evidence for performance, reliability, and accountability.
  • Practitioners should treat observability as a prerequisite for governing AI-mediated workflows, not as a substitute for authorization.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

OWASP Non-Human Identity Top 10, MITRE ATT&CK and OWASP API Security Top 10 address the attack and risk surface, while NIST CSF 2.0 sets the governance and control requirements practitioners need to meet.

FrameworkControl / ReferenceRelevance
OWASP Non-Human Identity Top 10NHI-04 — Insecure AuthenticationMCP telemetry exposes whether AI tool access is behaving as intended across clients and sessions.
NHI-05 — Overprivileged NHITool invocation visibility helps spot AI-mediated access that reaches beyond its intended scope.
Recommendation — Instrument MCP flows so you can detect and investigate tool access that behaves outside intended authentication paths. Review MCP tool usage for scope creep and reduce any access paths that exceed their intended task boundary.
NIST CSF 2.0PR.AA-05 — Access Permissions, Entitlements and AuthorizationsMCP servers mediate access decisions for AI clients, so authorization evidence is central.
Recommendation — Use entitlement and authorization checks to govern which AI clients may invoke each MCP tool.
MITRE ATT&CKTA0006;TA0007 — Credential Access; DiscoveryThe article's core concern is visibility into how tool access and usage patterns unfold.
Recommendation — Map tool-usage anomalies to credential-access and discovery behaviours to prioritise investigation.
OWASP API Security Top 10API10 — Unsafe Consumption of APIsMCP servers often broker API calls on behalf of AI clients, making consumption safety relevant.
Recommendation — Assess MCP-mediated API consumption paths for unsafe downstream calls and tighten validation where needed.

Key terms

  • MCP observability: MCP observability is the ability to see how Model Context Protocol connections behave across agents, tools, and data sources. It includes logging requests, responses, tool calls, errors, latency, and policy decisions so teams can detect misuse, troubleshoot failures, and verify that agent actions stay within approved identity and access boundaries.
  • Tool Invocation Telemetry: Tool invocation telemetry is the event data generated when an AI client calls a tool through an MCP server. It typically includes the tool name, timing, outcome, and source client, giving identity and security teams the evidence needed to review runtime behaviour rather than just configuration.
  • User Journey Reconstruction: The process of rebuilding a session from discrete events so teams can see how a user or AI client moved through tools and data sources. In MCP environments, it helps explain multi-step execution paths that ordinary logs often flatten or fragment.
  • Control Plane Visibility: A governance pattern where the operational record for a system becomes the place where teams verify, diagnose, and account for access behaviour. For MCP, it means analytics must expose enough context to support both reliability work and identity governance.

Deepen your knowledge

NHI governance, agentic AI identity, and machine identity lifecycle are core topics in our NHI Foundation Level course, the industry's only accredited NHI security programme. If you are building or maturing an IAM programme, it is worth exploring.
NHIMG Editorial Note
Published by the NHIMG editorial team on June 7, 2026.
Updated on October 7, 2026.
NHI Mgmt Group, the independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org