Subscribe to the Non-Human & AI Identity Journal

Notifications
Clear all

Telemetry gaps and detection failures: what security teams miss


(@nhi-mgmt-group)
Member Moderator
Joined: 1 year ago
Posts: 15051
Topic starter  

TL;DR: Security engineering underpins detection and threat hunting because telemetry quality, coverage, and latency determine whether rules, baselines, and investigations can work at all, according to Abstract Security. The hard problem is not alert logic but the data pipeline, where gaps, parsing failures, and performance issues turn detection into guesswork.

NHIMG editorial — based on content published by Abstract Security: Detection Doesn’t Fail First: Data Does

Questions worth separating out

Q: How should security teams build telemetry for detection and hunting?

A: Start with the investigation questions, then instrument the systems that answer them.

Q: Why do poor logs break detection even when rules are good?

A: Because detection depends on data fidelity as much as logic.

Q: What do security teams get wrong about threat hunting at scale?

A: They often treat hunting as a query-writing problem instead of a workflow design problem.

Practitioner guidance

  • Map telemetry coverage to critical identity and workload paths Inventory the systems that generate access, authentication, and privilege-change signals, then verify that each source has reliable collection, parsing, and retention.
  • Measure ingestion delay and query response separately Track the time from event creation to query availability, then compare it with the time required to pivot across recent and historical investigations.
  • Instrument telemetry failures as security alerts Alert when parsers fail, fields disappear, or a source stops sending expected records.

What's in the full article

Abstract Security's full article covers the operational detail this post intentionally leaves for the source:

  • Specific examples of telemetry pipeline failures that make detections unreliable in practice
  • How security engineering teams structure logging, normalisation, and storage tiers for hunting workflows
  • Where detection engineers and platform teams should hand off ownership for broken fields or missing data
  • Practical considerations for scaling telemetry without degrading query performance

👉 Read Abstract Security's analysis of why telemetry data quality underpins detection →

Telemetry gaps and detection failures: what security teams miss?

Explore further

View Full Forum →  |  NHI Foundation Course →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 3 months ago
Posts: 14635
 

Telemetry is the control plane for detection, not a support function. Security teams still talk about logging as if it were a downstream service, but modern detection depends on telemetry design choices made upstream. When the data model is weak, every detection engineer inherits the limitation. For IAM and NHI programmes, this means access activity must be instrumented at the source, not inferred later. The programme that controls data quality controls investigative speed.

A question worth separating out:

Q: Who is accountable when telemetry gaps hide an incident?

A: Accountability usually spans SOC operations, platform engineering, and the owners of the logging integrations. If credential expiry, parser failure, or collector outage causes missed visibility, then the control failure is shared across the teams responsible for monitoring, identity management, and pipeline reliability. Governance must define ownership before the gap becomes an incident.

👉 Read our full editorial: Detection engineering fails when telemetry data is missing or poor



   
ReplyQuote
Share: