Subscribe to the Non-Human & AI Identity Journal

Notifications
Clear all

SIEM enrichment timing: what security teams are missing


(@nhi-mgmt-group)
Member Moderator
Joined: 1 year ago
Posts: 13010
Topic starter  

TL;DR: Enrichment that happens before SIEM ingestion can cut retained data volumes by 50 to 70 percent and reduce licensing costs by more than half, according to DataBahn, because context determines whether telemetry deserves full-fidelity storage. The architectural shift matters because post-ingestion enrichment turns a security decision into a billing decision.

NHIMG editorial — based on content published by DataBahn: Why are Legacy SIEMs a problem?

By the numbers:

Questions worth separating out

Q: How should security teams implement pre-ingestion enrichment in a SIEM pipeline?

A: Start by enriching telemetry at the collection or stream layer, not after storage.

Q: Why does late enrichment create more cost and risk than it removes?

A: Because the organisation has already paid ingestion-tier pricing before context can change the routing decision.

Q: What do teams get wrong about filtering telemetry before the SIEM?

A: They often treat filtering as a separate optimisation from enrichment.

Practitioner guidance

  • Implement pre-ingestion enrichment for high-value telemetry Attach threat intelligence, asset ownership, and identity resolution before data reaches the SIEM so retention decisions happen while context is still actionable.
  • Cache repeated lookups and pre-index intel feeds Use local indexes for known indicators and cache high-frequency values such as common IPs or trusted domains to avoid synchronous per-event API calls.
  • Tier retention based on enriched signal Route known-malicious or high-risk events to full-fidelity SIEM storage and send low-risk internal activity to lower-cost storage with retrieval paths intact.

What's in the full article

DataBahn's full article covers the operational detail this post intentionally leaves for the source:

  • Pipeline-stage examples showing where Smart Edge collection, stream enrichment, and routing decisions happen in sequence.
  • The practical mechanics of pre-indexed threat intelligence, caching, and asynchronous lookups under production load.
  • The cost logic behind full-fidelity SIEM retention versus lower-cost storage after enrichment.
  • The medical-device deployment example that shows how edge enrichment translated into rapid cost reduction.

👉 Read DataBahn's analysis of why SIEM enrichment timing determines retention value →

SIEM enrichment timing: what security teams are missing?

Explore further

View Full Forum →  |  NHI Foundation Course →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 3 months ago
Posts: 12594
 

Context-first telemetry is now a governance control, not just an engineering choice. When enrichment determines what gets retained, the pipeline is also determining what the organisation can afford to investigate. That makes the enrichment layer part of operational governance, not merely data plumbing. In identity-heavy environments, the same principle applies to asset ownership and NHI resolution. If context arrives after ingestion, the programme has already paid to store uncertainty.

A question worth separating out:

Q: How should organisations decide what belongs in full SIEM retention?

A: Use enriched signal, not raw event volume, to decide. Events with malicious indicators, sensitive identity context, or elevated investigation value should stay in full-fidelity retention. Routine internal activity can move to cheaper storage if the pipeline preserves retrieval and the classification logic is auditable.

👉 Read our full editorial: Legacy SIEM enrichment is a timing problem, not a tooling problem



   
ReplyQuote
Share: