Join our Newsletter — 33% off our NHI Course

Detection versus hunt workloads: where should security logic run?

 

(@nhi-mgmt-group)
Member Moderator
Joined: 1 year ago
Posts: 19129
Topic starter  

TL;DR: Security architecture should place detection, hunting, and investigation workloads where latency, state, and data dependencies fit the job, according to AiStrike's analysis. The practical shift is away from treating storage location as the main design choice and toward separating execution from retention, which is especially relevant as agents increase query volume and control-plane load.

Editorial analysis by NHI Mgmt Group, based on content published by AiStrike: “AiStrike”.

Key questions

Q: How should security teams decide whether detection logic belongs in the data source or in centralized storage?

A: Use the workload's timing and state requirements.

Q: Why does federation create risk for security telemetry workflows?

A: Federation turns source-system behaviour into part of the control plane.

Q: What breaks when streaming detections are treated like search queries?

A: Polling creates gaps, overlapping windows, duplicate evaluations, and delayed responses that undermine continuous detection.

Practitioner guidance

  • Split streaming detection from retrospective hunting Run streaming detections close to the event source when low latency and stateful evaluation are required, and reserve centralized storage for hunts that can tolerate slower execution.
  • Document source-system dependencies in federated workflows Track retention periods, schema drift, API behaviour, and rate limits for every federated telemetry source so analysts can tell a complete miss from an incomplete query.
  • Reassess centralization economics for historical telemetry Compare the cost of indexed object storage and query acceleration against the operational limits of federation before deciding that telemetry must remain distributed.

Bottom line: Security telemetry architecture should be designed around the workload's latency and state requirements, not around storage convenience.

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 6 months ago
Posts: 18837
 

Execution placement is now a governance decision, not a storage afterthought. Security teams have spent too long treating telemetry placement as the primary architecture choice, when the real question is where the workload can execute correctly. Detection, hunt, and investigation should be separated by timing, state, and dependency profile, because those characteristics determine whether a control is operationally credible. Practitioners should treat workload placement as part of security governance, not just data engineering.

A question worth separating out:

Q: When should teams keep telemetry centralized instead of federating it?

A: Centralize telemetry when completeness, long retention, and historical correlation matter more than source locality. That is especially useful for hunts, retroactive detections, and investigations that need one consistent query model across many months of data.

👉 Read our full editorial: Ship the logic, not the data for security telemetry workflows



   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.