It becomes risky when filtering or summarisation removes data needed for investigations, compliance, or incident reconstruction. If analysts cannot explain why an event was kept or dropped, or cannot reconstruct a timeline from retained records, the optimisation layer has crossed from efficiency into evidence loss.
Why This Matters for Security Teams
Telemetry optimisation is meant to reduce noise, lower storage costs, and make detection pipelines easier to operate. The risk appears when those efficiency gains start changing what the organisation can prove after an incident. If logs are aggressively filtered, normalised too early, or summarised beyond recoverability, security teams may lose the ability to validate alerts, reconstruct attacker movement, or satisfy audit requests. That matters as much for investigations as it does for governance.
Current guidance in the NIST Cybersecurity Framework 2.0 points organisations toward measuring, protecting, and recovering from security events with evidence that is fit for purpose. In practice, telemetry is part of that evidence chain. The mistake many teams make is assuming that observability tooling can safely act as a recordkeeping layer, even though its primary design goal is operational efficiency. Once that assumption takes hold, quiet data loss becomes a control failure rather than a tuning decision. In practice, many security teams encounter this only after an investigation stalls because the original context was optimised away.
How It Works in Practice
Telemetry optimisation becomes a security control decision whenever it changes retention, fidelity, or queryability. That includes dropping fields from event records, sampling traffic, deduplicating alerts, aggregating logs into coarse buckets, or using AI summarisation to compress long event streams. These techniques can be useful, but they need explicit governance because different security use cases depend on different levels of detail. A detection engineer may only need high-level trends, while a forensics analyst may need raw timestamps, source IPs, command lines, object identifiers, and original message order.
The practical question is not whether to optimise, but what can be removed without breaking downstream security tasks. The safest approach is to classify telemetry by purpose and treat high-value records as evidence, not just operational data. For example, authentication logs, privilege changes, cloud control plane events, and agent actions often require stronger retention and integrity checks than routine application metrics. Where summarisation is used, the original records should remain available for reconstruction, and the summary should be traceable back to its source.
- Define minimum viable telemetry for detection, investigation, compliance, and legal hold.
- Preserve raw or minimally transformed records for events that can affect incident reconstruction.
- Track what each transformation removes, including timestamps, fields, and sequence information.
- Validate that analysts can explain why a record was kept, reduced, or discarded.
- Test recovery of timelines from retained data before relying on the optimisation layer.
Where identity and privilege are involved, the issue is sharper. Loss of detail around service accounts, non-human identities, tokens, or delegated actions can obscure accountability for both human and machine-driven activity. That becomes especially relevant in environments using automated responders, AI agents, or shared platform identities, because the event trail must still show who or what acted, under which authority, and against which resource. These controls tend to break down when optimisation is applied uniformly across high-volume cloud and endpoint feeds because the most important evidence is often buried in the records considered least important for day-to-day operations.
Common Variations and Edge Cases
Tighter telemetry reduction often lowers storage and alert fatigue, requiring organisations to balance faster operations against evidentiary completeness. That tradeoff is real, and the right answer is not always maximum retention. Best practice is evolving toward tiered telemetry, where some data is short-lived but richly detailed, while other data is compressed for trend analysis. The key is to make those tiers deliberate and auditable rather than implicit.
There is no universal standard for this yet, especially in mixed environments that span cloud, endpoint, SaaS, and agentic workflows. AI-assisted summarisation can be useful for triage, but it should not be treated as a substitute for source records when compliance or incident reconstruction is in scope. Likewise, sampling may be acceptable for performance monitoring but dangerous for rare attack patterns, low-and-slow abuse, or privileged misuse that appears only in a small fraction of events. Where legal, regulatory, or contractual retention obligations apply, telemetry optimisation must preserve the evidence path, not just the metric.
Identity-heavy systems deserve special caution because access decisions, token issuance, and non-human identity actions often look routine until they are the only clue that matters. If a platform cannot retain enough context to explain a sensitive operation, the optimisation has crossed into risk. For control mapping and operating discipline, teams often anchor these decisions to the NIST Cybersecurity Framework 2.0, then extend them to logging standards, retention policies, and incident-ready evidence handling.
Standards & Framework Alignment
This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.
MITRE ATT&CK and OWASP Non-Human Identity Top 10 address the attack and risk surface, while NIST CSF 2.0, NIST AI RMF and NIST IR 8596 set the governance and control requirements practitioners need to meet.
| Framework | Control / Reference | Relevance |
|---|---|---|
| NIST CSF 2.0 | DE.CM-01 | Telemetry feeds continuous monitoring, so loss of fidelity weakens detection coverage. |
| MITRE ATT&CK | T1070 | Log clearing and evidence removal are direct adversary behaviours telemetry must expose. |
| OWASP Non-Human Identity Top 10 | NHI-07 | Non-human identity actions need traceable evidence to support accountability and forensics. |
| NIST AI RMF | GOVERN | Optimisation choices in AI-assisted telemetry need governance, accountability, and traceability. |
| NIST IR 8596 | Cyber AI systems can compress or summarise evidence, creating risk if provenance is lost. |
Document who can transform telemetry and require review of loss of evidence before deployment.
Related resources from NHI Mgmt Group
Deepen Your Knowledge
Reviewed and updated by the NHIMG editorial team on August 18, 2026.
NHI Mgmt Group — the #1 independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org