TL;DR: Autonomous vulnerability triage needs more than text similarity, because duplicate findings often depend on context, location, and vulnerability class, according to Xbow. The post shows how multi-view embedding, per-CWE tuning, and analyst ground truth can reduce noise without collapsing distinct security issues that still need separate remediation.
NHIMG editorial — based on content published by Xbow: Engineering the Impossible: How XBOW De-Duplicates Findings
By the numbers:
- Reported finding volume is down 30% after Xbow applied its de-duplication system.
- Approximately 90% of duplicate findings were eliminated by the de-duplication system.
- On the tuning set, the clusters achieved approximately 90% agreement with analyst-created clusters.
Questions worth separating out
Q: How should security teams prevent autonomous triage tools from merging distinct findings?
A: Teams should compare findings by field, not by one blended text block.
Q: Why does deduplication become risky when the same weakness appears in multiple endpoints?
A: Because repeated language does not always mean repeated risk.
Q: What are the signs that finding deduplication is too aggressive?
A: Look for merged reports that hide different parameters, different users, or different workflows behind one summary.
Practitioner guidance
- Define class-specific deduplication rules Separate application-wide issues from context-sensitive issues such as reflected XSS, and do not use one global merge rule for every weakness class.
- Normalize dynamic identifiers before scoring Replace numeric IDs, UUIDs, tokens, and other high-cardinality path elements with canonical placeholders before embedding or comparison.
- Split findings into comparison fields Evaluate description, reproduction, location, and impact independently so that shared language in one field does not dominate the whole decision.
What's in the full article
Xbow's full article covers the implementation detail this post intentionally leaves at the analysis layer:
- Field-by-field embedding design for description, reproduction, location, and impact
- Per-CWE weighting and threshold tuning logic for different vulnerability classes
- Analyst clustering workflow used to create ground truth for evaluation
- Normalization rules for paths, IDs, UUIDs, and tokens before similarity scoring
👉 Read Xbow's analysis of autonomous finding de-duplication in security testing →
Autonomous finding de-duplication: why context still matters for SOC teams?
Explore further
Context-aware deduplication is now a governance control, not just a triage convenience. When autonomous security systems generate findings at scale, the question is no longer whether they can detect issues, but whether they can preserve the distinctions that matter for remediation. That is a governance problem because noise, over-collapse, and misclassification all affect risk prioritisation. In identity-heavy environments, the same principle applies to NHI telemetry and access events: repeated signals are not automatically duplicates. Practitioners should treat deduplication as a control design decision, not an engineering afterthought.
A question worth separating out:
Q: How do teams know whether their deduplication model is actually working?
A: Measure it against expert-labelled clusters, not just raw volume reduction. Useful signals include agreement with analyst decisions, preservation of separate fixes where context differs, and lower report volume without a rise in reopened or misclassified findings. If the system is only shrinking the queue, it may be hiding useful distinctions.
👉 Read our full editorial: Autonomous finding de-duplication needs context, not one global model