Join our Newsletter — 33% off our NHI Course

What are the signs that a threshold-based detection is set too high or too low?

A threshold set too high misses real attacks and creates false negatives, especially when malicious activity stays just below the line. A threshold set too low produces floods of false positives and repeated analyst fatigue. The clearest signs are excessive noisy alerts, little investigative action, and alert patterns that do not match the environment’s normal behavior.

When does a threshold become too high?

A threshold is usually too high when it suppresses alerting until the activity is already well outside normal behavior. The practical sign is not just fewer alerts, but missed or delayed detection of events that investigators later recognise as meaningful. In mature environments, high thresholds often hide slow, low-and-slow abuse rather than making the signal cleaner.

What makes this hard is that a high threshold can look “stable” on paper. The dashboard appears calm, yet the control is failing to surface borderline malicious activity, especially when an attacker intentionally stays just under the line. If analysts only learn about the behavior after an incident review, the threshold was probably set above the point of useful detection.

When is a threshold too low?

A threshold is usually too low when it creates alert volume that is out of proportion to actual risk. The clearest sign is a stream of noisy notifications that analysts repeatedly close without action, or that require so much routine triage that genuinely suspicious events get less attention. The signal is not sensitivity by itself, but whether sensitivity still produces usable work.

Low thresholds often fail because they do not reflect the environment’s baseline patterns. Normal bursts, batch jobs, seasonal business activity, or known automation can all be mistaken for anomalies if the threshold is set without enough context. When an alert rule fires constantly on expected activity, it stops functioning as a detection mechanism and becomes noise.

How do you tell the difference in practice?

The most useful test is to compare alert behavior against investigation behavior. If alerts are frequent but rarely lead to confirmed issues, the threshold is likely too low. If alerts are sparse and investigators keep finding missed cases, the threshold is likely too high. Good thresholds produce a manageable volume of alerts with a meaningful share of triage value.

Two other signals matter. First, look for mismatch between the alert pattern and the environment’s normal rhythm, because a threshold that ignores recurring operational patterns will be brittle. Second, watch for analyst fatigue, since repeated false positives degrade review quality and can cause true positives to be deprioritised. Threshold tuning is therefore a detection-quality exercise, not only a math problem.

Risk and Threat Considerations

Threshold miscalibration creates asymmetric risk. If the bar is too high, adversaries can deliberately remain below it and blend into normal activity; if it is too low, defenders drown in noise and lose confidence in the control. In both cases, the organisation pays for detection tooling but gets weaker decision-making.

Failure mechanism: The detection rule fails either by under-sampling suspicious behavior or by over-firing on benign activity, which breaks the link between alerting and meaningful investigation.

Impact: Missed intrusions, delayed response, analyst fatigue, and lower trust in the monitoring program can all follow, especially when thresholding is used as the main gate for escalation.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

MITRE ATT&CK addresses the attack and risk surface, while NIST CSF 2.0 sets the governance and control requirements practitioners need to meet.

Framework Control / Reference Relevance
MITRE ATT&CK Adversary Tactics and Techniques Threshold tuning affects detection of low-and-slow attacker behavior and evasion.
Recommendation — Map missed alerts to ATT&CK techniques and tune detections against observed adversary behavior.
NIST CSF 2.0 DE.CM-01 — Monitoring for anomalous activity Thresholds directly shape whether anomalous activity is detected or buried in noise.
Recommendation — Tune alert thresholds to sustain effective anomalous-activity monitoring.

Practitioner Guidance

What to verify: Validate thresholds against actual historical event distributions, not just vendor defaults or a single “expected” number. A good threshold should preserve meaningful outliers while suppressing routine operational spikes that your team already understands.

What to measure: Track alert-to-investigation ratio, confirmed-positive rate, and the frequency of repeated dismissals for the same rule. Those measures tell you whether the threshold is helping analysts focus or just shifting effort into triage.

Practitioner takeaway: The right threshold is the one that preserves actionable signal, not the one that generates the most alerts or the fewest.