Join our Newsletter — 33% off our NHI Course

Prometheus

Prometheus is an open-source monitoring and alerting system built around time-series metrics. It scrapes instrumented targets, stores metric data, and supports querying through PromQL. In practice, it is commonly used as a backend for infrastructure monitoring and alerting in cloud-native environments.

Expanded Definition

Prometheus is a metrics collection and alerting platform, not a general logging, tracing, or SIEM tool. Its core model is pull-based scraping of instrumented endpoints, where targets expose time-series metrics that Prometheus stores and queries with PromQL. That matters because the term is often used loosely to mean “monitoring,” but the security and operational meaning is narrower: it is about measurable system state, alert thresholds, and the reliability of the telemetry pipeline.

Guidance versus consensus: there is broad consensus that Prometheus is the canonical open-source metrics stack for cloud-native environments, but practitioners still disagree on where it should stop and adjacent observability layers should begin. Prometheus is strongest when the question is “what is the current condition of this system,” while logs and traces answer different questions. An important boundary is that metric exposure itself can become sensitive if labels or targets reveal internal topology, service names, or capacity patterns.

Examples and Use Cases

Prometheus typically appears in environments where operators need continuous visibility into service health and alertable conditions. It is especially common where Kubernetes, microservices, or automated scaling require lightweight, queryable telemetry rather than manual checks.

  • Scraping application endpoints that expose request latency, error rates, and queue depth so teams can alert on service degradation before users notice it.
  • Monitoring Kubernetes control-plane and workload metrics to detect node pressure, restart loops, or failing deployments.
  • Tracking infrastructure indicators such as CPU saturation, memory pressure, and disk exhaustion to support capacity planning and incident triage.
  • Driving alert rules that trigger on sustained threshold breaches rather than one-off spikes, which helps reduce noise at the cost of slower reaction to short-lived anomalies.
  • Acting as the metrics backend for dashboards that help engineers compare normal baselines with current behaviour across clusters and services.

Prometheus is often adopted because it is simple to instrument and easy to automate, but that convenience can create hidden operational dependencies on stable scrape intervals, endpoint availability, and label consistency.

Security Implications

Prometheus is usually deployed as an operational control, but it also creates security exposure if telemetry is overly permissive or poorly segmented. Metrics can disclose service names, hostnames, version details, environment labels, and traffic patterns that help an attacker map the environment. In mature environments, this is treated as an information disclosure and visibility problem, not just a monitoring concern.

A second failure mode is trust in incomplete telemetry. If scrape targets are down, relabelled incorrectly, or partially instrumented, alerts may remain quiet while a service is actually degraded or compromised. That matters because security teams may assume “no alert” means “no issue,” when the real problem is missing data. Prometheus can also become operationally noisy if alert rules are too sensitive, which desensitises responders and slows response to real incidents.

From NHI Management Group’s perspective, the practical lesson is that telemetry quality affects both detection and governance. A monitoring stack that cannot reliably see critical systems creates blind spots that attackers, outages, and misconfigurations can all exploit.

Domain and Governance Relevance

In its primary domain, Prometheus supports observability governance: teams use it to define what is measured, who receives alerts, and which service conditions count as operationally significant. That makes it part of the evidence layer for reliability, incident response, and service ownership. The main governance question is whether the metrics being collected are sufficient, stable, and appropriately scoped for the decisions they inform.

The identity and access angle becomes material when Prometheus is used to monitor platforms that depend on machine-to-machine connectivity, such as cloud services, service accounts, or automation agents. In those environments, telemetry quality can reveal whether credentials, tokens, or workload access paths are failing, but Prometheus is still the monitoring mechanism rather than the identity control itself. The boundary matters: it should support governance of those systems without becoming a substitute for access management or secret control.

When used well, Prometheus improves accountability by making system behaviour observable; when used carelessly, it can expose too much operational detail while still missing the failures that matter most.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

MITRE ATT&CK and OWASP Non-Human Identity Top 10 address the attack and risk surface, while NIST CSF 2.0 and CIS Controls v8 set the governance and control requirements practitioners need to meet.

Framework Control / Reference Relevance
NIST CSF 2.0 DE.CM-1 — Monitoring for Unauthorized Personnel, Connections, Devices, and Software Prometheus underpins continuous monitoring of system state and anomalies.
Recommendation — Use DE.CM-1 to ensure Prometheus alerts reflect monitored assets and detectable abnormal conditions.
CIS Controls v8 8 — Audit Log Management Prometheus metrics support detection, validation, and incident context around operational events.
Recommendation — Apply Control 8 to retain telemetry that helps validate alerts and reconstruct failures.
MITRE ATT&CK T1613 — Data from Configuration Repository Prometheus labels and targets can expose environment structure and naming details.
Recommendation — Map exposed metric metadata to T1613 and reduce environment details in publicly reachable endpoints.
OWASP Non-Human Identity Top 10 NHI-01 — Inventory and Ownership Prometheus often monitors machine-driven estates where visibility supports identity and asset ownership.
Recommendation — Use NHI-01 to keep monitored machine identities and their telemetry sources fully inventoried.