Join our Newsletter — 33% off our NHI Course

What breaks when organisations only check open source packages at release time?

Release-only checks miss vulnerabilities, malicious packages, and abandoned dependencies that arrive between release cycles. That leaves teams exposed during development, testing, and deployment, when risky code can still move through the pipeline. Continuous monitoring is needed because dependency risk changes after the initial approval and often before production use.

Why This Matters for Security Teams

Release-only package screening creates a false sense of control because software supply chain risk is not static. A dependency can be safe when a build is approved and unsafe by the time a sprint ends. That gap matters for vulnerabilities, typosquatting, dependency confusion, compromised maintainers, and packages that are effectively abandoned but still in use. Security teams also miss the operational reality that package decisions affect build integrity, release confidence, and incident response readiness at the same time.

This is why guidance from NIST SP 800-53 Rev 5 Security and Privacy Controls is useful here: control outcomes are meant to be sustained, not checked once and forgotten. A package can pass a point-in-time review and still become unsafe before production deployment if a new CVE appears or a maintainer account is compromised. The main mistake is treating release approval as proof of ongoing trust.

In practice, many security teams encounter dependency risk only after a build has already shipped or a developer has already pulled a compromised package into active work.

How It Works in Practice

The operational failure is simple: release-time checks only validate a snapshot. Modern package ecosystems move quickly, and the risk profile of an open source dependency can change between commits, builds, staging, and production. Continuous monitoring closes that gap by rescanning manifests, lockfiles, and resolved dependencies whenever the source tree, build pipeline, or package intelligence changes. It also helps teams distinguish between direct dependencies and transitive ones, which is where many hidden exposures live.

For practical implementation, teams usually combine repository scanning, build-time policy enforcement, and post-release monitoring of package advisories and maintainer trust signals. That means watching for new vulnerabilities, suspicious version jumps, package name similarity attacks, ownership changes, and deprecated or unmaintained components. Best practice is evolving, but the control objective is clear: do not rely on a single approval checkpoint when the dependency graph is dynamic.

  • Scan source manifests and lockfiles on every pull request, not just at release.
  • Monitor transitive dependencies, since indirect packages often introduce the highest exposure.
  • Re-evaluate packages when advisories, maintainer status, or integrity signals change.
  • Block high-risk packages with policy gates instead of waiting for manual review.

Framework guidance from OWASP Software Supply Chain Security Top 10 aligns well with this approach because it treats package integrity, provenance, and dependency oversight as ongoing duties rather than one-time checks. Teams should also connect findings to vulnerability management workflows so exposed libraries are prioritised by reachability and deployment scope, not just by release date.

These controls tend to break down when builds are heavily cached or when multiple application teams reuse shared internal artifacts without a consistent dependency inventory, because risk updates can be missed between the scan point and the actual deployment path.

Common Variations and Edge Cases

Tighter dependency governance often increases build friction and review overhead, so organisations need to balance faster delivery against stronger supply chain assurance. That tradeoff becomes more visible in polyglot environments, monorepos, and platforms that rely on private registries, vendored code, or ephemeral build containers.

Some teams assume that signed packages eliminate the need for ongoing checks, but signature validation only answers whether a package is authentic, not whether it is still safe. Others rely on dependency pinning and assume the problem is solved, when pinned versions can still contain latent vulnerabilities or become unmaintained over time. There is no universal standard for this yet on how often every organisation should rescan, but the current guidance suggests monitoring should be continuous enough to catch material change before deployment.

For software exposed to regulated or high-impact environments, the argument for continuous monitoring is stronger. The CISA Known Exploited Vulnerabilities Catalog is a useful operational signal when prioritising packages that have moved from theoretical weakness to active exploitation. In practice, the right answer is less about checking more often for its own sake and more about reducing the time a dangerous dependency can remain invisible in the pipeline.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

MITRE ATT&CK address the attack and risk surface, while NIST CSF 2.0 and CIS-Controls set the governance and control requirements practitioners need to meet.

Framework Control / Reference Relevance
NIST CSF 2.0 ID.RA-1 Dependency risk is a supply chain risk that must be identified continuously.
MITRE ATT&CK T1195 Supply chain compromise maps directly to malicious package and dependency abuse.
CIS-Controls 2.3 Asset inventory includes software dependencies and libraries that must be tracked.

Maintain a living dependency risk inventory and refresh it whenever code, builds, or advisories change.