Security teams should validate applications before release, not after, using runtime testing in CI/CD so vulnerabilities are found while code is still fixable. The goal is evidence that security was built in, with documented test results, remediation status, and repeatable checks across every build. That approach supports secure-by-design claims and reduces the chance of shipping known exploitable weaknesses.
Why This Matters for Security Teams
The eu cyber resilience act places software delivery under a much stricter evidence model: teams must be able to show that security testing happened before release, that issues were handled, and that products were not shipped with avoidable weaknesses. That changes pre-production testing from a release gate into a control that supports compliance, product assurance, and customer trust. The most common mistake is treating security scans as a checkbox rather than a documented decision process. Current guidance from the EU Cyber Resilience Act points toward demonstrable due diligence, not just tool output.
For security teams, the practical challenge is not whether testing exists, but whether it is repeatable, scoped to product risk, and tied to remediation before deployment. In modern pipelines, that usually means combining static, dependency, configuration, and runtime checks with clear pass or fail criteria. If a team cannot produce evidence on demand, the testing may be happening too late or in the wrong place. In practice, many security teams encounter compliance gaps only after a release review or incident has already exposed missing test evidence, rather than through intentional pre-production control design.
How It Works in Practice
Effective pre-production testing under the CRA should be built into the delivery workflow, not bolted on at the end. Security teams generally need a policy that defines which tests are mandatory, when they run, who approves exceptions, and how results are retained. The objective is to make security evidence part of the product record, similar to build artefacts or release approvals.
A practical baseline usually includes:
- Static application security testing and dependency analysis during pull request or build stages.
- Dynamic or runtime testing in staging, especially for externally reachable services and authenticated workflows.
- Container, infrastructure, and configuration checks before deployment to reduce environment-driven exposure.
- Documented triage for findings, including accepted risk, fixed issues, and retest evidence.
- Release criteria that block production when critical issues remain unresolved.
Where teams handle AI-enabled components, the same principle applies to model inputs, output validation, and supply chain integrity. The attack surface can include prompt injection, insecure tool use, poisoned training inputs, and weak provenance controls. That is why modern pre-production testing often needs to extend beyond traditional code scanning and include adversarial checks informed by MITRE ATLAS adversarial AI threat matrix where AI features are part of the product. Security teams should also align evidence collection with control expectations in NIST SP 800-53 Rev 5 Security and Privacy Controls, especially for assessment, monitoring, and remediation traceability.
Operationally, this works best when test results flow into the same systems used for engineering change control, ticketing, and release approval. That gives product owners and security reviewers a common view of risk before shipping. These controls tend to break down when builds are heavily customised per customer or when staging environments do not faithfully mirror production, because the test evidence no longer reflects real deployment conditions.
Common Variations and Edge Cases
Tighter pre-production testing often increases release friction and engineering overhead, requiring organisations to balance delivery speed against evidence quality. That tradeoff is real, especially for teams shipping frequently or supporting multiple product lines. Best practice is evolving, but there is no universal standard for which test types must be mandatory in every environment.
For low-risk internal tools, teams may rely more heavily on static testing, dependency checks, and approval controls. For internet-facing products, connected devices, or software with security-sensitive functions, current guidance suggests stronger runtime validation, abuse-case testing, and retesting after material changes. If AI features are embedded in the product, pre-production testing should also include model and prompt abuse scenarios, because a clean application scan does not prove safe AI behaviour. The CISA cyber threat advisories and ENISA Threat Landscape are useful references for shaping realistic test cases around active threat patterns rather than abstract vulnerability lists.
Documentation is another edge case. A team can have strong testing discipline but still struggle to prove CRA alignment if results are fragmented across tools or discarded after the pipeline finishes. The better approach is to preserve test artefacts, exception approvals, and remediation evidence in a searchable record. Where software includes agentic or AI-assisted automation, teams should also review whether the behaviour seen in staging would remain safe once connected to real credentials, real tools, and real data. That gap is often missed until deployment, and the same risk logic is increasingly visible in the attack patterns described in the Anthropic report on AI-orchestrated cyber espionage.
Standards & Framework Alignment
This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.
OWASP Agentic AI Top 10 address the attack surface, NIST CSF 2.0 and NIST SP 800-53 Rev 5 set the technical controls, and EU Cyber Resilience Act define the regulatory obligations.
| Framework | Control / Reference | Relevance |
|---|---|---|
| EU Cyber Resilience Act | Pre-release testing and evidence are central to CRA secure-by-design expectations. | |
| NIST CSF 2.0 | DE.CM-8 | Testing evidence supports ongoing security monitoring and verification of control effectiveness. |
| NIST SP 800-53 Rev 5 | CA-2 | Security assessments map directly to documented pre-release validation and retesting. |
| OWASP Agentic AI Top 10 | AI-enabled products need abuse testing for prompt injection and unsafe tool execution. |
Build mandatory pre-production checks and retain proof that critical issues were fixed before release.
Related resources from NHI Mgmt Group
- Who is accountable when a device or software product fails to meet EU Cyber Resilience Act requirements?
- Why does the EU Cyber Resilience Act matter to IAM and AppSec teams?
- How should security teams implement secure SDLC controls across modern delivery pipelines?
- Why do Cyber Resilience Act requirements create more risk for product teams than a simple deadline would?
Deepen Your Knowledge
Reviewed and updated by the NHIMG editorial team on August 24, 2026.
NHI Mgmt Group — the #1 independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org