Subscribe to the Non-Human & AI Identity Journal
Home FAQ Cyber Security What do organisations get wrong about penetration testing…
Cyber Security

What do organisations get wrong about penetration testing and SOC 2?

← Back to all FAQ
By NHI Mgmt Group Editorial Team Updated August 2, 2026 Domain: Cyber Security

They often assume testing itself is the objective. In practice, the value comes from finding weaknesses, remediating them, and retaining proof that the control process closed the loop. Auditors care about operating effectiveness, so the testing record should show scope, findings, remediation, and retest outcomes.

Why This Matters for Security Teams

penetration testing and SOC 2 both get misread as one-time compliance tasks, when they are really evidence-producing controls. A test that only creates a report, without tracked remediation and retesting, says little about operating effectiveness. For SOC 2, the issue is not whether a vulnerability existed at a point in time, but whether the organisation had a repeatable process to find, prioritise, fix, and verify weaknesses. That distinction is central to assurance work and to the SOC 2 trust services criteria expectations around control design and performance.

The other common mistake is treating the penetration test as a substitute for broader security monitoring. A point-in-time assessment can reveal exploitable paths, but it does not confirm resilient detection, alerting, or response. Security teams that rely on the test alone often miss recurring issues such as weak segmentation, stale access, exposed secrets, or compensating controls that never actually fire. In practice, many security teams encounter those gaps only after a failed audit or a real incident has already exposed them, rather than through intentional control validation.

How It Works in Practice

Effective penetration testing for SOC 2 should be framed as part of a control lifecycle, not as an isolated event. The test should define scope, assets, methods, business constraints, and rules of engagement in advance. Results then need to move into a tracked remediation workflow with owners, due dates, risk ranking, and evidence that fixes were actually implemented. For auditors, that closed loop is often more valuable than the raw exploit narrative.

Operationally, teams usually need three layers of evidence. First, the test plan shows what was in scope and why. Second, the findings and remediation tickets show that weaknesses were acknowledged and addressed. Third, the retest or verification output shows that the original weakness is no longer present or is reduced to an accepted residual risk. This approach aligns well with the practical guidance in the NIST Cybersecurity Framework, especially around risk identification, protective implementation, and recovery discipline.

A good SOC 2 program also distinguishes between a vulnerability scan, a penetration test, and continuous security monitoring. Those are related but not interchangeable. A scan may support routine hygiene, while a penetration test validates whether chaining weaknesses creates actual business impact. Security teams should also keep testing focused on the system boundary that matters for the report period, including identity paths, privileged access, internet-facing services, cloud misconfigurations, and any third-party dependencies that could affect service commitments. The ENISA Threat Landscape is useful here because it reinforces how adversaries often combine technical weaknesses with identity abuse and operational gaps.

  • Document the objective of the test: assurance, validation, or pre-assessment.
  • Track every finding to a named remediation owner and target date.
  • Retest the same issue after the fix, not just the surrounding control.
  • Preserve evidence that the control operated during the SOC 2 period.
  • Include privileged accounts, external attack surface, and key trust boundaries in scope.

These controls tend to break down when testing is scheduled too late in the audit cycle because remediation and retesting no longer fit inside the reporting period.

Common Variations and Edge Cases

Tighter testing and evidence requirements often increase operational overhead, requiring organisations to balance audit readiness against release speed. That tradeoff becomes sharper in fast-moving cloud and SaaS environments, where assets change frequently and a point-in-time test can age out before remediation finishes.

Best practice is evolving for continuous validation, but there is no universal standard for replacing annual penetration tests in SOC 2. Some organisations supplement traditional testing with targeted red-team exercises, cloud posture reviews, or identity-focused assessments, while others rely on more frequent vulnerability management and change-aware monitoring. The important point is that the auditor should be able to see a coherent process, not a collection of disconnected security activities.

Edge cases often appear in environments with shared responsibility, microservices, or heavy third-party integration. A finding may originate in a platform layer, but the remediation may sit with application, identity, or infrastructure teams. In those cases, the evidence trail needs to show ownership clearly, especially where privilege boundaries, service accounts, or automation tokens are involved. NHIMG sees this most often where the test uncovers an identity issue that was not considered part of the security baseline, even though it directly affected the attack path.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

MITRE ATT&CK address the attack and risk surface, while NIST CSF 2.0, NIST SP 800-53 Rev 5 and SOC-2 set the governance and control requirements practitioners need to meet.

FrameworkControl / ReferenceRelevance
NIST CSF 2.0ID.RARisk assessment covers pen test findings and remediation prioritisation.
MITRE ATT&CKT1589Pen tests often validate exposure that enables reconnaissance and access chaining.
NIST SP 800-53 Rev 5CA-8Security assessments and penetration tests need defined scope and follow-up.
SOC-2SOC 2 requires evidence that controls operate effectively over the period.

Run scoped assessments, track findings, and verify remediation before closing evidence.

NHIMG Editorial Note
Reviewed and updated by the NHIMG editorial team on August 2, 2026.
NHI Mgmt Group — the #1 independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org