Join our Newsletter — 33% off our NHI Course

How should teams evaluate whether their compliance programme is actually working?

Look for evidence that controls are operational, repeatable and reviewable: access logs, approval trails, encryption coverage, incident playbooks and regular reassessment. If controls exist only in policy documents or slide decks, the programme is not working. Real compliance is visible in routine operations, not just in audits.

What to Measure Beyond the Audit Binder

compliance programme fail when teams measure document production instead of control behaviour. A policy can be current while the underlying process is inconsistent, manual, or never exercised. The practical test is whether the control produces the same result in routine operations, not just during a scheduled review.

That means looking for repeatable evidence across time, teams, and systems. If access is reviewed only once a year, if encryption is only claimed in architecture diagrams, or if incident response exists only as a tabletop slide, the programme may be compliant in form but not functioning in practice.

A useful evaluation question is whether the organisation could demonstrate the control without preparing a special case for auditors. If the evidence is already present in daily operations, the programme is closer to being real.

Which Operational Signals Prove the Programme Is Alive?

The strongest signals are artefacts generated by normal work: access logs, approval trails, ticket histories, exceptions with expiry dates, encryption coverage reports, incident exercises, and reassessment records. These show that people are using the control, not just naming it. SOC 2 Trust Services Criteria (AICPA) is one useful external reference point when teams need assurance that operational evidence exists for security, availability, confidentiality, and processing integrity claims.

Coverage alone is not enough. A control should also be reviewable: someone must be able to explain who checked it, what they found, what changed, and when the next review will occur. That is what separates a control from a one-time implementation.

Repeatability matters because compliance decay is often gradual. Teams may start with strong access approvals or logging, then drift into informal exceptions, stale reviews, or inconsistent incident follow-up. The programme is healthy only if the control still works when the original project team is no longer watching it.

When a Compliance Programme Is Mostly Theatre

A programme is not working when evidence exists only for the audit, while day-to-day operations tell a different story. Typical warning signs are manual screenshots instead of system records, policy exceptions that never expire, approvals that do not match actual access, and controls that no one can verify independently. NIST SP 800-53 Rev 5 Security and Privacy Controls is a useful external benchmark for thinking about whether audit, access control, and integrity practices are implemented as controls rather than declarations.

This failure mode matters because superficial compliance creates false confidence. Leaders believe risk is managed, but the organisation has only produced paperwork. In practice, that leaves gaps in accountability, weakens incident response, and makes control failures harder to detect before they become material.

The most telling indicator is whether teams can produce fresh evidence without scrambling. If a control cannot be shown through routine logs, system outputs, or operational records, it is probably not embedded in the process.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

NIST SP 800-53 Rev 5 and NIST CSF 2.0 set the technical controls, while SOC 2 (AICPA) defines the regulatory obligations.

Framework Control / Reference Relevance
SOC 2 (AICPA) CC7.2 — Security Monitoring Routine evidence and reviews show whether controls operate continuously.
Recommendation — Verify controls through ongoing monitoring evidence, not audit-only snapshots.
NIST SP 800-53 Rev 5 AU-6 — Audit Record Review, Analysis, and Reporting Operational logs and review trails are central to proving controls work.
Recommendation — Review audit records continuously to confirm controls are actually functioning.
NIST CSF 2.0 GV.RM-01 — Risk management strategy Programme effectiveness depends on measuring whether controls reduce real risk.
Recommendation — Align compliance checks to risk outcomes, not only policy completion.

Practitioner Guidance

What to verify: Ask for current evidence from production systems, not exported summaries or hand-built slides. The test is whether the control leaves a trace in normal operations that another reviewer could independently follow.

  • Check that approvals, reviews, and exceptions have timestamps, owners, and expiry or follow-up points.
  • Confirm that logging, encryption, incident handling, and reassessment are happening on schedule, not only during assurance cycles.
  • Compare policy language against actual records and look for mismatches in scope, timing, or ownership.

Common mistake: Treating audit pass results as proof of programme health. A clean audit can coexist with weak operational discipline if teams only assemble evidence when asked.

What good looks like: Control evidence is continuous, routine, and hard to fake because it is produced by the systems and teams that run the environment. The organisation can explain control performance without needing a special project to reconstruct it.

Practitioner takeaway: Evaluate compliance as an operational property, not a documentation exercise, and assume the programme is weak until its controls can prove themselves in live, repeatable use.