They should do both, but control refreshes have to follow any material change in threat, architecture, or identity model. A test that validates outdated assumptions can create a false sense of preparedness, while refreshed controls keep the next test meaningful.
Why the order depends on what changed
Recovery testing and control refreshes solve different problems. Testing tells you whether the organisation can recover under current conditions. Control refreshes make sure those conditions are still true. If the threat landscape, architecture, or identity model has shifted, refreshing the control set first is usually the better move because it prevents recovery exercises from validating assumptions that no longer match reality.
A recovery test is strongest when it exercises controls that are already current, monitored, and owned. If the controls are stale, the test may still be valuable, but mainly as a way to expose the gap. In practice, the more material the change, the more the organisation should treat control refresh as a prerequisite for meaningful testing.
What each activity actually proves
Recovery testing proves whether people, processes, dependencies, and technical paths can restore service within acceptable tolerances. It is evidence of operational readiness, not evidence that the underlying control environment is still fit for purpose. A team can pass a test while still relying on outdated access paths, deprecated failover logic, or unreviewed recovery credentials.
Control refreshes prove something different: that the preventative, detective, and responsive controls reflect the current environment. This includes changes in architecture, new integrations, altered trust boundaries, updated identity or privilege patterns, and revised backup or restore dependencies. Current controls make the next recovery test more meaningful because the test is validating the live design, not an old one.
For that reason, the best sequence is often iterative rather than linear. Refresh the affected controls when a material change occurs, then test recovery against the refreshed state, then use the test results to refine both runbooks and control ownership. That cycle is what turns resilience from a paper exercise into an operational capability.
When delay becomes a resilience problem
Delaying control refreshes can create a false sense of coverage. If a recovery test succeeds after major changes, the organisation may infer that it is resilient when it is only compatible with a previous environment. The gap becomes more dangerous when recovery depends on identity, access, or routing assumptions that have silently changed.
Delayed refresh also increases the chance that failures will appear only during an actual incident, when there is no time to discover that backup access, failover permissions, or restoration dependencies no longer work as expected. The practical question is not whether the organisation can run a test now, but whether the test still reflects the control state that would exist during a real outage.
Risk and Threat Considerations
Outdated controls and untested recovery paths create a real exposure: teams may believe they are resilient while attackers or system failures are exploiting stale assumptions. That is especially problematic after changes to architecture or identity because the attack surface and the recovery path can shift at the same time.
Failure mechanism: Material change alters trust boundaries, access paths, or restore dependencies, but the organisation continues testing against old procedures and permissions. The test can pass even though the live control environment no longer supports the same recovery outcome.
Impact: Recovery time, data integrity, and operational confidence all degrade at the moment they matter most. In a compromise or outage, the organisation may discover that the real failure was not the incident itself, but the mismatch between current reality and the controls the test assumed.
Standards & Framework Alignment
This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.
NIST CSF 2.0, NIST SP 800-53 Rev 5 and CIS Controls v8 set the technical controls, while ISO/IEC 27001:2022 defines the regulatory obligations.
| Framework | Control / Reference | Relevance |
|---|---|---|
| NIST CSF 2.0 | RC.RP-01 — Recovery Plan Execution | Directly supports the recovery-testing side of the question. |
| GV.SC-04 — Cyber Supply Chain Risk Management | Architecture and dependency changes can invalidate recovery assumptions and control coverage. | |
| ID.RA-05 — Threats, Vulnerabilities, Likelihoods, and Impacts are Used to Understand Risk | The answer hinges on change-driven risk reassessment before relying on old tests. | |
| Recommendation — Test recovery plans against the current environment and update them after material changes. Refresh dependent controls when upstream services or dependencies change. Reassess risk when the threat model or environment changes materially. | ||
| NIST SP 800-53 Rev 5 | CP-4 — Contingency Plan Testing | Directly addresses recovery testing and validation of restore capability. |
| CM-2 — Baseline Configuration | Control refreshes depend on keeping the baseline aligned with current architecture. | |
| IA-5 — Authenticator Management | Identity model changes can affect recovery access paths and control validity. | |
| Recommendation — Exercise contingency plans regularly and after material environment changes. Rebaseline controls whenever material architecture changes occur. Refresh authenticator and credential lifecycle controls after identity changes. | ||
| ISO/IEC 27001:2022 | A.5.29 — Information security during disruption | Maps to maintaining effective controls while preparing and testing recovery. |
| A.8.13 — Information backup | Recovery testing depends on backup and restore controls remaining current. | |
| A.8.32 — Change management | Change management is the control-refresh trigger in the question. | |
| Recommendation — Align recovery arrangements with current control requirements before testing. Verify backup and restore controls after any material system change. Require control review and refresh whenever material changes are introduced. | ||
| CIS Controls v8 | CIS-17 — Incident Response Management | Incident readiness depends on practiced recovery, not just documented intent. |
| Recommendation — Exercise recovery procedures and revise them after major changes. | ||
Practitioner Guidance
What to prioritise: Treat any material change in threat, architecture, or identity model as a trigger to refresh the affected controls before the next formal recovery test. If the change affects access, privilege, segmentation, backup reachability, or recovery ownership, the test should not be the first thing you trust.
What to verify: Confirm that recovery procedures, dependencies, and permissions still match production reality, especially where restore actions require privileged access or cross-system coordination. A passed exercise is only useful if the path it exercised is still the path you would use during an actual incident.
Practitioner takeaway: Testing validates readiness, but refreshed controls preserve relevance, and relevance is what makes a resilience test worth doing in the first place.
Related resources from NHI Mgmt Group
- Should organisations prioritise external exposure or internal credential governance first?
- Should organisations prioritise static testing or runtime testing first?
- Should organisations prioritise recovery coverage or user convenience first?
- Which control should organisations prioritise first when attack windows collapse?
Deepen Your Knowledge
Free weekly newsletter
Subscribe to the NHI & AI Identity Journal
The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.
Bonus 33% off our NHI Course when you subscribe.
Reviewed and updated by the NHIMG editorial team on October 11, 2026.
NHI Mgmt Group — the #1 independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org