A SOAR platform holds standing credentials to your firewalls, identity provider, endpoint agents and cloud consoles, and most rollouts connect those integrations long before anyone has decided which actions a machine may take on its own. Security orchestration, automation and response (SOAR) pays off only when the playbooks are trusted, and trust is lost quickly when an automated action isolates a production server or disables a director's account by mistake. This playbook sets out a vendor-neutral, phased rollout: the decisions to make before the first connector, the order to automate use cases, how to test in shadow mode, how to roll back, and how to show it is working. It is for SOC leads, detection engineers and security platform owners. What SOAR is and which use cases to automate are covered in the SOAR and Security Automation Guide; this page is the delivery plan.
Key takeaways
- Get the SIEM and incident process right first. The Australian Signals Directorate advises against prioritising SOAR where there is no mature SIEM or no experienced security team, because automation amplifies whatever the detection layer feeds it.
- Treat every connector as a privileged non-human identity. One least-privilege identity per integration, credentials in a vault, an owner and a review date, before the connector goes live.
- Classify actions by blast radius before you automate them. Enrichment can run unattended from day one; containment that can stop a business service needs an approval gate and an exclusion list.
- Shadow mode is the pilot. Run playbooks in recommend-only mode against live alerts and compare their decisions with analysts' for an agreed period before anything executes.
- Every playbook has an off switch and every action has an undo. A playbook that misfires should drop to notify-only in one change, and the runbook should say how to reverse each action it took.
Before you start: decisions that are hard to change later
Write a short design record and get it approved by the SOC lead, the platform owner and the owners of the systems the SOAR will act on. The Australian Signals Directorate's SIEM and SOAR practitioner guidance, published with CISA and other partners in May 2025, recommends naming an accountable system owner and involving platform engineers, developers and legal or GRC staff, not only analysts.
| Decision | Options | What to consider |
|---|---|---|
| Deployment model | SaaS; self-hosted; SOAR features inside the SIEM or XDR | SaaS needs outbound connectivity and often an on-premises relay or engine to reach internal tools. Self-hosted puts patching and availability on you. Built-in automation reduces integration work but may limit cross-vendor actions. |
| Where actions run | Central engine; distributed engines or relays per network zone | Engines inside each zone avoid opening inbound firewall paths but multiply the hosts that hold credentials. Hosting the SOAR in a segregated monitoring enclave may limit what it can remediate, as the ASD guidance notes. |
| Credential storage | Platform credential store; external secrets manager | An external secrets manager gives one rotation and audit point. Either way, analysts and playbook authors should never see connector secrets in clear. |
| Playbook format and source control | Visual editor only; playbooks exported to a repository; open format such as OASIS CACAO v2.0 | Version control with review is what makes rollback possible. CACAO v2.0 (Committee Specification 01, November 2023) defines playbooks in JSON and keeps authentication information separate from steps, which helps portability. |
| Case management | SOAR as the case system; ITSM as the case system; SIEM cases | Pick one system of record for incidents and evidence. Two half-used case systems split the audit trail. |
| Who may publish playbooks | Any analyst; detection engineers with peer review; change board for high-impact playbooks | Separate authoring from approval for anything that can contain or change production, in line with NIST SP 800-53 AC-5 and CM-3. |
Small versus large organisations: a small SOC, or one using a managed detection provider, usually gets more from the automation built into its SIEM or XDR, a handful of enrichment and phishing playbooks, and approval for every containment action. A large SOC with many tools benefits from a dedicated SOAR, distributed engines per zone, playbooks in source control and a detection engineering team that owns them as code.
Classify actions before you automate them
The single most useful artefact in a SOAR rollout is an action catalogue: every action any playbook can take, its blast radius and the gate it needs. Agree it with system owners before building playbooks.
| Tier | Example actions | Gate | Undo |
|---|---|---|---|
| 0. Read only | Look up IP, domain, hash reputation; query EDR for process tree; pull user and device details from directory and asset inventory | None; runs automatically | Not needed |
| 1. Notify and record | Open or update a case, message the user or system owner, create an ITSM ticket | None, with rate limits | Close or annotate |
| 2. Reversible, narrow | Delete a phishing email from mailboxes, block a hash or URL, add an indicator to a block list with expiry | Automatic for high-confidence detections, approval otherwise | Restore messages, remove indicator |
| 3. Contain a user or host | Isolate an endpoint, revoke sessions and tokens, disable an account, reset credentials | Analyst approval; exclusion list for critical systems and executive or break-glass accounts | Release isolation, re-enable account; credential resets cannot be undone |
| 4. Network or service wide | Firewall rule changes, DNS sinkhole, disable an application integration, rotate a shared secret | Two-person approval and change record | Revert rule from version history |
The ASD guidance names system quarantine, traffic blocking and credential revocation as typical automated actions, and warns that a SOAR can misread normal activity as an incident and isolate systems in a way that disrupts service delivery. The tiers above are how NHI Mgmt Group recommends containing that risk.
The rollout at a glance
| Phase | Main outputs | Exit criteria |
|---|---|---|
| 0. Readiness and design | Design record, action catalogue, baseline metrics, use case shortlist | SIEM alert quality acceptable for the chosen use cases; incident response plan current; system owner named |
| 1. Platform foundations | Hardened platform, SSO and roles, connector identities, vault, logging, source control | Every connector has an owner and a least-privilege identity; platform audit logs reach the SIEM |
| 2. Enrichment and case handling | Tier 0 and 1 playbooks for the top alert types | Analysts use enriched cases daily; enrichment failures alert |
| 3. Shadow-mode response | Tier 2 and 3 playbooks in recommend-only mode | Agreement with analyst decisions above the agreed threshold for the agreed period |
| 4. Gated execution | Tier 2 automatic for high-confidence detections; tier 3 behind approval | No unplanned business impact; rollback exercised for each action type |
| 5. Operate and expand | Monthly playbook review, quarterly exercises, new use cases by analyst time saved | Metrics reviewed; retired playbooks removed |
Phase 0 and 1: readiness and foundations
- Baseline: record alert volume by type, mean time to triage, mean time to contain and analyst hours per alert type for at least a month. Without a baseline the rollout cannot show value.
- Pick three use cases: high volume, well understood and low risk. User-reported phishing, IOC enrichment and vulnerability or EDR alert ticketing are common starting points. Write the human runbook first; automate only steps the runbook already contains.
- Harden the platform: SSO with phishing-resistant MFA for all users, role-based access that separates viewers, analysts, playbook authors and administrators, no local accounts except a vaulted break-glass account, and patching on the same cadence as other security tools. The Securing the SOAR platform itself guide covers the hardening baseline.
- Create connector identities: one identity per integration, scoped to the actions in the catalogue and no more. A connector that only needs to read EDR telemetry should not hold isolation rights until the tier 3 phase.
- Vault the credentials: store connector secrets in the credential store or an external secrets manager, prefer short-lived tokens or certificate authentication where the target supports them, and set rotation dates.
- Log the platform: send SOAR audit events (logins, playbook edits and publishes, connector changes, every action executed with its target) to the SIEM, retained for as long as incident records.
- Put playbooks under version control: peer review for every change, and a tagged release for anything that reaches production.
Phases 2 to 4: from enrichment to gated execution
- Enrichment first: automate tier 0 and 1 steps for the chosen use cases. Measure how often enrichment fails or times out, since a silent connector failure leaves analysts with empty cases.
- Shadow mode: build tier 2 and 3 playbooks so they write their recommended action into the case without executing it. Compare with what the analyst did. NHI Mgmt Group suggests at least two to four weeks and a high agreement rate on the specific alert type before enabling execution.
- Test beyond the happy path: replay historic alerts, feed malformed and duplicate alerts, simulate a connector timeout and a target system outage, and test that exclusion lists hold. The ASD guidance recommends repeating exercises on well-known techniques and adding ad hoc tests of new ones; pair each detection test with the playbook it triggers.
- Enable with gates: turn on automatic execution for tier 2 actions where detections are high confidence, and approval steps for tier 3 and 4. Approvals should show the analyst the evidence, the target, its criticality and the undo path.
- Rate limits and circuit breakers: cap how many hosts a playbook may isolate or accounts it may disable per hour, and stop the playbook when the cap is hit. A bad detection rule should not become an outage.
- Rollback: each playbook has a switch that returns it to notify-only, and each action type has a documented undo in the runbook. When a playbook misfires, disable it first and investigate second. Day-two procedures belong in the SOAR platform day-2 operations runbook.
Where identity fits
A SOAR is one of the most privileged non-human identities in the estate: it can disable accounts, change firewall rules and pull data from every security tool. Attackers who reach it, or its credential store, inherit all of that.
- Inventory connector identities: record each service account, API key, OAuth client and certificate the SOAR uses, with owner, scope, target system and rotation date. The Service Account Security Guide covers the controls.
- Least privilege by tier: grant containment rights only when the matching playbook reaches gated execution, and remove rights when a playbook is retired.
- Watch the watcher: alert when a connector identity is used from anywhere other than the SOAR engines, outside the hours its playbooks run, or for actions not in the catalogue.
- Protect high-value targets: exclude break-glass, domain admin and executive accounts and critical servers from automatic containment, and route them to a human. The SOAR platform integration security guide covers each integration type.
- AI agents in the SOC: where an AI triage agent drives SOAR actions, it uses the same connector identities, so the same tiers and approval gates apply to it.
Detection and measurement
| Signal | Why it matters | Response |
|---|---|---|
| Playbook published or edited outside the release process | Unreviewed change to automated response | Revert to the last tagged release; review the author's access |
| Connector identity used from an unexpected source | Possible credential theft from the SOAR or its vault | Rotate the credential; investigate the source |
| Spike in tier 3 or 4 actions | Faulty detection, loop or abuse | Circuit breaker stops the playbook; analyst review |
| Enrichment or action failures | Expired credentials or changed APIs leave cases incomplete | Fix the connector; alert owners before expiry |
| Approvals granted in seconds, repeatedly | Approval fatigue turns gates into rubber stamps | Review the gate; move safe actions to automatic or improve evidence shown |
Metrics that show the rollout is working:
- Mean time to triage and mean time to contain for automated alert types, against the phase 0 baseline.
- Analyst hours saved per month, by playbook.
- Automated action accuracy: share of executed actions not reversed as false positives.
- Share of connector identities with an owner, least-privilege scope and a rotation date in the last 12 months.
- Percentage of playbooks exercised in the last quarter, including their rollback path.
Common failure patterns
- Automating a weak SIEM: noisy detections fed into automatic containment produce outages, and the SOC switches automation off for good.
- God-mode connectors: one administrator account per tool used by every playbook, so a compromised SOAR has full control of the security stack.
- No exclusion lists: an automatic disable hits a break-glass or service account and takes down authentication or a production integration.
- Playbooks nobody owns: built by a consultant or one engineer, never reviewed, and broken silently when a target API changes. The ASD guidance warns against treating the platform as set and forget.
- Happy-path testing only: playbooks tested with one clean alert fail on duplicates, missing fields or a timed-out connector.
- Two case systems: evidence split between the SOAR and the ITSM tool, so the incident record is incomplete when regulators or insurers ask for it.
Framework mapping
| Rollout element | NIST SP 800-53 Rev. 5 | NIST CSF 2.0 | Other |
|---|---|---|---|
| Automated incident handling | IR-4, IR-4(1) | RS.MI-01, DE.AE-02 | NIST SP 800-61 Rev. 3 |
| Playbooks aligned to the incident response plan | IR-8 | RS.MA-01, ID.IM-04 | OASIS CACAO v2.0 |
| Separation of playbook authoring and approval | AC-5, CM-3 | PR.AA-05 | Change management |
| Least-privilege connector identities and credentials | AC-6, IA-5 | PR.AA-05 | Secrets management |
| Platform audit logging and monitoring | AU-2, AU-6, SI-4 | DE.AE-02 | ASD SIEM and SOAR guidance |
| Playbook testing and exercises | SA-11 | ID.IM-04 | Purple team exercises |
Practitioner checklist
- Confirm SIEM detection quality and a current incident response plan before buying or switching on SOAR.
- Name a system owner and approve a design record covering deployment, engines, credential storage, playbook format and case system.
- Build and agree an action catalogue with tiers, gates, exclusion lists and an undo for every action.
- Create one least-privilege identity per connector, vault its credential and set a rotation date.
- Send all SOAR audit events, including executed actions and playbook changes, to the SIEM.
- Keep playbooks in version control with peer review and tagged releases.
- Run tier 2 and 3 playbooks in shadow mode and measure agreement before enabling execution.
- Add rate limits and circuit breakers to every containment playbook.
- Exercise each playbook and its rollback path at least quarterly.
- Report time to triage, time to contain, action accuracy and hours saved against the baseline.
Standards and references
- NIST: SP 800-61 Rev. 3, Incident Response Recommendations and Considerations for Cybersecurity Risk Management
- OASIS: CACAO Security Playbooks Version 2.0
- Australian Signals Directorate: Implementing SIEM and SOAR platforms, practitioner guidance
- CISA: Guidance for SIEM and SOAR Implementation
- NIST: SP 800-53 Rev. 5, Security and Privacy Controls for Information Systems and Organizations
- NIST: Cybersecurity Framework 2.0
Related NHI Mgmt Group resources: SOAR Buyer's Guide · SOAR platform migration playbook · OASIS CACAO Security Playbooks Standard Guide · SIEM rollout playbook · If your SOAR platform is compromised