By NHI Mgmt Group Editorial TeamDomain: Cyber SecuritySource: PantherPublished May 5, 2026

TL;DR: AI can reduce breach lifecycle and costs while 42% of SOCs still deploy out-of-the-box AI and ML tools that score low on satisfaction, underscoring a gap between automation promise and operational reality, according to Panther. The real issue is not replacement but whether teams can supervise AI, tune detections, and preserve human judgment where context matters.


At a glance

What this is: This is an analysis of how AI is changing SOC work, with the key finding that AI augments repetitive triage but does not replace analyst judgment.

Why it matters: It matters to IAM and security practitioners because SOC automation depends on trustworthy data, context-rich detections, and human oversight, all of which intersect with identity telemetry and privilege-aware response.

By the numbers:

  • 42% of SOCs deploy AI/ML tools out-of-the-box without customization, and those tools consistently receive low satisfaction.
  • 4, OC teams face an average alert volume of 4,400+ alerts, and many alerts still go uninvestigated because of resource constraints.
  • False positive rates reach more than 80% of investigated alerts, meaning analysts spend the vast majority of triage time on noise.

👉 Read Panther's analysis of how AI is changing SOC analyst roles


Context

AI in the SOC is not a replacement story so much as a governance story. The core problem is that machine-speed triage can only be useful when it sits on top of structured data, clear approval boundaries, and analysts who understand the business context behind alerts. For identity-heavy environments, that context includes privileged accounts, service accounts, and session behaviour.

The article argues that AI performs best on repetitive work such as alert prioritisation and false-positive filtering, but it struggles when the decision depends on organisational knowledge or ambiguous evidence. That distinction matters because many investigations hinge on identity signals, access patterns, and legitimate administrative activity that can look malicious unless human reviewers interpret them correctly.


Key questions

Q: How should security teams use AI in the SOC without losing human control?

A: Use AI to remove repetitive work, enrich alerts, and accelerate triage, but keep humans accountable for escalation, containment, and exception handling. The right model is human-centred automation, where AI expands analyst capacity without becoming the final decision-maker for high-risk actions. That requires explicit approval gates, audit trails, and ownership for every automated step.

Q: Why do identity signals matter in AI-driven SOC investigations?

A: Identity signals matter because many security decisions depend on who acted, from where, with what access, and whether the behaviour fits the user's normal pattern. Without identity context, an investigation may misclassify benign business activity as malicious or miss privilege abuse hidden inside ordinary-seeming events.

Q: What do security teams get wrong about GenAI in the SOC?

A: They often assume the model reduces the need for analyst judgment. In practice, GenAI reduces reading and writing time, but the analyst still owns interpretation, prioritisation, and escalation. If the team uses the model to replace verification, it will amplify mistakes instead of reducing workload.

Q: How do organisations know if AI is actually helping the SOC?

A: Look for lower alert backlog, faster triage, fewer false positives, and better investigator confidence in the outputs. If AI only speeds up noise, or if analysts still need to rework most findings, the system is not adding reliable operational value and probably needs data or rule tuning.


Technical breakdown

Why AI accelerates SOC triage but not judgment

AI works well in the SOC when the task is bounded, repetitive, and data-rich. Alert enrichment, log correlation, and first-pass summaries fit that pattern because they can be modelled from patterns across structured telemetry. Judgement is different. Analysts use institutional knowledge, business context, and awareness of planned change windows to interpret whether the same event is malicious or normal. This is why AI can reduce queue pressure without removing the need for human review. The underlying issue is not model capability alone, but whether the environment provides enough reliable context for a defensible decision.

Practical implication: route AI to repetitive triage, but keep humans on ambiguous identity and privilege decisions.

How detection engineering shapes AI effectiveness in the SOC

Detection engineering is the control plane that makes AI useful. In modern SOCs, detection logic is increasingly treated as code, with version control, testing, and iterative tuning. AI can assist with summarisation and candidate rule generation, but humans still define the logic, validate it, and decide when a signal is strong enough to become a production detection. Threat hunting feeds that pipeline by testing hypotheses before they harden into rules. Without this engineering layer, AI becomes a noisy classifier rather than an operational control.

Practical implication: strengthen detection-as-code and treat AI output as input to tuning, not as final truth.

Why security data lakes reduce hallucination risk

AI output quality depends heavily on the data architecture behind it. A security data lake with normalised schemas and consistent identifiers gives AI more complete context, which improves cross-system correlation and reduces hallucination risk. Fragmented telemetry does the opposite. When identity, cloud, and endpoint events do not align on timestamps or user identifiers, the model has to infer missing context and can misread benign operations as attacks or miss real attack chains. This is a data governance issue as much as an AI issue.

Practical implication: normalise identity and event data before expanding AI-driven investigation workflows.


NHI Mgmt Group analysis

AI in the SOC is an augmentation layer, not a replacement layer. The vendor's evidence points to a narrow but real gain in repetitive triage, while the hard work of interpretation still sits with analysts. That means the market is moving toward human validated automation rather than autonomous closure. For security leaders, the lesson is to redesign work allocation, not count on headcount elimination.

Detection engineering is becoming the control that determines whether AI creates signal or noise. AI can only scale what the detection logic and telemetry quality allow it to see. In practice, that shifts value toward teams that can write, test, and tune detections as code and then use AI to accelerate the workflow. Practitioners should treat AI capability as dependent on control quality, not as a control itself.

Identity context is the hidden requirement in AI-assisted operations. Many SOC decisions hinge on whether a login, token use, or privileged action is expected, and that answer lives in identity and access governance rather than in raw logs. When service accounts, admin scripts, and human break-glass activity are not well governed, AI has little reliable context to work with. The governance problem is therefore broader than SOC tooling. Practitioners need identity-aware telemetry before they can trust AI-assisted response.

Security data architecture is now an AI governance issue. Normalised, queryable data is what lets AI show its reasoning and avoid overconfident summaries based on partial evidence. Fragmented pipelines create hallucination risk, coverage gaps, and broken correlation, which undermines both analyst confidence and operational response. That places data engineering alongside SOC process design in the core control stack. Teams should measure AI readiness through data quality, not model enthusiasm.

What this signals

Identity-aware telemetry is becoming a prerequisite for trustworthy SOC automation. AI-assisted operations will keep failing wherever privileged access, service accounts, and break-glass activity remain poorly governed, because the system cannot distinguish expected from abusive behaviour without identity context. Teams that want better AI outcomes should first tighten access review, logging, and identity classification across cloud and SaaS environments, then map those controls to NIST Cybersecurity Framework 2.0.

Detection quality now depends on the quality of the identity and event pipeline. A security data lake can reduce correlation errors only if identity records, privilege changes, and cloud events are normalised early enough for the SOC to trust them. That makes data engineering, not model selection, the deciding factor in whether AI improves investigations or just accelerates confusion.

NHI governance and SOC operations are converging. If service accounts and tokens are not lifecycle-managed, AI will inherit the same blind spots that human analysts already face when they investigate stale credentials, orphaned accounts, or over-privileged automation. Practitioners should treat the identity layer as part of detection architecture, not as a separate admin problem.


For practitioners

  • Separate repetitive triage from judgment calls Use AI for alert prioritisation, enrichment, and first-pass summarisation, but require human review for privileged access events, production-impacting actions, and ambiguous identity activity. This keeps automation inside a defined decision boundary and avoids auto-closing alerts that depend on business context.
  • Adopt detection-as-code for AI-supervised workflows Version-control detection logic, test changes in staging, and peer-review rule updates so AI output can be validated against known cases. Treat model-generated summaries as inputs to investigation, not as final incident decisions.
  • Normalise identity telemetry before scaling AI Ensure login events, privilege changes, cloud actions, and endpoint logs share consistent timestamps and identifiers so correlation is reliable. If identity data is fragmented, AI will infer more than it can prove, which raises hallucination risk.
  • Measure false positives by workflow stage Track how many alerts are filtered, escalated, or incorrectly auto-classified at each stage of the SOC process. Use those measures to tune the AI workflow and to identify where human review still adds the most value.

Key takeaways

  • AI is changing SOC operations by automating repeatable triage, but it does not remove the need for human judgement where business context and privilege decisions matter.
  • The strongest operational gains come when detection engineering and data normalisation improve the quality of what AI sees, not when teams assume the model itself is the control.
  • For identity-heavy environments, the practical question is whether SOC automation can trust service accounts, privileged actions, and telemetry enough to support defensible response.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

MITRE ATT&CK address the attack surface, NIST CSF 2.0, NIST SP 800-53 Rev 5 and NIST AI RMF set the technical controls, and ISO/IEC 27001:2022 define the regulatory obligations.

FrameworkControl / ReferenceRelevance
NIST CSF 2.0DE.CM-7AI-assisted SOC triage depends on continuous monitoring of identity and event signals.
NIST SP 800-53 Rev 5AU-6Alert triage and investigation summaries depend on audit analysis and review.
MITRE ATT&CKTA0006 , Credential Access; TA0008 , Lateral MovementThe article references lateral movement and identity-driven attack investigation patterns.
NIST AI RMFMEASUREThe article focuses on evaluating whether AI improves SOC outcomes and reduces error.
ISO/IEC 27001:2022A.5.15Access control governance underpins the identity context AI needs for reliable SOC decisions.

Map AI-assisted detections to credential access and lateral movement tactics to improve investigation fidelity.


Key terms

  • Security Data Lake: A security data lake is a centralised repository for storing large volumes of security telemetry in a queryable form. Unlike a narrow SIEM pipeline, it is designed to keep heterogeneous logs accessible at scale so analysts and automation can correlate identity, endpoint, cloud, network, and application evidence.
  • Detection Engineering: The discipline of designing, testing, and maintaining detection logic so it remains useful against real attacker behaviour. It covers telemetry selection, rule quality, false-positive management, and the operational workflow needed to keep alerts actionable.
  • AI-Assisted Triage: The use of machine-driven prioritisation to sort, rank or route suspicious cases for human review. It can improve speed and consistency, but only if analysts can understand, challenge and override the recommendation. Without governance, it becomes a hidden decision layer inside the investigation process.
  • Hallucination Risk: Hallucination risk is the chance that an AI system produces a confident but incorrect explanation because the input data is incomplete, inconsistent, or misleading. In security operations, it usually appears when context is missing and the model has to infer more than the telemetry can prove.

What's in the full article

Panther's full blog covers the operational detail this post intentionally leaves for the source:

  • Cresta-style workflow examples showing how Panther AI reduced triage time in a live SOC setting.
  • The specific detection engineering examples behind AI-assisted investigation summaries and alert tuning.
  • Data architecture guidance on normalising cloud, identity, and endpoint telemetry for better AI correlation.
  • The practical comparison between high-volume triage automation and human-led validation in ambiguous cases.

👉 The full Panther article covers the triage examples, detection engineering detail, and data architecture implications.

Deepen your knowledge

NHI Foundation Level course, the industry's only accredited NHI security programme, covers NHI governance, machine identity security, and secrets management in the context of operational security decisions. It is designed for practitioners who need to connect identity control to broader security programmes.
NHIMG Editorial Note
Published by the NHIMG editorial team on August 2, 2026.
NHI Mgmt Group — the independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org