Independent analysis by NHI Mgmt GroupSource article: Abnormal AI, “Year in Review: The Most Impactful SOC Lessons From 2025” (January 7, 2026)

TL;DR: SOC leaders found that AI worked best for data collection and enrichment, while humans outperformed automated judgment; social engineering also dominated 2025 incidents, expanding the SOC’s remit across email, identity, hiring, and collaboration tools, according to Abnormal AI. The lesson is that context, not just speed, now separates effective detection from noisy automation.


At a glance

What this is: NHI Mgmt Group's analysis, drawing on Abnormal AI's blog post: SOC teams are shifting away from automating judgment and toward using AI for collection, enrichment, and analyst support, with behavioural detection and social engineering response becoming central.

Why it matters: It matters because SOC programmes that over-automate decision-making can miss context, while identity, email, and collaboration abuse now require human-led triage and organisation-specific detections.


Context

Security operations teams are under pressure when attackers use social engineering, identity abuse, and workflow manipulation rather than obvious malware. The governance gap is not a lack of alerts, but a lack of contextual judgment at the point where detection becomes a decision.

For IAM and SOC programmes, this shifts the problem from simple alert handling to behavioural interpretation across email, identity, hiring, and collaboration tools. Generic detections age quickly because attackers learn them, so defenders need baselines that reflect their own environment rather than copied rules.


Key questions

Q: How should SOC teams balance automation with human decision-making?

A: SOC teams should automate the mechanical parts of detection, such as enrichment and correlation, while keeping human analysts in charge of interpretation and response decisions. That balance preserves context, reduces false confidence, and makes it harder for attackers to exploit trust-based or identity-driven abuse paths that simple workflows miss.

Q: Why do behavioural detections work better than copied signatures?

A: Behavioural detections work better because they are built from the organisation’s own normal patterns, not from rules attackers can easily learn in advance. Copied signatures age quickly, especially when adversaries already know the common detection logic. Internal baselines surface subtle deviations that generic content misses.

Q: What are the signs that a SOC is over-automating judgment?

A: A SOC is over-automating judgment when alerts close quickly but analysts cannot explain why they were closed, or when detection quality depends on generic rules rather than local context. Another sign is rising noise alongside missed social engineering because the team removed interpretation too early.

Q: How should teams build analysts who can handle social engineering cases?

A: Rotate analysts through real incidents, different tools, and varied alert types so they develop judgment from experience, not just queue handling. Teams that keep people in a single narrow role tend to build speed without context, which is a poor fit for identity, email, and collaboration abuse.


Technical breakdown

Why automated SOC judgment fails without context

Automation can collect telemetry, enrich alerts, and correlate events, but it cannot reliably decide what matters when the signal depends on local business context. Judgment requires knowledge of the organisation’s workflows, identity patterns, and normal communication paths. When teams automate the decision layer too early, they compress nuance into rigid rules and increase both false positives and missed abuse cases. That is especially true in social engineering scenarios, where the attacker’s success depends on making a legitimate action look routine. Practical implication: keep deterministic work automated, but preserve human review for decisions that depend on environment-specific context.

Practical implication: Keep collection and enrichment automated, but route context-dependent decisions to analysts who understand the environment.

Behavioral detection beats copied signatures in mature SOCs

Behavioral detection looks for deviations from an organisation’s own baseline, such as unusual authentication flows, abnormal collaboration patterns, or identity activity that does not fit the normal sequence. Generic signatures are easier for attackers to anticipate because they are often shared, copied, or publicly known. A mature SOC therefore shifts from pattern matching to anomaly interpretation, with detections tuned to how the business actually operates. That approach is more resilient in identity-heavy incidents because the attack often blends into ordinary work. Practical implication: build detections from internal behaviour baselines, then continuously validate them against live incident data.

Practical implication: Tune detections to internal baselines and refresh them as attackers adapt to common patterns.

SOC talent development depends on real incident exposure

The strongest SOCs treat analysts as practitioners who learn through exposure to real incidents, not as entry-level operators who stay on a narrow queue forever. Rotating across tools and cases builds judgment, reduces burnout, and improves the team’s ability to recognise context under pressure. This matters because modern attacks cross email, identity, collaboration, and human workflows, so no single-tool specialist sees the full picture. A SOC that trains only for alert closure tends to miss the broader attack story. Practical implication: design rotation and training around incident variety, not just queue throughput.

Practical implication: Rotate analysts across tools and case types so they build judgment from real attack exposure.


NHI Mgmt Group analysis

Human-led judgment is now a control layer, not a fallback. The article shows that AI is most effective when it supports collection, enrichment, and correlation, while humans remain responsible for deciding what an event means. That is not a temporary operating preference. It is a governance boundary: judgment cannot be reduced to automation without losing the context that makes detection useful.

Organization-specific baselines are the real detection asset: copied detections decay because attackers already know them, but environment-specific behaviour remains difficult to predict. This is why behavioural detection has become the durable advantage in SOC operations. The practitioner lesson is to treat baseline quality as a control objective, not a tuning exercise.

Social engineering has expanded the SOC’s identity scope: attacks now move through email, identity, hiring, and collaboration workflows, so the SOC can no longer think only in terms of endpoint or malware events. That broadens the identity surface the SOC must understand, especially where trust is being manipulated rather than broken technically. The implication is that SOC and IAM governance now overlap far more than many programmes assume.

Analyst development is a security capability, not just a staffing model. The strongest teams used rotations, training, and real incident exposure to build judgment and reduce burnout. That turns talent management into an operational control because it affects whether the SOC can interpret complex attacks under stress. Practitioners should view training design as part of detection maturity, not an HR side topic.

Modern SOC maturity depends on human-machine division of labour. Automation should remove friction from data handling, not replace the reasoning that distinguishes benign activity from abuse. When security teams preserve that division, they get faster response without flattening context. The field is moving toward a model where machines scale observation and humans scale accountability.

From our research library:

  • 28% of secrets incidents now originate outside code repositories, in Slack, Jira, and Confluence, and are 13% more likely to be categorised as critical than code-based leaks, according to the State of Secrets Sprawl 2026.
  • Read next: Top 10 NHI Issues

What this signals

Human-led decision-making is becoming the SOC’s differentiator. Teams that keep automation at the data layer and preserve human judgment at the decision layer are better positioned for social engineering, identity abuse, and workflow-based attacks. That matters because the attack surface now includes email, hiring, and collaboration systems, not just infrastructure alerts.

Behavioural baselines should be treated as living control logic. If detections are copied from elsewhere, attackers learn them faster than defenders can tune them. SOC programmes need internal baselines that reflect local identity and communication patterns, then continuous validation when workflows change.

Burnout and detection quality are linked. Rotations, exposure to real incidents, and training are operational controls because they preserve analyst judgment under pressure. Programmes that reduce people to single-tool work tend to lose the context needed for high-confidence decisions.


For practitioners

  • Automate data collection and enrichment Use automation for telemetry gathering, enrichment, and correlation so analysts spend time on interpretation rather than repetitive retrieval work.
  • Preserve human judgment for decisions Require analyst review for alerts where business context, trust relationships, or identity behaviour determine whether an event is benign or malicious.
  • Build organisation-specific behavioural baselines Tune detections to your own authentication, collaboration, and workflow patterns instead of importing generic signatures that attackers already expect.
  • Rotate analysts across tools and case types Move people through different alert types and platforms so they learn how attacks unfold across email, identity, and collaboration workflows.

Key takeaways

  • The article argues that SOC effectiveness now depends on preserving human judgment for decisions while using automation for repetitive collection and enrichment.
  • Social engineering broadened the SOC’s remit into identity, hiring, and collaboration workflows, which makes context a core detection requirement.
  • Teams that invest in analyst rotation, behavioural baselines, and real incident exposure are better positioned to sustain detection quality under pressure.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

NIST CSF 2.0 provides the primary governance reference for this term.

FrameworkControl / ReferenceRelevance
NIST CSF 2.0DE.CM-01 — Monitoring for Anomalies and EventsThe article centres on behavioural detection and SOC monitoring quality.
PR.AA-05 — Access Permissions, Entitlements and AuthorizationsSocial engineering now targets identity workflows that depend on permissions and trust.
DE.AE — Anomalies and EventsThe post emphasises abnormal behaviour over static signatures.
Recommendation — Use DE.CM-01 to maintain detection logic tuned to organisation-specific behaviour. Review PR.AA-05 controls where identity-driven workflows can be manipulated by trusted actors. Treat unusual communication and authentication patterns as priority signals under DE.AE.

Key terms

  • Behavioral Detection: A monitoring approach that looks for unusual activity rather than relying only on static inventories. For SaaS integrations, it detects drift in token use, data movement, timing, and endpoint behavior so teams can spot compromise, misuse, or automation that no longer matches its expected pattern.
  • Human-Led Judgment: Human-led judgment is the SOC practice of reserving final decisions for analysts when context, intent, or business process shape the meaning of an alert. It does not reject automation; it defines where machine support ends and accountable interpretation begins.
  • Organisation-Specific Baseline: An organisation-specific baseline is the set of normal behaviours, relationships, and sequences that represent expected activity in a given environment. It is more useful than generic rules because it reflects how that business actually authenticates, communicates, and responds.
  • SOC Talent Engine: A SOC talent engine is a security operations model that treats incident response as a place where analysts build skill, judgment, and resilience. Instead of using the SOC as a churn point, the organisation uses it to develop practitioners through real exposure and rotation.

Deepen your knowledge

NHI governance, agentic AI identity, and machine identity lifecycle are core topics in our NHI Foundation Level course, the industry's only accredited NHI security programme. If you are building or maturing an IAM programme, it is worth exploring.
NHIMG Editorial Note
Published by the NHIMG editorial team on June 27, 2026.
Updated on October 8, 2026.
NHI Mgmt Group, the independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org