Subscribe to the Non-Human & AI Identity Journal

Why does AI not eliminate the need for security analysts?

Security work is adversarial, context-heavy, and often ambiguous. AI can process patterns quickly, but it cannot reliably judge business impact, resolve contradictory evidence, or explain high-stakes decisions with the transparency that regulated environments require. Analysts remain necessary for interpretation, exception handling, and final accountability.

Why This Matters for Security Teams

AI changes the pace of analysis, but it does not remove the need for human judgement. Security teams still have to decide whether an alert is noise, whether an anomalous event is a false positive or an active intrusion, and whether containment actions will disrupt critical services. That is exactly why the NIST Cybersecurity Framework 2.0 still matters: it reinforces governance, detection, response, and recovery as organisational responsibilities, not automation outcomes.

The practical risk is overtrust. An AI system can summarise logs, rank alerts, or draft an incident narrative, but it may miss business context, inherit bad training assumptions, or present confident conclusions without showing the evidence chain. In regulated or high-consequence environments, that is not a minor flaw. It can turn a useful assistant into a source of operational blind spots. Analysts remain necessary to validate what the system found, challenge what it ignored, and connect technical signals to real-world impact.

In practice, many security teams encounter AI limitations only after a false sense of coverage has already delayed escalation or weakened response quality.

How It Works in Practice

AI is most useful as an amplifier for analyst workflow rather than a replacement for analyst responsibility. In a SOC or security operations setting, it can cluster related alerts, extract indicators from unstructured text, correlate events across tools, and suggest likely attack paths. Those are valuable time-saving functions, especially in environments with heavy alert volume. But the analyst still has to verify source data, interpret uncertainty, and decide whether the output reflects a genuine threat or a modelling artifact.

Good practice is to define where AI can assist and where it cannot act autonomously. For example, AI may triage phishing reports, summarise endpoint telemetry, or surface likely privilege escalation patterns, while a human approves containment, account suspension, or executive escalation. This maps well to current guidance from NIST AI Risk Management Framework, which treats trustworthy AI as a governance and lifecycle problem, not just a tooling problem.

  • Use AI for pattern detection, enrichment, and prioritisation.
  • Keep humans responsible for final triage on ambiguous or high-impact cases.
  • Require evidence-backed outputs, not only confidence scores.
  • Test for drift, hallucination, and bias in security-specific workflows.
  • Document escalation criteria so analysts know when to override automation.

This is especially important where AI touches identity data, privileged access, or incident containment decisions. If the system is allowed to recommend action on accounts, secrets, or access paths, then its outputs become part of the control plane and should be governed accordingly. The same logic applies to adversarial use cases described in MITRE ATLAS, where model abuse, prompt manipulation, and inference-time attacks can distort security decisions. These controls tend to break down when AI is connected directly to response automation in tool-rich environments because small errors can propagate into irreversible actions.

Common Variations and Edge Cases

Tighter automation often increases operational risk if organisations treat AI outputs as authoritative, requiring them to balance speed against oversight. That tradeoff is sharpest in environments with regulated data, rapid incident response expectations, or complex business-critical systems. In those settings, the analyst’s role shifts from manual detection to decision quality assurance, exception handling, and control validation.

There is no universal standard for fully autonomous security analysis yet. Best practice is evolving toward bounded autonomy, where AI handles repetitive enrichment and correlation while humans retain authority over material decisions. This is also where OWASP guidance for LLM applications is useful, because it highlights prompt injection, insecure output handling, and excessive agency as practical failure modes. Security leaders should also consider how agentic workflows intersect with identity governance: if an AI system can query tools, open tickets, or trigger response playbooks, it needs explicit permissions, monitoring, and revocation paths similar to other non-human identities.

Edge cases emerge when the environment is highly dynamic, the model is poorly tuned to the organisation’s telemetry, or the response process lacks clear human approval points. In those conditions, AI may still speed up analysis, but it cannot safely absorb accountability, especially when evidence is incomplete or business impact is unclear.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

MITRE ATLAS and OWASP Agentic AI Top 10 address the attack and risk surface, while NIST CSF 2.0, NIST AI RMF and NIST AI 600-1 set the governance and control requirements practitioners need to meet.

Framework Control / Reference Relevance
NIST CSF 2.0 GV.OC Analyst judgment depends on business context and organisational risk ownership.
NIST AI RMF GOV AI use in security operations needs governance, accountability, and oversight.
MITRE ATLAS AML.TA0001 AI systems used in security can be manipulated through adversarial techniques.
OWASP Agentic AI Top 10 A03 Agentic systems can overreach when granted tool access without human control.
NIST AI 600-1 GenAI security guidance is directly relevant to hallucination and output handling.

Define who owns security decisions and how AI-supported findings map to business impact.