By NHI Mgmt Group Editorial TeamPublished 2025-10-08Domain: Governance & RiskSource: Orca Security

TL;DR: AI is now used in the cloud by 84% of organisations, while security teams that extensively use AI save an average of $1.9 million per breach, according to Orca Security and the 2025 Cost of a Data Breach Report. The deeper issue is that AI amplifies both detection and attack speed, so identity, access, and response controls must be built for machine-paced decision making.


At a glance

What this is: This is an independent analysis of how AI is changing cloud security, with the key finding that AI strengthens defence while also accelerating attacker tradecraft.

Why it matters: It matters because IAM, NHI, and security teams now have to govern AI-enabled detection, response, and abuse paths at machine speed rather than human cadence.

By the numbers:

👉 Read Orca Security's analysis of how AI is changing cloud security


Context

AI in cloud security is the practical problem of using machine learning and generative systems to improve detection, response, and prioritisation while also facing AI-accelerated phishing, malware adaptation, and asset discovery. The article's central point is that cloud security programmes are being pulled in both directions at once: AI can strengthen controls, but it also increases the pace and realism of attacks.

For IAM and NHI programmes, the important shift is not whether AI is useful, but whether identity controls can keep up with machine-speed action and machine-speed abuse. Static trust assumptions, delayed review cycles, and manual response paths become weaker when both defenders and attackers can operate faster than traditional governance loops.


Key questions

Q: How should security teams use AI without creating more identity risk?

A: Use AI for detection, correlation, and response only after identity ownership, asset inventory, and secret management are reliable. AI should narrow triage and speed containment, but it should not be trusted to compensate for stale entitlements, exposed credentials, or weak verification of high-risk requests.

Q: Why do exposed cloud secrets become more dangerous in an AI-driven environment?

A: Because attackers can discover and attempt reuse far faster than manual teams can react. Once a key or token is exposed, AI-assisted scanning can turn a short-lived mistake into immediate access, so the real control question is how quickly the secret can be invalidated and scoped down.

Q: What do security teams get wrong about AI-powered phishing?

A: They often overestimate human ability to spot deception. AI makes phishing messages, voice, and video more convincing, so security teams need phishing-resistant authentication, tighter approval workflows, and independent verification for any request that can change access or move money.

Q: Who is accountable when AI-driven detection or response makes the wrong call?

A: The owning security and IAM teams remain accountable because AI is an execution aid, not a governance substitute. Teams should define decision ownership, escalation criteria, and containment limits before automation is enabled, especially where a bad action could affect production identities or workloads.


Technical breakdown

How AI improves threat detection and response

AI security systems work by correlating large telemetry streams, spotting patterns that human analysts miss, and triggering automated containment. In cloud environments, that often means linking identity events, workload behaviour, vulnerability signals, and configuration drift into a single risk picture. The operational value comes from speed and scale, not from replacing judgement. But the same automation only works well when the underlying identity and asset inventory is current, because AI cannot prioritise what it cannot see or attribute correctly.

Practical implication: integrate AI-driven detection with authoritative identity and asset data so alerts map to real workloads, principals, and entitlements.

Why AI-assisted phishing and deepfakes change identity risk

Generative AI lowers the cost of believable social engineering by making messages, audio, and video more tailored and context-aware. That changes identity risk because the attack is no longer limited to obvious spelling errors or generic lures; it can target trust relationships, escalation paths, and help desk workflows with realistic pretext. In identity terms, the main weakness is any control that assumes humans can reliably spot deception before authentication or approval happens.

Practical implication: strengthen phishing-resistant authentication and verify sensitive requests through out-of-band identity checks.

Why machine-speed attack discovery outpaces manual defence

AI allows attackers to scan exposed assets, test credentials, and prioritise likely entry points far faster than manual teams can investigate. The article notes that leaked keys on GitHub were discovered and exploited in minutes in prior research, which shows the operational gap clearly. In cloud security, this means exposed secrets, over-permissioned service accounts, and weak perimeter assumptions become immediate risk multipliers. Response models that depend on human review before action are structurally slower than the threat.

Practical implication: reduce standing exposure windows for secrets and automate containment for exposed cloud credentials.



NHI Mgmt Group analysis

AI changes cloud security because it compresses both defence and attack cycles. The article correctly frames AI as a force multiplier on both sides, but the governance consequence is sharper than that. Security teams are no longer only deciding where to apply automation; they are trying to govern identities, telemetry, and response paths that now operate at machine pace. Practitioners should treat speed as a control variable, not just an operational benefit.

Static credentials become a bigger liability when AI can find and abuse them in minutes. The article's example of leaked keys being discovered quickly shows that exposure windows are now too short for manual detection to be reliable. That aligns directly with NHI governance: secrets, tokens, and service accounts need lifecycle discipline because attackers can exploit them before traditional processes even register the event. The implication is that exposure management must be built for immediate abuse, not eventual review.

AI-driven defence only helps when identity context is authoritative. AI can correlate signals, but it cannot correct bad ownership, stale entitlements, or unclear workload identity. If the cloud inventory is incomplete, the model will prioritise noise with confidence. The practical takeaway for IAM and cloud teams is that AI should sit on top of clean identity and asset governance, not replace it.

AI-powered social engineering collapses the assumption that humans will spot the warning signs. The article's phishing and deepfake examples show that identity assurance cannot rely on user suspicion alone. That affects both human IAM and privileged workflows, because the attack target is often the approval chain rather than the endpoint. Practitioners should recognise that verification has to move closer to the transaction, not depend on human judgement at the edge.

Identity blast radius is the real cloud-security metric when AI accelerates discovery. Once exposed keys or over-permissioned accounts are found quickly, the question is no longer whether compromise can happen, but how far it can move before containment. That makes privilege scope, secret lifetime, and workload segmentation the controls that determine whether an AI-assisted attack becomes a local event or a broader breach. Teams should measure blast radius, not just alert volume.

From our research:

  • 67% of organizations still rely heavily on static credentials despite the risks they pose to agentic AI deployments, according to The 2026 Infrastructure Identity Survey.
  • Only 44% of organizations have implemented any policies to manage their AI agents, even though 92% agree that governing AI agents is critical to enterprise security.
  • For a broader identity baseline, read The 52 NHI breaches Report for recurring failure patterns in exposed credentials and over-privilege.

What this signals

Shadow AI controls will converge with machine identity controls. As more cloud teams adopt AI for triage and response, the line between observability tooling and identity governance will keep thinning. The programme question is no longer whether to adopt AI, but whether the identity layer can describe who or what is acting fast enough for the automation to remain trustworthy.

With 70% of organisations granting AI systems more access than they would give a human employee performing the exact same job, the governance gap is already visible in entitlement design rather than just in incident response. That means next year's priority is likely to be policy enforcement at the identity layer, not just better detection tuning.

The practical signal to watch is whether secret sprawl, workload ownership, and containment automation are being managed together. When those three move independently, AI amplifies the mismatch instead of reducing it.


For practitioners

  • Shorten secret exposure windows Treat cloud keys, tokens, and certificates as high-speed liabilities. Rotate or remove them quickly, inventory where they are used, and ensure exposed credentials are invalidated before they can be reused across cloud services.
  • Harden identity verification for sensitive requests Use phishing-resistant authentication and add out-of-band verification for privilege changes, payment actions, and help desk resets. AI-generated pretexts are convincing enough that request validation must not depend on message quality.
  • Link AI detections to authoritative identity context Connect alerts to workload identity, service ownership, and entitlement data so response automation isolates the right principal. Without that mapping, AI may accelerate containment against the wrong asset or miss the true blast radius.
  • Measure cloud blast radius before AI adoption expands Review which identities can reach production data, control planes, and sensitive automation paths. The goal is to know how far compromised access can travel before detection, especially where AI-assisted attackers can move faster than humans can respond.

Key takeaways

  • AI strengthens cloud security only when identity, asset, and secret data are accurate enough for machine-speed decisions.
  • The same capabilities that help defenders also let attackers reach exposed credentials, believable phishing, and fast-moving abuse paths.
  • Security teams should shorten secret lifetimes, harden verification, and measure blast radius before AI-driven attack speed outpaces response.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

NIST CSF 2.0, NIST Zero Trust (SP 800-207) and NIST SP 800-63 set the governance and control requirements practitioners need to meet.

FrameworkControl / ReferenceRelevance
NIST CSF 2.0AI-driven detection and response map to govern, detect, respond, and recover functions.
NIST Zero Trust (SP 800-207)PR.AC-4Least privilege is central when AI and attackers can reach cloud resources quickly.
NIST SP 800-63Phishing-resistant verification matters when AI makes social engineering more convincing.

Apply zero trust principles to reduce standing access and verify every high-risk identity action.


Key terms

  • AI-Driven Security: The use of machine learning and generative systems to support detection, prioritisation, and response in security operations. In practice, it increases speed and scale, but it still depends on accurate identity, asset, and event data to produce trustworthy decisions.
  • Phishing-Resistant Authentication: Authentication methods designed to resist credential theft and deceptive prompts, such as hardware-backed or origin-bound authenticators. They matter because AI can make social engineering more convincing, so the control must reduce reliance on human judgement at the point of login.
  • Identity Blast Radius: The amount of systems, data, and administrative power reachable if an identity is compromised. In cloud and NHI environments, blast radius is shaped by privilege scope, token lifetime, and segmentation, and it often matters more than the initial compromise itself.
  • Static Credentials: Long-lived secrets such as keys, tokens, or certificates that remain valid across many sessions or workflows. They are risky because once exposed, attackers can reuse them quickly, especially in cloud environments where AI-assisted scanning can accelerate discovery and abuse.

Deepen your knowledge

NHI governance, agentic AI identity, and machine identity security are core topics in our NHI Foundation Level course, the industry's only accredited NHI security programme. If you are responsible for identity security strategy or programme maturity, it is worth exploring.

This post draws on content published by Orca Security: AI is helping and challenging our cybersecurity. Read the original.

NHIMG Editorial Note
Published by the NHIMG editorial team on 2025-10-08.
NHI Mgmt Group — the independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org