TL;DR: AI systems are now part of the cloud attack surface, but traditional IAM, segmentation, and monitoring controls do not fully address model poisoning, inference abuse, prompt injection, or shadow AI, according to Orca Security. The practical gap is governance, not just tooling: security teams need inventory, ownership, lifecycle controls, and continuous monitoring for models and pipelines.
At a glance
What this is: This is Orca Security's analysis of AI security in cloud environments, with the key finding that traditional cloud and IAM controls do not fully cover model, pipeline, and inference risk.
Why it matters: It matters because practitioners now have to govern AI assets alongside human and non-human identities, or they will miss shadow AI, exposed credentials, and unmanaged model access paths.
By the numbers:
- Only 13% of organisations feel extremely prepared for the reality of agentic AI despite the majority racing toward autonomous adoption.
- 69% of security leaders agree identity management must fundamentally shift to address agentic AI systems.
👉 Read Orca Security's analysis of AI security in cloud environments
Context
AI security is the discipline of protecting AI systems, data, and the surrounding infrastructure from misuse, manipulation, and attack. In cloud environments, that means the problem is no longer limited to models in isolation. It extends to the identities, data stores, APIs, and pipelines that let those models operate.
Orca Security is describing a real governance gap: organisations are deploying AI faster than they are defining ownership, visibility, and control boundaries. For IAM, NHI, and cloud security teams, the issue is not whether AI belongs in the security model. It is how quickly existing identity and posture controls can be adapted to cover it.
Key questions
Q: How should security teams govern AI systems in cloud environments?
A: They should govern AI systems the same way they govern other high-risk identity-bearing assets: establish ownership, inventory every model and endpoint, control access, and monitor behaviour continuously. AI security fails when teams rely on static approvals alone. The operating model must combine IAM, lifecycle evidence, and runtime validation so that model risk is visible and accountable.
Q: Why do traditional IAM controls fall short for AI security?
A: Traditional IAM controls reduce exposure, but they do not address adversarial inputs, model poisoning, inference abuse, or output manipulation. AI systems have behaviour-based attack surfaces that sit outside normal access decisions. Practitioners need both entitlement controls and model-specific monitoring if they want meaningful security coverage.
Q: How can organisations tell whether AI security controls are working?
A: Look for clear ownership, complete inventory, stable version history, and telemetry that catches abnormal inference activity or model drift. If the security team cannot explain which models are live, what data they use, and who is responsible, the programme is not working. Effective AI security leaves evidence that can be audited end to end.
Q: What is the difference between securing AI and using AI for security?
A: Securing AI protects models, data, and pipelines from attack. Using AI for security applies machine learning to improve detection, prioritisation, and response. Both matter, but they solve different problems. A mature programme needs controls for the AI system itself, not only AI-assisted security operations.
Technical breakdown
AI model sprawl and shadow AI in cloud environments
AI security starts with inventory because you cannot govern what you cannot see. In cloud estates, models, inference endpoints, training pipelines, and supporting data stores are often spread across SaaS, containers, serverless functions, and third-party APIs. That creates shadow AI, where sanctioned and unsanctioned systems coexist without a single owner or authoritative catalog. When this happens, access controls, logging, and risk prioritisation become partial by definition. The failure mode is not only exposure, but invisible exposure.
Practical implication: build a living inventory of AI services, models, endpoints, and data dependencies before setting policy.
Why IAM controls alone do not secure AI systems
Traditional IAM controls still matter, but they are not sufficient for AI security. Least privilege, segmentation, and authentication reduce exposure to model endpoints and supporting infrastructure, yet they do not prevent adversarial inputs, data poisoning, model inversion, or output manipulation. AI-specific attack surfaces sit above and below the identity layer. That means security teams need both access governance and model behaviour controls, including input validation, drift monitoring, and output review. Treating AI as just another workload underestimates its attack surface.
Practical implication: pair least-privilege access with AI-specific testing, telemetry, and validation controls.
Model lifecycle governance and runtime monitoring
A workable AI security programme needs lifecycle controls as well as runtime visibility. Ownership, data lineage, versioning, and audit logging define who is accountable for each model and what changed over time. Continuous monitoring then tracks inference requests, performance drift, and anomalous API activity so that abuse can be detected as a security event, not just a data science issue. This is where governance and operations converge. Without lifecycle evidence, security teams cannot tell whether a model is behaving as intended or simply still running.
Practical implication: tie model ownership, versioning, and telemetry into incident response and access review workflows.
NHI Mgmt Group analysis
AI security is now an identity governance problem, not just a model security problem. Once AI services sit inside cloud workflows, the question becomes who can access them, who owns them, and how their privileges are tracked across their lifecycle. That makes the topic relevant to IAM, NHI, and cloud posture teams at the same time. The practitioner conclusion is simple: AI security fails when ownership and access governance are treated as separate disciplines.
Model and pipeline sprawl creates a governance gap that traditional inventory models do not close. A living catalog is not a reporting exercise here, it is the minimum condition for assigning accountability across training data, inference endpoints, and third-party APIs. Without that baseline, policy cannot reach the real control points. The practitioner conclusion is that shadow AI is a discovery failure before it is a protection failure.
Least privilege for AI workloads must be paired with runtime behaviour control. Access restrictions can narrow the blast radius, but they do not stop model poisoning, prompt injection, or inference abuse once the workload is live. That is why AI security needs both identity controls and behavioural validation. The practitioner conclusion is that entitlement review alone cannot describe AI risk exposure.
Governance without lifecycle evidence is incomplete for AI systems. Versioning, ownership, data lineage, and audit logging are what allow teams to prove what changed, when it changed, and who is responsible. Those artefacts are the bridge between DevOps, data science, and security operations. The practitioner conclusion is that lifecycle traceability is the control plane for AI accountability.
Confidentiality, integrity, and availability remain the right frame, but AI changes what each one means. Model weights, training data, inference endpoints, and output integrity all need protection because compromise at any one layer can distort the whole system. The practical implication is that cloud security programmes should map AI assets into their existing control sets rather than treating them as an exception.
From our research:
- 69% of security leaders agree identity management must fundamentally shift to address agentic AI systems, according to The 2026 Infrastructure Identity Survey.
- 67% of organisations still rely heavily on static credentials despite the risks they pose to agentic AI deployments, according to The 2026 Infrastructure Identity Survey.
- If your programme is still treating AI as an add-on, OWASP NHI Top 10 is the next place to pressure-test your assumptions.
What this signals
AI security will increasingly be judged by whether identity teams can prove ownership, visibility, and lifecycle traceability across models. The organisations that treat AI as a governed asset class will be better positioned to absorb the operational noise of shadow AI, third-party APIs, and model drift without losing control.
With 70% of organisations already granting AI systems more access than human employees, per the 2026 Infrastructure Identity Survey, the governance gap is structural rather than tactical. Programmes that still separate cloud security from identity governance will miss the point where AI risk becomes operational.
Shadow AI is the named concept security leaders should track. It is the state where models, endpoints, or AI-enabled workflows operate outside the authoritative inventory or ownership model. Once that happens, policy, monitoring, and incident response all lose precision, and the first fix is discovery, not escalation.
For practitioners
- Inventory AI assets continuously Create a living list of models, inference endpoints, training pipelines, and connected data stores across cloud and SaaS environments. Classify each asset by sensitivity, exposure, and business criticality so ownership is explicit and shadow AI is visible.
- Extend IAM to AI runtime surfaces Apply least-privilege access, network segmentation, and strong authentication to the infrastructure that AI uses, then add validation controls for inputs and outputs. This keeps identity governance connected to the actual places where AI can be abused.
- Add adversarial testing to security validation Include prompt injection, poisoning, and inference abuse in red team exercises and risk assessments. Use the results to tune monitoring thresholds and to decide which models require stricter controls before production rollout.
- Tie model ownership to incident response Require named owners for every model, with audit logging, version history, and remediation status attached to the same record. Route anomalies in inference traffic or model drift into the existing alerting and response process.
Key takeaways
- AI security fails when organisations treat models as isolated technical assets instead of governed identity-bearing systems.
- The risk is already material because cloud AI expands the attack surface into models, endpoints, data pipelines, and exposed credentials.
- Practitioners need inventory, lifecycle evidence, and runtime monitoring together, or they will keep seeing only part of the problem.
Standards & Framework Alignment
This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.
OWASP Agentic AI Top 10 and OWASP Non-Human Identity Top 10 address the attack and risk surface, while NIST CSF 2.0 set the governance and control requirements practitioners need to meet.
| Framework | Control / Reference | Relevance |
|---|---|---|
| OWASP Agentic AI Top 10 | AI systems introduce runtime behaviour and tool-use risk that must be governed. | |
| OWASP Non-Human Identity Top 10 | NHI-03 | AI services rely on secrets, credentials, and access paths that can be exposed in code and repos. |
| NIST CSF 2.0 | PR.AC-4 | AI workload access and least privilege map directly to identity protection and access control. |
Map AI services to agentic risk patterns and require controls for autonomy, access, and monitoring.
Key terms
- AI security: AI security is the discipline of protecting models, data, pipelines, and surrounding infrastructure from misuse or attack. In practice it combines governance, access control, monitoring, and adversarial testing so AI can operate safely in cloud environments without exposing the organisation to hidden model or data risk.
- Shadow AI: Shadow AI is AI that exists in an environment without clear inventory, ownership, or approved governance. It may be a sanctioned model deployed through an unsanctioned path or a completely unmanaged workflow, which makes policy enforcement, logging, and incident response unreliable.
- Inference endpoint: An inference endpoint is the interface where a model receives input and returns an output. Because it exposes live behaviour, it becomes a security boundary that can be abused through weak authentication, prompt injection, traffic abuse, or data extraction if not monitored and constrained.
- Model lifecycle governance: Model lifecycle governance is the control of ownership, versioning, data lineage, approval, and retirement for AI systems. It gives security and compliance teams the evidence needed to explain what changed, who is responsible, and whether a model is operating within its intended boundary.
Deepen your knowledge
NHI governance, agentic AI identity, and machine identity security are core topics in our NHI Foundation Level course, the industry's only accredited NHI security programme. If you are responsible for identity security strategy or governance maturity, it is worth exploring.
This post draws on content published by Orca Security: AI Security in the cloud. Read the original.
Published by the NHIMG editorial team on 2025-11-05.
NHI Mgmt Group — the independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org