TL;DR: AI-generated deepfakes, hallucinations and shadow AI are pushing organisations toward continuous verification of identities, devices and actions rather than default trust, according to Commvault. The governance lesson is clear: responsible AI adoption succeeds when policy, guardrails and approved tools reduce blind trust without blocking productivity.
At a glance
What this is: This is a Commvault analysis of why AI trust now depends on continuous verification rather than one-time approval, with shadow AI and AI-generated deception weakening default assumptions.
Why it matters: It matters because IAM, PAM, NHI and AI governance teams now have to treat verification as an ongoing control across people, devices, AI tools and actions, not a one-time trust decision.
Context
AI trust is not a binary state. In practice, it is a governance problem about when to verify identity, what to trust by default, and where automation needs continuous checks because AI can imitate people, generate persuasive output, and be adopted outside approved workflows.
This article sits at the intersection of AI governance, shadow AI and identity assurance. The identity angle is real because organisations are not only securing AI systems, they are also deciding how to verify human users, approved tools, and the actions those systems take on their behalf.
Key questions
Q: How should security teams handle trust assumptions when customers use AI shopping agents?
A: Treat the agent as a delegated identity with a limited scope, not as a harmless interface. Define what actions it may take, how long it may act, what data it may use and how quickly permissions can be revoked. Without those controls, the customer’s trust becomes the attacker’s access path.
Q: Why does shadow AI create more risk when organisations try to prohibit it?
A: Prohibition often shifts usage underground, which reduces visibility and weakens logging, data control, and accountability. Once employees move to hidden tools, the organisation loses the ability to see which identities are active or what information is being exposed. That makes the risk harder to detect and more expensive to remediate.
Q: What are the signs that continuous trust controls are too weak for AI-driven environments?
A: A common sign is that access remains unchanged after context shifts, risky actions proceed without step-up checks, and telemetry cannot explain why an identity was still trusted. If the programme only checks login events, it is likely blind to runtime misuse. That is a governance failure, not just a monitoring gap.
Q: Should organisations trust AI differently from human users and devices?
A: Yes, because AI can generate deceptive output, imitate people and operate through delegated or non-human paths. The right model is not to distrust AI automatically, but to verify it continuously and separately from the human who initiated the task. That reduces false confidence without blocking useful automation.
Technical breakdown
Continuous verification versus default trust
Continuous verification means the organisation does not stop checking once an identity, device or action has been approved. That differs from legacy access models that assume a login or policy approval creates a durable trust state. In AI environments, that assumption breaks quickly because content can be synthetic, tasks can be delegated, and usage can move outside sanctioned workflows. The control problem is therefore not just who signed in, but whether the current action still matches approved context, device posture and policy. For AI governance, this pushes verification closer to execution time rather than relying on static approval records.
Practical implication: move trust decisions closer to each AI action and tie them to live context instead of one-time approval.
Shadow AI and the governance gap in approved tooling
Shadow AI appears when people use AI tools that were not selected, reviewed or monitored by the organisation. That creates a governance gap because the business sees productivity gains before it sees the data exposure, policy drift or compliance risk. The article’s core point is not that employee use of AI is inherently bad, but that unmanaged use makes it impossible to apply consistent controls over prompts, outputs, data handling and retention. For identity teams, the relevant issue is access boundary enforcement: if the approved control plane is bypassed, the organisation loses visibility into both user behaviour and downstream system trust.
Practical implication: establish approved AI pathways and monitor for unmanaged use before policy exceptions become the norm.
Zero trust for AI actions and digital identities
Zero trust in this context means the organisation does not grant ongoing confidence to a person, device or system simply because it previously authenticated. Instead, every sensitive action is re-evaluated against identity, device and behavioural context. That matters for AI because the system can amplify a weak trust decision into wide impact very quickly. The same principle also applies to non-human identities when AI tools, bots or service accounts act on behalf of users. The governance shift is toward validating the action, not only the account, and toward treating AI outputs as claims that still need verification.
Practical implication: extend zero trust controls to AI-enabled workflows, including the identities and credentials they use.
Threat narrative
Attacker objective: The objective is to exploit trust gaps so that deceptive content, unauthorised AI use or impersonation can influence decisions, access data, or bypass controls.
- Entry occurs when users adopt AI tools outside approved channels, creating a shadow AI foothold that bypasses governance and monitoring.
- Credentialed or trusted access is then abused when the AI tool interacts with company data, makes decisions, or imitates a person in a way that the organisation has not explicitly verified.
- Impact follows when the organisation cannot reliably distinguish legitimate AI-assisted activity from deceptive or unsanctioned behaviour, increasing exposure to data loss, fraud and control failure.
Breaches seen in the wild
- Vercel Context.ai OAuth Supply Chain Breach: Shadow AI app Context.ai OAuth integration exposes Vercel customer data via unmanaged third-party token.
Read and download The State of NHI & AI Agent Breach Report 2026, covering 200+ breaches impacting Non-Human Identities including AI Agents.
NHI Mgmt Group analysis
AI trust is now an identity and action-verification problem, not a branding problem. The article correctly frames trust as something that must be continuously validated across people, devices and actions rather than assumed after one login or one policy acknowledgement. In practical terms, the security question is whether the current action still fits the approved identity context. That makes the issue squarely relevant to IAM, NHI governance and AI control design.
Shadow AI is the clearest sign that policy-only governance is not enough. Employees adopt AI when it helps them work faster, which means the control challenge is to provide safe channels rather than rely on prohibition. Once unmanaged tools appear, the organisation loses visibility into prompt handling, data movement and output reuse. The practitioner lesson is to govern AI adoption through approved access paths and monitored usage, not by trusting intention.
Zero trust needs to extend to AI-mediated decisions and non-human actions. The article’s strongest contribution is its reminder that zero trust is not about distrusting people, but about refusing to grant durable confidence to any action just because it came from a known user or system. Where AI tools, bots or service accounts act on behalf of humans, the organisation must verify the action boundary as rigorously as the login boundary. That is now a core governance requirement, not an advanced option.
Continuous verification creates a named concept the field should adopt: verification at the point of use. That phrase captures the shift away from static trust decisions toward checks that happen when an AI system, user or delegated process actually tries to do something sensitive. This matters because AI can accelerate misuse faster than traditional review cycles can detect it. Practitioners should design controls around issuance, action and context, not only onboarding and approval.
From our research library:
- Organisations that describe themselves as confident in their AI deployment actually experience a 72% security incident rate, compared to 33% for those who remain cautious, according to the 2026 Infrastructure Identity Survey.
- Only 13% of organisations feel extremely prepared for the reality of agentic AI despite the majority racing toward autonomous adoption, according to the 2026 Infrastructure Identity Survey.
- Read next: Zero Trust for AI Agents
What this signals
Verification at the point of use: AI governance is moving away from static approval lists toward checks that happen when a user or system actually attempts a sensitive action. That shift is essential because AI can change context, output and intent faster than traditional review cycles can respond. Teams should expect access control to become more dynamic across both human and non-human workflows.
Shadow AI is a control-plane problem as much as a policy problem. Once employees adopt unmanaged tools, the organisation loses visibility into prompts, data paths and downstream use, which means governance cannot rely on awareness training alone. The stronger model is to make approved AI paths easier to use than unsanctioned ones.
NHI governance and zero trust now intersect more directly because AI tools, bots and service accounts increasingly act on behalf of people. 90% of IT leaders say properly managing NHIs is essential for a successful zero-trust implementation according to the Ultimate Guide to NHIs. That makes identity lifecycle, delegated access and runtime validation part of the same control story.
For practitioners
- Define approved AI access paths Publish clear, role-based routes for sanctioned AI use so employees know which tools, data types and workflows are permitted without ambiguity.
- Verify identities at the point of use Require live validation of user, device and context before sensitive AI-assisted actions rather than assuming trust from prior authentication.
- Detect shadow AI usage Monitor for unsanctioned AI applications, browser-based use and third-party integrations that bypass the approved control plane.
- Extend zero trust to AI workflows Treat AI outputs and delegated actions as untrusted until the surrounding identity, device and policy context has been rechecked.
Key takeaways
- AI trust now depends on continuous verification of identities, devices and actions rather than a single trust decision made at sign-in.
- Shadow AI shows up as a governance gap when employees adopt AI tools outside approved channels and security teams lose visibility.
- Zero trust remains relevant because AI can accelerate misuse, impersonation and data movement faster than static review processes can catch.
Standards & Framework Alignment
This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.
OWASP Non-Human Identity Top 10 and OWASP Agentic AI Top 10 address the attack and risk surface, while NIST CSF 2.0 and NIST Zero Trust (SP 800-207) set the governance and control requirements practitioners need to meet.
| Framework | Control / Reference | Relevance |
|---|---|---|
| OWASP Non-Human Identity Top 10 | NHI-10 — Human Use of NHI | The article centers on employees adopting AI tools outside approved governance paths. |
| Recommendation — Map unsanctioned AI use to NHI-10 and constrain human-driven access to approved AI pathways. | ||
| OWASP Agentic AI Top 10 | ASI03 — Identity & Privilege Abuse | AI-assisted actions and delegated behaviour raise privilege and identity assurance issues. |
| Recommendation — Apply ASI03 to verify which identities and privileges AI-mediated actions may consume or extend. | ||
| NIST CSF 2.0 | PR.AA-05 — Access Permissions, Entitlements and Authorizations | Continuous verification depends on tightly governed permissions and authorisations. |
| Recommendation — Review AI-enabled access against PR.AA-05 so authorizations are checked at the point of use. | ||
| NIST Zero Trust (SP 800-207) | Continuous Verification — Continuous Verification | The article’s central idea is that trust must be revalidated continuously. |
| Recommendation — Implement continuous verification for identities, devices and actions in AI-enabled workflows. | ||
Key terms
- Continuous Verification: A Zero Trust practice that re-evaluates trust during the session instead of relying on a single successful login. The control is stronger when context signals are available in real time and when the identity programme can act on those signals without creating excessive exceptions.
- Shadow AI: AI agents, copilots, or connected tools operating without full visibility or governance from security teams. Shadow AI becomes an identity problem when those systems authenticate with unmanaged tokens, service accounts, or OAuth apps that can reach production resources.
- Zero Trust: A security model that assumes no identity, human or non-human, should be trusted by default, even inside a network perimeter. Every access request must be verified, authorised, and continuously validated.
- AI Governance: AI governance is the set of controls used to discover, classify, approve, restrict, monitor, and revoke AI-enabled access. It connects identity, data, and policy so organisations can manage what AI can reach, what it can share, and when it should be stopped.
Deepen your knowledge
NHI Mgmt Group covers identity security, NHI governance, and agentic AI through the NHI Foundation Level course, the industry's only accredited NHI security programme. It is designed for practitioners who need to govern access, delegation and runtime trust across modern identity programmes.
Published by the NHIMG editorial team on August 11, 2026.
Updated on October 12, 2026.
NHI Mgmt Group, the independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org