TL;DR: AI adoption has outrun governance, leaving teams stuck in manual policy review while regulators and business units move faster, according to Ethyca after a private dinner with 20 enterprise data and AI leaders. The practical shift is toward continuous, purpose-based governance that can operate at query level without turning every request into a human bottleneck.
At a glance
What this is: Ethyca describes a private executive discussion that surfaced a clear gap between rapid enterprise AI adoption and governance processes that still depend on slow, manual review.
Why it matters: For IAM, data, and AI governance teams, the message is that approval-centric controls do not scale when LLM usage, data sharing, and agentic workflows spread across the enterprise.
Context
AI governance is the control problem that appears when systems can move faster than the review process built around them. In this article, the underlying issue is not whether organisations understand the risk, but whether their operating model can keep pace with LLM use, data sharing, and policy enforcement across business units.
That matters because governance failures often show up first as coordination failures between legal, data, engineering, and security teams. Where AI agents or automated workflows touch sensitive data, the boundary between policy, access, and execution becomes part of the security model, not a separate compliance afterthought.
Key questions
Q: How should organisations govern AI-driven privacy workflows without relying on manual review cycles?
A: They should move governance into the workflow itself, so policy checks, approval logic, and evidence capture happen at the moment of action. Manual review still has a place for exceptions and oversight, but it cannot be the primary control when AI systems and data pipelines keep changing between review points.
Q: Why does manual governance create risk in enterprise AI programmes?
A: Because AI systems generate requests at machine speed, while manual review operates at human speed. That mismatch turns the approval queue into a control bottleneck, encourages workarounds, and leaves sensitive data use governed more by delay than by policy.
Q: What are the signs that AI governance is failing in the enterprise?
A: Common warning signs include rapid growth in AI use without matching policy coverage, sensitive files being copied into personal accounts, and a large share of AI apps carrying high or critical risk. Another indicator is weak visibility into who is using which tools and what data they are sending. If teams cannot answer those questions, governance is not working as intended.
Q: How should marketing, privacy, and security teams share accountability for AI use?
A: Marketing should own the use case, privacy should define the permission boundary, and security should enforce the control path in the systems that activate data. The shared rule is simple: no AI workflow should use customer data unless the purpose, lineage, and revocation path are all clear.
Technical breakdown
Why manual AI approval workflows become the bottleneck
Manual review systems assume requests arrive at a human pace and that a reviewer can meaningfully inspect each one before access is used. In enterprise AI environments, that assumption breaks quickly because queries, prompts, and data requests can be generated at machine speed. The result is not just delay but a governance queue that engineers route around. When the control plane depends on human approval for routine access, it becomes a throughput limit rather than a safeguard.
Practical implication: replace request-by-request approval with policy enforcement that can evaluate access at runtime.
Purpose-based governance for AI and data access
Purpose-based governance means deciding access based on why data is being used, not only who is requesting it. That is a better fit for AI workloads because the same identity may need different permissions depending on context, task, dataset, or model workflow. The control challenge is to express policy in a form that can be compiled, enforced, and audited continuously. This shifts governance from static permissions to contextual decisioning, which is closer to how modern AI systems actually operate.
Practical implication: define policies around purpose, dataset sensitivity, and workflow context instead of relying only on identity-based approval.
Why AI governance and privacy operations now overlap
The article shows that governance is no longer a clean separation between legal review and technical enforcement. Consent, permissibility, and data handling decisions are now embedded in AI usage patterns, especially where enterprise data is reused for model development or agentic workflows. That creates an overlap between privacy governance and operational security, because the same control failure can produce both regulatory exposure and access sprawl. The architecture has to treat policy, auditability, and enforcement as one operating layer.
Practical implication: align privacy, security, and data governance workflows so the same policy can be enforced technically and reviewed legally.
NHI Mgmt Group analysis
AI governance debt is now an operating risk, not a theoretical maturity issue. The article shows that organisations can no longer treat governance as something they will add after adoption stabilises. Once LLM use, data sharing, and automated workflows spread across functions, the backlog itself becomes a control failure. Practitioners should read this as a signal that governance architecture has to be designed for continuous enforcement, not periodic review.
Purpose-based control is the right response to AI-speed operations. Identity-only approvals assume the same user context every time, which is too blunt for AI and data workflows that vary by task and sensitivity. A policy model that evaluates purpose, context, and permitted use gives teams a better way to govern machine-paced activity without turning every request into a manual exception.
The real boundary is between policy intent and technical enforcement. The dinner discussion reflected a common enterprise pattern where privacy, security, and engineering each own part of the problem but none owns the full control loop. That is why governance stalls. For practitioners, the lesson is to connect policy design, audit logging, and runtime enforcement into one accountable system.
AI governance and privacy are converging into the same control surface. The article makes clear that consent, permissibility, and access decisions are no longer separate disciplines when AI systems reuse enterprise data. That means security teams cannot treat privacy as an external dependency, and privacy teams cannot rely on manual approvals as their primary enforcement mechanism. The practical conclusion is to govern data use continuously at the point of execution.
Automating the approval queue is not the same as automating governance. The article’s strongest point is that digitising review still leaves the human bottleneck intact. The named concept here is governance throughput mismatch: the gap between machine-speed AI activity and human-speed oversight. When that gap widens, organisations need controls that make the safe path the default path.
From our research library:
- Only 37% of organisations had policies for managing AI or detecting shadow AI, according to IBM's 2025 Cost of a Data Breach Report.
- Read next: AI Governance Guide
What this signals
Governance throughput mismatch: enterprises are now running AI adoption faster than their manual review processes can absorb, which means the governance model itself becomes part of the risk surface. Practitioners should expect more pressure to move control decisions closer to the workload and away from the ticket queue.
Security and privacy leaders should prepare for a convergence of policy, audit, and runtime enforcement around AI data use. The organisations that scale governance will be the ones that make the permitted path executable in the system, not just documented in policy.
The strongest operational signal is simple: when routine access still requires repeated human approval, governance has already fallen behind the workload.
For practitioners
- Define runtime policy enforcement for AI access Move routine access decisions from manual review into enforceable policy logic that evaluates query, purpose, and dataset sensitivity in real time.
- Map AI workflows to data purpose and sensitivity Document which AI use cases are allowed, what purpose they serve, and which data classes each workflow may touch.
- Reduce dependence on approval queues Identify recurring requests that can be pre-authorised under policy so reviewers only handle true exceptions and escalations.
- Align privacy and security controls Use one shared governance model for consent, permissibility, logging, and access enforcement so the technical and legal decisions stay consistent.
Key takeaways
- Enterprise AI adoption is now outpacing governance workflows, and manual approval queues are becoming a control bottleneck rather than a safeguard.
- Purpose-based policy enforcement is emerging as the more workable model because it matches how AI systems actually request and use data.
- Security, privacy, and data governance need a shared runtime control plane if organisations want policy intent to survive operational scale.
Standards & Framework Alignment
This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.
NIST AI RMF sets the technical controls, while ISO/IEC 42001:2023 and GDPR define the regulatory obligations.
| Framework | Control / Reference | Relevance |
|---|---|---|
| NIST AI RMF | GOVERN — AI Governance and Accountability | The article is fundamentally about governance operating models for AI use at enterprise scale. |
| MANAGE — AI Risk Management | The article focuses on operational controls that keep AI risk manageable as adoption accelerates. | |
| MAP — AI Context and Use Mapping | Purpose-based governance depends on understanding context, permitted use, and workflow sensitivity. | |
| Recommendation — Establish AI governance accountability so policy decisions can be enforced continuously rather than reviewed manually. Embed runtime controls that manage AI access, purpose, and data use at the point of execution. Map AI use cases, data sensitivity, and permitted purposes before allowing automated access. | ||
| ISO/IEC 42001:2023 | A.5 — Leadership and Commitment | The article highlights enterprise accountability gaps between legal, data, and engineering leadership. |
| Recommendation — Assign clear leadership ownership for AI governance so accountability spans policy and technical enforcement. | ||
| GDPR | Art.5 — Principles relating to processing of personal data | The privacy and permissibility concerns in the article overlap with lawful, purpose-limited data use. |
| Recommendation — Apply purpose limitation and data minimisation principles to AI workflows that process personal data. | ||
Key terms
- API Governance Debt: API governance debt is the accumulation of weak, inconsistent, or missing controls around how APIs are designed, approved, documented, secured, and retired. It creates hidden risk over time. Technically, it includes gaps in authentication, authorization, versioning, inventory, ownership, logging, and policy enforcement that make APIs harder to trust and govern.
- Purpose-Based Governance: A control model that authorises data or system access based on the intended use of the request, not only the identity of the requester. In AI environments, this is often more workable than identity-only approvals because the same workflow can be legitimate in one context and risky in another.
- Runtime Policy Enforcement: Runtime policy enforcement evaluates a request at the moment it is executed instead of relying only on preconfigured permissions. For AI agents, this allows decisions to reflect current context, target sensitivity, and behavioural signals rather than static assumptions.
- Governance Throughput Mismatch: The gap between the speed at which AI systems generate access or usage events and the speed at which humans can review them. When this gap widens, approval queues become bottlenecks, exceptions multiply, and governance shifts from control to delay management.
Deepen your knowledge
NHI Foundation Level course, the industry's only accredited NHI security programme, covers NHI governance, agentic AI identity, and secrets management for practitioners building reliable identity control. It helps security and governance teams turn policy intent into operational control across modern identity-driven systems.
Published by the NHIMG editorial team on October 16, 2026.
NHI Mgmt Group, the independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org