TL;DR: Enterprise employees are already sending sensitive data into public AI tools, and Seclore cites research showing 68% are not following policy while one in twelve prompts contains confidential information. The control problem is no longer whether AI is allowed, but whether data can be masked, logged, and governed before it reaches the model.
At a glance
What this is: Seclore argues that the enterprise AI risk has moved to the context window, where prompts, retrieved content, and user data enter models without enough protection.
Why it matters: This matters because AI governance now depends on controlling what reaches the model, which intersects with human policy enforcement, data security, and emerging AI agent access paths.
By the numbers:
- 68 percent of enterprise employees are not following policy on sharing sensitive data with external AI tools, according to Seclore.
Context
The security gap here is not whether employees use public AI tools, because many already do. The real issue is that most organisations still rely on policy statements and conventional DLP controls that were designed for email, file transfer, and storage, not for prompts, retrieval chains, or agent-driven interactions.
In AI-heavy environments, the context window becomes the enforcement point because it is where sensitive data is transformed into model input. That creates a governance problem for human users, applications, and AI agents alike, since all three can expose regulated or confidential data before traditional controls see it.
Key questions
Q: How should organisations govern access to data used by AI systems?
A: Treat AI data access as an identity governance problem, not just a data storage problem. Define who or what can use each dataset, what purpose is allowed, and what runtime restrictions apply. Then review humans, service accounts, and AI agents separately so entitlement scope matches actual behaviour rather than a generic AI policy.
Q: Why do conventional DLP controls miss AI prompt leakage?
A: Because they were built for fixed endpoints and predictable paths such as email, storage, and uploads. AI prompts are live interactions, often with retrieved context and no stable destination, so the sensitive value can enter the model before legacy inspection catches it.
Q: How can security teams tell whether AI lifecycle controls are working?
A: They should look for evidence that access requests, policy enforcement, and usage visibility are centrally recorded and current. If those signals are fragmented across platforms, the programme may be documenting governance rather than enforcing it. Continuous traceability is the practical test.
Q: What is the difference between masking and blocking in AI governance?
A: Masking substitutes sensitive values with safe tokens so the model can still process the request, while blocking stops the request entirely. Masking supports productive use of AI with confidential data, whereas blocking is reserved for cases where the data should never reach the model.
Technical breakdown
Why the context window is a new data exposure surface
A context window is the input space where a model receives prompts, retrieved content, and attached context before generating output. Unlike email or file transfer, the interaction is conversational, dynamic, and often invisible to perimeter controls. That makes the model input layer a distinct exposure surface, especially when employees paste sensitive data or retrieval systems surface records automatically. Traditional controls assume a fixed endpoint and a predictable path, which does not fit AI interaction patterns.
Practical implication: Treat model input as a governed control point, not a passive transport layer.
Why conventional DLP misses prompt-based leakage
Classic DLP was built to inspect and block data leaving a known channel, such as email, cloud storage, or web upload. Prompts break that model because the sensitive value is not being transferred as an attachment or file object. It is being embedded into a live interaction, often alongside other retrieved or generated context. By the time legacy tools recognise the content, the data has already reached the model and may be retained, logged, or reused downstream.
Practical implication: Extend inspection and policy enforcement to AI interactions rather than relying on endpoint-only or gateway-only controls.
How masking and tokenisation change the control model
Tokenisation replaces sensitive values with structure-preserving substitutes before the data enters the model. The model can still reason over the tokenised input and return useful output, while the enterprise retains the real value in a protected vault or internal system. This is a control design choice, not a simple block-or-allow decision. It preserves productivity while reducing unnecessary disclosure, which is especially relevant where regulated or confidential data is needed for the task.
Practical implication: Prefer masking for routine AI use cases and reserve blocking for truly disallowed data flows.
Threat narrative
Attacker objective: The objective is not a classic intrusion but uncontrolled access to enterprise data through the AI interaction layer, resulting in disclosure and governance loss.
- Entry occurs when employees, applications, or AI agents send confidential information into a public AI tool through a prompt, retrieval query, or agent workflow.
- Credential or data exposure follows because the sensitive content is now inside the model context window, outside the protection boundary built for conventional DLP.
- Impact emerges when the organisation loses visibility into what was shared, cannot prove policy compliance, and may expose regulated data to external processing or logging.
Breaches seen in the wild
- Firebase misconfiguration exposure 2024: Missing Firebase security rules on 916 websites exposed 125 million user records and 19.87 million plaintext passwords; a quarter were fixed.
Read and download The State of NHI & AI Agent Breach Report 2026, covering 200+ breaches impacting Non-Human Identities including AI Agents.
NHI Mgmt Group analysis
Context-window governance is becoming the new AI control plane. The article is right to frame the model input layer as the place where risk is decided, because that is where data either remains governed or becomes consumable by an external model. For identity and access teams, this shifts attention from only who can use AI to what data those users, applications, and agents are allowed to place into it. Practitioners should treat the context window as a policy enforcement boundary.
Policy without enforcement is now operationally weak. The article describes a common enterprise pattern: the organisation has a rule, employees still use AI, and security teams have little proof of what happened. That is a governance gap, not a user discipline problem. The named concept here is prompt-side data exposure, meaning sensitive content is leaked through interaction design rather than file movement. Practitioners should assume user policy alone will not hold at scale.
AI governance and identity governance are converging at the point of use. When applications and AI agents can call models directly, the data path is no longer a human-only issue. That means access policy, data classification, and model interaction controls need to be aligned, especially where non-human identities can submit prompts or retrieve context on behalf of users. Practitioners should govern the identity that initiates the AI action and the data class that enters the model together.
Masking is a governance control, not just a privacy feature. The article’s tokenisation approach is significant because it preserves business utility while reducing unnecessary disclosure. That matters in regulated environments where blanket blocking creates shadow usage and weak visibility. The practical lesson is that AI control design should prioritise controlled substitution and auditability before reaching for outright denial.
From our research library:
- Only 5.7% of organisations have full visibility into their service accounts, according to the Ultimate Guide to NHIs.
- Read next: Ultimate Guide to NHIs — Lifecycle Processes for Managing NHIs
What this signals
Prompt-side data exposure: this is the governance gap that now matters most, because sensitive information can be disclosed inside the interaction itself rather than in a file transfer or email event. Organisations that keep treating AI as a channel problem will miss the real control point and will continue to rely on policy enforcement that cannot observe the prompt.
AI usage will increasingly need the same treatment as other high-risk data flows: classification, authorised substitution, and audit reconstruction. For identity programmes, that means aligning human policy, application access, and non-human agent behaviour around the same data rules rather than managing each path separately.
For practitioners
- Implement context-window policy enforcement Classify sensitive values before they enter prompts, retrieval queries, or agent workflows, and apply policy at the interaction layer rather than only at the email or file boundary.
- Deploy tokenisation for approved AI use Replace regulated or confidential values with structure-preserving tokens so users can keep working without exposing the original data to the model.
- Log AI interactions for audit and review Capture who sent the request, what data classes were involved, which policy fired, and which model received the input so governance teams can reconstruct usage later.
- Separate allowable prompts from prohibited disclosures Define which data categories may be summarised, masked, or blocked in AI tools, and align those rules to business function and regulatory exposure.
- Extend controls to AI agents and applications Apply the same data-handling rules when non-human identities call models directly, because agent-driven workflows can bypass user-centric assumptions.
Key takeaways
- The enterprise AI risk is no longer abstract, because sensitive data can enter public models through ordinary work tasks and agent workflows.
- Conventional DLP was built for predictable data movement, so it does not reliably govern prompt-based disclosure or retrieval-driven leakage.
- The practical response is to enforce policy at the context window with masking, logging, and tightly scoped blocking where needed.
Standards & Framework Alignment
This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.
OWASP Agentic AI Top 10 addresses the attack and risk surface, while NIST AI RMF and NIST CSF 2.0 set the governance and control requirements practitioners need to meet.
| Framework | Control / Reference | Relevance |
|---|---|---|
| NIST AI RMF | GOVERN — AI Governance and Accountability | The article is fundamentally about governance of AI data use and accountability. |
| MANAGE — AI Risk Management | The article focuses on managing disclosure risk at the AI interaction layer. | |
| Recommendation — Use GOVERN to define ownership for prompt controls, masking rules, and auditability. Use MANAGE to set policy for sensitive inputs, tokenisation, and blocking thresholds. | ||
| NIST CSF 2.0 | PR.DS-01 — Data-at-rest is protected | The article extends data protection thinking into AI interaction flows and sensitive data handling. |
| Recommendation — Apply PR.DS controls to protect sensitive data before it reaches external AI systems. | ||
| OWASP Agentic AI Top 10 | ASI03 — Identity & Privilege Abuse | AI agents acting on behalf of users can submit sensitive data into models without human review. |
| Recommendation — Constrain agent privileges so non-human workflows cannot expose confidential data to models. | ||
Key terms
- Context Window: The context window is the text a model receives at one time, including prompts, retrieved documents, and conversation history. Security teams care about it because it becomes the practical boundary between trusted instructions and untrusted content, especially when the application assembles that text automatically.
- Tokenisation: Tokenisation replaces a sensitive value with a non-sensitive substitute that preserves workflow utility without revealing the original data. It is useful when systems need to process or display records while keeping direct personal identifiers out of normal operating paths.
- AI Data Governance: AI data governance is the set of rules, ownership decisions, and enforcement mechanisms that determine how data can be used by AI systems. It covers classification, access control, retention, and remediation, and it must account for both human users and autonomous software entities.
- Prompt-Side Data Exposure: Prompt-side data exposure happens when sensitive information is disclosed inside an AI interaction rather than through a traditional file or email transfer. It is a control failure at the point of input, where the organisation loses visibility before the model processes the data.
Deepen your knowledge
NHI Foundation Level course, the industry's only accredited NHI security programme, covers NHI governance, machine identity security, and agentic AI identity. It helps practitioners connect identity controls to the data and access decisions that shape modern AI risk.
Published by the NHIMG editorial team on August 18, 2026.
Updated on October 12, 2026.
NHI Mgmt Group, the independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org