TL;DR: Sensitive data can reach LLMs through prompts, files, APIs, browser sessions, and MCP-connected agents, so prompt filtering alone no longer protects PII, PHI, PCI data, credentials, or customer records, according to Strac. The governance problem is data boundary control, not simply restricting AI usage.
At a glance
What this is: This is an analysis of how sensitive data reaches LLMs and MCP-connected AI workflows, with the key finding that traditional prompt filtering is no longer enough to contain PII, PHI, PCI data, and credentials.
Why it matters: It matters because IAM, data security, and NHI teams need controls that govern what data AI systems can retrieve, inherit, and pass onward before it crosses an AI boundary.
By the numbers:
- Around 15% of workers pass sensitive data to ChatGPT inadvertently.
👉 Read Strac's analysis of how to keep PII and PHI out of OpenAI LLM workflows
Context
Large language model data leakage is no longer just a user behaviour problem. The control gap now spans prompts, uploaded files, APIs, browser sessions, and connected agent workflows, which means sensitive data can cross into an AI system before traditional review points are reached. In identity terms, that creates a new boundary problem for both human access and non-human identities.
MCP makes the issue sharper because AI agents can retrieve information directly from enterprise systems and pass it into an LLM without a person manually exporting the data. That changes the governance model for IAM, DLP, and NHI programmes: the question is no longer only who can use the AI tool, but what information the toolchain can collect and disclose.
Key questions
Q: How should security teams govern sensitive data in LLM workflows?
A: Security teams should govern the full data path, not just the model endpoint. That means classifying prompts, retrieval sources, logs, and outputs, then applying sensitivity checks before data reaches the model. The strongest programs treat AI interactions as identity-governed events with audit trails, retention limits, and explicit approval for high-risk content.
Q: Why do MCP-connected agents increase AI data leakage risk?
A: MCP-connected agents can retrieve data directly from enterprise systems, so sensitive information may enter AI workflows without a person copying it into a prompt. That creates a delegated retrieval path, which expands the attack and compliance surface. Organisations need policy controls on what the agent may retrieve and what may be passed onward to the model.
Q: What is the difference between redaction and tokenization in AI data protection?
A: Redaction removes sensitive content before it reaches the model, while tokenization replaces the value with a surrogate that can sometimes be reversed under controlled conditions. Redaction is better when the model should never see the data. Tokenization is useful when workflows need structure or referential integrity without exposing the original value.
Q: How can organisations prove their AI controls are actually working?
A: Look for evidence that policy decisions are logged, sensitive prompts are being redacted or blocked when required, and approved AI interactions are traceable by identity and business context. Effective programmes produce audit-ready records, not just policy text. If the control cannot explain what happened in a session, it is not operational enough.
Technical breakdown
Why prompt filtering fails in modern LLM workflows
Prompt filtering only inspects the text a user deliberately sends. Modern AI flows include files, browser context, API calls, and agent orchestration, so sensitive data can enter an LLM through paths the user never typed by hand. That makes the real control point upstream classification and policy enforcement, not just prompt inspection. In practice, privacy and compliance risk increases when the organisation treats the LLM as the boundary instead of treating the data source as the boundary.
Practical implication: move detection and redaction to the data source and workflow layer, not just the chat interface.
How MCP changes the AI data exposure model
MCP connects AI agents to tools and data sources, which is useful for context but risky for data governance. Once an agent can query SaaS apps, cloud stores, or internal systems, it may assemble regulated or confidential data into its working context even when the human user never saw the raw record. That creates a non-human access path that behaves like delegated retrieval, not simple user input. For identity teams, the key issue is whether the agent has explicit, scoped permission to retrieve the data it can now expose.
Practical implication: treat MCP tool access as governed retrieval permissions, with least privilege and data-level policy checks.
Redaction, masking, and tokenization as boundary controls
Redaction removes sensitive fields before they reach the model, masking obscures values while preserving some utility, and tokenization replaces the original value with a reversible surrogate. These are not the same control, and each suits different risk and workflow conditions. The strongest pattern is policy-driven selection based on data type and business use, with logging so teams can prove what was withheld or transformed. Without that evidence, organisations cannot support incident review, privacy investigations, or compliance attestations.
Practical implication: define which data classes must be blocked, masked, or tokenized before AI processing begins.
Threat narrative
Attacker objective: The objective is to move sensitive enterprise data into an AI workflow where it can be retained, exposed, or repurposed outside the original access boundary.
- Entry occurs when sensitive data is introduced through prompts, files, APIs, browser sessions, or agent-connected retrieval from enterprise systems.
- Escalation occurs when an AI agent or LLM context pulls additional records from SaaS or internal systems beyond what the user intended to share.
- Impact occurs when regulated, confidential, or credential data is exposed to the model, retained in workflow context, or surfaced in downstream outputs.
NHI Mgmt Group analysis
Data boundary control has become the real AI governance problem. Organisations have spent too much time assuming the only risk is a user typing sensitive text into a chatbot. The source article shows that AI agents and connected workflows can retrieve data directly from enterprise systems, which means the boundary now sits between source systems, orchestration layers, and the model. Practitioners should treat data egress into AI as a governed decision, not a user etiquette problem.
MCP creates a non-human retrieval path that identity programmes must govern. Once an AI agent can call SaaS and internal tools, it behaves like a non-human identity with delegated access to business data. That means IAM, PAM, and NHI controls need to cover scoped retrieval, session context, and output handling together. This is where least privilege must extend beyond accounts and into data access pathways.
Inline data transformation should be the default control for high-risk AI use cases. Redaction, masking, and tokenization are not compensating controls after the fact. They are the practical mechanism that allows organisations to use AI without handing the model raw PII, PHI, PCI data, or credentials. The control question is which data classes can safely cross the AI boundary and which must be transformed first.
LLM data security is converging with NHI governance. As AI agents retrieve more enterprise context, the line between application security, DLP, and identity governance keeps shrinking. A named concept here is AI retrieval boundary risk: the failure mode where data is exposed not through user input alone, but through delegated agent retrieval and downstream model context. Teams should align policy, logging, and access review around that boundary.
Compliance teams need evidence, not just policy statements. The article’s compliance references matter because organisations will have to show what was blocked, masked, or allowed into AI workflows. That requires auditable controls across source systems, connectors, and the LLM layer. Practitioners should assume regulators and auditors will ask for proof of boundary enforcement, not intent.
What this signals
AI data governance is shifting from content filtering to boundary enforcement. As LLMs absorb more enterprise context, security teams need policies that operate on source data, connector scope, and transformation rules rather than relying on user judgement alone. For identity programmes, this is a sign that non-human access governance and DLP will increasingly share the same control plane.
AI retrieval boundary risk will become a recurring programme issue because the same connector that improves productivity can also move regulated data into model context. Security teams should expect more pressure to prove where transformation occurred, who approved it, and what was denied. That evidence model aligns closely with governance expectations in NIST Cybersecurity Framework 2.0 and the operational control logic behind OWASP Agentic AI Top 10.
For identity and AI teams, the practical near-term priority is to map agent retrieval paths to data classes. That means deciding which systems an agent may query, which fields it may see, and which transformations must happen before context reaches the model. Programmes that do this well will be able to use AI with real business data while keeping the privacy and audit boundary intact.
For practitioners
- Define AI data boundary policies Classify which data types may enter LLM workflows, which must be masked, and which must be blocked entirely before retrieval or prompt submission.
- Apply retrieval controls to MCP connectors Treat each MCP-connected tool as a scoped data access path and enforce least privilege at the connector level, not just at the chat layer.
- Instrument redaction before model submission Place detection, redaction, masking, or tokenization ahead of the LLM so sensitive values are transformed before they can influence the model context.
- Log AI data egress decisions Record what data was allowed, masked, or blocked so incident response and compliance teams can reconstruct how sensitive information moved through the workflow.
Key takeaways
- LLM exposure is now a data boundary problem, not just a prompt hygiene problem.
- MCP-connected agents expand the path by which sensitive records can reach model context without manual copying.
- Organisations need upstream policy enforcement, transformation, and logging if they want AI use to remain governable.
Standards & Framework Alignment
This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.
OWASP Non-Human Identity Top 10 and OWASP Agentic AI Top 10 address the attack surface, NIST CSF 2.0 and NIST AI RMF set the technical controls, and GDPR define the regulatory obligations.
| Framework | Control / Reference | Relevance |
|---|---|---|
| OWASP Non-Human Identity Top 10 | NHI-03 | The article centers on secret and sensitive data exposure through AI workflows. |
| OWASP Agentic AI Top 10 | Agent retrieval and tool use create delegated access and data-leakage risks. | |
| NIST CSF 2.0 | PR.DS-1 | Sensitive data handling and protection are the core governance issues here. |
| NIST AI RMF | GOVERN | AI governance and accountability are central to deciding what data may enter model workflows. |
| GDPR | Art.32 | The article addresses personal data protection in AI processing. |
Assign governance ownership for AI data boundaries and require documented approval for high-risk flows.
Key terms
- AI data access boundary: An AI data access boundary is the limit on what information a model or connected tool is permitted to retrieve, summarise, or expose. It depends on identity, policy, and connector design, not just on the model’s content filters. If the boundary is too broad, safe prompting still leaves exposure risk.
- Model Context Protocol: Model Context Protocol is an open protocol that lets AI agents connect to tools and data sources. It expands what an agent can reach, so governance has to cover not only the model and its prompts, but also every system that can receive or return agent-driven data.
- Data Tokenization: Data tokenization replaces sensitive values with surrogate tokens that have no exploitable relationship to the original data. In AI environments, the control matters because prompts and responses often contain sensitive content in plain language, so the token must protect the value while preserving enough context for the model to remain useful.
- Redaction: Redaction is the removal or obscuring of sensitive content so it cannot be read by unauthorised users. It is different from simple hiding because the underlying values are intentionally transformed or removed, allowing organisations to share or store information while reducing privacy and breach risk.
What's in the full article
Strac's full article covers the operational detail this post intentionally leaves for the source:
- Detection and redaction patterns for sensitive text moving through prompts, files, and API workflows
- Tokenization and masking examples that preserve utility while preventing raw PII or PHI from reaching the model
- MCP DLP controls for connected agents that retrieve data directly from SaaS and internal systems
- Implementation guidance for applying policy before data crosses into an AI workflow
Deepen your knowledge
NHI Foundation Level course, the industry's only accredited NHI security programme, covers NHI governance, machine identity security, and secrets management. It helps practitioners connect identity controls to modern AI and data workflows without losing governance rigor.
Published by the NHIMG editorial team on August 20, 2026.
NHI Mgmt Group — the independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org