Join our Newsletter — 33% off our NHI Course

PHI in GenAI tools: are your controls keeping up with clinical use?

 

(@nhi-mgmt-group)
Member Moderator
Joined: 1 year ago
Posts: 16626
Topic starter  

TL;DR: Healthcare employees are pasting PHI into consumer and embedded GenAI tools faster than most security programmes can see or govern, according to Cyberhaven. The control gap is not just detection, but data-level policy, BAA enforcement, and approved alternatives that reduce shadow AI pressure.

Editorial analysis by NHI Mgmt Group, based on content published by Cyberhaven: “AI Security for Healthcare: How to Protect PHI When Employees Use GenAI Tools”.

Key questions

Q: What fails first when employees paste PHI into GenAI tools?

A: The first failure is usually governance visibility.

Q: When should healthcare teams prioritise BAA enforcement over tool allowlisting?

A: They should prioritise BAA enforcement when the main risk is patient data leaving the organisation through legitimate work tools.

Q: What are the signs that PHI governance in GenAI is failing?

A: Common signs include repeated use of personal AI accounts, clinicians relying on consumer tools for documentation, AI features appearing inside approved platforms without review, and no reliable audit trail for PHI prompts.

Practitioner guidance

  • Implement data-level PHI visibility Track where patient data moves after it leaves source systems so security teams can see AI prompts, embedded copilots, and external services in one control view.
  • Bind AI approval to BAA status Require that any tool receiving PHI is checked for a valid business associate agreement before data reaches it, and block the destination if the agreement is absent.
  • Enforce minimum-necessary prompts Apply controls that flag or block prompts containing structured PHI patterns or full patient records when a narrower query would satisfy the task.

Bottom line: PHI exposure in GenAI tools is not just a DLP problem because the main control failure is loss of governance over where patient data goes once staff start using AI in everyday work.

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 5 months ago
Posts: 17057
 

PHI in GenAI is a governance problem because the control boundary moved from the tool to the data path. Healthcare programmes that still think in terms of approved versus blocked applications are already behind the real risk. The decisive issue is whether patient data can be recognised, constrained, and audited after it enters AI workflows. For practitioners, that means policy has to follow the data, not just the application inventory.

A few things that frame the scale:

  • 28% of secrets incidents now originate outside code repositories, in Slack, Jira, and Confluence, and are 13% more likely to be categorised as critical than code-based leaks, according to the State of Secrets Sprawl 2026.
  • Only 23% of IT leaders were very confident in their organisation's ability to manage security and governance for GenAI deployments, according to a 2025 Gartner survey of 360 IT leaders.

A question worth separating out:

Q: How should healthcare organisations respond when PHI is sent to a non-compliant AI service?

A: They should treat it as a compliance and incident-review event, then determine whether the disclosure is reportable under HIPAA and whether the destination should be blocked at the data layer. The response should also feed back into policy updates, staff guidance, and tool approval criteria so the same path is not repeated.

👉 Read our full editorial: PHI exposure in GenAI tools is a governance problem, not just DLP



   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.