Join our Newsletter — 33% off our NHI Course

Public LLM conversations: what the safety data actually shows

 

(@nhi-mgmt-group)
Member Moderator
Joined: 1 year ago
Posts: 16521
Topic starter  

TL;DR: Analysis of 13,455 publicly shared ChatGPT conversations found that 99.06% contained no policy violations, over 80% were educational, and only 0.94% included sensitive material, according to Knostic. The data suggests that visible AI use is shaped as much by human self-presentation and accountability as by model safeguards.

Editorial analysis by NHI Mgmt Group, based on content published by Knostic: “99% of Publicly Shared AI Chats are Safe, New Study Finds”.

By the numbers:

  • 99.06% of analyzed conversations contained no policy violations.
  • Over 80% of the analyzed conversations centered on educational topics.
  • Only 0.94% contained sensitive material.

Key questions

Q: How should organisations interpret public LLM chats when setting AI governance policy?

A: Public chats are useful behavioural evidence, but they are not a full risk baseline.

Q: Why do visible AI conversations often look safer than private enterprise use?

A: Visibility changes behaviour because users self-censor when they expect an audience or accountability.

Q: What are the signs that LLM use is being governed more by self-presentation than by policy?

A: The main sign is a low rate of visible misuse paired with weak controls over private prompts, connected data, and user attribution.

Practitioner guidance

  • Separate public behaviour from enterprise exposure Use public-chat studies as context for policy design, but validate controls against internal prompts, connected repositories, and workflow integrations.
  • Add identity-aware logging for AI usage Record who initiated prompts, what data sources were reachable, and which permissions were exercised so accountability is tied to actual access.
  • Restrict sensitive data paths into LLM tools Apply least-privilege access to copilots, search tools, and chat integrations so the model cannot surface regulated or confidential content by default.

Bottom line: Public LLM conversations can look reassuring because visibility changes how people behave, but that does not prove enterprise AI use is safe.

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 5 months ago
Posts: 17012
 

Public visibility is a control, but not a control plane: The study shows that being observed changes user behaviour, which is useful but limited. Transparency can suppress obvious misuse, yet enterprise AI governance cannot depend on self-policing alone. Organisations still need policy enforcement, logging, and data-boundary controls because private use is where exposure risk usually concentrates.

A few things that frame the scale:

  • AI-related credential leaks surged 81.5% year-over-year in 2025, with the surrounding AI infrastructure leaking 5x faster than core LLM providers, according to the State of Secrets Sprawl 2026.

A question worth separating out:

Q: Should security teams trust public LLM studies to decide whether their AI controls are adequate?

A: No. Public studies are useful for understanding user behaviour, but they do not measure access to sensitive systems, enterprise data, or workflow automation. Teams should use them as directional context, then test controls against the environments where prompts, files, and permissions actually intersect.

👉 Read our full editorial: Public LLM use is mostly educational, not policy-breaking



   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.