Join our Newsletter — 33% off our NHI Course

Notifications
Clear all

LLM proxy exposure and prompt disclosure: what teams need to fix


(@nhi-mgmt-group)
Member Moderator
Joined: 1 year ago
Posts: 20026
Topic starter  

TL;DR: An unauthenticated LLM proxy let external users reach backend AI services, confirm unrestricted model access, and extract system prompt content during a private bug bounty assessment, according to FireCompass. The finding shows that AI endpoints need the same access control, separation, and abuse-prevention discipline as other privileged production interfaces, because prompt disclosure and cost abuse emerge fast once the proxy layer is weak.

NHIMG editorial — based on content published by FireCompass: How FireCompass AI Discovered an Unauthenticated LLM Proxy and System Prompt Disclosure Vulnerability

Questions worth separating out

Q: What breaks when an LLM proxy has no authentication or authorisation?

A: The proxy stops being a controlled access layer and becomes a public gateway to privileged model resources.

Q: Why do unauthenticated AI endpoints increase both disclosure and abuse risk?

A: Because the same missing boundary that allows model access also allows repeated probing, prompt injection attempts, and high-volume usage.

Q: How can security teams tell whether an LLM proxy is failing in practice?

A: Look for anonymous requests reaching the model, responses that reveal policy or instruction text, and traffic patterns that indicate repeated probing or runaway usage.

Practitioner guidance

  • Inventory every exposed AI entry point Map all LLM proxies, model gateways, and API routes that can reach production models.
  • Require strong caller validation at the proxy layer Enforce authentication and authorisation before any request is forwarded to a model.
  • Separate system instructions from user input Keep hidden prompts, policy text, and developer instructions outside user-controlled context wherever possible.

What's in the full article

FireCompass's full article covers the operational detail this post intentionally leaves for the source:

  • Step-by-step request and response traces from the proxy validation workflow
  • The exact prompt probes used to confirm system prompt disclosure behaviour
  • How the assessment distinguished real security findings from expected model output
  • Operational lessons for organisations building LLM-backed customer-facing services

👉 Read FireCompass's analysis of the unauthenticated LLM proxy and prompt disclosure issue →

LLM proxy exposure and prompt disclosure: what teams need to fix?

Explore further

View Full Forum →  |  NHI Foundation Course →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 4 months ago
Posts: 19617
 

LLM proxies are becoming non-human identity control points. Once an AI application sits behind a proxy that can call a model, the proxy itself functions like a privileged service identity. If caller validation, session binding, and authorisation are weak, the organisation has not just exposed an endpoint. It has exposed a non-human access path that can be reused at scale. For practitioners, the control question is no longer whether the model is safe, but whether the proxy is governed like any other privileged machine identity.

A question worth separating out:

Q: Should organisations treat AI gateways like privileged identity controls?

A: Yes. AI gateways mediate access to powerful non-human capabilities, so they need the same discipline used for sensitive service accounts and other privileged access paths. That means authentication, authorisation, logging, rate limiting, and explicit separation between user input and system instructions. Without those controls, the gateway becomes an unmanaged privilege surface.

👉 Read our full editorial: Unauthenticated llm proxies expose prompt leakage and abuse risk



   
ReplyQuote
Share: