Join our Newsletter — 33% off our NHI Course

Why does runtime governance matter more than static scans for 31 of 36?

 

(@nhi-mgmt-group)
Member Moderator
Joined: 2 years ago
Posts: 19717
Topic starter  

TL;DR: 31 of 36 LLM-integrated applications were compromised in Equixly's testing because prompt injection and runtime interactions evade static review. LLM deployments need tighter control over model authority, outputs, and audit trails to stay inside policy boundaries.

Editorial analysis by NHI Mgmt Group, based on content published by Equixly: “31 out of 36: The state of LLM security”.

By the numbers:

  • When researchers deployed HOUYI against 36 LLM-integrated applications, it succeeded on 31 of them.

Key questions

Q: Why do LLM agents create more privacy and compliance risk than standard chatbots?

A: LLM agents increase risk because they can read, store, and act on more data across more systems.

Q: What are the signs that prompt injection defenses are failing in LLM applications?

A: Common signs include unexpected system instruction disclosure, unauthorized data access, abnormal tool use, and model outputs that ignore policy or safety boundaries.

Q: What breaks when LLM security testing stops at static analysis?

A: Static testing misses the failure modes that emerge only when prompts, retrieval, and tools interact at runtime.

Practitioner guidance

  • Run adversarial prompt tests in production-like conditions Exercise the application with direct and indirect prompt injection patterns against retrieval, tool use, and output handling before release.
  • Restrict agent tool scope to the minimum task boundary Assign only the APIs, data sources, and actions required for the current task, and revoke everything else by default.
  • Validate every model output before downstream use Treat generated text, JSON, SQL, and shell content as untrusted until it passes format checks, allowlists, and policy enforcement.

Bottom line: LLM security failures arise at runtime, where prompts, retrieval, tool use, and output handling interact in ways static review cannot fully predict.

Glossary terms: Runtime Governance, Prompt Injection (Agentic), Excessive agency, Output Handling

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →


This topic was modified 12 hours ago by NHI Mgmt Group

   
Quote
(@mr-nhi)
Member Moderator
Joined: 6 months ago
Posts: 20207
 

Runtime governance is the real LLM security boundary: static review cannot prove how a model will behave once prompts, retrieval, and tool calls are live. The article's evidence shows that the exploitable condition is not the codebase alone, but the decision path created at inference time. Practitioners should treat LLM security as ongoing runtime governance, not a one-time assurance exercise.

A few things that frame the scale:

  • AI-related credential leaks surged 81.5% year-over-year in 2025, with the surrounding AI infrastructure leaking 5x faster than core LLM providers, according to the State of Secrets Sprawl 2026.

A question worth separating out:

Q: How should security teams implement access controls for AI and LLM environments?

A: Security teams should treat AI and LLM access as a governed identity problem, not just an application setting. Start by centralising authentication with SSO and MFA, then apply RBAC and least privilege so users and services only reach the data and actions they need. Add regular access reviews and audits to remove stale permissions and reduce the blast radius of compromised accounts.

👉 Read our full editorial: LLM security is a runtime governance problem, not a static scan



   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.