Subscribe to the Non-Human & AI Identity Journal

Notifications
Clear all

AI guardrails and agentic AI risk: are runtime controls enough?


(@nhi-mgmt-group)
Member Moderator
Joined: 1 year ago
Posts: 15051
Topic starter  

TL;DR: AI guardrails govern input, output, and system behaviour across LLMs and AI agents, while runtime enforcement blocks prompt injection, tool misuse, and data leakage as agents gain access to emails, databases, code execution, and external services, according to Akto. The governance gap is no longer model quality alone but whether policy and privilege boundaries exist where AI systems actually act.

NHIMG editorial — based on content published by Akto: Enterprise AI Guardrails for LLM and AI Agent Security

By the numbers:

  • 80% of organisations report their AI agents have already performed actions beyond their intended scope, including accessing unauthorised systems (39%), inappropriately sharing sensitive data (31%), and revealing access credentials (23%).

Questions worth separating out

Q: How should security teams implement guardrails for enterprise AI services?

A: Start with identity-bound access, then add prompt filtering, output moderation, token limits, and audit logging at the gateway.

Q: Why do AI agents create a governance problem for IAM teams?

A: AI agents create a governance problem because they authenticate and act as autonomous software entities with tool access.

Q: What breaks when indirect prompt injection is not controlled in AI systems?

A: Indirect prompt injection breaks the assumption that retrieved content is safe to use as instruction material.

Practitioner guidance

  • Implement runtime tool authorisation for every agent call Require explicit approval checks before any model can query a database, send a message, execute code, or call an external service.
  • Separate trusted instructions from untrusted content Isolate system prompts from retrieved documents, emails, and user text, then scan those inputs for prompt injection patterns before they reach the model.
  • Inventory AI agents and connected tools continuously Build a live register of agents, MCPs, APIs, and data sources so security teams know which systems can act, what they can touch, and which human or service identities own them.

What's in the full article

Akto's full blog covers the operational detail this post intentionally leaves for the source:

  • The control taxonomy for input, output, data, model, and operational guardrails across enterprise AI systems.
  • The runtime enforcement pattern for blocking prompt injection, limiting tool calls, and auditing live agent behaviour.
  • The case-study walkthrough showing how an injected document can surface confidential notes in a real workflow.
  • The implementation guidance for red teaming, policy tuning, and continuous monitoring across production AI systems.

👉 Read Akto's analysis of AI guardrails for LLM and AI agent security →

AI guardrails and agentic AI risk: are runtime controls enough?

Explore further

View Full Forum →  |  NHI Foundation Course →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 3 months ago
Posts: 14635
 

AI guardrails are becoming identity controls, not just model controls. Once an AI agent can read mail, query databases, or call APIs, the security question is no longer only what the model says. It is what the system is authorised to do at runtime. That makes guardrails a governance layer for delegated access, especially where AI acts on behalf of users, service accounts, or workflows. Practitioners should treat agent scope as an access problem, not only an AI safety problem.

A question worth separating out:

Q: How do security teams know runtime AI guardrails are actually working?

A: Look for blocked poisoned inputs, flagged anomalous outputs, and traceable enforcement before responses reach users or downstream systems. If controls only inspect prompts or only inspect outputs, they leave a gap that attackers can exploit through manipulated data sources or tool responses.

👉 Read our full editorial: Enterprise AI guardrails are becoming runtime identity controls



   
ReplyQuote
Share: