Join our Newsletter — 33% off our NHI Course
Home› Glossary› AI Security› LLM Agent
AI Security

LLM Agent

← Back to Glossary
By NHI Mgmt Group Updated October 30, 2026 Domain: AI Security

An LLM agent is a language model system that can plan, choose tools, remember context, and carry out tasks with limited human intervention. It goes beyond text generation by connecting reasoning to actions, which makes governance, access control, and monitoring much more important than in a basic chatbot.

How LLM Agents Work

LLM agents are more than conversational interfaces because they can turn a model’s output into actions. That usually means chaining planning, tool selection, state tracking, and task execution, often across external systems. The security significance is not the text generation itself, but the authority the system acquires when it can act on behalf of a user or workflow.

This makes the term useful for understanding the boundary between a passive model and an operational system. Once an LLM can call APIs, write to memory, or trigger business processes, it becomes part of the control plane of the environment, not just a content engine.

Core Security Properties of LLM Agents

The main security properties are delegation, constraint, and observability. Delegation defines what the agent is allowed to do, constraint limits which tools, data, and actions it can reach, and observability shows what it actually did. If any of those three are weak, the agent can overreach even when the underlying model behaves as intended.

Memory is also a security boundary. Short-term context, long-term memory, scratchpads, and retained conversation state can all become attack surfaces if they store secrets, sensitive prompts, or untrusted instructions. Tool use creates the same problem at another layer, because every connected service becomes a possible path for misuse or abuse.

Governance, Access, and Monitoring Implications

Because an LLM agent can act, organisations need explicit rules for who can deploy it, what it may access, and how its actions are reviewed. The practical issue is not only model quality, but also whether the agent is allowed to reach sensitive systems, persist state, or reuse context in ways that create hidden side effects.

Governance becomes especially important when an agent is embedded in enterprise workflows. A secure deployment should treat tool permissions, connector scope, logging, and data handling as first-class design decisions, not post-launch adjustments. That is why Enterprise AI Copilot Security Guide is relevant for rollout planning, and why AI Infrastructure Workload Identity Guide matters when the agent runs as part of broader AI infrastructure.

Common Failure Modes and Trust Boundaries

LLM agents fail when instructions, context, permissions, and external tools are not cleanly separated. Prompt injection, memory poisoning, unsafe delegation, and overbroad tool access all exploit the same structural weakness: the system trusts content too readily and authority too broadly. In practice, the most serious failures happen when an attacker can turn a benign instruction channel into an action channel.

That is why agent security often depends on protecting the memory layer, the connector layer, and the execution layer at the same time. If one layer is exposed, the others may still be enough to produce harmful actions, data leakage, or unauthorised operational changes.

Risk and Threat Considerations

LLM agents materially expand attack surface because they combine language understanding with action authority. The risk is not just bad answers, but malicious steering of the agent into disclosure, abuse, or unintended execution through prompts, memory, connectors, or delegated credentials.

Failure mechanism: Attackers can poison context, manipulate tool selection, or abuse over-permissive connectors so the agent performs actions or reveals data it should not. Compromise often becomes easier when the agent has persistent memory, broad workflow access, or reusable credentials.

Impact: The result can be data exposure, fraudulent actions, privilege abuse, lateral movement, or automation of offensive workflows at scale. In agentic systems, a single trust failure can cascade into repeated actions across multiple tools and sessions.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

OWASP Agentic AI Top 10 addresses the attack and risk surface, while NIST AI 600-1 and NIST SP 800-53 Rev 5 set the governance and control requirements practitioners need to meet.

FrameworkControl / ReferenceRelevance
OWASP Agentic AI Top 10ASI03 — Identity & Privilege AbuseLLM agents act with delegated authority and tool access.
ASI02 — Tool MisuseThe term centers on agents choosing and invoking tools at runtime.
ASI06 — Memory & Context PoisoningAgent memory and context are explicit parts of the subject.
Recommendation — Limit agent permissions and review every delegated action path. Constrain tool access and validate each tool invocation against policy. Isolate retained context and prevent untrusted writes into agent memory.
NIST AI 600-1Generative AI Risk Management ProfileProvides governance and testing guidance for generative AI systems that act via tools.
Recommendation — Apply GenAI governance, testing, and disclosure practices before enabling agent actions.
NIST SP 800-53 Rev 5AC-6 — Least PrivilegeAgent permissions and tool reach are core to safe deployment.
Recommendation — Apply least privilege to every agent action, connector, and service account.

Practitioner Guidance

Why practitioners should care: Treat the agent as an operational actor, not just a model endpoint. That means every connected tool, retained memory store, and execution permission should be deliberately scoped and reviewed before release.

Common misunderstanding: A useful model response does not mean the agent is safe to deploy. Many failures appear only after tool use, because the real risk emerges when reasoning is coupled to external authority.

Practitioner takeaway: The safest LLM agents are the ones whose actions can be limited, logged, and explained after the fact, even when the model’s reasoning is imperfect.

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.

NHIMG Editorial Note
Reviewed and updated by the NHIMG editorial team on October 30, 2026.
NHI Mgmt Group — the #1 independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org