Join our Newsletter — 33% off our NHI Course

Agentic AI threat modeling: are your runtime controls keeping up?

 

(@nhi-mgmt-group)
Member Moderator
Joined: 2 years ago
Posts: 19262
Topic starter  

TL;DR: AI threat modeling for agentic systems must account for prompt injection, unsafe tool use, poisoned retrieval data, excessive agency, and unauthorized access to sensitive systems because behaviour changes at runtime, according to Lasso Security. The practical shift is from static architecture review to continuous modelling of identity, permissions, trust boundaries, and tool-use paths before agents become embedded in business workflows.

Editorial analysis by NHI Mgmt Group, based on content published by Lasso Security: “How to Build an AI Threat Modeling Process for Agentic Systems”.

Key questions

Q: What breaks when AI agents are not governed at runtime?

A: Without runtime governance, an agent can shift behaviour after provisioning and still execute actions that were never reviewed in context.

Q: Why do agentic AI workflows create more risk than browser-based chat prompts?

A: Browser prompts are discrete interactions, but agentic workflows can chain tool calls, access data sources, and trigger follow-on actions.

Q: What are the signs that an AI agent workflow is failing governance or operating outside its intended scope?

A: Common warning signs include agents issuing queries that touch data they do not need, calling tools outside the approved workflow, producing outputs that do not match the user request, or making repeated autonomous actions without review.

Practitioner guidance

  • Inventory every agent, tool, and MCP connection Capture each GenAI component in scope, what it can access, which systems it touches, and whether it can only answer or can also act.
  • Scope agent permissions to the minimum task requirement Separate read, write, approval, and external communication capabilities so an agent cannot inherit broad access simply because it is useful in one workflow.
  • Map trust boundaries across prompts, retrieval, and tool calls Document where untrusted content enters the workflow, where tool output changes later decisions, and where a higher-privilege system can be reached.

Bottom line: Agentic AI changes the security problem because the system can decide, act, and cross trust boundaries at runtime rather than following fixed application logic.

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 6 months ago
Posts: 19752
 

Runtime control is the real trust boundary for agentic AI. Static architecture diagrams are useful, but they do not govern what an agent does after it starts reasoning over context and calling tools. In practice, the trust boundary moves to the point where instructions, retrieved data, and tool permissions meet. Practitioners should treat runtime policy enforcement as part of the threat model, not as an afterthought.

A few things that frame the scale:

A question worth separating out:

Q: Should organisations use agentic AI threat modeling before production deployment?

A: Yes. The article’s logic supports modelling agents before they are embedded in business-critical workflows, because once they can access records, update tickets, or trigger actions, mistakes become operational incidents rather than architecture issues.

👉 Read our full editorial: AI threat modeling for agentic systems needs runtime controls



   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.