Subscribe to the Non-Human & AI Identity Journal

Notifications
Clear all

AI risk management for agents: are your controls keeping up?


(@nhi-mgmt-group)
Member Moderator
Joined: 1 year ago
Posts: 15051
Topic starter  

TL;DR: AI systems now face prompt injection, data poisoning, leakage, and autonomous tool abuse, and Akto’s guide argues that traditional IT risk methods are too static for agentic environments. The real shift is that AI governance now depends on continuous monitoring, adversarial testing, and identity-aware access control, not just pre-launch review.

NHIMG editorial — based on content published by Akto: AI Risk Management Framework: Components, Risks and Implementation Guide

By the numbers:

Questions worth separating out

Q: How should security teams govern AI models that can call tools and access data?

A: Security teams should govern AI models as non-human identities with named owners, limited scope, short-lived credentials, and continuous authorization.

Q: Why do AI agents create a different access-risk profile than traditional applications?

A: AI agents can chain actions, call multiple tools, and change behaviour based on context, so one credential can enable more than one operational path.

Q: What do teams get wrong about AI guardrails and identity controls?

A: They often assume a content filter is a substitute for access governance.

Practitioner guidance

What's in the full article

Akto's full blog covers the operational detail this post intentionally leaves for the source:

  • Step-by-step AI inventory and classification workflow for LLMs, RAG pipelines, and agentic features.
  • Practical examples of prompt injection testing, red teaming, and guardrail placement across AI workflows.
  • Monitoring and audit-readiness guidance for tracking inputs, outputs, policy violations, and abnormal model behaviour.
  • Framework comparisons across NIST AI RMF, ISO/IEC 42001, and OECD AI Principles for programme owners.

👉 Read Akto's guide to AI risk management frameworks for agentic systems →

AI risk management for agents: are your controls keeping up?

Explore further

View Full Forum →  |  NHI Foundation Course →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 3 months ago
Posts: 14635
 

AI risk management has become an identity governance problem as much as a model risk problem. Once an AI system can authenticate to services, call tools, and take actions, it behaves like a non-human identity with its own lifecycle and privilege profile. That is why conventional application testing is insufficient on its own. IAM and PAM teams need to treat agents as governed actors, not just software features. The practical conclusion is that AI security programmes must inherit identity controls, not sit beside them.

A question worth separating out:

Q: Who is accountable when an AI system moves data outside policy?

A: Accountability should sit with the team that owns the AI workflow, the data it touches, and the credentials that enable it. If governance stops at authentication, ownership becomes blurred. Clear accountability means mapping the data path, the action scope, and the approving function before deployment.

👉 Read our full editorial: AI risk management now needs identity-aware controls for agentic systems



   
ReplyQuote
Share: