Subscribe to the Non-Human & AI Identity Journal

How can organisations tell whether AI governance is working?

They should look for continuous discovery coverage, real-time classification decisions, and evidence that prompts and responses are being inspected during the session. If controls only appear in policy documents or periodic reviews, the programme is tracking intent rather than control performance. Working governance leaves an operational trail, not just a compliance statement.

Why This Matters for Security Teams

ai governance is only working if it changes what happens at runtime. Policy language, model review boards, and quarterly attestations can all look mature while the underlying system still grants broad access, accepts unsafe prompts, or executes uninspected tool calls. That gap is especially visible in agentic environments, where autonomous workflows can chain actions faster than a human reviewer can intervene. Current guidance from the NIST AI Risk Management Framework is useful here because it treats governance as a lifecycle discipline, not a document set.

The operational question is whether controls produce evidence: discovery of AI systems, classification of their data and tools, approval of sensitive actions, and review of prompts and outputs while the session is still live. NHI teams should also look at whether governance spans the full identity chain described in Ultimate Guide to NHIs — Lifecycle Processes for Managing NHIs, because identity scope and credential handling are usually where governance first becomes measurable. In practice, many security teams encounter AI governance failure only after an over-privileged system has already acted, rather than through intentional control testing.

How It Works in Practice

Working governance shows up as a control loop. Discovery tools identify which AI systems, agents, models, and connected Top 10 NHI Issues are in use. Classification then tags each workload by sensitivity, owner, permitted tools, and data exposure. At execution time, the policy engine checks context, not just role. That means the system asks what the agent is trying to do, which resources it is touching, and whether the action fits the current trust posture.

For autonomous or goal-driven workloads, static RBAC is usually too coarse because an agent’s behaviour is dynamic. Better practice is emerging around intent-based authorisation, JIT credential issuance, and short-lived workload identity. A session should use cryptographic proof of the workload, not shared secrets that remain valid for months. That is consistent with the direction of NIST AI Risk Management Framework, NIST AI 600-1 Generative AI Profile, and agentic guidance such as NIST AI 600-1 GenAI Profile.

  • Use runtime checks for prompts, tool calls, and responses, not just pre-approval.
  • Issue short-lived credentials per task and revoke them on completion.
  • Log every high-risk decision with enough context to explain why it was allowed or blocked.
  • Review agent output against policy as the session runs, not after the fact.

Where this becomes visible in incident response is credential abuse and secret sprawl, a pattern also discussed in the DeepSeek breach material and in broader secret-exposure reporting. These controls tend to break down when agents are allowed to reuse long-lived static credentials across many tools, because revocation and attribution become too slow to keep pace with autonomous action.

Common Variations and Edge Cases

Tighter runtime control often increases friction, so organisations have to balance safety against developer and operator velocity. There is no universal standard for this yet, especially for multi-agent systems, but current guidance suggests treating autonomy level as the main driver of control strength rather than applying one policy to every model or workflow. That is the practical difference between a simple assistant and an agent that can authenticate, retrieve data, and trigger changes on its own.

Some environments, such as embedded automation, CI/CD assistants, or infrastructure agents, need especially strong separation between human approval and machine execution. In those settings, workload identity, ephemeral secrets, and policy-as-code are usually more reliable than manual review gates. The NIST Cybersecurity Framework 2.0 helps teams express this as continuous monitoring and response, while NIST AI Risk Management Framework keeps the focus on measurable risk outcomes.

AI governance also fails differently when the organisation only audits models but does not govern the surrounding identity fabric. If prompts are reviewed but the agent can still call privileged APIs, governance is partial at best. The Ultimate Guide to NHIs — Regulatory and Audit Perspectives is useful here because auditability depends on whether the system can prove who or what acted, under which policy, and with what credential lifetime.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

OWASP Agentic AI Top 10 and CSA MAESTRO address the attack and risk surface, while NIST AI RMF set the governance and control requirements practitioners need to meet.

Framework Control / Reference Relevance
OWASP Agentic AI Top 10 A01 Agentic AI risks center on unsafe autonomy and tool use.
CSA MAESTRO GOV-01 MAESTRO emphasizes governance, monitoring, and policy enforcement for agents.
NIST AI RMF AI RMF frames governance as continuous, measurable risk management.

Build continuous discovery, evaluation, and escalation into the AI governance lifecycle.