TL;DR: Enterprises evaluating trustworthy AI now face three complementary frameworks, with MITRE AI Assurance focused on technical assurance, NIST AI RMF on enterprise risk governance, and CSA AICM on control implementation, according to Cyera. The practical issue is not choosing one framework, but sequencing them so governance, controls, and testing reinforce each other.
At a glance
What this is: This is an independent comparison of three AI governance frameworks and the key finding is that they work best as a layered programme rather than as substitutes.
Why it matters: It matters because IAM, security, and governance teams need a shared model for AI risk, control design, and assurance across human, NHI, and autonomous workflows.
👉 Read Cyera's comparison of MITRE AI Assurance, NIST AI RMF and CSA AICM
Context
Trustworthy AI security is a governance problem before it is a tooling problem. As AI systems move deeper into enterprise operations, organisations need controls that address data integrity, access, provenance, explainability, and monitoring across the full lifecycle of the system.
For identity teams, the important question is which framework answers which layer of the risk stack. NIST AI RMF frames enterprise governance, CSA AICM translates intent into controls, and MITRE AI Assurance helps test whether those controls hold under realistic abuse conditions.
Key questions
Q: How should organisations structure AI governance across risk, controls, and testing?
A: Use a layered model. Start with an enterprise risk framework to define accountability and acceptable harm, translate those requirements into technical and procedural controls, then challenge the system with adversarial testing to see whether the controls hold under realistic conditions.
Q: Why do AI systems need data security in addition to model security?
A: Because most AI failures begin in the data path. If inputs are poisoned, poorly classified, untraceable, or overexposed, the model can produce unsafe or unreliable outcomes even when the model code itself has not changed.
Q: How do security teams know whether AI assurance is actually working?
A: Look for evidence that controls are mapped to real data flows, that ownership exists for each control, and that red-team or testing results can prove resilience under manipulation. A policy without failure testing is not assurance.
Q: What is the difference between AI governance and AI assurance?
A: AI governance defines who is responsible, what risk is acceptable, and how oversight works. AI assurance proves whether the system actually behaves within those boundaries through testing, validation, and operational evidence.
Technical breakdown
How MITRE AI Assurance supports technical testing
The MITRE AI Assurance Guide is built for assurance work at the system boundary. It focuses on robustness, resilience, verifiability, and adversarial testing, with heavy emphasis on data integrity and input manipulation because those are common ways AI behaviour degrades. In practice, this means red teams and testers are looking for failures in training data, prompts, pipelines, and runtime inputs rather than treating the model as a static asset. Its value is strongest when an organisation already knows what it is trying to prove about the system and needs a repeatable way to challenge that claim.
Practical implication: use MITRE-style testing to validate whether AI controls survive real adversarial conditions, not just policy review.
NIST AI RMF for enterprise AI risk governance
NIST AI RMF is the strategic layer that defines how an organisation should understand and govern AI risk. Its four functions, Map, Measure, Manage, and Govern, push teams to identify affected stakeholders, assess harm, set oversight structures, and embed accountability into operating models. The framework is especially relevant where AI depends on sensitive data, because it treats privacy, access, quality, and lifecycle management as governance issues rather than isolated technical concerns. That makes it the right starting point for enterprise ownership, policy design, and cross-functional risk decisions.
Practical implication: anchor AI governance in NIST AI RMF so ownership, risk appetite, and measurement are defined before control selection.
CSA AICM and control design for AI systems
CSA AICM is the most implementation-oriented of the three frameworks. It translates AI risk into a control catalogue spanning data classification, discovery, lineage, access controls, integrity validation, deployment, and third-party integration. That makes it useful for teams that need to move from governance statements to enforceable safeguards. The framework matters because AI systems are not only models, they are data pipelines, execution environments, and integration surfaces. The control question is therefore broader than model safety and includes who can feed, change, query, or exfiltrate the data and outputs that shape AI behaviour.
Practical implication: map AICM controls to the AI data path, then validate that each control has an owner, an audit trail, and a test.
Threat narrative
Attacker objective: The objective is to degrade trust in AI outputs while turning input weaknesses into operational harm, exposure, or abuse.
- Entry begins when an attacker or unsafe workflow influences the AI system through poisoned data, manipulated prompts, or compromised input channels.
- Escalation occurs when weak validation lets the model consume untrusted data, amplifying harmful instructions, leakage, or misclassification into the output layer.
- Impact follows when those outputs are trusted operationally, allowing bad decisions, disclosure, or downstream action in business processes.
Breaches seen in the wild
- DeepSeek breach — DeepSeek breach exposed 1M+ log lines and sensitive secret keys.
- LiteLLM PyPI package breach — LiteLLM PyPI supply chain attack, credentials stolen from users.
Read our 52 NHI Breaches Analysis report for a comprehensive view of breaches impacting Non-Human Identities including AI Agents.
NHI Mgmt Group analysis
These frameworks are complementary, not competing. AI governance breaks down when teams treat strategic risk management, technical assurance, and operational controls as substitutes. NIST AI RMF, CSA AICM, and MITRE AI Assurance each answer a different question about the same system. The practitioner conclusion is to sequence them as governance, controls, then testing.
Data security is the connective tissue across trustworthy AI. The article correctly places data integrity, provenance, access, and lifecycle management at the centre of AI assurance. That aligns with the reality that AI failures often begin long before model inference, in the quality and control of the inputs the system consumes. The practitioner implication is that AI security programmes must own the data path, not only the model.
AI governance cannot stop at policy statements. NIST AI RMF is valuable because it creates enterprise structure, but structure alone does not prove systems behave safely under pressure. MITRE-style assurance and CSA-style controls close the gap between intent and operation. The practitioner conclusion is that AI programmes need measurable controls and adversarial validation, not just a governance charter.
AI data lineage gap: When organisations cannot trace where AI inputs came from, who changed them, or which systems reused them, trust becomes unverifiable. That is not a documentation issue alone, it is a governance failure that spreads across security, compliance, and model reliability. The practitioner implication is to treat lineage as an assurance control, not a reporting artefact.
Identity governance will increasingly intersect with AI assurance. As AI systems pull from shared data stores, APIs, and third-party integrations, access control and accountability become part of model trust. That means IAM, NHI governance, and AI risk teams need a common view of who and what can influence AI behaviour. The practitioner conclusion is that AI assurance is becoming an identity problem as much as a model problem.
From our research:
- The average estimated time to remediate a leaked secret is 27 days, despite 75% of organisations expressing strong confidence in their secrets management capabilities, according to The State of Secrets in AppSec.
- Only 44% of developers are reported to follow security best practices for secrets management, exposing a significant developer behaviour gap, according to GitGuardian and CyberArk.
- That gap is why Top 10 NHI Issues is the better next step for teams mapping control failure to identity risk.
What this signals
AI data lineage gap: If AI inputs cannot be traced end to end, the resulting trust problem is not just technical, it is organisational. Security leaders should expect AI assurance demands to pull IAM, data governance, and model oversight into the same control conversation, especially where shared service accounts and broad API access influence outputs.
The practical signal is that AI programmes will increasingly be judged on evidence, not intention. A governance framework can define accountability, but only control telemetry and testing can show whether access, provenance, and integrity are actually enforced across the AI stack.
As AI systems adopt more third-party connectors and automation, identity controls around tokens, service accounts, and delegation chains become part of model risk. Teams that already struggle with secrets sprawl should treat AI assurance as an extension of NHI governance, not a separate initiative.
For practitioners
- Sequence AI governance by layer Start with an enterprise risk model, translate it into enforceable controls, then validate those controls with adversarial testing. This keeps policy, implementation, and assurance aligned instead of scattered across separate teams.
- Map controls to the AI data path Inventory where AI systems ingest, transform, store, and expose data, then attach owners and audit evidence to each stage. Focus on provenance, classification, access, and integrity checks rather than model output alone.
- Test for input manipulation and provenance failure Red team the prompts, datasets, connectors, and training inputs that can alter AI behaviour. Use failure findings to prove whether validation, monitoring, and approval gates actually work under abuse.
- Align IAM and NHI governance with AI oversight Review which service accounts, tokens, and integrations can influence AI systems without clear accountability. Where shared credentials or broad API access exist, require explicit ownership and review trails before expansion.
Key takeaways
- Trustworthy AI depends on governance, controls, and testing working together, not on any one framework in isolation.
- Data security is central to AI assurance because provenance, integrity, and access determine whether model outputs can be trusted.
- IAM and NHI teams should expect AI assurance to become part of identity governance as connectors, tokens, and service accounts shape AI behaviour.
Standards & Framework Alignment
This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.
OWASP Agentic AI Top 10 and CSA MAESTRO address the attack and risk surface, while NIST AI RMF set the governance and control requirements practitioners need to meet.
| Framework | Control / Reference | Relevance |
|---|---|---|
| NIST AI RMF | The article centres enterprise AI risk governance and oversight. | |
| OWASP Agentic AI Top 10 | Adversarial input handling and runtime trust are relevant to AI systems with tool use. | |
| CSA MAESTRO | The control model for AI systems matches the article's implementation focus. |
Translate AI risk into operational safeguards across data, deployment, and integration layers.
Key terms
- AI assurance: AI assurance is the practice of proving that an AI system behaves as intended under normal and adversarial conditions. It combines validation, testing, monitoring, and evidence gathering so organisations can move from policy claims to measurable trust.
- AI control management: AI control management is the discipline of turning AI risk requirements into concrete safeguards across data, models, integrations, and operations. It covers who can influence the system, how inputs are validated, and what evidence exists when something goes wrong.
- Data provenance: Data provenance is the ability to trace where data came from, how it changed, and which systems used it. In AI governance, provenance is essential because untrusted or unknown inputs can corrupt model behaviour, undermine reliability, and weaken accountability.
- Input manipulation: Input manipulation is the act of altering the prompts, data, or signals that an AI system consumes so it behaves in an unintended way. It is a core assurance concern because many AI failures begin at the point where untrusted inputs enter the pipeline.
Deepen your knowledge
AI governance and control validation are covered in our NHI Foundation Level course, the industry's only accredited NHI security programme. If you are extending identity governance into AI systems, it is worth exploring.
This post draws on content published by Cyera: Building Trustworthy AI, comparing the MITRE AI Assurance Guide, NIST AI RMF, and CSA AICM. Read the original.
Published by the NHIMG editorial team on 2025-07-02.
NHI Mgmt Group — the independent authority on Non-Human Identity, IAM, and Agentic AI security. nhimg.org