Subscribe to the Non-Human & AI Identity Journal

How should organisations audit AI use that happens outside approved tools?

Start by discovering sanctioned and unsanctioned AI across endpoints, SaaS apps, developer environments, and agent workflows. Then tie each interaction to a user or system identity, record intent, and preserve the enforcement decision. If you cannot define scope, you cannot produce audit evidence that will survive regulator scrutiny.

Why This Matters for Security Teams

Unapproved AI use is not just an acceptable-use problem. It creates a blind spot in identity, data handling, and enforcement evidence. Once staff paste prompts into shadow tools, browser extensions, local notebooks, or agent workflows, the organisation can lose the chain of custody needed for investigation, legal review, and regulatory response. NHI Management Group’s Ultimate Guide to NHIs — Regulatory and Audit Perspectives frames this as an auditability issue: if the interaction cannot be tied to a person, workload, or agent identity, it is functionally unauditable. That is especially true when AI systems touch secrets, code, customer data, or downstream automation.

Current guidance also aligns with NIST Cybersecurity Framework 2.0, which emphasises governance, detection, and response, but organisations often stop at app blocking and miss the harder requirement: proving what happened, who caused it, and what the system did with that request. In practice, many security teams encounter the evidence gap only after a leak, policy breach, or model abuse has already occurred, rather than through intentional monitoring.

How It Works in Practice

Effective audit design starts by treating AI activity as an identity event, not just an application event. Discovery should cover sanctioned chat tools, IDE assistants, browser plugins, SaaS copilots, MCP-connected services, and agent workflows that can act autonomously. The goal is to capture the full path from user or workload identity to prompt, tool call, data access, and enforcement outcome. That record should show whether the request was allowed, denied, stepped up for approval, or routed through JIT credentials.

For agentic environments, static RBAC alone is rarely enough. Agents do not behave like fixed-role humans, so audit controls need runtime context: task intent, data sensitivity, target system, and whether the action fits policy. This is where workload identity, ephemeral secrets, and real-time policy evaluation matter. A practical audit trail usually includes:

  • who initiated the action, including human, service, or agent identity
  • what model, tool, or connector was invoked
  • what data classes were exposed or transformed
  • which policy decided the outcome
  • whether credentials were short-lived, scoped, and revoked after use

That approach matches the direction of Top 10 NHI Issues and is consistent with the governance expectations in NIST Cybersecurity Framework 2.0. It also benefits from referencing the incident patterns discussed in DeepSeek breach, where exposed secrets and uncontrolled data paths showed how quickly AI misuse becomes an identity and audit problem. These controls tend to break down in unmanaged developer laptops and ad hoc browser-based AI use because local sessions and copied tokens escape central logging.

Common Variations and Edge Cases

Tighter monitoring often increases friction for developers and knowledge workers, requiring organisations to balance audit depth against workflow disruption. That tradeoff becomes sharper when teams use personal accounts, local models, or file-based prompts where central controls cannot see the interaction. Current guidance suggests organisations should prioritise controls that preserve evidence without creating false trust in complete visibility; there is no universal standard for this yet.

One common edge case is the autonomous agent with delegated access. In that setting, the question is not whether a person approved one prompt, but whether the agent should be allowed to chain actions across systems. Best practice is evolving toward intent-based authorisation, where policy is checked at request time against task context rather than a static entitlement set. Another edge case is secrets exposure through code assistants or plugins. The JetBrains GitHub plugin token exposure case shows why audit logs should capture secret access, not only user text. For deeper remediation patterns, NHI Management Group’s NHI Lifecycle Management Guide is useful when organisations need to map discovery, review, and revocation into a repeatable process.

For AI-driven workflows, align the audit programme with NIST Cybersecurity Framework 2.0, but also recognise that agentic risk needs specialist frameworks such as OWASP-AGENTIC, CSA-MAESTRO, and NIST-AIRMF. That is the practical path for proving what an AI did when the action originated outside approved tools and moved faster than human review.

Standards & Framework Alignment

This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.

OWASP Agentic AI Top 10 and CSA MAESTRO address the attack and risk surface, while NIST AI RMF set the governance and control requirements practitioners need to meet.

Framework Control / Reference Relevance
OWASP Agentic AI Top 10 A1 Agentic AI abuse and uncontrolled tool use require runtime authorization and traceability.
CSA MAESTRO M1 MAESTRO addresses governance for autonomous agents and their delegated actions.
NIST AI RMF AI RMF governs accountability, transparency, and monitoring for AI systems.

Build evidence capture into AI governance so every action is explainable and reviewable.