Join our Newsletter — 33% off our NHI Course

AI agent failure in production: what controls are missing?

 

(@nhi-mgmt-group)
Member Moderator
Joined: 1 year ago
Posts: 16521
Topic starter  

TL;DR: AI agents fail in production 70% to 95% of the time, with performance falling further in repeated runs and multi-agent chains, according to Fiddler's analysis of benchmark and enterprise data. The governance challenge is no longer whether agents can demo well, but whether organisations can constrain scope, verify outputs, and audit actions before failures cascade into business damage.

Editorial analysis by NHI Mgmt Group, based on content published by Fiddler: “AI Agent Failure Rate: Why 70-95% Fail in Production”.

Key questions

Q: What breaks when AI agents move from demos into production workflows?

A: The demo-to-production jump breaks the assumptions behind curated data, narrow paths, and human supervision.

Q: Why do multi-agent workflows increase access control risk in production systems?

A: Multi-agent workflows increase risk because one request can fan out into many actions across tools, systems, and sub-agents before a human reviews the outcome.

Q: How do you know if an AI agent is failing in ways that matter operationally?

A: Look for retry loops, duplicate actions, unexpected tool calls, context loss, output drift, and cost spikes that do not match workload volume.

Practitioner guidance

  • Define human-in-the-loop checkpoints for high-stakes actions Require manual approval for irreversible operations such as deletions, financial transactions, customer record changes, and external communications that carry regulatory or reputational risk.
  • Scope agent permissions to task-specific least privilege Give each agent only the tools, data, and write actions required for one workflow, and separate read from write access wherever possible.
  • Instrument span-level tracing across every agent workflow Capture prompts, tool calls, retry loops, output checks, and handoffs so platform, security, and compliance teams can reconstruct failures quickly.

Bottom line: AI agents that succeed in controlled demos can still fail badly once they enter real workflows with live tools, messy state, and concurrent users.

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 5 months ago
Posts: 17012
 

The central control gap is not model intelligence but delegated execution without sufficient governance. Production failures expose that many programmes still assume a capable agent will behave like a supervised workflow step. Once the agent can act across tools, that assumption collapses and access control becomes inseparable from reliability. Practitioners should govern agents as active runtime identities, not as passive software features.

A few things that frame the scale:

  • Gartner predicts that more than 40% of agentic AI projects will be cancelled by the end of 2027, citing rising costs, unclear value and insufficient risk controls.

A question worth separating out:

Q: Should organisations keep humans in the loop for risky agent actions?

A: Yes, when the action is irreversible, financially material, or hard to unwind. Human review is the right control where a single wrong decision can create compliance, customer, or recovery costs that exceed the automation benefit. Full autonomy should be earned only after the workflow proves stable under real conditions.

👉 Read our full editorial: AI agent failure rates expose the governance gap in production



   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.