Join our Newsletter — 33% off our NHI Course

Agentic AI scaling: are observability and governance keeping up?

 

(@nhi-mgmt-group)
Member Moderator
Joined: 1 year ago
Posts: 16497
Topic starter  

TL;DR: Agentic AI performance does not improve simply by adding more agents, according to Holistic AI’s analysis of Google and MIT research across 180 experiments. The results show that application fit, coordination overhead, and observability determine whether multi-agent systems improve outcomes or become slower, costlier, and harder to govern.

Editorial analysis by NHI Mgmt Group, based on content published by Holistic AI: “Don’t Throw Good Agents After Bad: Smarter Agentic AI Deployment”.

By the numbers:

  • Workloads that could take advantage of highly parallelized processing saw performance gains of up to 81% over a single-agent baseline.
  • Tasks requiring step-by-step workflow saw performance degrade by up to 70% when split across multiple agents.
  • Single agents averaged 67 successful tasks per 1,000 tokens, while centralized multi-agent systems managed just 21.

Key questions

Q: How should security teams govern multi-agent systems without slowing them down too much?

A: Use explicit checkpoints at decision boundaries rather than trying to inspect every token or every output.

Q: Why do multi-agent systems become harder to govern as they scale?

A: They become harder to govern because every added agent increases coordination, state sharing, and failure propagation.

Q: How do organisations know if agentic AI governance is actually working?

A: Look for three signals: access decisions tied to task context, complete audit records linking agents to datasets, and rapid revocation when scope changes.

Practitioner guidance

  • Define workload fit before scaling agents Separate parallelisable tasks from step-by-step workflows and only expand agent count where decomposition does not break dependencies.
  • Instrument runtime observability for agent workflows Capture agent-to-agent handoffs, tool calls, dependency chains, error propagation, and token consumption so governance can review actual behaviour.
  • Map accountability paths for every agentic workflow Assign a named owner to each workflow and document which credentials, approvals, and escalation paths govern that workflow in production.

Bottom line: Agentic AI does not scale linearly, and multi-agent designs can quickly become slower or costlier when the task structure is sequential rather than parallel.

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →



   
Quote
(@mr-nhi)
Member Moderator
Joined: 5 months ago
Posts: 16988
 

Agentic AI scaling is now an observability problem before it is a capacity problem. The article shows that adding agents can improve parallel work but harm sequential tasks, which means scale is conditional rather than linear. For identity and governance teams, that shifts the control question from how many agents exist to how clearly their runtime behaviour can be seen and bounded. The practitioner conclusion is to govern agent growth by measurable workload fit, not deployment enthusiasm.

A few things that frame the scale:

A question worth separating out:

Q: What happens when agents are added to workflows that are not parallelisable?

A: Performance often degrades because each step creates dependencies that the next step must inherit. In those cases, more agents increase handoffs, duplicate reasoning, and cost without improving outcomes. The practical failure is not just inefficiency but a workflow that becomes harder to explain, monitor, and trust.

👉 Read our full editorial: Agentic AI scaling depends on observability before more agents



   
ReplyQuote
Share:

Free weekly newsletter

Subscribe to the NHI & AI Identity Journal

The latest on NHI and Agentic AI security – articles, research, breaches, news and events every week.

Bonus 33% off our NHI Course when you subscribe.