TL;DR: Agentic AI performance does not improve simply by adding more agents, according to Holistic AI’s analysis of Google and MIT research across 180 experiments. The results show that application fit, coordination overhead, and observability determine whether multi-agent systems improve outcomes or become slower, costlier, and harder to govern.
Editorial analysis by NHI Mgmt Group, based on content published by Holistic AI: “Don’t Throw Good Agents After Bad: Smarter Agentic AI Deployment”.
By the numbers:
- Workloads that could take advantage of highly parallelized processing saw performance gains of up to 81% over a single-agent baseline.
- Tasks requiring step-by-step workflow saw performance degrade by up to 70% when split across multiple agents.
- Single agents averaged 67 successful tasks per 1,000 tokens, while centralized multi-agent systems managed just 21.
Key questions
Q: How should security teams govern multi-agent systems without slowing them down too much?
A: Use explicit checkpoints at decision boundaries rather than trying to inspect every token or every output.
Q: Why do multi-agent systems become harder to govern as they scale?
A: They become harder to govern because every added agent increases coordination, state sharing, and failure propagation.
Q: How do organisations know if agentic AI governance is actually working?
A: Look for three signals: access decisions tied to task context, complete audit records linking agents to datasets, and rapid revocation when scope changes.
Practitioner guidance
- Define workload fit before scaling agents Separate parallelisable tasks from step-by-step workflows and only expand agent count where decomposition does not break dependencies.
- Instrument runtime observability for agent workflows Capture agent-to-agent handoffs, tool calls, dependency chains, error propagation, and token consumption so governance can review actual behaviour.
- Map accountability paths for every agentic workflow Assign a named owner to each workflow and document which credentials, approvals, and escalation paths govern that workflow in production.
Bottom line: Agentic AI does not scale linearly, and multi-agent designs can quickly become slower or costlier when the task structure is sequential rather than parallel.
Explore further
View Full Forum → | NHI Foundation Course → | Our Services → | Read the full analysis →
Agentic AI scaling is now an observability problem before it is a capacity problem. The article shows that adding agents can improve parallel work but harm sequential tasks, which means scale is conditional rather than linear. For identity and governance teams, that shifts the control question from how many agents exist to how clearly their runtime behaviour can be seen and bounded. The practitioner conclusion is to govern agent growth by measurable workload fit, not deployment enthusiasm.
A few things that frame the scale:
- 69% of security leaders agree identity management must fundamentally shift to address agentic AI systems, according to the 2026 Infrastructure Identity Survey.
A question worth separating out:
Q: What happens when agents are added to workflows that are not parallelisable?
A: Performance often degrades because each step creates dependencies that the next step must inherit. In those cases, more agents increase handoffs, duplicate reasoning, and cost without improving outcomes. The practical failure is not just inefficiency but a workflow that becomes harder to explain, monitor, and trust.
👉 Read our full editorial: Agentic AI scaling depends on observability before more agents