Cloudflare AI Gateway: what changes when agents enter the stack?

TL;DR: Cloudflare AI Gateway handles edge concerns such as caching, rate limits, failover, and token logging, but it does not see the calling user, the tools an agent invokes, or the MCP server behind the request, according to Archestra. That separation matters because agent-layer identity and tool governance are a different control problem altogether.

Editorial analysis by NHI Mgmt Group, based on content published by Archestra: “Cloudflare AI Gateway + Archestra”.

Key questions

Q: What breaks when AI gateways are treated as the source of trust for agents?

A: Trust collapses because gateways can inspect traffic, but they cannot prove who the agent is, who authorized it, or whether the action is permitted at that moment.

Q: Why do agent systems need a different authorisation model than chat apps?

A: Chat apps usually need request-level protection, while agent systems need action-level protection because the runtime can choose tools and sequence work on behalf of a user.

Q: How do security teams know if agent governance is actually working?

A: It is working only if the team can answer three questions quickly for any agent: what it can reach, what it did recently, and whether that behaviour matches intent.

Practitioner guidance

• Define the edge boundary precisely Use the gateway for caching, rate limits, failover, and provider routing, but do not treat it as the control point for agent actions or tool authorisation.
• Bind agent actions to a real user identity Require the runtime to resolve the signed-in user before model calls and tool calls, then record that identity in the audit trail.
• Separate tool access from model access Put policy around which tools an agent can invoke, which MCP servers it can reach, and which actions require per-user delegation.

Bottom line: The central issue is not whether an AI gateway works, but whether it can govern delegated action once an agent starts using tools.

Explore further

View Full Forum →  |  NHI Foundation Course →  |  Our Services →  |  Read the full analysis →