Use multiple zones to model physical connectivity, such as clusters, regions, clouds, or data centres where direct proxy-to-proxy communication is constrained. Use multiple meshes when you need logical isolation for teams, applications, or security domains. The two are independent, so architects should combine them when physical topology and policy separation are both required.
Why the choice is really about topology plus policy
Platform teams should treat multiple zones and multiple meshes as two different design axes. Zones describe where traffic can move in the physical or network sense, while meshes describe where policy, trust, and operational ownership should be separated. The right answer is usually not either-or, because the deployment may need both transport constraints and organisational boundaries at the same time.
The practical question is whether the deployment problem is driven by network reachability or by control boundaries. If the main concern is that proxy-to-proxy communication is limited across clusters, regions, clouds, or data centres, zones are the natural construct. If the main concern is that teams or applications must not share the same control plane, policy scope, or trust domain, separate meshes are the better fit.
That distinction matters because a service mesh can hide transport complexity without solving governance problems. A single mesh may be convenient, but it can also collapse distinct policy needs into one shared operational model. Multiple meshes preserve stronger separation, while multiple zones preserve realistic topology modeling and cross-environment routing constraints.
When multiple zones are the better abstraction
Use multiple zones when the deployment needs to represent real connectivity boundaries. This is common when the same mesh spans clusters or infrastructure locations where latency, routing, firewall policy, or proxy reachability differs materially. In that case, zones help the mesh understand where traffic can be placed and how it should fail over without pretending every component is equally adjacent.
Zones are especially useful when the underlying environment has asymmetric connectivity. For example, a workload may be reachable inside one cluster but only indirectly reachable from another region. Modeling that as zones makes the mesh’s routing and failover behaviour line up with the actual network rather than with an idealised flat fabric.
Multiple zones also help when the same application must run across several physical domains but keep a shared operational model. The mesh can still present one logical service view while acknowledging that the data plane is distributed across separate environments. That gives platform teams a way to express topology without forcing a separate policy boundary where none is needed.
When multiple meshes are the better abstraction
Use multiple meshes when separation is the primary requirement. This is the right choice when different teams need independent lifecycle management, when applications have incompatible policy needs, or when security domains must not share the same trust and configuration surface. In those cases, a single mesh creates unnecessary coupling even if the traffic path is technically shared.
Multiple meshes are also a cleaner fit when the organization needs different operational cadences. One mesh may serve production services with strict change control, while another serves lower-risk workloads, experimental services, or a different business unit. The separation reduces the blast radius of policy mistakes and avoids one set of governance decisions being imposed on unrelated platforms.
The cost is duplication. Multiple meshes usually mean more control planes, more policy coordination, and more care around inter-mesh communication. That overhead is justified when the separation itself is the requirement, but it is inefficient if teams only want different routing rules inside the same trust boundary.
How to combine them without overengineering
Most mature deployments end up using both concepts together. A common pattern is multiple zones inside one mesh when the primary challenge is distributed infrastructure, or multiple meshes across several zones when the primary challenge is isolation plus geography. The design question is not which label sounds more advanced, but which boundary is actually doing the work.
Platform teams should start by mapping the failure domain, then the policy domain. If the boundary is about network reality, choose zones first. If the boundary is about ownership, trust, or exposure, choose meshes first. When both are true, keep them separate in the design so each one solves only the problem it is meant to solve.
For deeper context on workload identity and mesh trust boundaries, see Guide to SPIFFE and SPIRE. For the underlying zero trust model that often shapes these decisions, see NIST SP 800-207 Zero Trust Architecture.
Risk and Threat Considerations
The main failure mode is treating a topology boundary and a trust boundary as interchangeable. If teams use zones when they actually need isolation, policy changes in one area can affect unrelated workloads. If they use multiple meshes when simple distributed routing would suffice, they increase operational complexity and create more places for misconfiguration or drift.
Failure mechanism: Conflating physical reachability with logical separation leads to either under-segmentation, where unrelated workloads share the same policy surface, or over-segmentation, where mesh sprawl creates inconsistent controls and harder troubleshooting.
Impact: Under-segmentation raises blast radius and cross-team exposure, while over-segmentation increases control-plane overhead, policy drift, and the chance that traffic breaks in ways operators only discover during incidents.
Standards & Framework Alignment
This section maps relevant standards and security frameworks to the operational risks and controls described in this guidance.
NIST SP 800-53 Rev 5, NIST Zero Trust (SP 800-207) and CIS Controls v8 set the governance and control requirements practitioners need to meet.
| Framework | Control / Reference | Relevance |
|---|---|---|
| NIST SP 800-53 Rev 5 | SC-7 — Boundary Protection | Zones and meshes both define trust and traffic boundaries. |
| Recommendation — Define and enforce boundaries separately for connectivity and policy domains. | ||
| NIST Zero Trust (SP 800-207) | 3.1 — Never Trust, Always Verify | Mesh separation supports distinct trust domains and controlled east-west access. |
| Recommendation — Apply explicit trust boundaries before allowing cross-zone or cross-mesh traffic. | ||
| CIS Controls v8 | CIS-12 — Network Infrastructure Management | Mesh and zone choice changes network segmentation and operational control points. |
| Recommendation — Document and manage segmentation choices as part of network control governance. | ||
Practitioner Guidance
What to verify: Before choosing a pattern, verify whether the dominant constraint is connectivity, ownership, or trust. If the answer changes when you ask whether teams should share policies, you are probably looking at a multi-mesh decision; if the answer changes when you ask where traffic can physically move, you are probably looking at zones.
Decision rule: Prefer zones for transport reality and meshes for governance reality. If both realities exist, do not force one construct to carry both meanings, because that is where deployment designs become ambiguous and hard to operate.
Practitioner takeaway: The cleanest service mesh design is the one that keeps network topology and security boundary separate, so each can scale without accidentally redefining the other.
Related resources from NHI Mgmt Group
- How do security and platform teams decide between a managed agent service and a control plane approach?
- How should security teams decide between a data platform and a managed ML service for production AI workloads?
- How should security teams decide whether JIT access is safe for non-human identities?
- How should security teams decide between native ERP controls and a separate governance platform?