Service Mesh
A service mesh is a dedicated infrastructure layer, usually built from network proxies beside each service, that handles service-to-service traffic routing, encryption, retries and telemetry in microservices applications.
A service mesh is an infrastructure layer that manages communication between services in a distributed application. It typically deploys a lightweight proxy alongside each service instance, known as the sidecar pattern, or a shared proxy per node, and a control plane configures these proxies centrally. Traffic between services then passes through the proxies, which handle routing, retries, timeouts, mutual TLS encryption and telemetry without changes to application code.
Service meshes are used in large microservices deployments where consistent security and traffic policy across many services would otherwise have to be coded into each one. Typical uses include encrypting and authenticating all service-to-service traffic, canary releases through weighted routing, circuit breaking and collecting uniform latency and error metrics. Istio and Linkerd, both CNCF projects, are widely used open-source meshes, and Envoy is a common data-plane proxy.
A mesh adds latency, resource consumption and operational complexity, so it is usually justified only when the number of services and the security requirements are significant. Certificate management, proxy upgrades and debugging through an extra network hop require dedicated skills. Mutual TLS from a mesh supports zero trust principles but does not replace application-level authorisation.
Key points
- Proxies beside each service handle traffic, while a control plane configures them
- Provides mutual TLS, retries, timeouts, traffic splitting and uniform telemetry
- Istio and Linkerd are open-source meshes; Envoy is a common data-plane proxy
- Adds latency and complexity, so it suits larger microservices estates
Where AiVibe comes in
AiVibe Software Services delivers cloud solutions on AWS, Microsoft Azure, Google Cloud or on-premise, together with cloud security, legacy modernisation, data analytics and AI and machine learning services.
Related terms
- Microservices ArchitectureCloud & AI Infrastructure
- KubernetesCloud & AI Infrastructure
- Canary ReleaseCloud & AI Infrastructure
- ObservabilityCloud & AI Infrastructure
- Zero Trust Architecture (ZTA)Cybersecurity & Compliance
- API GatewayCloud & AI Infrastructure