---
title: "Envoy"
description: "1 posts about Envoy, summarised, each linking to the original."
---

# Envoy
> 1 posts about Envoy, summarised, each linking to the original.

## Articles

### [Modal's serverless Servers](https://yomu.fyi/post/modal-s-serverless-servers.md)
- Company: [Modal](https://yomu.fyi/company/modal.md)
- Published: Jun 25, 2026
- Type: Problem & solution

Modal introduces Servers, a low-latency HTTP serving solution designed for applications like LLM inference where milliseconds matter. Servers reduce p50 latency from 39ms to 6ms compared to Modal Web Functions by removing control-plane lookups and queuing from the hot path. The architecture uses a stateless proxy (fprs) for domain association and load balancing, with Envoy for TLS termination and HTTP/2 multiplexing. Two design principles governed development: maximizing resource sharing while minimizing interference, and making no network calls on the request path. The system supports autoscaling, regionalized routing, proxy authentication, and mirroring for A/B testing and continual learning.