---
title: "Traffic Mirring"
description: "1 posts about Traffic Mirring, summarised, each linking to the original."
---

# Traffic Mirring
> 1 posts about Traffic Mirring, summarised, each linking to the original.

## Articles

### [Endpoint Candidates: evaluate and promote inference endpoints](https://yomu.fyi/post/endpoint-candidates-evaluate-and-promote-inference-endpoints.md)
- Company: [Modal](https://yomu.fyi/company/modal.md)
- Author: Amit Lohe, Deven Navani, Garrett O'Brien
- Published: Oct 12, 2026
- Type: Announcement

Modal introduced Endpoint Candidates to stage alternative inference deployments for Dedicated Endpoints, allowing evaluation of quality, latency, throughput, and cost without affecting production traffic. Users create a Candidate by selecting a model from Modal’s catalog or importing custom weights, then set a percentage of production traffic to mirror. The Pingora-based proxy forks each request stream into separate bounded buffers per Candidate and shares body chunks across mirrors with a per-process memory budget; if a buffer fills or the budget is exceeded, the proxy cancels that mirrored request while production continues. Each Candidate receives its own URL for running existing evaluations on output quality and performance benchmarks under load, and all mirrored compute uses standard Modal compute pricing. When ready, users promote from the dashboard to roll out to the production endpoint, leaving other Candidates available for continued independent testing and enabling Auto Endpoints to validate automated inference optimizations.