---
title: "Resource Allocation"
description: "2 posts about Resource Allocation, summarised, each linking to the original."
---

# Resource Allocation
> 2 posts about Resource Allocation, summarised, each linking to the original.

## Articles

### [Sandbox resourcing: burst, don't reserve](https://yomu.fyi/post/sandbox-resourcing-burst-don-t-reserve.md)
- Company: [Modal](https://yomu.fyi/company/modal.md)
- Author: Kevin Yang
- Published: Nov 12, 2026
- Type: Explainer

Modal Sandboxes are bursty workloads that spend most of their time using far less than peak CPU, making reservation-based pricing wasteful. The post argues that reserving capacity for each Sandbox’s peak would require machine capacity equal to the sum of all peaks, while bursting allows multiple Sandboxes to share capacity efficiently. Modal uses active-resource pricing where Sandboxes are billed for a default request when idle and pay for additional resources only when they burst. CPU can burst up to 16 cores above the request, and memory has no limit by default, though limits can be set for consistency or cost capping. Evictions are rare, with an SLO of under 0.0001% OOM rate per minute for Sandboxes under 8 GiB, and tools like exit snapshots and volumes help mitigate their impact.


### [Intelligent Delivery: Making Every Unit of Compute Serve Better Ads](https://yomu.fyi/post/intelligent-delivery-making-every-unit-of-compute-serve-better-ads.md)
- Company: [Meta](https://yomu.fyi/company/meta.md)
- Author: Zhaojun Zhang
- Published: Nov 11, 2026
- Type: Problem & solution

Ads ranking models are growing toward LLM scale faster than hardware can keep up, and the marginal impact of compute varies across requests, models, and chips. Meta built Intelligent Delivery, an ML-driven system that allocates resources across the serving stack toward the system-wide optimum. It uses a Resource Core Model with 6B sparse parameters to predict per-request marginal utility, a hierarchy of decision engines for region, hardware, and within-host allocation, and agentic AI to continuously detect and respond to system shifts. Since 2017 through the first half of 2026, Intelligent Delivery has contributed an additional ~10% incremental ranking performance on top of model and system advancements. The system shortens the optimization loop from months to weeks, with AI agents now contributing to about 80% of engineering effort on the most automated mechanism.
