Loading…
Topic
Bursting
1 post about Bursting. Every summary links to the original.
- 1 post
- 1 company
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
Newest first
Posts
Sandbox resourcing: burst, don't reserve
Modal Sandboxes are bursty workloads that spend most of their time using far less than peak CPU, making reservation-based pricing wasteful. The post argues that reserving capacity for each Sandbox’s peak would require machine capacity equal to the sum of all peaks, while bursting allows multiple Sandboxes to share capacity efficiently. Modal uses active-resource pricing where Sandboxes are billed for a default request when idle and pay for additional resources only when they burst. CPU can burst up to 16 cores above the request, and memory has no limit by default, though limits can be set for consistency or cost capping. Evictions are rare, with an SLO of under 0.0001% OOM rate per minute for Sandboxes under 8 GiB, and tools like exit snapshots and volumes help mitigate their impact.
Related topics
All topics →Weekly digest
The best engineering reads, once a week.