Open, convenient and predictable: Introducing Provisioned Throughput

Summary

Companies adopting open-weight models for production workloads have faced a trade-off between convenient but best-effort serverless inference and powerful but complex dedicated GPU instances. Together AI’s Provisioned Throughput fills that gap with reserved inference capacity sold as Provisioned Throughput Units (PTUs). Each PTU is priced at $0.05 per minute and guarantees a fixed rate of tokens per minute for a specific model, with a 99% uptime SLA. Input, cached input, and output tokens draw down capacity at different rates, letting teams optimize for their traffic shape. Available now for MiniMax M3 and GLM-5.2 with capacity in North America and EMEA and a one-month minimum term, at full utilization costs can run roughly $0.36 per million input tokens and $2.16 per million output tokens, up to 90% below proprietary alternatives.

Takeaways

1. 1

   Provisioned Throughput offers reserved inference capacity for open models with token-based pricing and a 99% uptime SLA, eliminating the need to manage GPU infrastructure.

2. 2

   On MiniMax M3, one PTU provides 138,840 input tokens, 694,200 cached input tokens, or 23,140 output tokens per minute, with different consumption rates for each token type.

3. 3

   Costs at full utilization on MiniMax M3 are approximately $0.36 per million input tokens and $2.16 per million output tokens, up to 90% less than proprietary APIs like Claude Opus 4.8.

FAQ