Together AIAnnouncement
Together AI is collaborating with IBM and NVIDIA to scale enterprise-grade AI inference using a dedicated cluster of NVIDIA B300 GPUs on IBM Cloud with NVIDIA Spectrum-X Ethernet networking. This is the first large-scale inference cluster of its kind on IBM Cloud, and Together AI is the first customer running on it. Together AI operates the inference layer, IBM provides the cloud, and NVIDIA delivers the silicon and networking. The company serves hundreds of trillions of tokens per month to over a million developers, and demand continues to climb. Enterprises choose open models to keep their data sovereign and achieve frontier-level performance at a fraction of closed-model cost.
Together AI, IBM, and NVIDIA are collaborating to provide enterprise-grade AI inference capacity. Together AI operates the inference layer, IBM provides the cloud infrastructure, and NVIDIA supplies the B300 GPUs and Spectrum-X networking. The cluster is purpose-built for inference and is the first of its kind on IBM Cloud.
Together AI is deploying a dedicated, large-scale cluster of NVIDIA B300 GPUs on IBM Cloud, backed by NVIDIA Spectrum-X Ethernet networking, to run its inference platform for open models in enterprise production environments.
Together AI, IBM, and NVIDIA have deployed a dedicated B300 GPU cluster on IBM Cloud for enterprise inference, the first such cluster on that platform.
The cluster uses NVIDIA Spectrum-X Ethernet networking, engineered for high-throughput inference workloads.
Enterprises choose open models for data sovereignty and frontier-level performance at lower cost compared to closed models.
The cluster uses NVIDIA B300 GPUs and NVIDIA Spectrum-X Ethernet networking, purpose-built for high-throughput inference.
Together AI operates the inference platform, IBM provides the cloud infrastructure, and NVIDIA supplies the silicon and networking.
Summaries are generated from the original by a language model. Check the original before relying on it.
See the idea
Bare metal gives engineers direct control over GPU, network, and virtualization layers, but it shifts elasticity and lifecycle work onto the team. This trade-off map shows when that bargain pays off.
Keep reading
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
One useful email. Unsubscribe anytime.
