Loading post…
Together AIAnnouncement
Together AI and Y Combinator partner to launch the first dedicated GPU cluster for the YC community
Summary
Together AI and Y Combinator are partnering to provide YC portfolio companies with a dedicated GPU cluster, addressing compute access as a growing bottleneck for AI-native startups. The service is designed for both inference and training, letting founders reserve, provision, and manage GPUs through Together’s self-service portal rather than making long-term commitments or routing usage through YC. Startups can run short-term sprints at long-term rates, use capacity from single-node workloads to larger deployments, and receive GPUs in minutes, while the cluster is already running at full utilization and companies can plan needs months ahead. Together says its research on attention mechanisms and the Mamba architecture targets faster inference and improved unit economics. The partners plan to expand the cluster and support startups as their requirements grow.
Context
AI-native startups increasingly struggle to secure GPU capacity quickly and affordably. The source says that long-term compute commitments can exceed a young company’s cash balance, making access to flexible capacity a significant constraint.
Approach / What changed
Together AI built a dedicated cluster and self-service developer experience for YC portfolio companies. Founders reserve, provision, and manage GPUs directly through Together’s portal, using short-term access at long-term rates for inference and training, with support for workloads ranging from single-node compute to larger deployments.
Takeaways
YC portfolio companies can access GPUs for inference and training without making long-term commitments, using short-term sprints at long-term rates.
Founders manage reservations, provisioning, usage, and billing support through Together’s self-service portal rather than routing compute through YC.
The cluster is running at full utilization, but individual companies can still plan their compute needs months in advance; Together and YC plan to expand it.
FAQ
How do YC startups access and manage GPUs on the dedicated cluster?
Founders reserve, provision, and manage their own GPUs through Together’s self-service portal. Their usage does not need to route through YC, and the source says GPUs can be ready in minutes.
Does the cluster support both training and inference workloads?
Yes. The cluster is intended to provide compute for both inference and training, supporting needs from single-node workloads through companies scaling up.
Do startups need to sign a long-term compute contract?
No long-term commitment is required for the described access model. Startups can use GPUs for short-term sprints while benefiting from long-term rates.
Source and freshness
- Source
- together.ai
- Published
- Added to Yomu
Summaries are generated from the original by a language model. Check the original before relying on it.
Keep reading
Related reading
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
The best engineering reads, once a week
One useful email. Unsubscribe anytime.