---
title: "GPUs on Fly.io are available to everyone!"
description: "Fly.io has made GPU instances available to everyone, adding datacenter-grade accelerators to its globally distributed compute platform. Users can select Ampere A100 variants with 40GB or 80GB of memory, or a Lovelace L40s with 48GB, by setting an app or process’s vm.size to the corresponding GPU kind. The post demonstrates an Ollama deployment using an L40s, a 100GB persistent volume mounted at /root/.ollama, and HTTP service settings that allow machines to stop and start automatically with zero minimum running machines. These instances are positioned for large language model inference, text transcription, and image generation; lower-cost A10 GPUs are planned for the next few weeks, while some organizations may need additional verification based on account age and payment history."
---

# GPUs on Fly.io are available to everyone!

[Fly.io](https://yomu.fyi/company/fly-io) · Feb 12, 2024

**Type:** Announcement

## Summary

Fly.io has made GPU instances available to everyone, adding datacenter-grade accelerators to its globally distributed compute platform. Users can select Ampere A100 variants with 40GB or 80GB of memory, or a Lovelace L40s with 48GB, by setting an app or process’s vm.size to the corresponding GPU kind. The post demonstrates an Ollama deployment using an L40s, a 100GB persistent volume mounted at /root/.ollama, and HTTP service settings that allow machines to stop and start automatically with zero minimum running machines. These instances are positioned for large language model inference, text transcription, and image generation; lower-cost A10 GPUs are planned for the next few weeks, while some organizations may need additional verification based on account age and payment history.

## Context

Fly.io says users have been excited to use GPUs on the platform and announces that GPU instances are now available to everyone.

## Approach / What changed

Users can change an app or process’s vm.size to a100-40gb, a100-80gb, or l40s. The example deploys Ollama with an L40s, a 100GB volume for models, and automatic machine stopping and starting.

## Takeaways

- Available GPU options are the Ampere A100 with 40GB or 80GB of memory and the Lovelace L40s with 48GB.
- The Ollama example mounts a 100GB volume at /root/.ollama and sets min\_machines\_running to 0, allowing the service to scale to zero.
- Lower-cost A10 GPUs are expected in the next few weeks, and some organizations may require additional verification based on account age and payment history.

**Tags:** [Fly](https://yomu.fyi/topic/fly), [GPU](https://yomu.fyi/topic/gpu), [Ollama](https://yomu.fyi/topic/ollama)

- Source: [Fly.io](https://fly.io/blog/gpu-ga)
- Source URL: https://fly.io/blog/gpu-ga
- Ingested by Yomu: 2026-09-02T11:59:39.467Z

[Read original post](https://fly.io/blog/gpu-ga)