---
title: "Pathways"
description: "1 posts about Pathways, summarised, each linking to the original."
---

# Pathways
> 1 posts about Pathways, summarised, each linking to the original.

## Articles

### [What is Pathways? Single-controller training for large models](https://yomu.fyi/post/what-is-pathways-single-controller-training-for-large-models.md)
- Company: [Google](https://yomu.fyi/company/google.md)
- Author: Sujeeth Jinesh, Shaurya Gupta, Luke Baumann, Monica Song, Ivan Nardini, Akanksha Gupta, Anthony Owusu, Jing Yang, Sadi Kneipp, Yu Li
- Published: Nov 9, 2026
- Type: Explainer

Large-model training with SPMD struggles when jobs become non-uniform, such as pipeline parallelism or RL training loops, and cannot survive hardware failures without restarting. Pathways addresses this by introducing a single Python client that describes the entire computation as a graph of blocks and tensor edges. A distributed runtime places blocks on virtual devices, moves and reshards tensors, orders operations across the cluster, and remaps around a failed host. This separates model building from execution, allowing reasoning about the whole cluster instead of one slice. Pathways runs JAX programs on TPUs and is available on Google Cloud.
