---
title: "`LeRobotDataset:v3.0`: Bringing large-scale datasets to `lerobot`"
description: "LeRobotDataset:v3.0 is a new release for lerobot, Hugging Face’s robotics library, addressing file-system limitations encountered when LeRobotDataset:v2 stored one episode per file at million-episode scale. Version 3 packs multiple episodes into shared Parquet and MP4 files, while relational JSON and chunked episode metadata identify episode boundaries and locate the corresponding tabular and visual data. The format separates tabular data, visual data, and metadata; it stores low-dimensional readings in Apache Parquet, concatenates camera frames into MP4 videos, and supports native temporal windowing through delta_timestamps. It also introduces StreamingLeRobotDataset for processing batches from the Hugging Face Hub without downloading the full dataset locally, and provides a one-line conversion utility for datasets in the LeRobotDataset format. The release is planned for lerobot-v0.4.0 and is presented as a step toward datasets with millions of episodes."
---

# \`LeRobotDataset:v3.0\`: Bringing large-scale datasets to \`lerobot\`

[Hugging Face](https://yomu.fyi/company/hugging-face) · Francesco Capuano, Michel Aractingi, Quentin Lhoest, Caroline Pascal, Pepijn Kooijmans, Jade Choghari, Remi Cadene, Simon  Alibert, Adil Zouitine, Martino Russi, Steven Palma · Sep 16, 2025

**Type:** Announcement

## Summary

LeRobotDataset:v3.0 is a new release for lerobot, Hugging Face’s robotics library, addressing file-system limitations encountered when LeRobotDataset:v2 stored one episode per file at million-episode scale. Version 3 packs multiple episodes into shared Parquet and MP4 files, while relational JSON and chunked episode metadata identify episode boundaries and locate the corresponding tabular and visual data. The format separates tabular data, visual data, and metadata; it stores low-dimensional readings in Apache Parquet, concatenates camera frames into MP4 videos, and supports native temporal windowing through delta\_timestamps. It also introduces StreamingLeRobotDataset for processing batches from the Hugging Face Hub without downloading the full dataset locally, and provides a one-line conversion utility for datasets in the LeRobotDataset format. The release is planned for lerobot-v0.4.0 and is presented as a step toward datasets with millions of episodes.

## Context

LeRobotDataset:v2 stored one episode per file, which created file-system limitations when datasets grew to millions of episodes. The new release is motivated by the need to keep storage manageable while supporting large robotics datasets and processing them without downloading entire collections locally.

## Approach / What changed

LeRobotDataset:v3 concatenates data from multiple episodes into larger, chunked Parquet and MP4 files, using relational metadata to retrieve episode-specific boundaries and storage pointers. It separates tabular data, visual data, and metadata, adds the StreamingLeRobotDataset interface, supports temporal windowing with delta\_timestamps, and provides a one-line utility for converting datasets in the LeRobotDataset format.

## Takeaways

- meta/info.json defines feature schemas, data types, fps, codebase version, and file path templates; meta/stats.json stores aggregate mean, standard deviation, minimum, and maximum values.
- meta/tasks.jsonl maps natural-language task descriptions to integer task indices for task-conditioned policy training.
- PyTorch DataLoader can collate LeRobotDataset sample dictionaries into batched tensors, including temporal image stacks when delta\_timestamps is configured.

**Tags:** [Data Pipelines](https://yomu.fyi/topic/data-pipelines), [Machine Learning](https://yomu.fyi/topic/machine-learning), [Performance](https://yomu.fyi/topic/performance)

- Source: [Hugging Face](https://huggingface.co/blog/lerobot-datasets-v3)
- Source URL: https://huggingface.co/blog/lerobot-datasets-v3
- Ingested by Yomu: 2026-08-27T15:13:31.008Z

[Read original post](https://huggingface.co/blog/lerobot-datasets-v3)