---
title: "CephFS"
description: "1 posts about CephFS, summarised, each linking to the original."
---

# CephFS
> 1 posts about CephFS, summarised, each linking to the original.

## Articles

### [Benchmarking tiered KV cache offloading on H100 GPUs in OpenShift AI 3.5](https://yomu.fyi/post/benchmarking-tiered-kv-cache-offloading-on-h100-gpus-in-openshift-ai-3.md)
- Company: [Red Hat](https://yomu.fyi/company/red-hat.md)
- Author: Ramesh Doddaiah, Alberto Perdomo, Nathan Scott, Ashish Kamra, Naina Singh
- Published: Nov 2, 2026
- Type: Benchmark

Tiered KV cache offloading in Red Hat OpenShift AI 3.5 moves KV cache blocks from GPU HBM to CPU DRAM, local NVMe, or CephFS to avoid recomputation in long-context workloads. On agentic workloads averaging 50K input tokens, offloading improved throughput by up to 5.8x and reduced mean time to first token from 60 s to 10 s for Nemotron-Ultra-253B on H100 GPUs. CPU offload alone delivered 3.3x throughput improvement, while adding NVMe or CephFS nearly doubled that to 5.8x. The benefit depends on whether the KV working set exceeds the CPU tier capacity; when it fits, CPU offload captures most of the gain. The post recommends workload-driven evaluation: characterize storage latency, calculate the restore-versus-recompute crossover, and validate with representative inference traces before production deployment.
