---
title: "BitNet"
description: "1 posts about BitNet, summarised, each linking to the original."
---

# BitNet
> 1 posts about BitNet, summarised, each linking to the original.

## Articles

### [Run a Local LLM on a CPU With BitNet and a Sprite](https://yomu.fyi/post/run-a-local-llm-on-a-cpu-with-bitnet-and-a-sprite.md)
- Company: [Fly.io](https://yomu.fyi/company/fly-io.md)
- Published: Nov 6, 2026
- Type: Tutorial

Microsoft’s BitNet uses 1.58-bit quantization and ternary weights to run a 2.4 billion parameter model on a CPU, fitting in 1.1GB of RAM and achieving 50 tokens per second. The author deploys this model on a Sprite, a hardware-isolated compute unit that provides a URL with TLS, sleeps when idle, and wakes on request with a 1.2-second model load time. A Python HTTP server wraps llama-cli as a subprocess, exposing an OpenAI-compatible API at /v1/chat/completions, a status page, and a self-addressed client at /client.py. Checkpoints capture the entire environment atomically, allowing safe rollback when experimenting with different models, kernel parameters, or prompt formats. The Sprite registers as a service on port 8080, making the inference endpoint available to any other Sprite in the account without infrastructure changes.
