CloudflareMichelle ChenAnnouncement
Unifying Workers AI and AI Gateway into a single AI control plane
Summary
Workers AI and AI Gateway are converging into a unified AI control plane to simplify model access, billing, and observability. Developers can now access both services through a single entrypoint using unified Workers bindings and the /ai/ REST endpoint. Specifying a default gateway automatically instruments requests with payload logging, token tracking, and cost attribution without manual dashboard setup. Cloudflare has also rolled out unified prepaid billing, allowing teams to spend AI Gateway credits on Workers AI models while unlocking higher rate limits. Planned future features include model-first routing for automated provider failover and smart routing powered by task classifiers on Workers AI.
Context
AI Gateway and Workers AI initially existed as distinct products with separate workflows, creating fragmented billing, distinct API access paths, and manual observability setup for developers managing multiple AI model providers.
Approach / What changed
Cloudflare unified both products into a single control plane by sharing the AI Workers binding and /ai/ REST API endpoint, auto-provisioning default gateways on the first authenticated request, and extending AI Gateway prepaid credit billing to Workers AI usage with elevated rate limits.
Takeaways
Developers can route Workers AI inference through AI Gateway using the 'default' gateway ID in bindings or REST headers to auto-create logging and token tracking.
AI Gateway credits now apply directly to Workers AI usage, providing a unified wallet across external model providers and managed infrastructure alongside elevated rate limits.
Upcoming model-first and smart routing capabilities will automatically handle multi-provider failover and use Workers AI classifiers to dynamically select models based on prompt complexity.
Source and freshness
- Source
- blog.cloudflare.com
- Published
- Added to Yomu
- Last updated
Summaries are generated from the original by a language model. Check the original before relying on it.
Keep reading
Related reading
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
The best engineering reads, once a week
One useful email. Unsubscribe anytime.