---
title: "Serverless"
description: "102 posts about Serverless, summarised, each linking to the original."
---

# Serverless
> 102 posts about Serverless, summarised, each linking to the original.

## Articles

### [Building a serverless AI assistant at Pelago: concept to care in two weeks](https://yomu.fyi/post/building-a-serverless-ai-assistant-at-pelago-concept-to-care-in-two-we.md)
- Company: [AWS](https://yomu.fyi/company/aws.md)
- Author: Anton Aleksandrov
- Published: Jul 22, 2026
- Type: Problem & solution

Pelago engineered a serverless, event-driven AI assistant on AWS within two weeks to provide substance use recovery coaches with contextual response suggestions. Operating under strict Protected Health Information constraints, the system maintains clinical safety through human-in-the-loop review and keeps data confined to an Amazon VPC. Incoming messages flow via AWS AppSync and Amazon DynamoDB to an Amazon SNS topic, which fans out to independent AWS Lambda functions. The asynchronous Chat Assistant Lambda queries history, invokes Amazon Bedrock, and persists suggestions into Amazon RDS MySQL in under 10 seconds. When coaches access a conversation via Amazon API Gateway, pre-generated suggestions load in under 100 milliseconds.


### [Building multi-Region resiliency for AWS CloudFormation custom resource deployment](https://yomu.fyi/post/building-multi-region-resiliency-for-aws-cloudformation-custom-resourc.md)
- Company: [AWS](https://yomu.fyi/company/aws.md)
- Author: Raman Pujani
- Published: Jul 22, 2026
- Type: Problem & solution

AWS CloudFormation custom resources extend template provisioning capabilities but lack built-in multi-Region coordination, risking duplicate executions and unhandled failures during regional outages. To solve this limitation, an active-active architecture leverages Amazon Simple Notification Service topics to fan out lifecycle events across primary and secondary infrastructure Regions. The primary Region processes events immediately, whereas the secondary Region processes incoming messages after a deliberate delay implemented via Amazon Simple Queue Service. Coordination relies on Amazon DynamoDB Global Tables with conditional writes to manage distributed locking and enforce idempotency. When failures occur in the primary Region, Amazon CloudWatch alarms signal Amazon Application Recovery Controller to automate failover without manual intervention.


### [Automate custom PII detection at scale with Amazon Macie and Step Functions](https://yomu.fyi/post/automate-custom-pii-detection-at-scale-with-amazon-macie-and-step-func.md)
- Company: [AWS](https://yomu.fyi/company/aws.md)
- Author: Aishwariya Khiani
- Published: Jul 22, 2026
- Type: Tutorial

Regulated organizations ingesting large data volumes must detect and classify standard and domain-specific personally identifiable information to satisfy compliance mandates like GDPR, HIPAA, CCPA, and PCI DSS. To eliminate manual inspection, an event-driven architecture orchestrates Amazon Macie scans for files landing in Amazon S3. Amazon EventBridge captures upload events and invokes AWS Step Functions, which manages Lambda functions to stage objects, trigger Macie classification jobs with custom regex identifiers, and poll for results. The pipeline separates data across a three-bucket pattern representing raw, staged, and scanned states to prevent mixing unprocessed data with validated assets. Finally, the workflow exports timestamped compliance reports in CSV and JSON formats while alerting security teams via Amazon SNS on high-severity findings.


### [How to price serverless GPUs](https://yomu.fyi/post/how-to-price-serverless-gpus.md)
- Company: [Modal](https://yomu.fyi/company/modal.md)
- Author: Charles Frye
- Published: Jul 6, 2026
- Type: Explainer

Modal’s engineering blog presents a cost model comparing serverless and reserved GPU pricing for AI workloads, centered on the peak-to-average demand ratio. Serverless GPUs charge only for usage, while reserved GPUs require long-term contracts for fixed capacity, often achieving under 30% utilization. The model shows that when the peak-to-average ratio exceeds the reservation discount rate (typically 2-5x), serverless GPUs become cheaper despite higher base rates, with real workloads like inference and training having ratios of 5-10x, making serverless an obvious cost win. An interactive tool allows teams to estimate costs using preset workloads or custom traffic patterns, defaulting to current B200 GPU rates on Modal and hyperscaler reservations. The post discusses model limitations, including assumptions of perfect prediction and instant allocation, and notes that serverless also reduces engineering costs through faster development and reduced dev/prod skew, while mixed strategies can combine baseline reservations with serverless bursting for high peak-to-average bursts.


### [Agentic Coding on Supabase with OpenCode](https://yomu.fyi/post/agentic-coding-on-supabase-with-opencode.md)
- Company: [Supabase](https://yomu.fyi/company/supabase.md)
- Author: ekhar
- Published: Jun 30, 2026
- Type: Announcement

Supabase has made its OpenCode integration available, connecting an AI coding agent to Supabase account and project management APIs and bundled Supabase skills. Users invoke /supabase, authenticate, and, for database, Edge Functions, logs, and other project-scoped capabilities, are guided through connecting Supabase MCP; the integration requires OpenCode 1.3.4 or later. It can list organizations and projects, create projects, open the MCP setup flow, monitor agent activity in real time, and let agents query data, check logs, and deploy functions, while the plugin is open source. The post demonstrates the workflow in Minecraft, where OpenCode connected through MCP, created and populated a table, and deployed an Edge Function on a real Supabase project.


### [What To Look For in a Serverless Database for AI Applications](https://yomu.fyi/post/what-to-look-for-in-a-serverless-database-for-ai-applications.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: Jun 25, 2026
- Type: Explainer

Serverless databases are presented as a baseline for AI applications whose traffic can be volatile, idle for long periods, or spike when agents fan out queries. The guide distinguishes managed serverless systems from autoscaling products by focusing on architectural separation of compute and storage, true scale-to-zero, cold-start behavior, connection handling, pricing, performance, portability, governance, and AI capabilities such as vector search. It recommends evaluating both low- and high-utilization costs, published warm-up times, tail latency (p95/p99), and built-in pooling or HTTP/Data APIs for high-concurrency agents and serverless functions. The text positions Lakebase as an example that combines serverless Postgres, shared lakehouse storage, and Unity Catalog governance, and cites reported cost and management reductions from a 2025 study while noting that provisioned deployments may suit continuously high-throughput workloads.


### [Modal's serverless Servers](https://yomu.fyi/post/modal-s-serverless-servers.md)
- Company: [Modal](https://yomu.fyi/company/modal.md)
- Published: Jun 25, 2026
- Type: Problem & solution

Modal introduces Servers, a low-latency HTTP serving solution designed for applications like LLM inference where milliseconds matter. Servers reduce p50 latency from 39ms to 6ms compared to Modal Web Functions by removing control-plane lookups and queuing from the hot path. The architecture uses a stateless proxy (fprs) for domain association and load balancing, with Envoy for TLS termination and HTTP/2 multiplexing. Two design principles governed development: maximizing resource sharing while minimizing interference, and making no network calls on the request path. The system supports autoscaling, regionalized routing, proxy authentication, and mirroring for A/B testing and continual learning.


### [What's new in ClickStack - May 2026](https://yomu.fyi/post/what-s-new-in-clickstack-may-2026.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Published: Jun 23, 2026
- Type: Announcement

ClickStack’s May and early-June release focused on making observability dashboards more useful during investigations and expanding access to related workflows. Dashboard table actions can open searches against selected sources with templated WHERE clauses or link to other dashboards, while scoped filters prevent source-specific conditions from affecting unrelated tiles. Number visualizations gained fixed or threshold-based colors and automatic text scaling, and the service map added latency percentiles, throughput metrics, server-side filtering, and focus mode. The release also includes a Browser RUM dashboard template, experimental PromQL support through the ClickHouse TimeSeries Engine, expanded MCP tools, AI Notebooks beta for Managed ClickStack, and ClickStack Cloud in private preview.


### [Enabling Governed Vibe Coding for Enterprise Apps on Databricks](https://yomu.fyi/post/enabling-governed-vibe-coding-for-enterprise-apps-on-databricks.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Evan Pandya, Justin DeBrabant, Cong Xu
- Published: Jun 16, 2026
- Type: Announcement

Databricks introduces three capabilities intended to bring vibe coding to enterprise applications, where speed alone does not provide business-data context, deployment safety, or cost control. App Spaces lets admins define resource and data access, on-behalf-of-user API scopes, and security policies for groups of apps, with each app inheriting those settings. Genie App Builder turns plain-language descriptions into working internal apps through generated plans, live previews, AppKit, and awareness of workspace data assets and Unity Catalog semantics. Serverless micro apps run in isolated lightweight virtual machines, start quickly when needed, scale to zero while idle, and use usage-based rather than reserved-capacity infrastructure. Together, the capabilities are presented as a way for business-proximate users to build on enterprise data while organizations apply consistent governance and support broader app portfolios; all three are coming to Databricks Apps, with private previews coming soon.


### [Announcing Apps on Databricks Marketplace](https://yomu.fyi/post/announcing-apps-on-databricks-marketplace.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Tia Chang, Akram Chetibi, Harish Gaur, Stephen Orban, Mengxi Chen
- Published: Jun 16, 2026
- Type: Announcement

Databricks announces the Public Preview of Apps on Databricks Marketplace, allowing customers to discover, install, and run third-party data and AI applications inside secure Databricks workspaces. The offering addresses procurement challenges involving data movement, lengthy security reviews, custom integrations, and fragmented identity management by bringing applications to the customer’s data. Installed apps run in isolated sandboxes within the consumer’s Databricks account, inherit Unity Catalog governance, and use dedicated serverless compute with consumer-controlled external access through Serverless Egress Gateway policies. Providers can publish closed-source containerized apps once for no-egress distribution without maintaining per-customer infrastructure, while applications connect natively to services including SQL Warehouse, Lakebase, Model Serving, and Foundation Model APIs. The Public Preview launches with 20 partners, and planned additions include bundled assets, provider analytics, and commercial monetization.


### [Product updates: VM Sandboxes, Lower latency routing, RBAC, and more](https://yomu.fyi/post/product-updates-vm-sandboxes-lower-latency-routing-rbac-and-more.md)
- Company: [Modal](https://yomu.fyi/company/modal.md)
- Published: Jun 15, 2026
- Type: Announcement

Modal also announced several product updates including VM Sandboxes in alpha, lower latency regional routing, and role-based access control. VM Sandboxes, currently in alpha, are a new VM runtime that runs a real Linux kernel, supporting Docker containers and Linux features like eBPF, systemd, cgroups, and custom filesystem mounts for better I/O performance. Regional routing lets Functions run in US West, EU West, or Asia Pacific South instead of default US East with a single setting, lowering latency and keeping data in-region. RBAC is now available for Team and Enterprise plans, with Environments as security boundaries and read-only defaults via Restricted Environments, tied into Audit Logs. Other updates include domain allowlisting, named images, volume subdirectory mounts, readiness probes, configurable snapshot TTLs with a 30-day default, SDK updates, and a partnership with Anthropic for Claude Managed Agents.


### [How we achieved truly serverless GPUs](https://yomu.fyi/post/how-we-achieved-truly-serverless-gpus.md)
- Company: [Modal](https://yomu.fyi/company/modal.md)
- Author: Charles Frye
- Published: May 12, 2026
- Type: Problem & solution

GPU inference workloads suffer from spiky demand, leading to low GPU Allocation Utilization when capacity is fixed. Modal reduced replica startup latency from over 2 kiloseconds to about 50 seconds using four techniques. A buffer of idle GPUs removes instance allocation from the hot path. A custom content-addressed filesystem serves container images lazily from a multi-tier cache. CPU and CUDA checkpoint/restore fast-forward through initialization by directly restoring processes and GPU contexts into memory. These optimizations enable truly serverless GPU inference, as demonstrated by Reducto’s document processing scaling to thousands of GPUs with cold starts reduced from ~70s to ~12s.


### [Supabase Is Now an Official ChatGPT App](https://yomu.fyi/post/supabase-is-now-an-official-chatgpt-app.md)
- Company: [Supabase](https://yomu.fyi/company/supabase.md)
- Author: gregnr
- Published: May 8, 2026
- Type: Announcement

Supabase is now an official app in ChatGPT, allowing users to connect Supabase projects and manage database infrastructure through conversation. The app provides 29 tools for executing SQL on Postgres, designing and modifying schemas, listing tables and extensions, checking security recommendations, and handling project operations such as logs, costs, pausing, and restoring. It also supports development branches and migrations, serverless edge functions, and direct Supabase documentation search, while ChatGPT Projects can scope chats to a project reference. Users install it from ChatGPT’s app directory, authorize access to their Supabase organization, and can use it on all Supabase plans with paid ChatGPT plans. The stated result is conversational management of Supabase projects without leaving ChatGPT.


### [Rethinking Distributed Systems for Serverless Performance and Reliability](https://yomu.fyi/post/rethinking-distributed-systems-for-serverless-performance-and-reliabil.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Aaron Davidson, Roland Fäustlin, Zach Williams
- Published: May 6, 2026
- Type: Explainer

Building serverless compute for Apache Spark requires more than warm machine pools or basic autoscaling because traditional deployments couple user applications to infrastructure, allowing contention and inefficiencies to undermine performance and reliability. The proposed architecture separates these concerns through Spark Connect’s client-server model over gRPC, a gateway that routes workloads using query size, cluster utilization, and latency profile, and an adaptive autoscaler that adjusts capacity horizontally and vertically. Spark Connect isolates user applications from drivers, while the gateway continually re-evaluates placement to reduce interference between workloads. The autoscaler offers Standard and Performance-Optimized modes and can respond to out-of-memory errors by restarting tasks on larger VMs without manual intervention. Reported outcomes include a 99.998% upgrade success rate across more than 4.5 billion workloads, 2–5x faster Unilever pipelines, and operational-cost reductions of 25%.


### [Introducing @supabase/server](https://yomu.fyi/post/introducing-supabase-server.md)
- Company: [Supabase](https://yomu.fyi/company/supabase.md)
- Author: tomas\_pozo, kalleby\_santos, katerina\_skroumpelou, matt\_johnston
- Published: May 6, 2026
- Type: Announcement

Supabase is releasing @supabase/server in public beta, a package for authentication verification, client setup, request context, and common server-side boilerplate across backend runtimes. Supabase says an anonymous analysis of 25,000 deployed Edge Functions found developers repeatedly rebuilding setup for clients, JWT verification, claims parsing, CORS, auth context, and shared files. The package's withSupabase wrapper or createSupabaseContext function supplies a SupabaseContext containing a user-scoped client, service-role admin client, verified identity, JWT claims, auth metadata, and auth mode, while declarative modes cover user, none, secret, publishable, or combined access. It returns standard Request-to-Response handlers for Edge Functions, Vercel Functions, Cloudflare Workers, Hono, Bun, and Deno, and includes primitives for custom middleware and adapters. @supabase/server does not replace @supabase/ssr, which remains focused on cookie-based sessions, and the release invites feedback on its public-beta API and adapters.


### [DeepInfra on Hugging Face Inference Providers 🔥](https://yomu.fyi/post/deepinfra-on-hugging-face-inference-providers.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Aray Sultanbekova, Shang-Pin, Utemuratov, Yessen K, Oguz Vuruskaner, Célina Hanouti, Simon Brandeis, Lucain Pouget
- Published: Apr 29, 2026
- Type: Announcement

DeepInfra is now a supported Inference Provider on the Hugging Face Hub, adding its serverless inference platform and catalog of more than 100 models to model pages and client integrations. The initial integration supports conversational and text-generation tasks, with access to open-weight LLMs including DeepSeek V4, Kimi-K2.6, and GLM-5.1; support for text-to-image, text-to-video, embeddings, and other tasks will roll out soon. Users can configure provider API keys and preferences in account settings, or authenticate with a Hugging Face token so requests are routed through Hugging Face, including from the Python and JavaScript SDKs and supported agent harnesses. Direct requests are billed by the provider, while routed requests use standard provider API rates without additional markup, and Hugging Face PRO users receive $2 of monthly Inference credits.


### [OVHcloud on Hugging Face Inference Providers 🔥](https://yomu.fyi/post/ovhcloud-on-hugging-face-inference-providers.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Gilles Closset, Fabien Ric, Elias Tourneux
- Published: Nov 24, 2025
- Type: Announcement

OVHcloud is now integrated as a supported Inference Provider on the Hugging Face Hub, expanding serverless inference options across model pages and client SDKs. The integration enables access to open-weight models, including gpt-oss, Qwen3, DeepSeek R1, and Llama, using European infrastructure with pay-per-token pricing starting at €0.04 per million tokens. Developers can connect via Python and JavaScript SDKs using either direct custom API keys or automatic routing through Hugging Face tokens. The service supports structured outputs, function calling, multimodal workflows, and embedding models while providing sub-200ms first-token response times. Calls routed through Hugging Face pass through standard provider pricing without markups, and PRO tier subscribers receive monthly inference credits.


### [Scaleway on Hugging Face Inference Providers 🔥](https://yomu.fyi/post/scaleway-on-hugging-face-inference-providers.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Guillaume Noale, Franck Pagny, Fred Bardolle, Guillaume Calmettes, Constance Morales, Célina Hanouti, Julien Chaumond, Simon Brandeis, Lucain Pouget
- Published: Sep 19, 2025
- Type: Announcement

Scaleway is integrated as a supported serverless Inference Provider on the Hugging Face Hub, expanding model deployment options across Hub model pages and official client SDKs for JavaScript and Python. Operating out of European data centers located in Paris, France, Scaleway Generative APIs host open-weight models including gpt-oss, Qwen3, DeepSeek R1, and Gemma 3 with structured outputs, function calling, multimodal processing, and sub-200ms first-token response times. Developers can route inference requests using their Hugging Face tokens or supply direct Scaleway API keys. Billing for routed requests charges standard provider rates starting at €0.20 per million tokens without markups, while direct requests bill to Scaleway accounts. Hugging Face PRO subscribers receive two dollars of monthly inference credits applicable across providers.


### [Public AI on Hugging Face Inference Providers 🔥](https://yomu.fyi/post/public-ai-on-hugging-face-inference-providers.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Joseph Low, Joshua Tan, Célina Hanouti, Julien Chaumond, Simon Brandeis, Lucain Pouget
- Published: Sep 17, 2025
- Type: Announcement

Hugging Face has integrated Public AI as a supported Inference Provider on the Hugging Face Hub. Public AI operates as a nonprofit, open-source project providing access to sovereign and public models from institutions such as the Swiss AI Initiative and AI Singapore. Its distributed infrastructure combines a vLLM-powered backend serving OpenAI-compatible APIs across partner-donated clusters with a global load-balancing routing layer. Users can access these models through the Hugging Face web UI, Python client SDK, and JavaScript SDK using either direct provider API keys or routed Hugging Face tokens. At the time of announcement, inference through the Public AI provider is free of charge, supported by donated GPU time and advertising subsidies.


### [Seamlessly connect Stripe events to your frontend](https://yomu.fyi/post/seamlessly-connect-stripe-events-to-your-frontend.md)
- Company: [Stripe](https://yomu.fyi/company/stripe.md)
- Author: Josh Kahn
- Published: Sep 11, 2025
- Type: Explainer

Stripe events can connect backend state changes to responsive frontend interfaces for payments, subscriptions, connected accounts, and Stripe Terminal workflows. The post contrasts polling, which can increase traffic, latency, and delta-computation complexity, with push subscriptions, while noting that a hybrid of initial API loading and incremental updates is common. It describes webhook endpoints and Amazon EventBridge as ingestion choices, then emphasizes idempotency, ordering, duplicate detection, and failure handling. Frontend delivery options include WebSockets, MQTT, gRPC, Server-Sent Events, polling, AWS AppSync, and Momento, selected according to messaging pattern, direction, latency, scale, and operational trade-offs. An abbreviated lounge example uses a PaymentIntent and Terminal reader, routes payment\_intent.requires\_payment\_method through EventBridge to AWS AppSync Events, and lets a React client mark the reader ready to collect payment.


[Newer posts](https://yomu.fyi/topic/serverless/page/2.md) · [Older posts](https://yomu.fyi/topic/serverless/page/4.md)