---
title: "LLMs"
description: "673 posts about LLMs, summarised, each linking to the original."
---

# LLMs
> 673 posts about LLMs, summarised, each linking to the original.

## Articles

### [Building trust into AI](https://yomu.fyi/post/building-trust-into-ai.md)
- Company: amazon.science
- Author: Staff writer
- Published: May 4, 2026
- Type: Explainer

Amazon integrates responsible AI practices across four core model development phases: pretraining, post-training, evaluation, and third-party monitoring. During pretraining, researchers augment training corpuses with specialized safety datasets, multimodality alignments, and learning exercises to teach foundational safety concepts instead of purely filtering harmful text. In post-training, reinforcement learning from human feedback uses human preference rankings, auxiliary-reward models, and independent LLM judges to ensure model outputs adhere to safety policies. For specialized use cases requiring access to sensitive domains like security testing, researchers apply low-rank adaptors to alter model behaviors surgically without retraining base weights. Cross-functional policy teams guide these technical stages by mapping risks against eight responsible AI dimensions and continuously updating behavioral boundaries to reflect evolving regulatory frameworks.


### [Learnings from init to deploy](https://yomu.fyi/post/learnings-from-init-to-deploy.md)
- Company: [Stripe](https://yomu.fyi/company/stripe.md)
- Author: Anna Spysz
- Published: May 4, 2026
- Type: Tutorial

An agent was used to build a transcription app for a team from initialization through deployment with Stripe Projects, OpenRouter, and Vercel. The app sends video-generated subtitles through an OpenRouter agent with a detailed system prompt and Stripe documentation tool calls, producing a formatted transcription whose speaker and service names are corrected. The author recommends treating agent-generated plans like design documents, verifying provider behavior, and using streaming for long transcripts because Vercel serverless limits made non-streaming responses prone to 504s for a roughly 1,500-line transcript. Testing led to removing an unreliable free-model tier, defaulting to openrouter/auto, and choosing Claude Opus 4.5-thinking over Claude Sonnet 4.5; shared agent files were committed, and a separate review agent was used before human review.


### [LLM Vs AI: A Practical Guide to Differences, Use Cases, and Tools](https://yomu.fyi/post/llm-vs-ai-a-practical-guide-to-differences-use-cases-and-tools.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: May 1, 2026
- Type: Explainer

This guide distinguishes artificial intelligence, a broad field covering systems that perform tasks associated with human intelligence, from large language models (LLMs), specialized generative AI models for language and code. It places LLMs within generative AI and deep learning, and explains how transformer self-attention processes tokens while training data, parameter scale, and context windows shape capability and limitations. Examples include content drafting, code generation, translation, customer-service chatbots, sentiment analysis, extraction, summarization, and tool-connected agentic workflows, while traditional machine learning remains suited to structured labels and numeric predictions. It recommends retrieval-augmented generation, human review, bias testing, privacy controls, and evidence-based pilots with defined workflows, metrics, budgets, realistic data, and logged outputs.


### [Generative AI for Business: A Complete Strategy and Implementation Guide](https://yomu.fyi/post/generative-ai-for-business-a-complete-strategy-and-implementation-guid.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: May 1, 2026
- Type: Explainer

Generative AI is presented as an enterprise technology shift with potential value across customer operations, marketing and sales, software engineering, and research and development, which together are described as accounting for approximately 75% of use-case value across industries. The guide distinguishes generative systems, which create text, images, code, audio, or structured data from predictive models, and explains how foundation models and LLMs support open-ended business applications. Its implementation strategy prioritizes reliable data infrastructure, high-impact low-complexity pilots, and governance covering sensitive data, model limitations, monitoring, human review, and compliance. Recommended execution includes a cross-functional squad, predefined KPIs, user training, baseline measurements, and a 90-day executive review with scale, iterate, or discontinue decisions. Retrieval-augmented generation is identified as the most widely adopted way to reduce hallucinations by grounding responses in verified proprietary data, while ROI is expected within six to twelve months for a well-structured pilot.


### [AI Applications: Tools, Use Cases, and Platforms](https://yomu.fyi/post/ai-applications-tools-use-cases-and-platforms.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: May 1, 2026
- Type: Explainer

The guide maps AI applications for data scientists, machine learning engineers, and technical leaders, covering predictive AI, generative AI, conversational AI, and autonomous agents across consumer, developer, and enterprise settings. It distinguishes consumer-facing tools from developer platforms and describes production concerns including model lifecycle management, vector search, data lineage, deployment, monitoring, governance, and evaluation. Generative systems create text, images, code, audio, and video from prompts, while large language models and mixture-of-experts architectures are presented as important foundations for enterprise applications; open models offer control over weights, governance, and deployment. The guide recommends defining use cases, assessing data readiness, and building privacy, bias-auditing, and monitoring controls before production, while noting that agents coordinate multi-step workflows across tools, APIs, and databases.


### [Agentic AI vs Generative AI: Comparing Autonomy, Workflows, and Use Cases](https://yomu.fyi/post/agentic-ai-vs-generative-ai-comparing-autonomy-workflows-and-use-cases.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: May 1, 2026
- Type: Explainer

Agentic AI and generative AI differ primarily in whether a system autonomously pursues a multi-step goal or produces content in response to a prompt. The post defines agentic systems through a perceive-plan-act cycle: agents maintain memory and state, decompose goals, call tools or sub-agents, evaluate conditions, and recover from errors, while generative AI typically performs bounded, reactive inference. It presents workflow examples such as sales follow-up and market-intelligence summarization, showing how APIs connect agents to CRMs, databases, communication platforms, and news services while LLMs provide text generation or reasoning at individual steps. RAG can ground generative outputs in external knowledge, but agentic deployments add operational concerns around repeated inference loops, human oversight, provenance logging, and access controls. The conclusion recommends choosing by task structure: generative AI for single-turn creation or summarization, agentic AI for autonomous coordination, and both together for complex enterprise workflows.


### [Goodbye limitations, hello data: How Qonto is rethinking observability with ClickHouse Cloud](https://yomu.fyi/post/goodbye-limitations-hello-data-how-qonto-is-rethinking-observability-w.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Author: ClickHouse Team
- Published: May 1, 2026
- Type: Problem & solution

Qonto struggled with slow queries, system instability, and aggressive data sampling when handling distributed traces in Grafana Tempo. To enable wide-event querying without strict cardinality limits, the team migrated their telemetry storage to ClickHouse Cloud. Telemetry from applications, Kubernetes, and GitHub routes through OpenTelemetry collectors over AWS PrivateLink into ClickHouse, while Grafana remains the primary dashboard interface. By compressing 231 TB of uncompressed trace attributes down to 376 GB, Qonto achieved substantial storage savings and integrated an AI incident companion using the ClickHouse Model Context Protocol. The new architecture eliminated cardinality policing, allowed product and support teams to self-serve incident investigations, and enabled real-time streaming pre-aggregations using Apache Flink.


### [Granite 4.1 LLMs: How They’re Built](https://yomu.fyi/post/granite-4-1-llms-how-they-re-built.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Yousaf Shah
- Published: Apr 29, 2026
- Type: Explainer

Granite 4.1 is a family of dense decoder-only language models in 3B, 8B, and 30B sizes, trained on approximately 15T tokens. Its five-phase pre-training pipeline moves from broad web-scale data to progressively curated mixtures, increases math and code emphasis, and extends context from 4K to 512K tokens through staged long-context training. Supervised fine-tuning uses about 4.1M curated samples evaluated with LLM-as-Judge and rule-based checks, while reinforcement learning uses on-policy GRPO with DAPO loss. The 8B instruct model matches or surpasses the earlier Granite 4.0-H-Small 32B-A9B MoE model despite its simpler dense architecture and fewer parameters, and the Granite 4.1 models are released under Apache 2.0.


### [Evaluating AI at Scale: How Thumbtack Approaches Reliability, Safety, and Quality in GenAI](https://yomu.fyi/post/evaluating-ai-at-scale-how-thumbtack-approaches-reliability-safety-and.md)
- Company: [Thumbtack](https://yomu.fyi/company/thumbtack.md)
- Author: Thumbtack Engineering
- Published: Apr 29, 2026
- Type: Problem & solution

Thumbtack evaluates generative AI features across customer and service professional experiences to prevent unsupported claims, tone inconsistencies, and safety issues. The engineering organization transitioned from decentralized evaluation efforts to a dedicated cross-functional Evals team that provides shared infrastructure while preserving product team autonomy. System architectures combine rule-based checks, AI-as-a-judge scorers powered by DeepEval, trust and safety assessments, and crowdsourced human reviews. Teams leverage three parallel orchestration paths, including an MLflow-tracked stack, nightly Databricks batch jobs integrated with data warehouses, and multi-layer human-in-the-loop pipelines. Future milestones target centralized LLM judge registries, full task journey evaluations, automated judge-writing workflows, and cost-aware evaluation orchestration.


### [DeepInfra on Hugging Face Inference Providers 🔥](https://yomu.fyi/post/deepinfra-on-hugging-face-inference-providers.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Aray Sultanbekova, Shang-Pin, Utemuratov, Yessen K, Oguz Vuruskaner, Célina Hanouti, Simon Brandeis, Lucain Pouget
- Published: Apr 29, 2026
- Type: Announcement

DeepInfra is now a supported Inference Provider on the Hugging Face Hub, adding its serverless inference platform and catalog of more than 100 models to model pages and client integrations. The initial integration supports conversational and text-generation tasks, with access to open-weight LLMs including DeepSeek V4, Kimi-K2.6, and GLM-5.1; support for text-to-image, text-to-video, embeddings, and other tasks will roll out soon. Users can configure provider API keys and preferences in account settings, or authenticate with a Hugging Face token so requests are routed through Hugging Face, including from the Python and JavaScript SDKs and supported agent harnesses. Direct requests are billed by the provider, while routed requests use standard provider API rates without additional markup, and Hugging Face PRO users receive $2 of monthly Inference credits.


### [From init to deploy: building with agents and Stripe Projects](https://yomu.fyi/post/from-init-to-deploy-building-with-agents-and-stripe-projects.md)
- Company: [Stripe](https://yomu.fyi/company/stripe.md)
- Author: Anna Spysz
- Published: Apr 29, 2026
- Type: Tutorial

The post describes an internal agentic transcription app built to reduce the manual effort required to correct auto-generated subtitles for Stripe Developers videos. The app uses a Next.js interface with transcript, chat, and corrected-output panels, while Stripe Projects CLI links Vercel and OpenRouter and populates required environment variables. An LLM client supports selectable models, iterative instructions, and a transcription agent whose system prompt emphasizes preserving transcript structure; the agent can also use Stripe documentation search through MCP. In a benchmark on a 771-line meetup script, Gemini 2.5 Pro reached 99% accuracy, while the tested models reduced editing from more than 30 minutes to just over two minutes of generated edits plus a human check. The reported overall reduction was 4x, with testing costs totaling $2.54.


### [Introducing NVIDIA Nemotron 3 Nano Omni: Long-Context Multimodal Intelligence for Documents, Audio and Video Agents](https://yomu.fyi/post/introducing-nvidia-nemotron-3-nano-omni-long-context-multimodal-intell.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Tuomas Rintamaki, Amala Sanjay Deshmukh, Nabin Mulepati, Collin McCarthy, Pritam Biswas, Arushi Goel, Alexandre Milesi, Danial Mohseni Taheri, Kateryna Chumachenko, Isabel Hulseman, Zhehuai Chen, Karan, Tao, Leili Tavabi, Ehsan Hosseini Asl
- Published: Apr 28, 2026
- Type: Announcement

NVIDIA Nemotron 3 Nano Omni is introduced as an omni-modal understanding model for document analysis, multiple-image reasoning, automatic speech recognition, long audio-video understanding, agentic computer use, and general reasoning. It extends the Nemotron multimodal line from vision-language processing to text, image, video, and audio, targeting long, dense inputs such as 100-plus-page documents and mixed audio-visual evidence. Its unified encoder-projector-decoder combines a Nemotron 3 Nano 30B-A3B hybrid Mamba-Transformer MoE backbone with C-RADIOv4-H and Parakeet-TDT-0.6B-v2 encoders; dynamic visual resolution, Conv3D tubelets, and Efficient Video Sampling support multimodal context compression. The post reports leading or top results across document, video, audio-video, voice, and ASR benchmarks, alongside up to 9x higher throughput and 2.9x single-stream reasoning speed on multimodal use cases, and provides BF16, FP8, and NVFP4 checkpoints.


### [Connecting Agents to Decisions](https://yomu.fyi/post/connecting-agents-to-decisions.md)
- Company: [Palantir](https://yomu.fyi/company/palantir.md)
- Author: Palantir
- Published: Apr 28, 2026
- Type: Explainer

Palantir’s Ontology is presented as a decision-centric architecture for human-agent operations, intended to represent how enterprises make and execute decisions rather than only storing or analyzing data. It combines data, logic, action, and security in a shared, dynamic representation that can connect operational data, computational processes, workflow execution, and policy controls. The data layer includes structured, streaming, edge, unstructured, imagery, and decision data, with decision lineage recording the data version, application, and decision context; logic binding connects heterogeneous business, modeling, planning, and optimization assets for human and agent workflows. The architecture exposes approved actions to agents with configurable human review and guardrails, while capturing decisions as learning material for improving workflows and agentic memory. It concludes that a real-time ontology can anchor AI in enterprise conditions while controlling where automation is allowed.


### [OpenAI GPT-5.5 + Codex, now available and fully governed on Databricks](https://yomu.fyi/post/openai-gpt-5-5-codex-now-available-and-fully-governed-on-databricks.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Patrick Wendell, Hanlin Tang, Ahmed Bilal, Arnav Singhvi, Ivan Zhou, Harish Gaur
- Published: Apr 24, 2026
- Type: Announcement

Databricks announces native support for OpenAI’s GPT-5.5, making it available for coding workflows with Codex, enterprise agents, document pipelines, and data-driven employee workflows. Access is governed through Unity AI Gateway, which provides permissions and rate limits, configurable guardrails for PII, prompt injection, and content safety, MCP tool-call auditing, failover, and request-level observability for model and Codex interactions. The announcement describes GPT-5.5 use with Genie for natural-language analytics, Agent Bricks Custom Agents for multi-step workflows, and Lakeflow Spark Declarative Pipelines for document-focused GenAI ETL involving summarization, extraction, and classification. GPT-5.5 is available on Databricks across AWS, Azure, and GCP, with entry points including AI Playground, governed Codex endpoints, Agent Bricks, and the Foundation Model API.


### [DeepSeek-V4: a million-token context that agents can actually use](https://yomu.fyi/post/deepseek-v4-a-million-token-context-that-agents-can-actually-use.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: ben burtenshaw
- Published: Apr 24, 2026
- Type: Explainer

DeepSeek V4 is presented as an open model family aimed at long-running agentic workloads, with Pro and Flash MoE checkpoints offering 1M-token context windows. Its central architecture alternates Compressed Sparse Attention (CSA) and Heavily Compressed Attention (HCA), compressing KV entries by 4x and 128x respectively, while using FP8/BF16 storage and FP4 indexing. The post-training design preserves reasoning across user turns when tool calls are present, introduces a dedicated XML tool-call schema, and relies on DSec, a Rust sandbox platform for RL rollouts. At 1M tokens, Pro uses 27% of V3.2's single-token FLOPs and 10% of its KV cache, while Flash uses 10% and 7%; V4-Pro-Max reports 80.6% on SWE Verified and 0.59 MRCR 8-needle retrieval at 1M.


### [Databricks partners with OpenAI on GPT-5.5](https://yomu.fyi/post/databricks-partners-with-openai-on-gpt-5-5.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Hanlin Tang, Ahmed Bilal, Arnav Singhvi, Ivan Zhou, Harish Gaur
- Published: Apr 23, 2026
- Type: Announcement

Databricks announces a partnership with OpenAI around GPT-5.5, described as OpenAI’s strongest frontier model for enterprise agentic work, complex document reasoning, and long-horizon coding agents. The model powers Codex and is presented as able to research, analyze data, create documents and spreadsheets, operate software, use tools, check outputs, recover from ambiguity, and continue through multi-part tasks. Databricks evaluated it on OfficeQA, a benchmark built from 89,000 pages of U.S. Treasury Bulletins that tests document retrieval, table interpretation, and precise calculation. With retrieval handled, GPT-5.5 scored 64.66% versus GPT-5.4’s 57.14%; in the full-agent OfficeQA Pro Agent Harness, it scored 52.63% versus 36.10%, representing reported improvements of roughly 13% and a 46% reduction in errors.


### [How to Use Transformers.js in a Chrome Extension](https://yomu.fyi/post/how-to-use-transformers-js-in-a-chrome-extension.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Nico Martin
- Published: Apr 23, 2026
- Type: Tutorial

The guide explains how to build a Chrome extension that runs local AI with Transformers.js under Manifest V3, using a browser assistant as the reference architecture. It assigns model orchestration, lifecycle management, tool execution, and conversation state to a background service worker, while a side panel handles chat and a content script handles page extraction and highlighting. The implementation uses Gemma 4 E2B in q4f16 for text generation and all-MiniLM-L6-v2 in fp32 for embeddings, with WebGPU, DynamicCache-based KV caching, explicit download progress, and reusable pipelines. Typed message contracts, model-output parsing, and separate internal and UI transcripts support a deterministic tool loop, while chrome.storage.local, IndexedDB, and background caches place data according to lifecycle and access needs; the guide concludes that separating these runtimes keeps the UI responsive and avoids duplicate model loads.


### [Are LLM agents good at join order optimization?](https://yomu.fyi/post/are-llm-agents-good-at-join-order-optimization.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Eric Liang, Ryan Marcus, Sid Taneja, Yuhao Zhang
- Published: Apr 22, 2026
- Type: Benchmark

Join ordering is difficult because relational optimizers choose among exponentially many plans and depend on potentially inaccurate cardinality estimates. Databricks and UPenn researchers built an LLM agent that uses structured outputs to generate valid join reorderings and executes candidates through a tool returning runtime and intermediate subplan sizes. It can test up to 50 iterations, while the evaluation tested 15 rollouts per query across 113 Join Order Benchmark queries after duplicating each dataset row ten times. With a frontier model, the best tested orders improved geometric-mean latency by 1.288 times and reduced P90 latency by 41% versus the standard Databricks optimizer. A five-way example links its gain to LIKE predicates that are exceptionally difficult for cardinality estimators.


### [How to Influence LLM Responses: A Guide to AI Visibility](https://yomu.fyi/post/how-to-influence-llm-responses-a-guide-to-ai-visibility.md)
- Company: [Brandwatch](https://yomu.fyi/company/brandwatch.md)
- Author: Ksenia Newton
- Published: Apr 22, 2026
- Type: Explainer

AI tools increasingly answer consumer questions directly, reducing click-throughs while making remaining referrals more likely to convert, according to the Post. Brands therefore need to influence the broader information environment that shapes LLM recommendations, not merely optimize the URLs shown as citations. LLMs draw on owned content, earned media, and social conversations, including crawlable trade publications, industry blogs, Reddit, forums, and podcast transcripts. A telecommunications brand illustrates the owned-content route: after identifying real troubleshooting questions and publishing targeted answers, it reduced call center contact volume by 25% and improved issue resolution. The guidance also stresses concrete claims, authentic participation, and monitoring outdated or inaccurate narratives to build fresher context around a brand.


### [Flow generation through natural language: An agentic modeling approach](https://yomu.fyi/post/flow-generation-through-natural-language-an-agentic-modeling-approach.md)
- Company: [Shopify](https://yomu.fyi/company/shopify.md)
- Author: 2023-10-18
- Published: Apr 22, 2026
- Type: Explainer

Shopify built a tool-calling agent for Sidekick that converts natural-language requests into Shopify Flow workflows, addressing the cold-start problem by working backward from thousands of anonymized production workflows. The team generated synthetic queries and tool trajectories, fine-tuned Qwen3-32B, and changed Flow’s nested JSON DSL into an equivalent Python representation connected by a round-trip transpiler. Using Python improved syntactic correctness by 22 points and semantic correctness by 13 points on a 300-example benchmark, while matching production tool names, ordering, responses, and prompts proved essential to avoid degradation. Production evaluation exposed a 35% gap masked by benchmark parity, so Shopify built a weekly feedback loop that scores conversations, filters training data, identifies slice gaps, retrains, and deploys. The resulting agent serves most production traffic, runs 2.2 times faster at 68% lower cost, and outperforms closed models.


[Newer posts](https://yomu.fyi/topic/llm/page/22.md) · [Older posts](https://yomu.fyi/topic/llm/page/24.md)