---
title: "Retrieval-Augmented Generation"
description: "12 posts about Retrieval-Augmented Generation, summarised, each linking to the original."
---

# Retrieval-Augmented Generation
> 12 posts about Retrieval-Augmented Generation, summarised, each linking to the original.

## Articles

### [Why AI Agents Get the Right Facts but the Wrong Answer—and How GraphRAG Helps](https://yomu.fyi/post/why-ai-agents-get-the-right-facts-but-the-wrong-answer-and-how-graphra.md)
- Company: [Salesforce](https://yomu.fyi/company/salesforce.md)
- Author: Scott Nyberg
- Published: Aug 31, 2026

The post examines why an agent can cite accurate return-policy evidence yet reject an eligible customer when decisive facts are distributed across systems. Its washing-machine scenario combines a product classification, an extended-policy rule, membership tier, purchase amount, and purchase date to show that retrieving enough evidence differs from retrieving relevant evidence. GraphRAG addresses the gap by extracting entities and relationships into a knowledge graph, then using multi-hop retrieval to follow connections from WM-500 to the applicable policy and supporting records. The implementation also uses explicit pointers from graph entities to structured data, while separating the TBox blueprint from ABox instances and requiring business validation of the schema. The diagnostic framework distinguishes missing retrieved context, omitted business rules, and broken record mappings, while noting that these examples are not benchmark results and that correct evidence can still be used incorrectly.


### [What is an AI Copilot?](https://yomu.fyi/post/what-is-an-ai-copilot.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: Aug 28, 2026

An AI copilot is an assistant embedded in a software application that uses workflow context to offer suggestions, generated content, or approved actions while keeping the human in control. Unlike a standalone chatbot, it combines an LLM with contextual grounding, retrieval-augmented generation (RAG), access to enterprise data, and action layers that can call APIs, execute code, trigger workflows, or update records. The explainer surveys code, productivity, data and analytics, customer-facing, and domain-specific copilots, including uses such as SQL generation, dashboard creation, email drafting, and case summarization. Reported benefits include faster routine work, broader data access, more consistent outputs, and less context switching; a cited GitHub study found Copilot users completed a controlled coding task 55% faster. It also stresses hallucinations, privacy, bias, overreliance, integration complexity, cost, and the requirement for human review, governance, and accountability.


### [RAG vs Fine Tuning: Enterprise Decisions for AI Models and AI Systems](https://yomu.fyi/post/rag-vs-fine-tuning-enterprise-decisions-for-ai-models-and-ai-systems.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: Jun 2, 2026

The guide frames enterprise choice between retrieval-augmented generation (RAG) and fine tuning as a trade-off between injecting knowledge at inference time and changing model weights before deployment. RAG connects an LLM to external stores by embedding a query, searching vector databases for similar chunks, and adding retrieved context to the prompt, making current information and citations possible. Fine tuning uses curated input-output examples and supervised training to update parameters; full-model training is expensive, while LoRA trains a smaller set of added weights and can support a single-GPU pilot. The decision depends on whether the priority is stable behavior and output format or fresh, traceable knowledge, alongside data quality, latency, compute, and maintenance requirements. For many mature deployments, the guide recommends combining both: fine tuning for domain understanding and consistency, and RAG for real-time data.


### [How World Bank Group uses Databricks to eradicate poverty through shared knowledge](https://yomu.fyi/post/how-world-bank-group-uses-databricks-to-eradicate-poverty-through-shar.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Kacey Hertan
- Published: May 22, 2026

The World Bank Group is building a unified data and AI platform on Databricks to make tens of millions of repository documents and structured operational data findable for teams pursuing shared prosperity. Legacy databases and disconnected document repositories forced researchers to search manually, slowing decisions and limiting the ability to surface lessons learned across its global portfolio. The implementation migrates operational data, applies Unity Catalog governance, uses Databricks Volumes for unstructured content, Genie for natural-language structured queries, a metrics layer for deterministic reporting, and vector search for retrieval-augmented generation over project documents. Because each Genie serves a specific metrics domain, an agentic layer combines intent and domain classification with query decomposition, routing requests among domain agents, RAG, and visualization components before assembling one response; a multi-region feedback prototype was deployed in approximately two and a half days.


### [From manual to autonomous: how AI agents are transforming electric grid operations](https://yomu.fyi/post/from-manual-to-autonomous-how-ai-agents-are-transforming-electric-grid.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Julien Debard, Edward Tavares
- Published: May 14, 2026

Electric utilities are facing rising demand, retiring generation, extreme weather, aging infrastructure, and fragmented operational data that manual processes cannot manage at scale. AI agents are presented as a human-centered alternative that synthesizes heterogeneous data, learns from outcomes, and progresses from human-approved recommendations to exception-based control and eventually autonomous operations within defined parameters. Hawaiian Electric used a Retrieval Augmented Generation proof-of-concept with Databricks AI Search, Unity Catalog, and Lakeflow Declarative Pipelines to query regulatory documents and provide page-specific citations. The system reduced response times from five minutes to five seconds and was implemented in two weeks, while the article describes broader potential for predictive maintenance, outage response, load forecasting, and customer service.


### [Generative AI for Business: A Complete Strategy and Implementation Guide](https://yomu.fyi/post/generative-ai-for-business-a-complete-strategy-and-implementation-guid.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: May 1, 2026

Generative AI is presented as an enterprise technology shift with potential value across customer operations, marketing and sales, software engineering, and research and development, which together are described as accounting for approximately 75% of use-case value across industries. The guide distinguishes generative systems, which create text, images, code, audio, or structured data from predictive models, and explains how foundation models and LLMs support open-ended business applications. Its implementation strategy prioritizes reliable data infrastructure, high-impact low-complexity pilots, and governance covering sensitive data, model limitations, monitoring, human review, and compliance. Recommended execution includes a cross-functional squad, predefined KPIs, user training, baseline measurements, and a 90-day executive review with scale, iterate, or discontinue decisions. Retrieval-augmented generation is identified as the most widely adopted way to reduce hallucinations by grounding responses in verified proprietary data, while ROI is expected within six to twelve months for a well-structured pilot.


### [How to transform document activation workflows with Genie and Agent Bricks](https://yomu.fyi/post/how-to-transform-document-activation-workflows-with-genie-and-agent-br.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Elena Tesser
- Published: Apr 22, 2026

Enterprise document workflows often require people to read PDFs, copy fields into spreadsheets, and re-enter data into business systems, creating delays, error risk, and weak auditability. The proposed alternative combines AI/BI Genie for natural-language queries over Delta tables, Agent Bricks for production agents, and Unity Catalog for permissions, lineage, and traceability. A five-phase workflow extracts fields into Lakeflow Bronze, Silver, and Gold layers, then supports structured queries, clause-level RAG answers, multi-agent routing, and actions through MCP servers. Examples include syncing validated rights data to ERP or CRM systems, updating billing entitlements, and triggering workflows from detected obligations. The approach targets media, advertising, ad tech, and telecommunications, where customers see improvements including faster month-end close, recovered revenue, reduced leakage, and lower operational risk.


### [A Practical Guide to LLM Fine Tuning](https://yomu.fyi/post/a-practical-guide-to-llm-fine-tuning.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: Apr 21, 2026

The guide presents LLM fine tuning as a way to adapt a pre-trained model to specific tasks, domains, or applications without full pretraining. It explains when prompting or few-shot learning is sufficient and when fine tuning is justified by quality gaps, domain terminology, latency, cost, or behavioral control. The recommended lifecycle covers scoping, data collection and cleaning, base-model and method selection, training, evaluation, deployment, and monitoring, with production-format consistency and held-out splits treated as important safeguards. It compares supervised and full fine tuning with parameter-efficient fine tuning (PEFT), including LoRA and QLoRA, which update fewer parameters and reduce compute and memory requirements. The main risks are noisy data, overfitting, and catastrophic forgetting; the proposed default is a pilot that compares a PEFT-adapted model with its base model, while combining fine tuning with RAG and prompt engineering when appropriate.


### [LLM apps: Real-world use cases, core building blocks and risks to know](https://yomu.fyi/post/llm-apps-real-world-use-cases-core-building-blocks-and-risks-to-know.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: Apr 21, 2026

LLM applications are presented as production systems that extend beyond chatbots by connecting foundation models to external data, tools, APIs, memory and workflows. Modern categories include assistants and copilots, retrieval-augmented generation (RAG), autonomous agents, multi-agent systems and local or on-device inference, each with distinct capabilities and trade-offs. A typical RAG pipeline uses vector search over a curated knowledge base, then supplies retrieved passages to the model; chunking, source freshness and retrieval accuracy affect results. Production systems also require orchestration, evaluation, observability, governance, guardrails, audit trails and human-in-the-loop checkpoints, especially when agents can call tools or execute workflows. The source distinguishes prompt engineering, which guides behavior without changing model weights, from fine-tuning, which adapts models to domain-specific tasks, and describes a unified path combining data, models, retrieval, orchestration, evaluation and governance for production deployment.


### [What is pgvector?](https://yomu.fyi/post/what-is-pgvector.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: Apr 17, 2026

pgvector is an open-source PostgreSQL extension that adds vector storage, indexing, and similarity search for embeddings alongside relational application data. It supports semantic search, recommendations, retrieval-augmented generation (RAG), image similarity, anomaly detection, and deduplication without requiring a separate vector database for many workloads. The extension uses the vector data type and distance metrics including L2, cosine similarity, and inner product, with HNSW and IVFFlat indexes offering different speed and memory trade-offs. Vector queries can also combine relational filters with Postgres full-text search for hybrid retrieval. pgvector is positioned as a practical choice for existing Postgres deployments, while pgvectorscale can extend its usefulness as data and query demands grow; dedicated vector databases become more relevant at larger scales, and Databricks AI Search serves complementary lakehouse workloads.


### [Introducing the SOP-driven LLM agent frameworks](https://yomu.fyi/post/introducing-the-sop-driven-llm-agent-frameworks.md)
- Company: [Grab](https://yomu.fyi/company/grab.md)
- Author: Fujiao Liu
- Published: Apr 25, 2025

Grab introduces an LLM agent framework that uses Standard Operating Procedures (SOPs) to guide enterprise automation and improve consistency in complex processes. It represents SOPs as trees of action and decision nodes, while a planner uses Depth-First Search, prompt generation, and backtracking to direct an LLM-powered worker agent; context compression and limited APIs are used to address hallucination and efficiency concerns. An SOP editor, plugins for APIs, Python, and SQL, workflows, a GRAG pipeline, playground, multilingual user agent, and state stack extend the framework’s capabilities. Reported evaluations include over 99.8% accuracy, an Account Takeover Investigations bot automating 87% of cases and reducing investigation time from 23 minutes to three, and fraud investigations cutting AHT by 45% and saving over 300 man-hours monthly.


### [From RAG to Richness: How Ramp Revamped Industry Classification](https://yomu.fyi/post/from-rag-to-richness-how-ramp-revamped-industry-classification.md)
- Company: [Ramp](https://yomu.fyi/company/ramp.md)
- Author: Ryne Carbone
- Published: Jan 15, 2025

Ramp's former industry classification system combined third-party data, sales-entered information, and customer self-reporting, creating inconsistent, overly broad, and unauditable categories. Precise classification was needed for compliance, portfolio monitoring, sales targeting, and product analytics, despite fuzzy boundaries, sparse data, and no ground truth. Ramp migrated to six-digit NAICS codes and built an in-house Retrieval-Augmented Generation model that embeds business data, retrieves candidate codes, and uses an LLM to select a final prediction. The system evaluates retrieval with accuracy-at-k and final predictions with a hierarchy-aware fuzzy-accuracy metric, while ClickHouse stores knowledge-base embeddings and Kafka logs intermediate results. Deployed guardrails validate output codes, and the model has improved data quality, consistency, auditability, and control over tuning and costs.