---
title: "Memory scaling for AI agents"
description: "Memory scaling is proposed as an agent’s performance improving when it accumulates past conversations, feedback, interaction trajectories, and business context in persistent external memory. Unlike model-parameter or inference-time scaling, it relies on selective retrieval to supply relevant information without filling long context windows. In MemAlign experiments on Databricks Genie Spaces, adding labeled examples raised test scores from near zero to 70%, about 5% above an expert-curated baseline, while average reasoning steps fell from about 20 to 5; filtered user logs produced similarly strong gains, exceeding 50% after 62 records. Production use requires storage and retrieval for episodic and semantic memories with organizational and user-level scoping, plus controls that preserve permissions and sensitivity labels."
---

# Memory scaling for AI agents

[Databricks](https://yomu.fyi/company/databricks) · The Databricks AI Research Team · Sep 18, 2026

**Type:** Explainer

## Summary

Memory scaling is proposed as an agent’s performance improving when it accumulates past conversations, feedback, interaction trajectories, and business context in persistent external memory. Unlike model-parameter or inference-time scaling, it relies on selective retrieval to supply relevant information without filling long context windows. In MemAlign experiments on Databricks Genie Spaces, adding labeled examples raised test scores from near zero to 70%, about 5% above an expert-curated baseline, while average reasoning steps fell from about 20 to 5; filtered user logs produced similarly strong gains, exceeding 50% after 62 records. Production use requires storage and retrieval for episodic and semantic memories with organizational and user-level scoping, plus controls that preserve permissions and sensitivity labels.

## Context

Memory scaling is presented as a complement to parametric and inference-time scaling. It uses persistent external memory to provide domain knowledge, user preferences, successful workflows, and business context without changing model weights, while selective retrieval avoids the latency, cost, and reasoning degradation associated with inserting very large raw contexts.

## Approach / What changed

MemAlign stores past interactions as episodic memories, uses an LLM to distill them into generalized semantic memories, and retrieves relevant entries during inference. The broader design combines structured and unstructured search, organizational and user-level scoping, memory-management pipelines, and governance controls; the Instructed Retriever translates natural-language instructions and knowledge-source schemas into structured search queries.

## Takeaways

- With labeled Genie Space examples, test scores rose from near zero to 70%, about 5% above the expert-curated baseline, while average reasoning steps dropped from about 20 to 5.
- In a live Genie Space, an automated reference-free judge filtered historical user logs; performance exceeded the 33.0% expert-curated baseline after 62 records and rose above 50%.
- Memory growth creates operational risks: low-quality traces, stale knowledge, privacy leaks, and inaccessible memories can limit scaling, so retrieval, freshness, permissions, and sensitivity labels must be managed.

## FAQ

### How does MemAlign turn interaction history into usable memory?

It stores interaction records as episodic memories, then uses an LLM to distill generalized rules and patterns into semantic memories. Relevant episodic and semantic entries are retrieved at inference time to guide the agent.

### Why not put all historical information into a large context window?

Packing millions of raw tokens into a prompt increases latency and compute costs and can degrade reasoning as irrelevant tokens compete for attention. Memory scaling instead uses selective retrieval to surface high-signal information for the current task.

### What can prevent an agent from benefiting as its memory grows?

Low-quality traces may teach incorrect behavior, and memories can become stale or violate privacy and access boundaries. Even accurate memories may remain unused if the agent cannot discover that they exist or issue an effective query.

**Tags:** [AI Agents](https://yomu.fyi/topic/ai-agents), [Architecture](https://yomu.fyi/topic/architecture), [Data Governance](https://yomu.fyi/topic/data-governance)

- Source: [Databricks](https://www.databricks.com/blog/memory-scaling-ai-agents)
- Source URL: https://www.databricks.com/blog/memory-scaling-ai-agents
- Ingested by Yomu: 2026-09-17T14:06:17.675Z

[Read original post](https://www.databricks.com/blog/memory-scaling-ai-agents)