# Building Deep Research: How we Achieved State of the Art

[Hugging Face](https://yomu.fyi/company/hugging-face) · Michael Griff, Dean Sacoransky, Noah Nefsky · Nov 24, 2025

**Type:** Problem & solution

## Summary

Building production AI research agents presents challenges around context window pollution, escalating token costs, and architectural brittleness across model updates. To resolve these issues, Tavily rebuilt its deep research system around simplified orchestration, compact tooling, and active context curation. The agent mimics human research workflows by distilling tool outputs into concise reflections for ongoing reasoning, withholding raw retrieved web data until the final deliverable stage. Compared to traditional ReAct propagation architectures where token consumption scales quadratically, this reflection-based approach achieves linear token growth. As a result, the system reduced token consumption by 66% compared to Open Deep Research while reaching state-of-the-art performance on DeepResearch Bench.

## Context

Long-horizon AI research agents face critical failure modes due to context window saturation, tool selection errors, non-deterministic drift, and quadratic token accumulation across iterative retrieval loops.

## Approach / What changed

Tavily redesigned its deep research agent by simplifying orchestration logic, utilizing a minimal toolset, deduplicating search sources, and performing tool-side context curation via Tavily Advanced Search. Instead of propagating cumulative raw outputs across tool-calling iterations, the agent stores distilled reflections in short-term context and supplies raw content only when generating the final deliverable.

## Takeaways

- Distilling tool outputs into reflections rather than propagating raw web tokens changes tool-calling context growth from quadratic to linear, reducing token consumption by 66% relative to Open Deep Research.
- Global state persistence and source deduplication keep agent context fresh, signal when information scope is narrowing to trigger broader exploration, and enable accurate source attribution.
- Providing a smaller, essential toolset reduces failure modes compared to large toolsets, helping models reliably choose tools and avoid iterative breakdowns.

**Tags:** [Architecture](https://yomu.fyi/topic/architecture), [LLMs](https://yomu.fyi/topic/llm), [Performance](https://yomu.fyi/topic/performance), [Search](https://yomu.fyi/topic/search)

[Read original post](https://huggingface.co/blog/Tavily/tavily-deep-research)