DatabricksCharlie Klein, Bryan SmithProblem & solution
The Web Search Your Agent Inherited Isn't Good Enough
Summary
An agent that keeps a company’s market view current must combine Databricks-hosted internal account records with external web signals such as funding rounds, leadership changes, product launches, and hiring surges. The initial implementation duplicates enrichment logic across Claude Code, Codex, and a direct model API, with inconsistent search results and no shared cost, governance, or audit trail. Omnigent consolidates the agent definition, model, tools, policies, limits, and model-call governance above those harnesses, while letting the engineer select a common search provider. Nimble’s Search API supplies live web data, while its Web Search Agents orchestrate multi-source retrieval and extraction, cross-check sources, return citations, and adapt to difficult sites and recurring retrieval paths. In Nimble’s testing, adding its search increased LLM benchmark accuracy from 46% to 71% and halved web search costs; the proposed Databricks setup then connects internal records and external context under one governance surface.
Context
The post describes an agent monitoring a few hundred thousand prospects and customer accounts. Internal records reside in Databricks Delta tables governed by Unity Catalog, while relevant engagement signals live on the web. Rebuilding the same enrichment logic across multiple agent harnesses creates inconsistent search quality, duplicated configuration work, and fragmented cost, policy, and audit controls.
Approach / What changed
Define the agent once in Omnigent with its model, tools, policies, and limits, then run it on a Databricks-hosted model through the Foundation Model APIs. Assign Nimble to the web_search builtin so each underlying harness uses the same Search API; use Nimble’s Web Search Agents for research or enrichment requiring multi-source extraction, cross-checking, citations, and an audit trail. The setup requires connecting Omnigent to Databricks and providing a Nimble account key.
Takeaways
Omnigent places one agent definition and governance surface above Claude Code, Codex, and direct API execution, eliminating separate enrichment implementations and centralizing model-call cost and audit capture.
Nimble’s Web Search Agents can cross-check multiple sources, return citations, and retrieve data behind JavaScript, filters, and pagination that an ordinary crawler may miss.
Nimble reports that its search raised LLM benchmark accuracy from 46 percent to 71 percent while cutting web search costs in half in its testing.
FAQ
When should an agent use Nimble’s Search API versus Web Search Agents?
The Search API provides fresh, real-time web data for general grounding. Web Search Agents are intended for deeper research, enrichment, or dataset-building tasks that need search and extraction orchestration, source cross-checking, citations, and an audit trail.
How does Omnigent make search consistent across different agent harnesses?
The engineer names Nimble on the web_search builtin in the shared agent configuration. Every Databricks-hosted agent underneath then points to the same Nimble Search API instead of relying on each harness’s bundled search tool.
What prerequisites are required for the Databricks setup?
The Omnigent Beta must be enabled for the workspace, and the workspace must be in a region supporting Unity AI Gateway. The setup also requires a Nimble key, which the post says is available through a free trial.
Source and freshness
- Source
- databricks.com
- Published
- Added to Yomu
Summaries are generated from the original by a language model. Check the original before relying on it.
Keep reading
Related reading
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
The best engineering reads, once a week
One useful email. Unsubscribe anytime.