---
title: "How FactSet cut model training and deployment from days to hours with Databricks AI Runtime"
description: "FactSet’s Text-to-Formula (TTF) system converts natural-language investment queries from professionals into correct FactSet Query Language (FQL) formulas. Initially built on retrieval-augmented generation (RAG), the approach hit a quality ceiling as queries became more specialized and formulas more complex. FactSet adopted fine-tuned open models within a Compound AI architecture, reducing end-to-end latency by about 60 percent and improving quality for complex formulas. Fine-tuning runs on Databricks AI Runtime with serverless GPU infrastructure, where engineers choose compute based on prompt length and output needs, and the pipeline integrates with MLflow, the Lakehouse, and Lakeflow Jobs for a unified workflow. This setup cut model setup, training, and deployment from days to hours, enabling the team to retrain every two to three weeks as new data and models become available."
---

# How FactSet cut model training and deployment from days to hours with Databricks AI Runtime

[Databricks](https://yomu.fyi/company/databricks) · Nikhil Hiriyur Sunderraj, Dakshina Murthy Malladi, Nikitha Goram, Ryan Roser, Kate Stepp, Julia Powell, Tejas Sundaresan, Lucas de Paula · Oct 15, 2026

**Type:** Problem & solution

## Summary

FactSet’s Text-to-Formula (TTF) system converts natural-language investment queries from professionals into correct FactSet Query Language (FQL) formulas. Initially built on retrieval-augmented generation (RAG), the approach hit a quality ceiling as queries became more specialized and formulas more complex. FactSet adopted fine-tuned open models within a Compound AI architecture, reducing end-to-end latency by about 60 percent and improving quality for complex formulas. Fine-tuning runs on Databricks AI Runtime with serverless GPU infrastructure, where engineers choose compute based on prompt length and output needs, and the pipeline integrates with MLflow, the Lakehouse, and Lakeflow Jobs for a unified workflow. This setup cut model setup, training, and deployment from days to hours, enabling the team to retrain every two to three weeks as new data and models become available.

## Context

FactSet’s Text-to-Formula (TTF) system converts natural-language investment queries into FactSet Query Language (FQL) formulas. Initially built on RAG, the approach hit a quality ceiling as queries became more specialized. The team turned to fine-tuned open models, but needed efficient infrastructure for recurring training every two to three weeks.

## Approach / What changed

FactSet uses Databricks AI Runtime to run fine-tuning on serverless GPU infrastructure, allowing engineers to select compute based on prompt length and output needs without provisioning hardware. The pipeline integrates with MLflow for experiment tracking and the Lakehouse for data governance, and uses Lakeflow Jobs as a plug-and-play reusable framework. This setup keeps training inside the development loop alongside data, experimentation, and model management.

## Takeaways

- FactSet’s earlier work on TTF found that incorporating fine-tuned open models reduced end-to-end latency by about 60% compared to a RAG-only system.
- By running fine-tuning on Databricks AI Runtime’s serverless GPU infrastructure, FactSet eliminated the need to provision and configure GPU environments for each training run, cutting setup, training, and deployment from days to hours.
- FactSet retrains its TTF models every two to three weeks, and the reusable pipeline built on Lakeflow Jobs allows easy adoption across different TTF tasks and other teams.

## FAQ

### How often does FactSet fine-tune its TTF models?

FactSet fine-tunes its models roughly every two to three weeks, as new training data accumulates and model updates become part of the development cycle.

### What latency improvement did fine-tuning achieve over RAG?

FactSet found that incorporating fine-tuned models reduced end-to-end latency by about 60% compared to the earlier RAG-only approach.

### What models has FactSet used for fine-tuning?

FactSet has worked with Llama-based models and continues to evaluate newer open models. Different models, prompt lengths, and output characteristics can require different compute configurations.

**Tags:** [Databricks](https://yomu.fyi/topic/databricks), [Fine-Tuning](https://yomu.fyi/topic/fine-tuning), [LLMs](https://yomu.fyi/topic/llm), [MLflow](https://yomu.fyi/topic/mlflow), [RAG](https://yomu.fyi/topic/rag)

- Source: [Databricks](https://www.databricks.com/blog/how-factset-cut-model-training-and-deployment-days-hours-databricks-ai-runtime)
- Source URL: https://www.databricks.com/blog/how-factset-cut-model-training-and-deployment-days-hours-databricks-ai-runtime
- Ingested by Yomu: 2026-10-15T18:00:13.659Z

[Read original post](https://www.databricks.com/blog/how-factset-cut-model-training-and-deployment-days-hours-databricks-ai-runtime)