DatabricksJonathan Brito, Gary ShambatAnnouncement
Unlock powerful insights and forecasts with Predictive AI Functions
Summary
Data teams frequently field questions about future sales, metric movements, and anomalous data, but answering them typically requires data science teams to build and manage models, creating a bottleneck. Predictive AI Functions, now in Beta, remove that bottleneck by providing SQL-native functions for forecasting, driver analysis, and anomaly detection, backed by state-of-the-art ML models maintained centrally by Databricks. The launch includes ai_forecast for time series projection, ai_top_drivers for segment driver analysis, ai_detect_anomalies for outlier detection, and ai_predict_value and ai_predict_class for regression and classification. These functions can be called directly in SQL, invoked through Genie with plain-language questions, or embedded in dashboards, delivering consistent, high-quality answers without infrastructure management. Benchmarking on fev-bench shows ai_forecast outperforms forecasting functions from leading cloud data warehouses, achieving industry-leading accuracy out of the box with no tuning required.
Context
Databricks announces Predictive AI Functions, a set of SQL-native functions for advanced analytics, now in Beta. The functions aim to democratize forecasting, driver analysis, and anomaly detection by making them accessible to analysts and business users without data science expertise.
Approach / What changed
Databricks provides SQL-native Predictive AI Functions backed by centrally maintained ML models. Users call ai_forecast, ai_top_drivers, ai_detect_anomalies, ai_predict_value, and ai_predict_class directly in SQL, through Genie with plain-language questions, or embedded in dashboards, without building or managing infrastructure.
Takeaways
Predictive AI Functions include ai_forecast, ai_top_drivers, ai_detect_anomalies, ai_predict_value, and ai_predict_class, all callable as native SQL functions.
ai_forecast uses a transformer-based time series foundation model pretrained on diverse time series, requiring no tuning and supporting holiday effects and external covariates.
In fev-bench benchmarking, ai_forecast outperformed forecasting functions from a leading cloud data warehouse, achieving a higher task win rate.
FAQ
How do Predictive AI Functions work?
Predictive AI Functions are SQL-native functions backed by ML models maintained centrally by Databricks. Users call them directly in SQL, through Genie with plain-language questions, or embedded in dashboards, without building or managing any infrastructure.
What functions are included?
The launch includes ai_forecast for time series projection, ai_top_drivers for segment driver analysis, ai_detect_analytics for outlier detection, ai_predict_value for regression, and ai_predict_class for classification.
How does ai_forecast compare to other cloud data warehouse forecasting?
In fev-bench benchmarking, ai_forecast outperformed forecasting functions from a leading cloud data warehouse, achieving a higher task win rate with no tuning required.
Source and freshness
- Source
- databricks.com
- Published
- Added to Yomu
Summaries are generated from the original by a language model. Check the original before relying on it.
Keep reading
Related reading
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
The best engineering reads, once a week
One useful email. Unsubscribe anytime.