DBScholar

Back to papers

Ultron: History-Based Query Optimization at Databricks

Summary: Ultron brings history-based, subplan-level query optimization to Databricks’ massive lakehouse, compensating for sparse statistics by learning from repetitive workloads. Its drift-aware, three-tier architecture safely complements AQE, improving eligible join latency 25% in production. (summarized by gpt-5.6-luna on Aug 28 2026)

Paper ID
hf53f556bacf68a2f
Venue
VLDB
Year
2026
Pagerank
4.9769913e-05
Overall Rank
10,950 | 26.41%
DOI
10.14778/3827998.3828038
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

BibTeX Citation

@article{nakandala_vldb26,
        title = {{Ultron: History-Based Query Optimization at Databricks}},
        author = {Nakandala, Supun and Korlapati, RK and Liang, Eric and Zhang, Yunjia and Zhang, Yuhao and Gubichev, Andrey and Jiang, Kelvin and Sismanis, Yannis and Mokhtar, Mostafa and Taneja, Sid and Ercegovac, Vuk and Hormati, Amir and Shukla, Amit and Petropoulos, Michalis and Xin, Reynold and Marcus, Ryan},
        journal = {PVLDB},
        series = {{VLDB} '26},
        volume = {19},
        number = {12},
        pages = {4358--4371},
        doi = {10.14778/3827998.3828038},
        url = {https://doi.org/10.14778/3827998.3828038},
        year = {2026}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank Citing Paper Year Venue Pagerank
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 50 of 51 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
1 Access Path Selection in a Relational Database Management System 1979 SIGMOD 0.0023943337
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061067652
53 Eddies: Continuously Adaptive Query Processing 2000 SIGMOD 0.000408505
98 LEO - DB2's LEarning Optimizer 2001 VLDB 0.00034099838
361 Bao: Making Learned Query Optimization Practical 2021 SIGMOD 0.00020000855
560 Plan-Structured Deep Neural Network Models for Query Performance Prediction 2019 VLDB 0.00016408613
735 Adaptive Filters for Continuous Queries over Distributed Data Streams 2003 SIGMOD 0.00014367765
950 Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics 2021 CIDR 0.00012889569
1,487 Photon: A Fast Query Engine for Lakehouse Systems 2022 SIGMOD 0.00010516813
1,800 SkinnerDB: Regret-Bounded Query Evaluation via Reinforcement Learning 2018 VLDB 9.6082185e-05
1,834 Why TPC Is Not Enough: An Analysis of the Amazon Redshift Fleet 2024 VLDB 9.5349903e-05
2,248 QueryFormer: A Tree Transformer Model for Query Plan Representation 2022 VLDB 8.7567205e-05
2,890 Query Optimizers: Time to Rethink the Contract? 2009 SIGMOD 7.9010819e-05
2,989 Adapting to Source Properties in Processing Data Integration Queries 2004 SIGMOD 7.7736772e-05
3,154 Robust Join Processing with Diamond Hardened Joins 2024 VLDB 7.5849549e-05
3,171 Panda: Performance Debugging for Databases using LLM Agents 2024 CIDR 7.5661555e-05
3,311 Cloud Analytics Benchmark 2023 VLDB 7.4364696e-05
3,440 Advanced Partitioning Techniques for Massively Distributed Computation 2012 SIGMOD 7.2954357e-05
3,479 LOGER: A Learned Optimizer towards Generating Efficient and Robust Query Execution Plans 2023 VLDB 7.2665349e-05
3,948 Deploying a Steered Query Optimizer in Production at Microsoft 2022 SIGMOD 6.9051584e-05
4,113 Automatic Database Configuration Debugging using Retrieval-Augmented Language Models 2025 SIGMOD 6.7964307e-05
4,191 Kepler: Robust Learning for Faster Parametric Query Optimization 2023 SIGMOD 6.7425275e-05
4,234 Adaptive Statistics in Oracle 12c 2017 VLDB 6.7104002e-05
4,677 AutoSteer: Learned Query Optimization for Any SQL Database 2023 VLDB 6.4721041e-05
4,945 Debunking the Myth of Join Ordering: Toward Robust SQL Analytics 2025 SIGMOD 6.3418058e-05
5,042 Leveraging Query Logs and Machine Learning for Parametric Query Optimization 2022 VLDB 6.2995365e-05
5,216 Stage: Query Execution Time Prediction in Amazon Redshift 2024 SIGMOD 6.2218868e-05
5,236 FASTgres: Making Learned Query Optimizer Hinting Effective 2023 VLDB 6.2153504e-05
5,354 Adaptive and Robust Query Execution for Lakehouses at Scale 2024 VLDB 6.1661231e-05
5,438 Eraser: Eliminating Performance Regression on Learned Query Optimizer 2024 VLDB 6.1278045e-05
5,700 PilotScope: Steering Databases with Machine Learning Drivers 2024 VLDB 6.028998e-05
5,895 Yannakakis+: Practical Acyclic Query Evaluation with Theoretical Guarantees 2025 SIGMOD 5.9534254e-05
6,024 Proactive Re-optimization with Rio 2005 SIGMOD 5.9096276e-05
6,240 Predicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses 2024 SIGMOD 5.8373399e-05
6,575 Can Large Language Models Be Query Optimizer for Relational Databases? 2026 SIGMOD 5.7428777e-05
6,714 Simple Adaptive Query Processing vs. Learned Query Optimizers: Observations and Analysis 2023 VLDB 5.6993812e-05
6,763 Guided automated learning for query workload re-optimization 2019 VLDB 5.6870172e-05
6,811 Instance-Optimal Acyclic Join Processing Without Regret: Engineering the Yannakakis Algorithm in Column Stores 2025 VLDB 5.6754603e-05
7,546 Learned Offline Query Planning via Bayesian Optimization 2025 SIGMOD 5.4966669e-05
7,810 Parachute: Single-Pass Bi-Directional Information Passing 2025 VLDB 5.4477354e-05
7,864 Changing Flights in Mid-air: A Model for Safely Modifying Continuous Queries 2011 SIGMOD 5.4366003e-05
8,373 GenJoin: Conditional Generative Plan-to-Plan Query Optimizer that Learns from Subplan Hints 2026 SIGMOD 5.3427119e-05
8,531 ROME: Robust Query Optimization via Parallel Multi-Plan Execution 2024 SIGMOD 5.3206021e-05
9,122 Presto’s History-based Query Optimizer 2024 VLDB 5.2251319e-05
9,635 Low Rank Learning for Offline Query Optimization 2025 SIGMOD 5.1453041e-05
10,296 This is Going to Sound Crazy, But What If We Used Large Language Models to Boost Automatic Database Tuning Algorithms By Leveraging Prior History? We Will Find Better Configurations More Quickly Than Retraining From Scratch! 2026 SIGMOD 5.0407989e-05
10,297 Why Database Manuals Are Not Enough: Efficient and Reliable Configuration Tuning for DBMSs via Code-Driven LLM Agents 2026 VLDB 5.0407989e-05
10,298 Andromeda: Debugging Database Performance Issues with Retrieval-Augmented Large Language Models 2025 SIGMOD 5.0407989e-05
10,299 D-Bot: An LLM-Powered DBA Copilot 2025 SIGMOD 5.0407989e-05
10,362 Survivorship Bias in Industrial Database Workloads 2026 CIDR 4.9769913e-05
Previous Page 1 / 2 Next

Semantically Similar Papers