DBScholar

Back to papers

Ultron: History-Based Query Optimization at Databricks

Summary: Ultron brings history-based, subplan-level query optimization to Databricks’ massive lakehouse, compensating for sparse statistics by learning from repetitive workloads. Its drift-aware, three-tier architecture safely complements AQE, improving eligible join latency 25% in production. (summarized by gpt-5.6-luna on Aug 28 2026)

Paper ID
hf53f556bacf68a2f
Venue
VLDB
Year
2026
Pagerank
4.9793485e-05
Overall Rank
10,941 | 26.44%
DOI
10.14778/3827998.3828038

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

BibTeX Citation

@article{nakandala_vldb26,
        title = {{Ultron: History-Based Query Optimization at Databricks}},
        author = {Nakandala, Supun and Korlapati, RK and Liang, Eric and Zhang, Yunjia and Zhang, Yuhao and Gubichev, Andrey and Jiang, Kelvin and Sismanis, Yannis and Mokhtar, Mostafa and Taneja, Sid and Ercegovac, Vuk and Hormati, Amir and Shukla, Amit and Petropoulos, Michalis and Xin, Reynold and Marcus, Ryan},
        journal = {PVLDB},
        series = {{VLDB} '26},
        volume = {19},
        number = {12},
        pages = {4358--4371},
        doi = {10.14778/3827998.3828038},
        url = {https://doi.org/10.14778/3827998.3828038},
        year = {2026}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank Citing Paper Year Venue Pagerank
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 50 of 51 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
1 Access Path Selection in a Relational Database Management System 1979 SIGMOD 0.0023947656
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061066921
53 Eddies: Continuously Adaptive Query Processing 2000 SIGMOD 0.00040860054
98 LEO - DB2's LEarning Optimizer 2001 VLDB 0.00034106982
362 Bao: Making Learned Query Optimization Practical 2021 SIGMOD 0.00019989474
560 Plan-Structured Deep Neural Network Models for Query Performance Prediction 2019 VLDB 0.00016403151
734 Adaptive Filters for Continuous Queries over Distributed Data Streams 2003 SIGMOD 0.00014374443
950 Lakehouse: A New Generation of Open Platforms that Unify Data Warehousing and Advanced Analytics 2021 CIDR 0.00012895553
1,487 Photon: A Fast Query Engine for Lakehouse Systems 2022 SIGMOD 0.00010521722
1,800 SkinnerDB: Regret-Bounded Query Evaluation via Reinforcement Learning 2018 VLDB 9.6093317e-05
1,839 Why TPC Is Not Enough: An Analysis of the Amazon Redshift Fleet 2024 VLDB 9.5304799e-05
2,250 QueryFormer: A Tree Transformer Model for Query Plan Representation 2022 VLDB 8.7533306e-05
2,891 Query Optimizers: Time to Rethink the Contract? 2009 SIGMOD 7.9021718e-05
2,987 Adapting to Source Properties in Processing Data Integration Queries 2004 SIGMOD 7.7773398e-05
3,153 Robust Join Processing with Diamond Hardened Joins 2024 VLDB 7.5883271e-05
3,169 Panda: Performance Debugging for Databases using LLM Agents 2024 CIDR 7.5696238e-05
3,316 Cloud Analytics Benchmark 2023 VLDB 7.4373161e-05
3,440 Advanced Partitioning Techniques for Massively Distributed Computation 2012 SIGMOD 7.2986853e-05
3,487 LOGER: A Learned Optimizer towards Generating Efficient and Robust Query Execution Plans 2023 VLDB 7.263041e-05
3,949 Deploying a Steered Query Optimizer in Production at Microsoft 2022 SIGMOD 6.9052796e-05
4,114 Automatic Database Configuration Debugging using Retrieval-Augmented Language Models 2025 SIGMOD 6.7971182e-05
4,202 Kepler: Robust Learning for Faster Parametric Query Optimization 2023 SIGMOD 6.7374091e-05
4,234 Adaptive Statistics in Oracle 12c 2017 VLDB 6.7134191e-05
4,683 AutoSteer: Learned Query Optimization for Any SQL Database 2023 VLDB 6.4716143e-05
4,950 Debunking the Myth of Join Ordering: Toward Robust SQL Analytics 2025 SIGMOD 6.3421691e-05
5,039 Leveraging Query Logs and Machine Learning for Parametric Query Optimization 2022 VLDB 6.3023214e-05
5,214 Stage: Query Execution Time Prediction in Amazon Redshift 2024 SIGMOD 6.2248104e-05
5,241 FASTgres: Making Learned Query Optimizer Hinting Effective 2023 VLDB 6.2154384e-05
5,348 Adaptive and Robust Query Execution for Lakehouses at Scale 2024 VLDB 6.1690434e-05
5,456 Eraser: Eliminating Performance Regression on Learned Query Optimizer 2024 VLDB 6.1239873e-05
5,871 PilotScope: Steering Databases with Machine Learning Drivers 2024 VLDB 5.9639223e-05
5,902 Yannakakis+: Practical Acyclic Query Evaluation with Theoretical Guarantees 2025 SIGMOD 5.9536872e-05
6,029 Proactive Re-optimization with Rio 2005 SIGMOD 5.9105715e-05
6,240 Predicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses 2024 SIGMOD 5.8382355e-05
6,586 Can Large Language Models Be Query Optimizer for Relational Databases? 2026 SIGMOD 5.7430662e-05
6,710 Simple Adaptive Query Processing vs. Learned Query Optimizers: Observations and Analysis 2023 VLDB 5.7019157e-05
6,764 Guided automated learning for query workload re-optimization 2019 VLDB 5.6873334e-05
6,805 Instance-Optimal Acyclic Join Processing Without Regret: Engineering the Yannakakis Algorithm in Column Stores 2025 VLDB 5.6780394e-05
7,817 Parachute: Single-Pass Bi-Directional Information Passing 2025 VLDB 5.4477841e-05
7,860 Changing Flights in Mid-air: A Model for Safely Modifying Continuous Queries 2011 SIGMOD 5.4391693e-05
8,332 Learned Offline Query Planning via Bayesian Optimization 2025 SIGMOD 5.3528188e-05
8,524 ROME: Robust Query Optimization via Parallel Multi-Plan Execution 2024 SIGMOD 5.3231221e-05
9,113 Presto’s History-based Query Optimizer 2024 VLDB 5.2276066e-05
9,300 GenJoin: Conditional Generative Plan-to-Plan Query Optimizer that Learns from Subplan Hints 2026 SIGMOD 5.1987909e-05
9,670 Low Rank Learning for Offline Query Optimization 2025 SIGMOD 5.1452097e-05
10,290 This is Going to Sound Crazy, But What If We Used Large Language Models to Boost Automatic Database Tuning Algorithms By Leveraging Prior History? We Will Find Better Configurations More Quickly Than Retraining From Scratch! 2026 SIGMOD 5.0431863e-05
10,291 Why Database Manuals Are Not Enough: Efficient and Reliable Configuration Tuning for DBMSs via Code-Driven LLM Agents 2026 VLDB 5.0431863e-05
10,292 Andromeda: Debugging Database Performance Issues with Retrieval-Augmented Large Language Models 2025 SIGMOD 5.0431863e-05
10,293 D-Bot: An LLM-Powered DBA Copilot 2025 SIGMOD 5.0431863e-05
10,350 Survivorship Bias in Industrial Database Workloads 2026 CIDR 4.9793485e-05
Previous Page 1 / 2 Next

Semantically Similar Papers