DBScholar

Back to papers

How Good Are Query Optimizers, Really?

Summary: Introduces the Join Order Benchmark (JOB) to test optimizer components on real-world, multi-join workloads. Cardinality estimators are error-prone; cost models matter less than estimates; exhaustive dynamic programming improves plan quality over heuristics under poor cardinality. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h476371500a44338b
Venue
VLDB
Year
2016
Pagerank
0.00061066921
Overall Rank
15 | 99.91%
DOI
10.14778/2850583.2850594

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{leis_vldb16,
        title = {{How Good Are Query Optimizers, Really?}},
        author = {Leis, Viktor and Gubichev, Andrey and Mirchev, Atanas and Boncz, Peter and Kemper, Alfons and Neumann, Thomas},
        journal = {PVLDB},
        series = {{VLDB} '16},
        volume = {9},
        number = {3},
        pages = {204--215},
        doi = {10.14778/2850583.2850594},
        url = {https://doi.org/10.14778/2850583.2850594},
        year = {2016}
}

Incoming Citations (Sorted by Pagerank)

Showing 50 of 330 citing papers.

Rank Citing Paper Year Venue Pagerank
2,842 Query Performance Prediction for Concurrent Queries using Graph Embedding 2020 VLDB 7.949193e-05
2,846 FactorJoin: A New Cardinality Estimation Framework for Join Queries 2023 SIGMOD 7.9453616e-05
2,974 Accurate Summary-based Cardinality Estimation Through the Lens of Cardinality Estimation Graphs 2022 VLDB 7.7938744e-05
3,052 A Unified Deep Model of Learning from both Data and Queries for Cardinality Estimation 2021 SIGMOD 7.7052471e-05
3,060 Towards a Hands-Free Query Optimizer through Deep Learning 2019 CIDR 7.6928239e-05
3,073 Pushing Data-Induced Predicates Through Joins in Big-Data Clusters 2020 VLDB 7.6777283e-05
3,131 Every Row Counts: Combining Sketches and Sampling for Accurate Group-By Result Estimates 2019 CIDR 7.6141006e-05
3,160 A Learned Sketch for Subgraph Counting 2021 SIGMOD 7.5807496e-05
3,193 A Statistical Perspective on Discovering Functional Dependencies in Noisy Data 2020 SIGMOD 7.5505481e-05
3,204 Columnar Storage and List-based Processing for Graph Database Management Systems 2021 VLDB 7.5400217e-05
3,271 Estimating Cardinalities with Deep Sketches 2019 SIGMOD 7.4744941e-05
3,285 Performance-Optimal Filtering: Bloom Overtakes Cuckoo at High Throughput 2019 VLDB 7.4559907e-05
3,327 Robust Query Driven Cardinality Estimation under Changing Workloads 2023 VLDB 7.4207879e-05
3,336 GenRewrite: Query Rewriting via Large Language Models 2026 SIGMOD 7.4137763e-05
3,402 RHEEM: Enabling Cross-Platform Data Processing - May The Big Data Be With You! - 2018 VLDB 7.3304477e-05
3,487 LOGER: A Learned Optimizer towards Generating Efficient and Robust Query Execution Plans 2023 VLDB 7.263041e-05
3,545 Computation Reuse in Analytics Job Service at Microsoft 2018 SIGMOD 7.2134803e-05
3,562 Astrid: Accurate Selectivity Estimation for String Predicates using Deep Learning 2021 VLDB 7.2046519e-05
3,563 Auto-WLM: Machine Learning Enhanced Workload Management in Amazon Redshift 2023 SIGMOD 7.2042148e-05
3,592 Looking Ahead Makes Query Plans Robust: Making the Initial Case with In-Memory Star Schema Data Warehouse Workloads 2017 VLDB 7.1835842e-05
3,645 UDO: Universal Database Optimization using Reinforcement Learning 2021 VLDB 7.1397796e-05
3,741 FACE: A Normalizing Flow based Cardinality Estimator 2022 VLDB 7.0594076e-05
3,777 HTAP Databases: What is New and What is Next 2022 SIGMOD 7.0268163e-05
3,916 JSON Tiles: Fast Analytics on Semi-Structured Data 2021 SIGMOD 6.9285787e-05
3,949 Deploying a Steered Query Optimizer in Production at Microsoft 2022 SIGMOD 6.9052796e-05
3,965 MB2: Decomposed Behavior Modeling for Self-Driving Database Management Systems 2021 SIGMOD 6.8918628e-05
3,982 Simplicity Done Right for Join Ordering 2021 CIDR 6.8750228e-05
3,992 Guaranteeing the O~(AGM/OUT) Runtime for Uniform Sampling and Size Estimation over Joins 2023 PODS 6.8685334e-05
4,007 Automated Generation of Materialized Views in Oracle 2020 VLDB 6.8592987e-05
4,079 Towards Dynamic and Safe Configuration Tuning for Cloud Databases 2022 SIGMOD 6.818264e-05
4,132 SQLStorm: Taking Database Benchmarking into the LLM Era 2025 VLDB 6.7885553e-05
4,137 The Art of Balance: A RateupDB Experience of Building a CPU/GPU Hybrid Database Product 2021 VLDB 6.7861661e-05
4,199 Adaptive Work Placement for Query Processing on Heterogeneous Computing Resources 2017 VLDB 6.7410637e-05
4,202 Kepler: Robust Learning for Faster Parametric Query Optimization 2023 SIGMOD 6.7374091e-05
4,234 Adaptive Statistics in Oracle 12c 2017 VLDB 6.7134191e-05
4,253 Sample Debiasing in the Themis Open World Database System 2020 SIGMOD 6.7015395e-05
4,258 LEON: A New Framework for ML-Aided Query Optimization 2023 VLDB 6.6994722e-05
4,369 Predicate Transfer: Efficient Pre-Filtering on Multi-Join Queries 2024 CIDR 6.6315141e-05
4,457 Lightweight and Accurate Cardinality Estimation by Neural Network Gaussian Process 2022 SIGMOD 6.5913732e-05
4,563 Warper: Efficiently Adapting Learned Cardinality Estimators to Data and Workload Drifts 2022 SIGMOD 6.5320994e-05
4,683 AutoSteer: Learned Query Optimization for Any SQL Database 2023 VLDB 6.4716143e-05
4,690 Columnstore and B+ tree – Are Hybrid Physical Designs Important? 2018 SIGMOD 6.4687131e-05
4,707 PreQR: Pre-training Representation for SQL Understanding 2022 SIGMOD 6.4587914e-05
4,711 Learned Index Benefits: Machine Learning Based Index Performance Estimation 2022 VLDB 6.4573842e-05
4,756 Cuckoo Index: A Lightweight Secondary Index Structure 2020 VLDB 6.43221e-05
4,793 Permutable Compiled Queries: Dynamically Adapting Compiled Queries without Recompiling 2021 VLDB 6.4127583e-05
4,852 LpBound: Pessimistic Cardinality Estimation using ℓp-Norms of Degree Sequences 2025 SIGMOD 6.3806134e-05
4,950 Debunking the Myth of Join Ordering: Toward Robust SQL Analytics 2025 SIGMOD 6.3421691e-05
4,968 Budget-aware Index Tuning with Reinforcement Learning 2022 SIGMOD 6.3348803e-05
5,003 COMPASS: Online Sketch-based Query Optimization for In-Memory Databases 2021 SIGMOD 6.3188773e-05
Previous Page 2 / 7 Next

Outgoing Citations (Sorted by Pagerank)

Showing 23 of 23 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
1 Access Path Selection in a Relational Database Management System 1979 SIGMOD 0.0023947656
91 On the Propagation of Errors in the Size of Join Results 1991 SIGMOD 0.0003475226
98 LEO - DB2's LEarning Optimizer 2001 VLDB 0.00034106982
103 Selectivity Estimation Without the Attribute Value Independence Assumption 1997 VLDB 0.00033894985
160 CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies 2004 SIGMOD 0.00027837289
255 The History of Histograms (abridged) 2003 VLDB 0.00022981861
386 Preventing Bad Plans by Bounding the Impact of Cardinality Estimation Errors 2009 VLDB 0.00019444411
397 R* Optimizer Validation and Performance Evaluation for Local Queries 1986 SIGMOD 0.00019157058
569 Towards a Robust Query Optimizer: A Principled and Practical Approach 2005 SIGMOD 0.00016245271
884 Dynamic Programming Strikes Back 2008 SIGMOD 0.00013267935
1,060 Lightweight Graphical Models for Selectivity Estimation Without Independence Assumptions 2011 VLDB 0.00012224575
1,606 The Picasso Database Query Optimizer Visualizer 2010 VLDB 0.00010089789
1,891 CS2: A New Database Synopsis for Query Estimation 2013 SIGMOD 9.4184294e-05
1,929 Consistently Estimating the Selectivity of Conjuncts of Predicates 2005 VLDB 9.3546057e-05
1,987 Plan Bouquets: Query Processing without Selectivity Estimation 2014 SIGMOD 9.250242e-05
2,245 Cache-Efficient Aggregation: Hashing Is Sorting 2015 SIGMOD 8.7649358e-05
2,251 Counter Strike: Generic Top-Down Join Enumeration for Hypergraphs 2013 VLDB 8.7511987e-05
2,530 Adaptive and Big Data Scale Parallel Execution in Oracle 2013 VLDB 8.3391175e-05
2,891 Query Optimizers: Time to Rethink the Contract? 2009 SIGMOD 7.9021718e-05
3,367 Exact Cardinality Query Optimization for Optimizer Testing 2009 VLDB 7.3719456e-05
3,797 Query Simplification: Graceful Degradation for Join-Order Optimization 2009 SIGMOD 7.0163619e-05
4,052 Of Snowstorms and Bushy Trees 2014 VLDB 6.8283077e-05
6,800 ROX: Run-time Optimization of XQueries 2009 SIGMOD 5.6792071e-05
Previous Page 1 / 1 Next

Semantically Similar Papers