Towards a Hands-Free Query Optimizer through Deep Learning

Summary: Vision to replace heuristic, hand-tuned optimizers with end-to-end deep RL agents that learn plan search, cost estimation, and operator choices, reducing manual tuning. Paper analyzes deployment challenges (exploration, reward sparsity, generalization) and sketches three DL approaches. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 341
Venue: CIDR
Year: 2019
Pagerank: 7.8121919e-05
Overall Rank: 3,051 | 79.07%
DOI: -

Incoming Non-self Citations Over Time

Authors

1. Ryan Marcus (Brandeis University)
2. Olga Papaemmanouil (Brandeis University)

BibTeX Citation

@inproceedings{marcus_cidr19,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '19},
        title = {{Towards a Hands-Free Query Optimizer through Deep Learning}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Marcus, Ryan and Papaemmanouil, Olga},
        year = {2019}
}

Incoming Citations (Sorted by Pagerank)

Showing 19 of 19 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
154	Neo: A Learned Query Optimizer	2019	VLDB	0.00028726181
563	Plan-Structured Deep Neural Network Models for Query Performance Prediction	2019	VLDB	0.0001650812
1,551	Updatable Learned Index with Precise Positions	2021	VLDB	0.00010381398
1,876	Flow-Loss: Learning Cardinality Estimates That Matter	2021	VLDB	9.5717543e-05
1,949	Diagnosing Root Causes of Intermittent Slow Queries in Cloud Databases	2020	VLDB	9.430385e-05
1,982	WeTune: Automatic Discovery and Verification of Query Rewrite Rules	2022	SIGMOD	9.3573897e-05
3,035	Instance-Optimized Data Layouts for Cloud Analytics Workloads	2021	SIGMOD	7.8297746e-05
3,213	Estimating Cardinalities with Deep Sketches	2019	SIGMOD	7.6328677e-05
3,729	CARMI: A Cache-Aware Learned Index with a Cost-based Construction Algorithm	2022	VLDB	7.1683974e-05
3,769	Proving Query Equivalence Using Linear Integer Arithmetic	2023	SIGMOD	7.1403543e-05
3,953	Efficient Deep Learning Pipelines for Accurate Cost Estimations Over Large Scale Query Workload	2021	SIGMOD	6.996368e-05
4,470	Kepler: Robust Learning for Faster Parametric Query Optimization	2023	SIGMOD	6.6817353e-05
5,558	HMAB: Self-Driving Hierarchy of Bandits for Integrated Physical Database Design Tuning	2023	VLDB	6.1749098e-05
5,978	From Auto-tuning One Size Fits All to Self-designed and Learned Data-intensive Systems	2019	SIGMOD	6.0212877e-05
6,271	Is Your Learned Query Optimizer Behaving As You Expect? A Machine Learning Perspective	2024	VLDB	5.9326197e-05
7,829	Robust Query Processing: Mission Possible	2020	VLDB	5.5360082e-05
8,783	Tiresias: Enabling Predictive Autonomous Storage and Indexing	2022	VLDB	5.3740362e-05
9,966	Generating Application-Specific Data Layouts for In-memory Databases	2019	VLDB	5.1870939e-05
10,316	GenJoin: Conditional Generative Plan-to-Plan Query Optimizer that Learns from Subplan Hints	2026	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 8 of 8 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
18	How Good Are Query Optimizers, Really?	2016	VLDB	0.00059284255
43	The Case for Learned Index Structures	2018	SIGMOD	0.00046060254
100	LEO - DB2's LEarning Optimizer	2001	VLDB	0.00034385207
176	Deep Learning for Entity Matching: A Design Space Exploration	2018	SIGMOD	0.00027191081
222	Adaptive Selectivity Estimation Using Query Feedback	1994	SIGMOD	0.00024193708
234	Self-Driving Database Management Systems	2017	CIDR	0.00023810722
448	Self-tuning Histograms: Building Histograms Without Looking at Data	1999	SIGMOD	0.00018292618
566	Towards a Robust Query Optimizer: A Principled and Practical Approach	2005	SIGMOD	0.00016436005

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	7,156	The Case for Deep Query Optimisation	2020	CIDR
2	1,573	Deep Learning Models for Selectivity Estimation of Multi-Attribute Queries	2020	SIGMOD
3	8,163	Learned Offline Query Planning via Bayesian Optimization	2025	SIGMOD
4	323	DeepDB: Learn from Data, not from Queries!	2020	VLDB
5	563	Plan-Structured Deep Neural Network Models for Query Performance Prediction	2019	VLDB
6	11,517	Can Transfer Learning be used to build a Query Optimizer?	2022	CIDR
7	11,548	DeepO: A Learned Query Optimizer	2022	SIGMOD
8	6,271	Is Your Learned Query Optimizer Behaving As You Expect? A Machine Learning Perspective	2024	VLDB
9	5,340	Machine Learning for Databases	2021	VLDB
10	9,215	Deep Query Optimization	2019	SIGMOD