Join Order Selection with Deep Reinforcement Learning: Fundamentals, Techniques, and Challenges

Summary: Tutorial surveys deep-RL join-order selection, relating approaches and contrasting their strengths with traditional optimization. Two open-source demonstrations and a synthesis of challenges highlight directions toward practical, experience-driven query optimization. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: hb7eba69f31ca76a7
Venue: VLDB
Year: 2023
Pagerank: 5.7270153e-05
Overall Rank: 6,632 | 55.42%
DOI: 10.14778/3611540.3611576

Incoming Non-self Citations Over Time

Authors

1. Zhengtong Yan (University of Helsinki)
2. Valter Uotila (University of Helsinki)
3. Jiaheng Lu (University of Helsinki)

BibTeX Citation

@article{yan_vldb23,
        title = {{Join Order Selection with Deep Reinforcement Learning: Fundamentals, Techniques, and Challenges}},
        author = {Yan, Zhengtong and Uotila, Valter and Lu, Jiaheng},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {12},
        pages = {3882--3885},
        doi = {10.14778/3611540.3611576},
        url = {https://doi.org/10.14778/3611540.3611576},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 6 of 6 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
8,879	Spatial Query Optimization With Learning	2024	VLDB	5.2568354e-05
9,073	Machine Learning for Graph Data Management and Query Processing	2025	VLDB	5.2283159e-05
9,720	APQO: An Adaptive Framework for Parametric Query Optimization	2026	SIGMOD	5.1349531e-05
10,741	OBELISK: Efficient Offline Query Planning with Bayesian Optimization-Informed Language Model Reasoning	2026	VLDB	4.9793485e-05
10,832	ReSequel: Robust LLM-assisted Query Rewriting and Optimization using Templatization and Sampling	2026	VLDB	4.9793485e-05
11,175	AJOSC: Adaptive Join Order Selection for Continuous Queries	2025	SIGMOD	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
1	Access Path Selection in a Relational Database Management System	1979	SIGMOD	0.0023947656
15	How Good Are Query Optimizers, Really?	2016	VLDB	0.00061066921
145	Neo: A Learned Query Optimizer	2019	VLDB	0.0002908188
362	Bao: Making Learned Query Optimization Practical	2021	SIGMOD	0.00019989474
796	Rapid Bushy Join-order Optimization with Cartesian Products	1996	SIGMOD	0.00013938011
884	Dynamic Programming Strikes Back	2008	SIGMOD	0.00013267935
1,186	Adaptive Optimization of Very Large Join Queries	2018	SIGMOD	0.0001160797
1,199	Balsa: Learning a Query Optimizer Without Expert Demonstrations	2022	SIGMOD	0.00011563985
1,301	Analysis of Two Existing and One New Dynamic Programming Algorithm for the Generation of Optimal Bushy Join Trees without Cross Products	2006	VLDB	0.00011112842
1,603	SkinnerDB: Regret-Bounded Query Evaluation via Reinforcement Learning	2019	SIGMOD	0.00010097649
2,210	Lero: A Learning-to-Rank Query Optimizer	2023	VLDB	8.8257742e-05
2,690	Cost-based or Learning-based? A Hybrid Query Optimizer for Query Plan Selection	2022	VLDB	8.1258173e-05
2,908	AI Meets Database: AI4DB and DB4AI	2021	SIGMOD	7.8742664e-05
3,487	LOGER: A Learned Optimizer towards Generating Efficient and Robust Query Execution Plans	2023	VLDB	7.263041e-05
4,741	Machine Learning for Databases	2021	VLDB	6.4410027e-05
5,425	Efficient Massively Parallel Join Optimization for Large Queries*	2022	SIGMOD	6.1349269e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	3,797	Query Simplification: Graceful Degradation for Join-Order Optimization	2009	SIGMOD
2	1,603	SkinnerDB: Regret-Bounded Query Evaluation via Reinforcement Learning	2019	SIGMOD
3	1,186	Adaptive Optimization of Very Large Join Queries	2018	SIGMOD
4	3,487	LOGER: A Learned Optimizer towards Generating Efficient and Robust Query Execution Plans	2023	VLDB
5	12,209	Improving Join Reorderability with Compensation Operators	2018	SIGMOD
6	4,741	Machine Learning for Databases	2021	VLDB
7	3,060	Towards a Hands-Free Query Optimizer through Deep Learning	2019	CIDR
8	8,039	Efficiently Computing Join Orders with Heuristic Search	2023	SIGMOD
9	7,367	ADOPT: Adaptively Optimizing Attribute Orders for Worst-Case Optimal Join Algorithms via Reinforcement Learning	2023	VLDB
10	11,806	Demonstrating ADOPT: Adaptively Optimizing Attribute Orders for Worst-Case Optimal Joins via Reinforcement Learning	2023	VLDB