Learned Cost Models for Query Optimization: From Batch to Streaming Systems

Summary: Unified overview of learned cost models (LCMs) for batch and streaming query optimization, contrasting input representations, model architectures, and optimizer integration. Emphasizes streaming-specific challenges—latency, non‑stationarity, continuous learning—and deployment tradeoffs. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 14374
Venue: VLDB
Year: 2025
Pagerank: 5.093636e-05
Overall Rank: 11,065 | 24.09%
DOI: 10.14778/3750601.3750699

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Roman Heinrich (German National Research Center for Information Technology; Technical University of Darmstadt)
2. Xiao Li (IT University of Copenhagen)
3. Manisha Luthra (German National Research Center for Information Technology; Technical University of Darmstadt)
4. Zoi Kaoudi (IT University of Copenhagen)

BibTeX Citation

@article{heinrich_vldb25,
        title = {{Learned Cost Models for Query Optimization: From Batch to Streaming Systems}},
        author = {Heinrich, Roman and Li, Xiao and Luthra, Manisha and Kaoudi, Zoi},
        journal = {PVLDB},
        series = {{VLDB} '25},
        volume = {18},
        number = {12},
        pages = {5482--5487},
        doi = {10.14778/3750601.3750699},
        url = {https://doi.org/10.14778/3750601.3750699},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 28 of 28 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
1	Access Path Selection in a Relational Database Management System	1979	SIGMOD	0.0024089429
18	How Good Are Query Optimizers, Really?	2016	VLDB	0.00059284255
84	Learned Cardinalities: Estimating Correlated Joins with Deep Learning	2019	CIDR	0.00035838391
154	Neo: A Learned Query Optimizer	2019	VLDB	0.00028726181
378	Bao: Making Learned Query Optimization Practical	2021	SIGMOD	0.00019638121
388	Preventing Bad Plans by Bounding the Impact of Cardinality Estimation Errors	2009	VLDB	0.00019410042
465	An End-to-End Learning-based Cost Estimator	2020	VLDB	0.0001803934
563	Plan-Structured Deep Neural Network Models for Query Performance Prediction	2019	VLDB	0.0001650812
1,241	Balsa: Learning a Query Optimizer Without Expert Demonstrations	2022	SIGMOD	0.00011521639
2,355	QueryFormer: A Tree Transformer Model for Query Plan Representation	2022	VLDB	8.7022189e-05
2,420	Lero: A Learning-to-Rank Query Optimizer	2023	VLDB	8.605257e-05
2,762	Cost-based or Learning-based? A Hybrid Query Optimizer for Query Plan Selection	2022	VLDB	8.1539867e-05
2,844	Zero-Shot Cost Models for Out-of-the-box Learned Cost Prediction	2022	VLDB	8.0608767e-05
2,888	AI Meets Database: AI4DB and DB4AI	2021	SIGMOD	7.9941489e-05
3,516	LOGER: A Learned Optimizer towards Generating Efficient and Robust Query Execution Plans	2023	VLDB	7.3524442e-05
3,809	Auto-WLM: Machine Learning Enhanced Workload Management in Amazon Redshift	2023	SIGMOD	7.1074195e-05
4,434	LEON: A New Framework for ML-Aided Query Optimization	2023	VLDB	6.7079088e-05
5,107	Stage: Query Execution Time Prediction in Amazon Redshift	2024	SIGMOD	6.3623786e-05
5,340	Machine Learning for Databases	2021	VLDB	6.2603359e-05
6,024	Expand your Training Limits! Generating Training Data for ML-based Data Management	2021	SIGMOD	6.0031118e-05
6,088	How Good are Learned Cost Models, Really? Insights from Query Optimization Tasks	2025	SIGMOD	5.9813965e-05
6,921	Rethinking Learned Cost Models: Why Start from Scratch?	2023	SIGMOD	5.7388557e-05
7,194	Model-Free Control for Distributed Stream Data Processing using Deep Reinforcement Learning	2018	VLDB	5.6766532e-05
8,572	T3: Accurate and Fast Performance Prediction for Relational Database Systems With Compiled Decision Trees	2025	SIGMOD	5.4102362e-05
9,128	Dalton: Learned Partitioning for Distributed Data Streams	2023	VLDB	5.3189314e-05
9,359	Farm Your ML-based Query Optimizer's Food! - Human-Guided Training Data Generation -	2022	CIDR	5.282159e-05
9,620	Apache Wayang in Action: Enabling Data Systems Integration via a Unified Data Analytics Framework	2025	SIGMOD	5.2434488e-05
11,023	Opening The Black-Box: Explaining Learned Cost Models For Databases	2025	VLDB	5.093636e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	5,059	Steering Query Optimizers: A Practical Take on Big Data Workloads	2021	SIGMOD
2	5,340	Machine Learning for Databases	2021	VLDB
3	465	An End-to-End Learning-based Cost Estimator	2020	VLDB
4	9,626	Spatial Query Optimization With Learning	2024	VLDB
5	6,323	Modeling Shifting Workloads for Learned Database Systems	2024	SIGMOD
6	11,023	Opening The Black-Box: Explaining Learned Cost Models For Databases	2025	VLDB
7	2,822	Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings	2020	SIGMOD
8	6,921	Rethinking Learned Cost Models: Why Start from Scratch?	2023	SIGMOD
9	2,844	Zero-Shot Cost Models for Out-of-the-box Learned Cost Prediction	2022	VLDB
10	6,088	How Good are Learned Cost Models, Really? Insights from Query Optimization Tasks	2025	SIGMOD