DBScholar

Back to papers

LEAP: A Low-cost Spark SQL Query Optimizer using Pairwise Comparison

Summary: LEAP is the first learned optimizer tailored to Spark SQL, avoiding unsupported physical-operator enumeration. It uses estimation-free pairwise plan comparisons and progressive, pruned enumeration, cutting native-optimizer execution time by up to 54%. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
h0e3e79290a196af2
Venue
VLDB
Year
2025
Pagerank
4.9793485e-05
Overall Rank
11,443 | 23.07%
DOI
10.14778/3712221.3712234

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

BibTeX Citation

@article{ye_vldb25,
        title = {{LEAP: A Low-cost Spark SQL Query Optimizer using Pairwise Comparison}},
        author = {Ye, Junhao and Li, Jiahui and Chen, Lu and Mao, Yuren and Gao, Yunjun and Li, Tianyi},
        journal = {PVLDB},
        series = {{VLDB} '25},
        volume = {18},
        number = {3},
        pages = {675--687},
        doi = {10.14778/3712221.3712234},
        url = {https://doi.org/10.14778/3712221.3712234},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank Citing Paper Year Venue Pagerank
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 27 of 27 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061066921
23 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00055406774
85 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR 0.00035864347
103 Selectivity Estimation Without the Attribute Value Independence Assumption 1997 VLDB 0.00033894985
145 Neo: A Learned Query Optimizer 2019 VLDB 0.0002908188
362 Bao: Making Learned Query Optimization Practical 2021 SIGMOD 0.00019989474
461 An End-to-End Learning-based Cost Estimator 2020 VLDB 0.00017829982
512 NeuroCard: One Cardinality Estimator for All Tables 2021 VLDB 0.00017050173
1,199 Balsa: Learning a Query Optimizer Without Expert Demonstrations 2022 SIGMOD 0.00011563985
1,257 Sampling-Based Query Re-Optimization 2016 SIGMOD 0.00011310561
1,678 Two-Level Sampling for Join Size Estimation 2017 SIGMOD 9.9088372e-05
1,734 Flow-Loss: Learning Cardinality Estimates That Matter 2021 VLDB 9.7545773e-05
2,004 FLAT: Fast, Lightweight and Accurate Method for Cardinality Estimation 2021 VLDB 9.2065719e-05
2,210 Lero: A Learning-to-Rank Query Optimizer 2023 VLDB 8.8257742e-05
2,250 QueryFormer: A Tree Transformer Model for Query Plan Representation 2022 VLDB 8.7533306e-05
2,522 Learned Cardinality Estimation: A Design Space Exploration and A Comparative Evaluation 2022 VLDB 8.3477168e-05
2,660 The Complexity of Transformation-Based Join Enumeration 1997 VLDB 8.1611913e-05
2,690 Cost-based or Learning-based? A Hybrid Query Optimizer for Query Plan Selection 2022 VLDB 8.1258173e-05
2,846 FactorJoin: A New Cardinality Estimation Framework for Join Queries 2023 SIGMOD 7.9453616e-05
3,327 Robust Query Driven Cardinality Estimation under Changing Workloads 2023 VLDB 7.4207879e-05
3,487 LOGER: A Learned Optimizer towards Generating Efficient and Robust Query Execution Plans 2023 VLDB 7.263041e-05
3,741 FACE: A Normalizing Flow based Cardinality Estimator 2022 VLDB 7.0594076e-05
4,258 LEON: A New Framework for ML-Aided Query Optimization 2023 VLDB 6.6994722e-05
4,311 ALECE: An Attention-based Learned Cardinality Estimator for SPJ Queries on Dynamic Workloads 2024 VLDB 6.6727978e-05
4,681 LOCAT: Low-Overhead Online Configuration Auto-Tuning of Spark SQL Applications 2022 SIGMOD 6.4721364e-05
5,481 A Comparative Study and Component Analysis of Query Plan Representation Techniques in ML4DB Studies 2024 VLDB 6.1125124e-05
6,660 Speeding Up End-to-end Query Execution via Learning-based Progressive Cardinality Estimation 2023 SIGMOD 5.7178404e-05
Previous Page 1 / 1 Next

Semantically Similar Papers