DBScholar

Back to papers

LEAP: A Low-cost Spark SQL Query Optimizer using Pairwise Comparison

Summary: LEAP is the first learned optimizer tailored to Spark SQL, avoiding unsupported physical-operator enumeration. It uses estimation-free pairwise plan comparisons and progressive, pruned enumeration, cutting native-optimizer execution time by up to 54%. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
h0e3e79290a196af2
Venue
VLDB
Year
2025
Pagerank
4.9769913e-05
Overall Rank
11,449 | 23.05%
DOI
10.14778/3712221.3712234
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

BibTeX Citation

@article{ye_vldb25,
        title = {{LEAP: A Low-cost Spark SQL Query Optimizer using Pairwise Comparison}},
        author = {Ye, Junhao and Li, Jiahui and Chen, Lu and Mao, Yuren and Gao, Yunjun and Li, Tianyi},
        journal = {PVLDB},
        series = {{VLDB} '25},
        volume = {18},
        number = {3},
        pages = {675--687},
        doi = {10.14778/3712221.3712234},
        url = {https://doi.org/10.14778/3712221.3712234},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank Citing Paper Year Venue Pagerank
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 27 of 27 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061067652
23 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00055384955
85 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR 0.00035876108
103 Selectivity Estimation Without the Attribute Value Independence Assumption 1997 VLDB 0.00033884854
144 Neo: A Learned Query Optimizer 2019 VLDB 0.00029090793
361 Bao: Making Learned Query Optimization Practical 2021 SIGMOD 0.00020000855
462 An End-to-End Learning-based Cost Estimator 2020 VLDB 0.00017836105
510 NeuroCard: One Cardinality Estimator for All Tables 2021 VLDB 0.00017059914
1,195 Balsa: Learning a Query Optimizer Without Expert Demonstrations 2022 SIGMOD 0.00011574218
1,258 Sampling-Based Query Re-Optimization 2016 SIGMOD 0.00011308863
1,678 Two-Level Sampling for Join Size Estimation 2017 SIGMOD 9.9056116e-05
1,735 Flow-Loss: Learning Cardinality Estimates That Matter 2021 VLDB 9.7566604e-05
2,002 FLAT: Fast, Lightweight and Accurate Method for Cardinality Estimation 2021 VLDB 9.2076835e-05
2,209 Lero: A Learning-to-Rank Query Optimizer 2023 VLDB 8.8360101e-05
2,248 QueryFormer: A Tree Transformer Model for Query Plan Representation 2022 VLDB 8.7567205e-05
2,518 Learned Cardinality Estimation: A Design Space Exploration and A Comparative Evaluation 2022 VLDB 8.3532841e-05
2,660 The Complexity of Transformation-Based Join Enumeration 1997 VLDB 8.1574087e-05
2,686 Cost-based or Learning-based? A Hybrid Query Optimizer for Query Plan Selection 2022 VLDB 8.1300913e-05
2,844 FactorJoin: A New Cardinality Estimation Framework for Join Queries 2023 SIGMOD 7.9446987e-05
3,327 Robust Query Driven Cardinality Estimation under Changing Workloads 2023 VLDB 7.4233639e-05
3,479 LOGER: A Learned Optimizer towards Generating Efficient and Robust Query Execution Plans 2023 VLDB 7.2665349e-05
3,742 FACE: A Normalizing Flow based Cardinality Estimator 2022 VLDB 7.0564546e-05
4,240 LEON: A New Framework for ML-Aided Query Optimization 2023 VLDB 6.7064546e-05
4,299 ALECE: An Attention-based Learned Cardinality Estimator for SPJ Queries on Dynamic Workloads 2024 VLDB 6.6766173e-05
4,686 LOCAT: Low-Overhead Online Configuration Auto-Tuning of Spark SQL Applications 2022 SIGMOD 6.4690725e-05
5,482 A Comparative Study and Component Analysis of Query Plan Representation Techniques in ML4DB Studies 2024 VLDB 6.1123461e-05
6,664 Speeding Up End-to-end Query Execution via Learning-based Progressive Cardinality Estimation 2023 SIGMOD 5.715134e-05
Previous Page 1 / 1 Next

Semantically Similar Papers