DBScholar

Back to papers

LEAP: A Low-cost Spark SQL Query Optimizer using Pairwise Comparison

Summary: LEAP is the first learned optimizer tailored to Spark SQL, avoiding unsupported physical-operator enumeration. It uses estimation-free pairwise plan comparisons and progressive, pruned enumeration, cutting native-optimizer execution time by up to 54%. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
h0e3e79290a196af2
Venue
VLDB
Year
2025
Pagerank
4.9605343e-05
Overall Rank
11,501 | 22.91%
DOI
10.14778/3712221.3712234
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

BibTeX Citation

@article{ye_vldb25,
        title = {{LEAP: A Low-cost Spark SQL Query Optimizer using Pairwise Comparison}},
        author = {Ye, Junhao and Li, Jiahui and Chen, Lu and Mao, Yuren and Gao, Yunjun and Li, Tianyi},
        journal = {PVLDB},
        series = {{VLDB} '25},
        volume = {18},
        number = {3},
        pages = {675--687},
        doi = {10.14778/3712221.3712234},
        url = {https://doi.org/10.14778/3712221.3712234},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank Citing Paper Year Venue Pagerank
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 27 of 27 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061463175
23 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00055523999
84 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR 0.00035920657
103 Selectivity Estimation Without the Attribute Value Independence Assumption 1997 VLDB 0.00033847446
142 Neo: A Learned Query Optimizer 2019 VLDB 0.00029114937
355 Bao: Making Learned Query Optimization Practical 2021 SIGMOD 0.00020146245
453 An End-to-End Learning-based Cost Estimator 2020 VLDB 0.0001801482
508 NeuroCard: One Cardinality Estimator for All Tables 2021 VLDB 0.00017108973
1,175 Balsa: Learning a Query Optimizer Without Expert Demonstrations 2022 SIGMOD 0.00011630532
1,261 Sampling-Based Query Re-Optimization 2016 SIGMOD 0.00011289724
1,681 Two-Level Sampling for Join Size Estimation 2017 SIGMOD 9.8821344e-05
1,740 Flow-Loss: Learning Cardinality Estimates That Matter 2021 VLDB 9.7289523e-05
2,009 FLAT: Fast, Lightweight and Accurate Method for Cardinality Estimation 2021 VLDB 9.1813272e-05
2,169 QueryFormer: A Tree Transformer Model for Query Plan Representation 2022 VLDB 8.9151935e-05
2,190 Lero: A Learning-to-Rank Query Optimizer 2023 VLDB 8.8848923e-05
2,523 Learned Cardinality Estimation: A Design Space Exploration and A Comparative Evaluation 2022 VLDB 8.3316032e-05
2,671 The Complexity of Transformation-Based Join Enumeration 1997 VLDB 8.1310287e-05
2,696 Cost-based or Learning-based? A Hybrid Query Optimizer for Query Plan Selection 2022 VLDB 8.1068354e-05
2,852 FactorJoin: A New Cardinality Estimation Framework for Join Queries 2023 SIGMOD 7.9201312e-05
3,269 Robust Query Driven Cardinality Estimation under Changing Workloads 2023 VLDB 7.463682e-05
3,481 LOGER: A Learned Optimizer towards Generating Efficient and Robust Query Execution Plans 2023 VLDB 7.2463722e-05
3,740 FACE: A Normalizing Flow based Cardinality Estimator 2022 VLDB 7.0398782e-05
4,247 LEON: A New Framework for ML-Aided Query Optimization 2023 VLDB 6.6920059e-05
4,315 ALECE: An Attention-based Learned Cardinality Estimator for SPJ Queries on Dynamic Workloads 2024 VLDB 6.6545412e-05
4,698 LOCAT: Low-Overhead Online Configuration Auto-Tuning of Spark SQL Applications 2022 SIGMOD 6.4476818e-05
5,484 A Comparative Study and Component Analysis of Query Plan Representation Techniques in ML4DB Studies 2024 VLDB 6.0980944e-05
6,672 Speeding Up End-to-end Query Execution via Learning-based Progressive Cardinality Estimation 2023 SIGMOD 5.6975871e-05
Previous Page 1 / 1 Next

Semantically Similar Papers