DBScholar

Back to papers

LEAP: A Low-cost Spark SQL Query Optimizer using Pairwise Comparison

Summary: LEAP is the first learned optimizer tailored to Spark SQL, avoiding unsupported physical-operator enumeration. It uses estimation-free pairwise plan comparisons and progressive, pruned enumeration, cutting native-optimizer execution time by up to 54%. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
14416
Venue
VLDB
Year
2025
Pagerank
5.093636e-05
Overall Rank
11,091 | 23.91%
DOI
10.14778/3712221.3712234

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

BibTeX Citation

@article{ye_vldb25,
        title = {{LEAP: A Low-cost Spark SQL Query Optimizer using Pairwise Comparison}},
        author = {Ye, Junhao and Li, Jiahui and Chen, Lu and Mao, Yuren and Gao, Yunjun and Li, Tianyi},
        journal = {PVLDB},
        series = {{VLDB} '25},
        volume = {18},
        number = {3},
        pages = {675--687},
        doi = {10.14778/3712221.3712234},
        url = {https://doi.org/10.14778/3712221.3712234},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank Citing Paper Year Venue Pagerank
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 27 of 27 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
18 How Good Are Query Optimizers, Really? 2016 VLDB 0.00059284255
24 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00054865648
84 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR 0.00035838391
101 Selectivity Estimation Without the Attribute Value Independence Assumption 1997 VLDB 0.00034376651
154 Neo: A Learned Query Optimizer 2019 VLDB 0.00028726181
378 Bao: Making Learned Query Optimization Practical 2021 SIGMOD 0.00019638121
465 An End-to-End Learning-based Cost Estimator 2020 VLDB 0.0001803934
513 NeuroCard: One Cardinality Estimator for All Tables 2021 VLDB 0.00017190574
1,241 Balsa: Learning a Query Optimizer Without Expert Demonstrations 2022 SIGMOD 0.00011521639
1,256 Sampling-Based Query Re-Optimization 2016 SIGMOD 0.00011457194
1,664 Two-Level Sampling for Join Size Estimation 2017 SIGMOD 0.00010070362
1,876 Flow-Loss: Learning Cardinality Estimates That Matter 2021 VLDB 9.5717543e-05
1,988 FLAT: Fast, Lightweight and Accurate Method for Cardinality Estimation 2021 VLDB 9.3501502e-05
2,355 QueryFormer: A Tree Transformer Model for Query Plan Representation 2022 VLDB 8.7022189e-05
2,420 Lero: A Learning-to-Rank Query Optimizer 2023 VLDB 8.605257e-05
2,627 The Complexity of Transformation-Based Join Enumeration 1997 VLDB 8.3284491e-05
2,723 Learned Cardinality Estimation: A Design Space Exploration and A Comparative Evaluation 2022 VLDB 8.2049453e-05
2,762 Cost-based or Learning-based? A Hybrid Query Optimizer for Query Plan Selection 2022 VLDB 8.1539867e-05
2,991 FactorJoin: A New Cardinality Estimation Framework for Join Queries 2023 SIGMOD 7.8880723e-05
3,338 Robust Query Driven Cardinality Estimation under Changing Workloads 2023 VLDB 7.5068221e-05
3,516 LOGER: A Learned Optimizer towards Generating Efficient and Robust Query Execution Plans 2023 VLDB 7.3524442e-05
3,688 FACE: A Normalizing Flow based Cardinality Estimator 2022 VLDB 7.201795e-05
4,349 ALECE: An Attention-based Learned Cardinality Estimator for SPJ Queries on Dynamic Workloads 2024 VLDB 6.7504619e-05
4,434 LEON: A New Framework for ML-Aided Query Optimization 2023 VLDB 6.7079088e-05
4,854 LOCAT: Low-Overhead Online Configuration Auto-Tuning of Spark SQL Applications 2022 SIGMOD 6.4779623e-05
5,767 A Comparative Study and Component Analysis of Query Plan Representation Techniques in ML4DB Studies 2024 VLDB 6.0945741e-05
6,543 Speeding Up End-to-end Query Execution via Learning-based Progressive Cardinality Estimation 2023 SIGMOD 5.8461929e-05
Previous Page 1 / 1 Next

Semantically Similar Papers