Back to papers
LEAP: A Low-cost Spark SQL Query Optimizer using Pairwise Comparison
Summary: LEAP: a learned optimizer tailored for Spark SQL that integrates natively and ranks candidate plans via estimation-free pairwise comparisons (no cost model). Combines progressive, pruned plan enumeration to cheaply find better plans, cutting end-to-end time vs Spark by up to 54% and vs other learned methods by up to 94%.
(summarized by gpt-5-mini on Feb 09 2026)
- Paper ID
- 14229
- Venue
- VLDB
- Year
- 2025
- Pagerank
- 4.1905499e-05
- Overall Rank
- 10,872 | 24.44%
- DOI
-
10.14778/3712221.3712234
Incoming Non-self Citations Over Time
No non-self incoming citations found for this paper in this database.
Incoming Citations (Sorted by Pagerank)
Showing 0 of 0 citing papers.
| Rank |
Citing Paper |
Year |
Venue |
Pagerank |
Outgoing Citations (Sorted by Pagerank)
Showing 27 of 27 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank |
Cited Paper |
Year |
Venue |
Pagerank |
| 66 |
Spark SQL: Relational Data Processing in Spark |
2015 |
SIGMOD |
0.00061707583 |
| 71 |
How Good Are Query Optimizers, Really? |
2016 |
VLDB |
0.00059446482 |
| 141 |
Selectivity Estimation Without the Attribute Value Independence Assumption |
1997 |
VLDB |
0.00041819767 |
| 203 |
Learned Cardinalities: Estimating Correlated Joins with Deep Learning |
2019 |
CIDR |
0.00034868567 |
| 329 |
Neo: A Learned Query Optimizer |
2019 |
VLDB |
0.00027301488 |
| 634 |
Bao: Making Learned Query Optimization Practical |
2021 |
SIGMOD |
0.00018844568 |
| 804 |
An End-to-End Learning-based Cost Estimator |
2020 |
VLDB |
0.0001643674 |
| 905 |
NeuroCard: One Cardinality Estimator for All Tables |
2021 |
VLDB |
0.00015423174 |
| 1,756 |
Sampling-Based Query Re-Optimization |
2016 |
SIGMOD |
0.00010659753 |
| 2,090 |
Balsa: Learning a Query Optimizer Without Expert Demonstrations |
2022 |
SIGMOD |
9.5668285e-05 |
| 2,254 |
Two-Level Sampling for Join Size Estimation |
2017 |
SIGMOD |
9.1871115e-05 |
| 2,769 |
FLAT: Fast, Lightweight and Accurate Method for Cardinality Estimation |
2021 |
VLDB |
8.1512848e-05 |
| 2,781 |
Flow-Loss: Learning Cardinality Estimates That Matter |
2021 |
VLDB |
8.1282042e-05 |
| 2,878 |
The Complexity of Transformation-Based Join Enumeration |
1997 |
VLDB |
7.9694937e-05 |
| 3,167 |
QueryFormer: A Tree Transformer Model for Query Plan Representation |
2022 |
VLDB |
7.4561078e-05 |
| 3,345 |
Lero: A Learning-to-Rank Query Optimizer |
2023 |
VLDB |
7.1908499e-05 |
| 3,455 |
Learned Cardinality Estimation: A Design Space Exploration and A Comparative Evaluation |
2022 |
VLDB |
7.0760196e-05 |
| 3,729 |
Cost-based or Learning-based? A Hybrid Query Optimizer for Query Plan Selection |
2022 |
VLDB |
6.8078013e-05 |
| 3,992 |
FactorJoin: A New Cardinality Estimation Framework for Join Queries |
2023 |
SIGMOD |
6.5519369e-05 |
| 4,413 |
Robust Query Driven Cardinality Estimation under Changing Workloads |
2023 |
VLDB |
6.1989918e-05 |
| 4,464 |
LOGER: A Learned Optimizer towards Generating Efficient and Robust Query Execution Plans |
2023 |
VLDB |
6.1552798e-05 |
| 4,543 |
FACE: A Normalizing Flow based Cardinality Estimator |
2022 |
VLDB |
6.0953507e-05 |
| 5,318 |
LOCAT: Low-Overhead Online Configuration Auto-Tuning of Spark SQL Applications |
2022 |
SIGMOD |
5.5685434e-05 |
| 5,339 |
LEON: A New Framework for ML-Aided Query Optimization |
2023 |
VLDB |
5.5596755e-05 |
| 5,405 |
ALECE: An Attention-based Learned Cardinality Estimator for SPJ Queries on Dynamic Workloads |
2024 |
VLDB |
5.5243727e-05 |
| 6,328 |
A Comparative Study and Component Analysis of Query Plan Representation Techniques in ML4DB Studies |
2024 |
VLDB |
5.1034426e-05 |
| 7,220 |
Speeding Up End-to-end Query Execution via Learning-based Progressive Cardinality Estimation |
2023 |
SIGMOD |
4.7926382e-05 |
Semantically Similar Papers
| Overall Rank |
Paper |
Year |
Venue |
Pagerank |
| 5,994 |
Steering Query Optimizers: A Practical Take on Big Data Workloads |
2021 |
SIGMOD |
5.2367998e-05 |
| 3,345 |
Lero: A Learning-to-Rank Query Optimizer |
2023 |
VLDB |
7.1908499e-05 |
| 5,728 |
Conjunctive Queries with Comparisons |
2022 |
SIGMOD |
5.350072e-05 |
| 6,687 |
How Good are Learned Cost Models, Really? Insights from Query Optimization Tasks |
2025 |
SIGMOD |
4.957987e-05 |
| 6,639 |
Leveraging Query Logs and Machine Learning for Parametric Query Optimization |
2022 |
VLDB |
4.976781e-05 |
| 5,941 |
Eraser: Eliminating Performance Regression on Learned Query Optimizer |
2024 |
VLDB |
5.2594013e-05 |
| 10,219 |
Practical Parameterized Query Optimization via Efficient Plan Reuse and List-wise Ranking |
2026 |
SIGMOD |
4.1905499e-05 |
| 9,122 |
Dynamic Speculative Optimizations for SQL Compilation in Apache Spark |
2020 |
VLDB |
4.3877539e-05 |
| 3,729 |
Cost-based or Learning-based? A Hybrid Query Optimizer for Query Plan Selection |
2022 |
VLDB |
6.8078013e-05 |
| 8,585 |
A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning |
2024 |
VLDB |
4.4856045e-05 |