DBScholar

Back to papers

Steering Query Optimizers: A Practical Take on Big Data Workloads

Summary: Steering query optimizers for big data; Bao adapted to SCOPE. Introduces rule signatures, a pipeline for recurring configs, and a learning method for unseen workloads; evaluated on 150K daily jobs with 7–30% latency savings, up to 90% on subset. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
6319
Venue
SIGMOD
Year
2021
Pagerank
6.3807509e-05
Overall Rank
5,059 | 65.30%
DOI
10.1145/3448016.3457568

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{negi_sigmod21,
        title = {{Steering Query Optimizers: A Practical Take on Big Data Workloads}},
        author = {Negi, Parimarjan and Interlandi, Matteo and Marcus, Ryan and Alizadeh, Mohammad and Kraska, Tim and Friedman, Marc and Jindal, Alekh},
        series = {{SIGMOD} '21},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3448016.3457568},
        url = {https://dl.acm.org/doi/10.1145/3448016.3457568},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 22 of 22 citing papers.

Rank Citing Paper Year Venue Pagerank
2,420 Lero: A Learning-to-Rank Query Optimizer 2023 VLDB 8.605257e-05
2,452 A Learned Query Rewrite System using Monte Carlo Tree Search 2022 VLDB 8.5584e-05
2,991 FactorJoin: A New Cardinality Estimation Framework for Join Queries 2023 SIGMOD 7.8880723e-05
3,809 Auto-WLM: Machine Learning Enhanced Workload Management in Amazon Redshift 2023 SIGMOD 7.1074195e-05
3,998 Deploying a Steered Query Optimizer in Production at Microsoft 2022 SIGMOD 6.9676473e-05
4,434 LEON: A New Framework for ML-Aided Query Optimization 2023 VLDB 6.7079088e-05
4,929 AutoSteer: Learned Query Optimization for Any SQL Database 2023 VLDB 6.4423294e-05
5,974 Towards instance-optimized data systems 2021 VLDB 6.0230488e-05
6,462 PilotScope: Steering Databases with Machine Learning Drivers 2024 VLDB 5.8717744e-05
7,661 Machine Learning for Cloud Data Systems: the Progress so far and the Path Forward 2021 VLDB 5.5736026e-05
7,882 Efficiently Computing Join Orders with Heuristic Search 2023 SIGMOD 5.5237338e-05
8,040 PerfGuard: Deploying ML-for-Systems without Performance Regressions, Almost! 2021 VLDB 5.5018396e-05
8,163 Learned Offline Query Planning via Bayesian Optimization 2025 SIGMOD 5.4751517e-05
8,175 SparkCruise: Workload Optimization in Managed Spark Clusters at Microsoft 2021 VLDB 5.4737932e-05
8,193 Towards Building Autonomous Data Services on Azure 2023 SIGMOD 5.4696038e-05
8,448 Towards Query Optimizer as a Service (QOaaS) in a Unified LakeHouse Ecosystem: Can One QO Rule Them All? 2025 CIDR 5.4235725e-05
8,798 GEqO: ML-Accelerated Semantic Equivalence Detection 2023 SIGMOD 5.3698781e-05
8,984 Hit the Gym: Accelerating Query Execution to Efficiently Bootstrap Behavior Models for Self-Driving Database Management Systems 2024 VLDB 5.3395569e-05
9,601 Low Rank Learning for Offline Query Optimization 2025 SIGMOD 5.2487799e-05
9,846 QO-Insight: Inspecting Steered Query Optimizers 2023 VLDB 5.2094004e-05
10,190 AgenticScholar: Agentic Data Management with Pipeline Orchestration for Scholarly Corpora 2026 SIGMOD 5.093636e-05
10,768 Intra-Query Runtime Elasticity for Cloud-Native Data Analysis 2025 SIGMOD 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 17 of 17 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
18 How Good Are Query Optimizers, Really? 2016 VLDB 0.00059284255
30 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.00051174276
66 The Snowflake Elastic Data Warehouse 2016 SIGMOD 0.00038561587
84 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR 0.00035838391
154 Neo: A Learned Query Optimizer 2019 VLDB 0.00028726181
401 Deep Unsupervised Cardinality Estimation 2020 VLDB 0.00019092557
445 Apache Calcite: A Foundational Framework for Optimized Query Processing Over Heterogeneous Data Sources 2018 SIGMOD 0.00018336751
513 NeuroCard: One Cardinality Estimator for All Tables 2021 VLDB 0.00017190574
607 F1: A Distributed SQL Database That Scales 2013 VLDB 0.00015800238
697 Selectivity Estimation for Range Predicates using Lightweight Models 2019 VLDB 0.00014888851
1,468 Towards a Learning Optimizer for Shared Clouds 2019 VLDB 0.00010686496
1,604 The Picasso Database Query Optimizer Visualizer 2010 VLDB 0.00010230973
2,822 Cost Models for Big Data Query Processing: Learning, Retrofitting, and Our Findings 2020 SIGMOD 8.0898536e-05
3,162 Efficiently Approximating Selectivity Functions using Low Overhead Regression Models 2020 VLDB 7.6785856e-05
3,605 Computation Reuse in Analytics Job Service at Microsoft 2018 SIGMOD 7.2640711e-05
6,019 Robustness Metrics for Relational Query Execution Plans 2018 VLDB 6.0060149e-05
7,619 AutoToken: Predicting Peak Parallelism for Big Data Analytics at Microsoft 2020 VLDB 5.5810604e-05
Previous Page 1 / 1 Next

Semantically Similar Papers