DBScholar

Back to papers

Stage: Query Execution Time Prediction in Amazon Redshift

Summary: Stage is a hierarchical predictor for Redshift, combining a cache, a per-instance light model with uncertainty, and a global transferable model. It mitigates cold starts and workload shifts, delivering ~20% lower latency with practical inference and memory. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h25cd3c28d011c209
Venue
SIGMOD
Year
2024
Pagerank
6.3834856e-05
Overall Rank
4,833 | 67.61%
DOI
10.1145/3626246.3653391
PDF
Download (CC BY 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{wu_sigmod24,
        title = {{Stage: Query Execution Time Prediction in Amazon Redshift}},
        author = {Wu, Ziniu and Marcus, Ryan and Liu, Zhengchun and Negi, Parimarjan and Nathan, Vikram and Pfeil, Pascal and Saxena, Gaurav and Rahman, Mohammad and Narayanaswamy, Balakrishnan and Kraska, Tim},
        series = {{SIGMOD} '24},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3626246.3653391},
        url = {https://dl.acm.org/doi/10.1145/3626246.3653391},
        year = {2024}
}

Incoming Citations (Sorted by Pagerank)

Showing 23 of 23 citing papers.

Rank Citing Paper Year Venue Pagerank
7,363 Blueprinting the Cloud: Unifying and Automatically Optimizing Cloud Data Infrastructures with BRAD 2024 VLDB 5.5279826e-05
7,483 T3: Accurate and Fast Performance Prediction for Relational Database Systems With Compiled Decision Trees 2025 SIGMOD 5.5007125e-05
7,997 The Holon Approach for Simultaneously Tuning Multiple Components in a Self-Driving Database Management System with Machine Learning via Synthesized Proto-Actions 2024 VLDB 5.3938336e-05
8,662 PBench: Workload Synthesizer with Real Statistics for Cloud Analytics Benchmarking 2025 VLDB 5.2781431e-05
9,011 Improving DBMS Scheduling Decisions with Accurate Performance Prediction on Concurrent Queries 2025 VLDB 5.2238303e-05
9,014 Resource-Adaptive Query Execution with Paged Memory Management 2025 CIDR 5.2235585e-05
9,154 Hit the Gym: Accelerating Query Execution to Efficiently Bootstrap Behavior Models for Self-Driving Database Management Systems 2024 VLDB 5.2050937e-05
9,662 Low Rank Learning for Offline Query Optimization 2025 SIGMOD 5.1283524e-05
9,672 QURE: AI-Assisted and Automatically Verified UDF Inlining 2025 SIGMOD 5.1267792e-05
9,995 Graph Transformers for Query Plan Representation: Potentials and Challenges 2025 VLDB 5.0845476e-05
10,109 veDB-HTAP: a Highly Integrated, Efficient and Adaptive HTAP System 2025 VLDB 5.0672857e-05
10,391 DQSim: Does the Task Assignment Slow Down Your Distributed Database System? 2027 SIGMOD 4.9605343e-05
10,392 E-LQO: A Comprehensive Energy Evaluation Framework for Learned Query Optimization 2027 SIGMOD 4.9605343e-05
10,429 Survivorship Bias in Industrial Database Workloads 2026 CIDR 4.9605343e-05
10,525 EncoderForge: Generating Efficient SQL for Encoders in Machine Learning Inference Pipelines 2026 SIGMOD 4.9605343e-05
10,762 The Case For Language Model Approximated LIKE Predicate 2026 SIGMOD 4.9605343e-05
10,812 OBELISK: Efficient Offline Query Planning with Bayesian Optimization-Informed Language Model Reasoning 2026 VLDB 4.9605343e-05
10,979 Incremental Query Optimizer Statistics in Amazon Redshift 2026 VLDB 4.9605343e-05
11,011 Ultron: History-Based Query Optimization at Databricks 2026 VLDB 4.9605343e-05
11,125 SafeLoad: Efficient Admission Control Framework for Identifying Memory-Overloading Queries in Cloud Data Warehouses 2026 VLDB 4.9605343e-05
11,139 KEN: An Execution Engine for Unstructured Database Systems 2026 VLDB 4.9605343e-05
11,142 Libra: One-Shot Parameter Sensitivity Estimation for Transfer Learning in Database Performance Prediction 2026 VLDB 4.9605343e-05
11,484 Learned Cost Models for Query Optimization: From Batch to Streaming Systems 2025 VLDB 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 31 of 31 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
40 The Case for Learned Index Structures 2018 SIGMOD 0.00046249672
74 Automatic Database Management System Tuning Through Large-scale Machine Learning 2017 SIGMOD 0.00037164008
122 Schism: a Workload-Driven Approach to Database Replication and Partitioning 2010 VLDB 0.00030701814
142 Neo: A Learned Query Optimizer 2019 VLDB 0.00029114937
320 DeepDB: Learn from Data, not from Queries! 2020 VLDB 0.00021128745
355 Bao: Making Learned Query Optimization Practical 2021 SIGMOD 0.00020146245
381 Preventing Bad Plans by Bounding the Impact of Cardinality Estimation Errors 2009 VLDB 0.00019497061
453 An End-to-End Learning-based Cost Estimator 2020 VLDB 0.0001801482
508 NeuroCard: One Cardinality Estimator for All Tables 2021 VLDB 0.00017108973
545 Plan-Structured Deep Neural Network Models for Query Performance Prediction 2019 VLDB 0.0001657599
651 Amazon Redshift Re-invented 2022 SIGMOD 0.00015126716
676 Robust Estimation of Resource Consumption for SQL Queries using Statistical Techniques 2012 VLDB 0.00014838681
870 Learning Multi-dimensional Indexes 2020 SIGMOD 0.0001332034
983 Cardinality Estimation in DBMS: A Comprehensive Benchmark Evaluation 2022 VLDB 0.00012677179
1,055 Tiresias: The Database Oracle for How-To Queries 2012 SIGMOD 0.0001225364
1,175 Balsa: Learning a Query Optimizer Without Expert Demonstrations 2022 SIGMOD 0.00011630532
1,190 Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads 2021 VLDB 0.00011564169
1,282 AI Meets AI: Leveraging Query Executions to Improve Index Recommendations 2019 SIGMOD 0.00011197535
1,803 SkinnerDB: Regret-Bounded Query Evaluation via Reinforcement Learning 2018 VLDB 9.5987229e-05
2,009 FLAT: Fast, Lightweight and Accurate Method for Cardinality Estimation 2021 VLDB 9.1813272e-05
2,147 Quickstep: A Data Platform Based on the Scaling-Up Approach 2018 VLDB 8.9595129e-05
2,619 Zero-Shot Cost Models for Out-of-the-box Learned Cost Prediction 2022 VLDB 8.1985665e-05
2,768 Query Performance Prediction for Concurrent Queries using Graph Embedding 2020 VLDB 8.0199086e-05
2,852 FactorJoin: A New Cardinality Estimation Framework for Join Queries 2023 SIGMOD 7.9201312e-05
2,892 WiSeDB: A Learning-based Workload Management Advisor for Cloud Databases 2016 VLDB 7.8872299e-05
3,269 Robust Query Driven Cardinality Estimation under Changing Workloads 2023 VLDB 7.463682e-05
3,328 Auto-WLM: Machine Learning Enhanced Workload Management in Amazon Redshift 2023 SIGMOD 7.4094448e-05
4,096 Self-Tuning Query Scheduling for Analytical Workloads 2021 SIGMOD 6.7949494e-05
4,577 HYPER: Hypothetical Reasoning With What-If and How-To Queries Using a Probabilistic Causal Approach 2022 SIGMOD 6.5111757e-05
5,043 Fine-Grained Modeling and Optimization for Intelligent Resource Management in Big Data Processing 2022 VLDB 6.28918e-05
5,245 FASTgres: Making Learned Query Optimizer Hinting Effective 2023 VLDB 6.1995935e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 5,670 Uncertainty Aware Query Execution Time Prediction 2014 VLDB
2 3,384 Towards Predicting Query Execution Time for Concurrent and Dynamic Database Workloads 2013 VLDB
3 1,791 Why TPC Is Not Enough: An Analysis of the Amazon Redshift Fleet 2024 VLDB
4 9,011 Improving DBMS Scheduling Decisions with Accurate Performance Prediction on Concurrent Queries 2025 VLDB
5 11,729 Predicting Query Execution time for JIT Compiled Database Engines 2023 CIDR
6 3,328 Auto-WLM: Machine Learning Enhanced Workload Management in Amazon Redshift 2023 SIGMOD
7 628 Performance Prediction for Concurrent Database Workloads 2011 SIGMOD
8 3,649 The evolution of Amazon Redshift (extended abstract) 2021 VLDB
9 10,979 Incremental Query Optimizer Statistics in Amazon Redshift 2026 VLDB
10 6,250 Predicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses 2024 SIGMOD