DBScholar

Back to papers

Auto-WLM: Machine Learning Enhanced Workload Management in Amazon Redshift

Summary: Auto-WLM is ML-driven WLM for Redshift that auto-tunes concurrency and memory to maximize throughput under workloads. Locally trained query performance models predict runtime and memory to guide millions of scheduling decisions in real time. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h1c0f9cd6cc596bf6
Venue
SIGMOD
Year
2023
Pagerank
7.2042148e-05
Overall Rank
3,563 | 76.05%
DOI
10.1145/3555041.3589677

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{saxena_sigmod23,
        title = {{Auto-WLM: Machine Learning Enhanced Workload Management in Amazon Redshift}},
        author = {Saxena, Gaurav and Rahman, Mohammad and Chainani, Naresh and Lin, Chunbin and Caragea, George and Chowdhury, Fahim and Marcus, Ryan and Kraska, Tim and Pandis, Ippokratis and Narayanaswamy, Balakrishnan (Murali)},
        series = {{SIGMOD} '23},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3555041.3589677},
        url = {https://dl.acm.org/doi/10.1145/3555041.3589677},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 25 of 25 citing papers.

Rank Citing Paper Year Venue Pagerank
1,839 Why TPC Is Not Enough: An Analysis of the Amazon Redshift Fleet 2024 VLDB 9.5304799e-05
4,666 Intelligent Scaling in Amazon Redshift 2024 SIGMOD 6.479878e-05
5,214 Stage: Query Execution Time Prediction in Amazon Redshift 2024 SIGMOD 6.2248104e-05
5,865 Modeling Shifting Workloads for Learned Database Systems 2024 SIGMOD 5.9659203e-05
6,209 Automated Multidimensional Data Layouts in Amazon Redshift 2024 SIGMOD 5.8495489e-05
7,460 T3: Accurate and Fast Performance Prediction for Relational Database Systems With Compiled Decision Trees 2025 SIGMOD 5.5215755e-05
7,864 Blueprinting the Cloud: Unifying and Automatically Optimizing Cloud Data Infrastructures with BRAD 2024 VLDB 5.4367919e-05
8,636 PBench: Workload Synthesizer with Real Statistics for Cloud Analytics Benchmarking 2025 VLDB 5.2981619e-05
8,800 PACE: Poisoning Attacks on Learned Cardinality Estimation 2024 SIGMOD 5.2742531e-05
9,012 ByteCard: Enhancing ByteDance’s Data Warehouse with Learned Cardinality Estimation 2024 SIGMOD 5.2375369e-05
9,211 DPconv: Super-Polynomially Faster Join Ordering 2024 SIGMOD 5.206112e-05
9,563 LeaFi: Data Series Indexes on Steroids with Learned Filters 2025 SIGMOD 5.1571823e-05
10,148 Improving DBMS Scheduling Decisions with Accurate Performance Prediction on Concurrent Queries 2025 VLDB 5.0715586e-05
10,309 Intra-Query Runtime Elasticity for Cloud-Native Data Analysis 2025 SIGMOD 5.0386264e-05
10,691 The Case For Language Model Approximated LIKE Predicate 2026 SIGMOD 4.9793485e-05
10,735 AQD: Online Adaptive Query Dispatcher for HTAP Databases 2026 VLDB 4.9793485e-05
10,909 Incremental Query Optimizer Statistics in Amazon Redshift 2026 VLDB 4.9793485e-05
10,949 Narwhal: Breaking the Local Boundary via Disaggregated Memory Scheduling for Alibaba AnalyticDB 2026 VLDB 4.9793485e-05
11,055 SafeLoad: Efficient Admission Control Framework for Identifying Memory-Overloading Queries in Cloud Data Warehouses 2026 VLDB 4.9793485e-05
11,127 Flux: Unifying Heterogeneous Infrastructure for Alibaba AnalyticDB 2025 SIGMOD 4.9793485e-05
11,238 PlanRGCN: Predicting SPARQL Query Performance 2025 VLDB 4.9793485e-05
11,425 Learned Cost Models for Query Optimization: From Batch to Streaming Systems 2025 VLDB 4.9793485e-05
11,433 CloudGlide: Deconstructing the Landscape of Cloud-Based Analytics 2025 VLDB 4.9793485e-05
11,447 LASER: Buffer-Aware Learned Query Scheduling in Master-Standby Databases 2025 VLDB 4.9793485e-05
11,499 Flux: Decoupled Auto-Scaling for Heterogeneous Query Workload in Alibaba AnalyticDB 2024 SIGMOD 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 33 of 33 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061066921
40 The Case for Learned Index Structures 2018 SIGMOD 0.00046284649
78 Automatic Database Management System Tuning Through Large-scale Machine Learning 2017 SIGMOD 0.00036684414
85 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR 0.00035864347
123 Schism: a Workload-Driven Approach to Database Replication and Partitioning 2010 VLDB 0.00030762995
145 Neo: A Learned Query Optimizer 2019 VLDB 0.0002908188
158 Deep Learning for Entity Matching: A Design Space Exploration 2018 SIGMOD 0.00028046388
224 Self-Driving Database Management Systems 2017 CIDR 0.00024013745
322 Tuning Database Configuration Parameters with iTuned 2009 VLDB 0.00021041865
362 Bao: Making Learned Query Optimization Practical 2021 SIGMOD 0.00019989474
406 Deep Unsupervised Cardinality Estimation 2020 VLDB 0.00019045544
463 The PGM-index: a fully-dynamic compressed learned index with provable worst-case bounds 2020 VLDB 0.00017804544
555 SageDB: A Learned Database System 2019 CIDR 0.00016506678
560 Plan-Structured Deep Neural Network Models for Query Performance Prediction 2019 VLDB 0.00016403151
680 Amazon Redshift Re-invented 2022 SIGMOD 0.00014828697
868 Learning Multi-dimensional Indexes 2020 SIGMOD 0.00013354403
1,191 Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads 2021 VLDB 0.00011590153
1,199 Balsa: Learning a Query Optimizer Without Expert Demonstrations 2022 SIGMOD 0.00011563985
1,279 AI Meets AI: Leveraging Query Executions to Improve Index Recommendations 2019 SIGMOD 0.00011226878
1,516 Automatically Indexing Millions of Databases in Microsoft Azure SQL Database 2019 SIGMOD 0.00010402594
1,800 SkinnerDB: Regret-Bounded Query Evaluation via Reinforcement Learning 2018 VLDB 9.6093317e-05
1,842 On Predictive Modeling for Optimizing Transaction Execution in Parallel OLTP Systems 2012 VLDB 9.526552e-05
2,137 Quickstep: A Data Platform Based on the Scaling-Up Approach 2018 VLDB 8.9777553e-05
2,885 Zero-Shot Cost Models for Out-of-the-box Learned Cost Prediction 2022 VLDB 7.9094988e-05
2,981 WiSeDB: A Learning-based Workload Management Advisor for Cloud Databases 2016 VLDB 7.7851845e-05
3,327 Robust Query Driven Cardinality Estimation under Changing Workloads 2023 VLDB 7.4207879e-05
3,949 Deploying a Steered Query Optimizer in Production at Microsoft 2022 SIGMOD 6.9052796e-05
4,059 Database-Agnostic Workload Management 2019 CIDR 6.8251711e-05
4,388 Self-Tuning Query Scheduling for Analytical Workloads 2021 SIGMOD 6.6228033e-05
5,041 LSched: A Workload-Aware Learned Query Scheduler for Analytical Database Systems 2022 SIGMOD 6.3006152e-05
5,087 Releasing Cloud Databases from the Chains of Performance Prediction Models 2017 CIDR 6.2809904e-05
5,110 Steering Query Optimizers: A Practical Take on Big Data Workloads 2021 SIGMOD 6.269351e-05
5,159 NashDB: An End-to-End Economic Method for Elastic Database Fragmentation, Replication, and Provisioning 2018 SIGMOD 6.2482448e-05
Previous Page 1 / 1 Next

Semantically Similar Papers