DBScholar

Back to papers

Auto-WLM: Machine Learning Enhanced Workload Management in Amazon Redshift

Summary: Auto-WLM is ML-driven WLM for Redshift that auto-tunes concurrency and memory to maximize throughput under workloads. Locally trained query performance models predict runtime and memory to guide millions of scheduling decisions in real time. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
6563
Venue
SIGMOD
Year
2023
Pagerank
7.1074195e-05
Overall Rank
3,809 | 73.87%
DOI
10.1145/3555041.3589677

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{saxena_sigmod23,
        title = {{Auto-WLM: Machine Learning Enhanced Workload Management in Amazon Redshift}},
        author = {Saxena, Gaurav and Rahman, Mohammad and Chainani, Naresh and Lin, Chunbin and Caragea, George and Chowdhury, Fahim and Marcus, Ryan and Kraska, Tim and Pandis, Ippokratis and Narayanaswamy, Balakrishnan (Murali)},
        series = {{SIGMOD} '23},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3555041.3589677},
        url = {https://dl.acm.org/doi/10.1145/3555041.3589677},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 23 of 23 citing papers.

Rank Citing Paper Year Venue Pagerank
2,408 Why TPC Is Not Enough: An Analysis of the Amazon Redshift Fleet 2024 VLDB 8.6154404e-05
5,107 Stage: Query Execution Time Prediction in Amazon Redshift 2024 SIGMOD 6.3623786e-05
5,369 Intelligent Scaling in Amazon Redshift 2024 SIGMOD 6.2437078e-05
6,323 Modeling Shifting Workloads for Learned Database Systems 2024 SIGMOD 5.9141228e-05
7,465 Automated Multidimensional Data Layouts in Amazon Redshift 2024 SIGMOD 5.6108826e-05
7,755 Blueprinting the Cloud: Unifying and Automatically Optimizing Cloud Data Infrastructures with BRAD 2024 VLDB 5.5519655e-05
8,572 T3: Accurate and Fast Performance Prediction for Relational Database Systems With Compiled Decision Trees 2025 SIGMOD 5.4102362e-05
8,643 PACE: Poisoning Attacks on Learned Cardinality Estimation 2024 SIGMOD 5.3940849e-05
8,849 ByteCard: Enhancing ByteDance’s Data Warehouse with Learned Cardinality Estimation 2024 SIGMOD 5.3577504e-05
9,042 DPconv: Super-Polynomially Faster Join Ordering 2024 SIGMOD 5.3256042e-05
9,377 LeaFi: Data Series Indexes on Steroids with Learned Filters 2025 SIGMOD 5.2755515e-05
9,777 PBench: Workload Synthesizer with Real Statistics for Cloud Analytics Benchmarking 2025 VLDB 5.2209769e-05
10,505 The Case For Language Model Approximated LIKE Predicate 2026 SIGMOD 5.093636e-05
10,553 AQD: Online Adaptive Query Dispatcher for HTAP Databases 2026 VLDB 5.093636e-05
10,608 SafeLoad: Efficient Admission Control Framework for Identifying Memory-Overloading Queries in Cloud Data Warehouses 2026 VLDB 5.093636e-05
10,691 Flux: Unifying Heterogeneous Infrastructure for Alibaba AnalyticDB 2025 SIGMOD 5.093636e-05
10,768 Intra-Query Runtime Elasticity for Cloud-Native Data Analysis 2025 SIGMOD 5.093636e-05
10,830 PlanRGCN: Predicting SPARQL Query Performance 2025 VLDB 5.093636e-05
10,969 Improving DBMS Scheduling Decisions with Accurate Performance Prediction on Concurrent Queries 2025 VLDB 5.093636e-05
11,065 Learned Cost Models for Query Optimization: From Batch to Streaming Systems 2025 VLDB 5.093636e-05
11,076 CloudGlide: Deconstructing the Landscape of Cloud-Based Analytics 2025 VLDB 5.093636e-05
11,095 LASER: Buffer-Aware Learned Query Scheduling in Master-Standby Databases 2025 VLDB 5.093636e-05
11,151 Flux: Decoupled Auto-Scaling for Heterogeneous Query Workload in Alibaba AnalyticDB 2024 SIGMOD 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 33 of 33 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
18 How Good Are Query Optimizers, Really? 2016 VLDB 0.00059284255
43 The Case for Learned Index Structures 2018 SIGMOD 0.00046060254
84 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR 0.00035838391
86 Automatic Database Management System Tuning Through Large-scale Machine Learning 2017 SIGMOD 0.00035316107
126 Schism: a Workload-Driven Approach to Database Replication and Partitioning 2010 VLDB 0.00030779127
154 Neo: A Learned Query Optimizer 2019 VLDB 0.00028726181
176 Deep Learning for Entity Matching: A Design Space Exploration 2018 SIGMOD 0.00027191081
234 Self-Driving Database Management Systems 2017 CIDR 0.00023810722
347 Tuning Database Configuration Parameters with iTuned 2009 VLDB 0.00020651582
378 Bao: Making Learned Query Optimization Practical 2021 SIGMOD 0.00019638121
401 Deep Unsupervised Cardinality Estimation 2020 VLDB 0.00019092557
477 The PGM-index: a fully-dynamic compressed learned index with provable worst-case bounds 2020 VLDB 0.00017851226
563 Plan-Structured Deep Neural Network Models for Query Performance Prediction 2019 VLDB 0.0001650812
568 SageDB: A Learned Database System 2019 CIDR 0.0001641553
818 Amazon Redshift Re-invented 2022 SIGMOD 0.00013822916
873 Learning Multi-dimensional Indexes 2020 SIGMOD 0.00013481915
1,174 Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads 2021 VLDB 0.00011817414
1,241 Balsa: Learning a Query Optimizer Without Expert Demonstrations 2022 SIGMOD 0.00011521639
1,279 AI Meets AI: Leveraging Query Executions to Improve Index Recommendations 2019 SIGMOD 0.00011361878
1,548 Automatically Indexing Millions of Databases in Microsoft Azure SQL Database 2019 SIGMOD 0.00010392475
1,815 SkinnerDB: Regret-Bounded Query Evaluation via Reinforcement Learning 2018 VLDB 9.6894541e-05
1,831 On Predictive Modeling for Optimizing Transaction Execution in Parallel OLTP Systems 2012 VLDB 9.6635729e-05
2,156 Quickstep: A Data Platform Based on the Scaling-Up Approach 2018 VLDB 9.0635624e-05
2,844 Zero-Shot Cost Models for Out-of-the-box Learned Cost Prediction 2022 VLDB 8.0608767e-05
2,958 WiSeDB: A Learning-based Workload Management Advisor for Cloud Databases 2016 VLDB 7.9197796e-05
3,338 Robust Query Driven Cardinality Estimation under Changing Workloads 2023 VLDB 7.5068221e-05
3,998 Deploying a Steered Query Optimizer in Production at Microsoft 2022 SIGMOD 6.9676473e-05
4,053 Database-Agnostic Workload Management 2019 CIDR 6.9355341e-05
4,493 Self-Tuning Query Scheduling for Analytical Workloads 2021 SIGMOD 6.6647555e-05
4,987 Releasing Cloud Databases from the Chains of Performance Prediction Models 2017 CIDR 6.4112736e-05
5,059 Steering Query Optimizers: A Practical Take on Big Data Workloads 2021 SIGMOD 6.3807509e-05
5,072 NashDB: An End-to-End Economic Method for Elastic Database Fragmentation, Replication, and Provisioning 2018 SIGMOD 6.3753956e-05
5,148 LSched: A Workload-Aware Learned Query Scheduler for Analytical Database Systems 2022 SIGMOD 6.3465986e-05
Previous Page 1 / 1 Next

Semantically Similar Papers