DBScholar

Back to papers

Auto-WLM: Machine Learning Enhanced Workload Management in Amazon Redshift

Summary: Auto-WLM is ML-driven WLM for Redshift that auto-tunes concurrency and memory to maximize throughput under workloads. Locally trained query performance models predict runtime and memory to guide millions of scheduling decisions in real time. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h1c0f9cd6cc596bf6
Venue
SIGMOD
Year
2023
Pagerank
7.200937e-05
Overall Rank
3,565 | 76.05%
DOI
10.1145/3555041.3589677
PDF
Download (CC BY 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{saxena_sigmod23,
        title = {{Auto-WLM: Machine Learning Enhanced Workload Management in Amazon Redshift}},
        author = {Saxena, Gaurav and Rahman, Mohammad and Chainani, Naresh and Lin, Chunbin and Caragea, George and Chowdhury, Fahim and Marcus, Ryan and Kraska, Tim and Pandis, Ippokratis and Narayanaswamy, Balakrishnan (Murali)},
        series = {{SIGMOD} '23},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3555041.3589677},
        url = {https://dl.acm.org/doi/10.1145/3555041.3589677},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 25 of 25 citing papers.

Rank Citing Paper Year Venue Pagerank
1,834 Why TPC Is Not Enough: An Analysis of the Amazon Redshift Fleet 2024 VLDB 9.5349903e-05
4,668 Intelligent Scaling in Amazon Redshift 2024 SIGMOD 6.4768105e-05
5,216 Stage: Query Execution Time Prediction in Amazon Redshift 2024 SIGMOD 6.2218868e-05
5,850 Modeling Shifting Workloads for Learned Database Systems 2024 SIGMOD 5.9697921e-05
6,027 Automated Multidimensional Data Layouts in Amazon Redshift 2024 SIGMOD 5.9089922e-05
7,464 T3: Accurate and Fast Performance Prediction for Relational Database Systems With Compiled Decision Trees 2025 SIGMOD 5.5189616e-05
7,869 Blueprinting the Cloud: Unifying and Automatically Optimizing Cloud Data Infrastructures with BRAD 2024 VLDB 5.4342182e-05
8,643 PBench: Workload Synthesizer with Real Statistics for Cloud Analytics Benchmarking 2025 VLDB 5.2956539e-05
8,808 PACE: Poisoning Attacks on Learned Cardinality Estimation 2024 SIGMOD 5.2717563e-05
9,010 ByteCard: Enhancing ByteDance’s Data Warehouse with Learned Cardinality Estimation 2024 SIGMOD 5.2371313e-05
9,221 DPconv: Super-Polynomially Faster Join Ordering 2024 SIGMOD 5.2036474e-05
9,571 LeaFi: Data Series Indexes on Steroids with Learned Filters 2025 SIGMOD 5.154741e-05
10,152 Improving DBMS Scheduling Decisions with Accurate Performance Prediction on Concurrent Queries 2025 VLDB 5.0691578e-05
10,319 Intra-Query Runtime Elasticity for Cloud-Native Data Analysis 2025 SIGMOD 5.0362412e-05
10,701 The Case For Language Model Approximated LIKE Predicate 2026 SIGMOD 4.9769913e-05
10,745 AQD: Online Adaptive Query Dispatcher for HTAP Databases 2026 VLDB 4.9769913e-05
10,918 Incremental Query Optimizer Statistics in Amazon Redshift 2026 VLDB 4.9769913e-05
10,958 Narwhal: Breaking the Local Boundary via Disaggregated Memory Scheduling for Alibaba AnalyticDB 2026 VLDB 4.9769913e-05
11,064 SafeLoad: Efficient Admission Control Framework for Identifying Memory-Overloading Queries in Cloud Data Warehouses 2026 VLDB 4.9769913e-05
11,136 Flux: Unifying Heterogeneous Infrastructure for Alibaba AnalyticDB 2025 SIGMOD 4.9769913e-05
11,246 PlanRGCN: Predicting SPARQL Query Performance 2025 VLDB 4.9769913e-05
11,431 Learned Cost Models for Query Optimization: From Batch to Streaming Systems 2025 VLDB 4.9769913e-05
11,439 CloudGlide: Deconstructing the Landscape of Cloud-Based Analytics 2025 VLDB 4.9769913e-05
11,453 LASER: Buffer-Aware Learned Query Scheduling in Master-Standby Databases 2025 VLDB 4.9769913e-05
11,505 Flux: Decoupled Auto-Scaling for Heterogeneous Query Workload in Alibaba AnalyticDB 2024 SIGMOD 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 33 of 33 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061067652
40 The Case for Learned Index Structures 2018 SIGMOD 0.00046363107
78 Automatic Database Management System Tuning Through Large-scale Machine Learning 2017 SIGMOD 0.00036675568
85 Learned Cardinalities: Estimating Correlated Joins with Deep Learning 2019 CIDR 0.00035876108
123 Schism: a Workload-Driven Approach to Database Replication and Partitioning 2010 VLDB 0.00030749898
144 Neo: A Learned Query Optimizer 2019 VLDB 0.00029090793
158 Deep Learning for Entity Matching: A Design Space Exploration 2018 SIGMOD 0.00028038831
224 Self-Driving Database Management Systems 2017 CIDR 0.00024011047
322 Tuning Database Configuration Parameters with iTuned 2009 VLDB 0.00021034201
361 Bao: Making Learned Query Optimization Practical 2021 SIGMOD 0.00020000855
406 Deep Unsupervised Cardinality Estimation 2020 VLDB 0.00019050182
458 The PGM-index: a fully-dynamic compressed learned index with provable worst-case bounds 2020 VLDB 0.00017880664
555 SageDB: A Learned Database System 2019 CIDR 0.0001650754
560 Plan-Structured Deep Neural Network Models for Query Performance Prediction 2019 VLDB 0.00016408613
681 Amazon Redshift Re-invented 2022 SIGMOD 0.0001482366
869 Learning Multi-dimensional Indexes 2020 SIGMOD 0.00013363241
1,188 Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads 2021 VLDB 0.00011598149
1,195 Balsa: Learning a Query Optimizer Without Expert Demonstrations 2022 SIGMOD 0.00011574218
1,280 AI Meets AI: Leveraging Query Executions to Improve Index Recommendations 2019 SIGMOD 0.00011224914
1,516 Automatically Indexing Millions of Databases in Microsoft Azure SQL Database 2019 SIGMOD 0.00010398346
1,800 SkinnerDB: Regret-Bounded Query Evaluation via Reinforcement Learning 2018 VLDB 9.6082185e-05
1,842 On Predictive Modeling for Optimizing Transaction Execution in Parallel OLTP Systems 2012 VLDB 9.5247433e-05
2,139 Quickstep: A Data Platform Based on the Scaling-Up Approach 2018 VLDB 8.9735524e-05
2,879 Zero-Shot Cost Models for Out-of-the-box Learned Cost Prediction 2022 VLDB 7.9126862e-05
2,983 WiSeDB: A Learning-based Workload Management Advisor for Cloud Databases 2016 VLDB 7.7831414e-05
3,327 Robust Query Driven Cardinality Estimation under Changing Workloads 2023 VLDB 7.4233639e-05
3,948 Deploying a Steered Query Optimizer in Production at Microsoft 2022 SIGMOD 6.9051584e-05
4,059 Database-Agnostic Workload Management 2019 CIDR 6.8226757e-05
4,391 Self-Tuning Query Scheduling for Analytical Workloads 2021 SIGMOD 6.6196806e-05
5,043 LSched: A Workload-Aware Learned Query Scheduler for Analytical Database Systems 2022 SIGMOD 6.2979214e-05
5,090 Releasing Cloud Databases from the Chains of Performance Prediction Models 2017 CIDR 6.278054e-05
5,110 Steering Query Optimizers: A Practical Take on Big Data Workloads 2021 SIGMOD 6.2678118e-05
5,160 NashDB: An End-to-End Economic Method for Elastic Database Fragmentation, Replication, and Provisioning 2018 SIGMOD 6.2454263e-05
Previous Page 1 / 1 Next

Semantically Similar Papers