Why TPC Is Not Enough: An Analysis of the Amazon Redshift Fleet
Summary: Telemetry from 400 Amazon Redshift instances shows cloud data-warehouse workloads diverge from TPC-H/DS: prominent write-heavy pipelines, temporal variability in load and query types, repetitive queries, and heavy-tailed distributions of query/workload properties. Argues benchmarks must broaden beyond pure query-engine throughput to model ingestion, temporal dynamics, repetition and tail behavior, and releases a 3-month query-statistics dataset to seed more realistic benchmark design. (summarized by gpt-5-mini on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Alexander van Renen (University of Technology Nuremberg)
- 2. Dominik Horn (Amazon)
- 3. Pascal Pfeil (Amazon)
- 4. Kapil Vaidya (Amazon)
- 5. Wenjian Dong (Amazon)
- 6. Murali Narayanaswamy (Amazon)
- 7. Zhengchun Liu (Amazon)
- 8. Gaurav Saxena (Amazon)
- 9. Andreas Kipf (University of Technology Nuremberg)
- 10. Tim Kraska (Amazon)
BibTeX Citation
@article{renen_vldb24,
title = {{Why TPC Is Not Enough: An Analysis of the Amazon Redshift Fleet}},
author = {van Renen, Alexander and Horn, Dominik and Pfeil, Pascal and Vaidya, Kapil and Dong, Wenjian and Narayanaswamy, Murali and Liu, Zhengchun and Saxena, Gaurav and Kipf, Andreas and Kraska, Tim},
journal = {PVLDB},
series = {{VLDB} '24},
volume = {17},
number = {11},
pages = {3694--3706},
doi = {10.14778/3681954.3682031},
url = {https://doi.org/10.14778/3681954.3682031},
year = {2024}
}Incoming Citations (Sorted by Pagerank)
Showing 28 of 28 citing papers.
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 13 of 13 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 8,576 | A Study of Database Performance Sensitivity to Experiment Settings | 2022 | VLDB |
| 2 | 5,983 | Adaptive and Robust Query Execution for Lakehouses at Scale | 2024 | VLDB |
| 3 | 3,173 | Why You Should Run TPC-DS:A Workload Analysis | 2007 | VLDB |
| 4 | 5,107 | Stage: Query Execution Time Prediction in Amazon Redshift | 2024 | SIGMOD |
| 5 | 7,959 | Terabyte-Scale Analytics in the Blink of an Eye | 2026 | VLDB |
| 6 | 9,777 | PBench: Workload Synthesizer with Real Statistics for Cloud Analytics Benchmarking | 2025 | VLDB |
| 7 | 3,585 | The evolution of Amazon Redshift (extended abstract) | 2021 | VLDB |
| 8 | 237 | Amazon Redshift and the Case for Simpler Data Warehouses | 2015 | SIGMOD |
| 9 | 3,071 | Choosing A Cloud DBMS: Architectures and Tradeoffs | 2019 | VLDB |
| 10 | 3,838 | Cloud Analytics Benchmark | 2023 | VLDB |