A Study of Database Performance Sensitivity to Experiment Settings
Summary: Examines how benchmark and hardware settings shape database performance; reproduces 11 prior studies on TPC-C and YCSB across broad ranges. Identifies drivers of variability; offers concrete steps to improve reproducibility and benchmark robustness. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Yang Wang (Ohio State University)
- 2. Miao Yu (Ohio State University)
- 3. Yujie Hui (Ohio State University)
- 4. Fang Zhou (Ohio State University)
- 5. Yuyang Huang (Ohio State University)
- 6. Rui Zhu (Ohio State University)
- 7. Xueyuan Ren (Ohio State University)
- 8. Tianxi Li (Ohio State University)
- 9. Xiaoyi Lu (University of California Merced)
BibTeX Citation
@article{wang_vldb22,
title = {{A Study of Database Performance Sensitivity to Experiment Settings}},
author = {Wang, Yang and Yu, Miao and Hui, Yujie and Zhou, Fang and Huang, Yuyang and Zhu, Rui and Ren, Xueyuan and Li, Tianxi and Lu, Xiaoyi},
journal = {PVLDB},
series = {{VLDB} '22},
volume = {15},
number = {7},
pages = {1439--1452},
doi = {10.14778/3523210.3523221},
url = {https://doi.org/10.14778/3523210.3523221},
year = {2022}
}Incoming Citations (Sorted by Pagerank)
Showing 4 of 4 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 9,130 | A Hybrid Approach to Integrating Deterministic and Non-deterministic Concurrency Control in Database Systems | 2025 | VLDB | 5.318565e-05 |
| 9,857 | NOC-NOC: Towards Performance-optimal Distributed Transactions | 2024 | SIGMOD | 5.2079113e-05 |
| 10,108 | An Elephant Under The Microscope: Analyzing The Interaction Of Optimizer Components In PostgreSQL | 2025 | SIGMOD | 5.1347137e-05 |
| 11,195 | On the Feasibility and Benefits of Extensive Evaluation | 2024 | SIGMOD | 5.093636e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 22 of 22 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
Previous
Page 1 / 1
Next
Semantically Similar Papers
| # | Overall Rank | Paper | Year | Venue |
|---|---|---|---|---|
| 1 | 12,956 | Database Performance in the Real World — TPC-D and SAP R/3 — | 1997 | SIGMOD |
| 2 | 5,524 | Database Benchmarking for Supporting Real-Time Interactive Querying of Large Data | 2020 | SIGMOD |
| 3 | 260 | Models for Studying Concurrency Control Performance: Alternatives and Implications | 1985 | SIGMOD |
| 4 | 226 | OLTP-Bench: An Extensible Testbed for Benchmarking Relational Databases | 2014 | VLDB |
| 5 | 3,994 | Generating Databases for Query Workloads | 2010 | VLDB |
| 6 | 14,454 | Database System Performance Measurement | 1986 | SIGMOD |
| 7 | 3,404 | Data Generation for Application-Specific Benchmarking | 2011 | VLDB |
| 8 | 45 | Benchmarking Database Systems: A Systematic Approach | 1983 | VLDB |
| 9 | 2,740 | Facilitating Database Tuning with Hyper-Parameter Optimization: A Comprehensive Experimental Evaluation | 2022 | VLDB |
| 10 | 2,508 | Benchmarking Simple Database Operations | 1987 | SIGMOD |