Speedup Your Analytics: Automatic Parameter Tuning for Databases and Big Data Systems

Summary: Survey of parameter tuning for databases, Hadoop, and Spark, with six approaches: rule-based, cost modeling, simulation, experiment-driven, ML, adaptive tuning. Outlines foundations, pros/cons, cloud, and challenges in heterogeneity and real-time analytics. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h8e1062a3b4f22b42
Venue: VLDB
Year: 2019
Pagerank: 5.9324372e-05
Overall Rank: 5,967 | 59.89%
DOI: 10.14778/3352063.3352112

Incoming Non-self Citations Over Time

Authors

1. Jiaheng Lu (University of Helsinki)
2. Yuxing Chen (University of Helsinki)
3. Herodotos Herodotou (Cyprus University of Technology)
4. Shivnath Babu (Duke University)

BibTeX Citation

@article{lu_vldb19,
        title = {{Speedup Your Analytics: Automatic Parameter Tuning for Databases and Big Data Systems}},
        author = {Lu, Jiaheng and Chen, Yuxing and Herodotou, Herodotos and Babu, Shivnath},
        journal = {PVLDB},
        series = {{VLDB} '19},
        volume = {12},
        number = {12},
        pages = {1970--1973},
        doi = {10.14778/3352063.3352112},
        url = {https://doi.org/10.14778/3352063.3352112},
        year = {2019}
}

Incoming Citations (Sorted by Pagerank)

Showing 10 of 10 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
2,908	AI Meets Database: AI4DB and DB4AI	2021	SIGMOD	7.8742664e-05
4,442	From BERT to GPT-3 Codex: Harnessing the Potential of Very Large Language Models for Data Management	2022	VLDB	6.5988336e-05
5,018	Breaking Down Memory Walls: Adaptive Memory Management in LSM-based Storage Systems	2021	VLDB	6.3121723e-05
5,974	Towards instance-optimized data systems	2021	VLDB	5.9305575e-05
6,753	Multi-Tenant Cloud Data Services: State-of-the-Art, Challenges and Opportunities	2022	SIGMOD	5.6904085e-05
7,829	TDSQL: Tencent Distributed Database System	2024	VLDB	5.4438901e-05
10,167	Exploiting Structure in Regular Expression Queries	2023	SIGMOD	5.0682654e-05
10,915	Reaching the Pinnacle of TPC-DS: Co-design of Architecture, Executor, and Storage in TDSQL	2026	VLDB	4.9793485e-05
11,134	TXSQL: Lock Optimizations Towards High Contented Workloads	2025	SIGMOD	4.9793485e-05
11,697	How To Optimize My Blockchain? A Multi-Level Recommendation Approach	2023	SIGMOD	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 13 of 13 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
43	A Comparison of Approaches to Large-Scale Data Analysis	2009	SIGMOD	0.00045546775
78	Automatic Database Management System Tuning Through Large-scale Machine Learning	2017	SIGMOD	0.00036684414
322	Tuning Database Configuration Parameters with iTuned	2009	VLDB	0.00021041865
508	Adaptive Self-Tuning Memory in DB2	2006	VLDB	0.00017089907
598	Automatic Performance Diagnosis and Tuning in Oracle	2005	CIDR	0.00015761263
753	Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs	2011	VLDB	0.00014237583
940	Starfish: A Self-tuning System for Big Data Analytics	2011	CIDR	0.00012964445
1,466	The Performance of MapReduce: An In-depth Study	2010	VLDB	0.00010569837
3,430	A Demonstration of the OtterTune Automatic Database Management System Tuning Service	2018	VLDB	7.3056632e-05
6,251	Foundations of Automated Database Tuning	2006	VLDB	5.8354449e-05
6,823	Self-Managing Technology in Database Management Systems	2004	VLDB	5.671749e-05
7,632	MRTuner: A Toolkit to Enable Holistic Optimization for MapReduce Jobs	2014	VLDB	5.4793438e-05
9,190	Tempo: Robust and Self-Tuning Resource Management in Multi-tenant Parallel Databases	2016	VLDB	5.2112843e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	9,816	Supporting Scalable Analytics with Latency Constraints	2015	VLDB
2	4,741	Machine Learning for Databases	2021	VLDB
3	6,080	From Auto-tuning One Size Fits All to Self-designed and Learned Data-intensive Systems	2019	SIGMOD
4	8,228	Operational Analytics Data Management Systems	2016	VLDB
5	9,693	Efficient Big Data Processing in Hadoop MapReduce	2012	VLDB
6	10,887	MFTune: An Efficient Multi-fidelity Framework for Spark SQL Configuration Tuning	2026	VLDB
7	322	Tuning Database Configuration Parameters with iTuned	2009	VLDB
8	2,772	Facilitating Database Tuning with Hyper-Parameter Optimization: A Comprehensive Experimental Evaluation	2022	VLDB
9	8,004	A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning	2024	VLDB
10	6,450	Towards General and Efficient Online Tuning for Spark	2023	VLDB