Automated Performance Management for the Big Data Stack

Summary: Characterizes performance-management requirements for heterogeneous big‑data stacks across applications, clusters, workloads, and deployment models (on‑prem, private/public/hybrid cloud) using extensive industrial telemetry. Proposes an automated cross‑layer architecture for diagnosis, tuning and SLA‑driven remediation, with deep dives into representative solutions. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 327
Venue: CIDR
Year: 2019
Pagerank: 5.093636e-05
Overall Rank: 11,829 | 18.85%
DOI: -

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Anastasios Arvanitis (Unravel Data Systems)
2. Shivnath Babu (Unravel Data Systems)
3. Eric Chu (Unravel Data Systems)
4. Adrian Popescu (Unravel Data Systems)
5. Alkis Simitsis (Unravel Data Systems)
6. Kevin Wilkinson (Unravel Data Systems)

BibTeX Citation

@inproceedings{arvanitis_cidr19,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '19},
        title = {{Automated Performance Management for the Big Data Stack}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Arvanitis, Anastasios and Babu, Shivnath and Chu, Eric and Popescu, Adrian and Simitsis, Alkis and Wilkinson, Kevin},
        year = {2019}
}

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
11,863	Cost-Effective, Workload-Adaptive Migration of Big Data Applications to the Cloud	2019	SIGMOD	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 10 of 10 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
120	HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads	2009	VLDB	0.00031680027
234	Self-Driving Database Management Systems	2017	CIDR	0.00023810722
347	Tuning Database Configuration Parameters with iTuned	2009	VLDB	0.00020651582
735	Profiling, What-if Analysis, and Cost-based Optimization of MapReduce Programs	2011	VLDB	0.00014522606
2,240	PerfEnforce Demonstration: Data Analytics with Performance Guarantees	2016	SIGMOD	8.8846115e-05
2,958	WiSeDB: A Learning-based Workload Management Advisor for Cloud Databases	2016	VLDB	7.9197796e-05
3,259	Characterizing Tenant Behavior for Placement and Crisis Mitigation in Multitenant DBMSs	2013	SIGMOD	7.5892257e-05
3,878	VQA: Vertica Query Analyzer	2014	SIGMOD	7.0511953e-05
4,987	Releasing Cloud Databases from the Chains of Performance Prediction Models	2017	CIDR	6.4112736e-05
9,039	Tempo: Robust and Self-Tuning Resource Management in Multi-tenant Parallel Databases	2016	VLDB	5.3267474e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	13,568	XCloud: Extensible Performance Management for Cloud Data Services	2015	CIDR
2	5,083	Automating Distributed Tiered Storage Management in Cluster Computing	2020	VLDB
3	9,640	Supporting Scalable Analytics with Latency Constraints	2015	VLDB
4	3,100	Rethinking Data Management Systems for Disaggregated Data Centers	2020	CIDR
5	8,072	Operational Analytics Data Management Systems	2016	VLDB
6	5,865	Speedup Your Analytics: Automatic Parameter Tuning for Databases and Big Data Systems	2019	VLDB
7	8,193	Towards Building Autonomous Data Services on Azure	2023	SIGMOD
8	5,978	From Auto-tuning One Size Fits All to Self-designed and Learned Data-intensive Systems	2019	SIGMOD
9	3,963	Solving Big Data Challenges for Enterprise Application Performance Management	2012	VLDB
10	11,863	Cost-Effective, Workload-Adaptive Migration of Big Data Applications to the Cloud	2019	SIGMOD