LOCAT: Low-Overhead Online Configuration Auto-Tuning of Spark SQL Applications

Summary: LOCAT uses online Bayesian optimization to tune Spark SQL configs, with QCSA to drop insensitive queries, DAGP for data-size modeling, and IICP to tune only influential parameters. Low-overhead, data-size-adaptive tuning yields 4.1–9.7× faster optimization and 1.9–2.4× speedups on TPC-DS, TPC-H, and HiBench on ARM/x86. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 6469
Venue: SIGMOD
Year: 2022
Pagerank: 5.5685434e-05
Overall Rank: 5,318 | 63.05%
DOI: 10.1145/3514221.3526157

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 9 of 9 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
6,489	Towards General and Efficient Online Tuning for Spark	2023	VLDB	5.0373773e-05
8,454	Towards Resource Efficiency: Practical Insights into Large-Scale Spark Workloads at ByteDance	2024	VLDB	4.5022073e-05
8,585	A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning	2024	VLDB	4.4856045e-05
9,643	Rockhopper: A Robust Optimizer for Spark Configuration Tuning in Production Environment	2025	SIGMOD	4.3067693e-05
9,955	SCompression: Enhancing Database Knob Tuning Efficiency Through Slice-Based OLTP Workload Compression	2025	VLDB	4.2332427e-05
10,278	LakeHelm: Zero-Shot Lakehouse Advisor for Joint Engine-Format Selection and Configuration	2026	VLDB	4.1905499e-05
10,382	Centrum: Model-based Database Auto-tuning with Minimal Distributional Assumptions	2025	SIGMOD	4.1905499e-05
10,863	Graph Transformers for Query Plan Representation: Potentials and Challenges	2025	VLDB	4.1905499e-05
10,872	LEAP: A Low-cost Spark SQL Query Optimizer using Pairwise Comparison	2025	VLDB	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 5 of 5 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
66	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00061707583
70	Hive - A Warehousing Solution Over a Map-Reduce Framework	2009	VLDB	0.00059744625
510	An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning	2019	SIGMOD	0.00021420477
779	QTune: A Query-Aware Database Tuning System with Deep Reinforcement Learning	2019	VLDB	0.00016719473
1,892	Black or White? How to Develop an AutoTuner for Memory-based Analytics	2020	SIGMOD	0.00010176219

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
3,207	Big Data Analytics with Datalog Queries on Spark	2016	SIGMOD	7.3847098e-05
10,641	AQETuner: Reliable Query-level Configuration Tuning for Analytical Query Engines	2025	VLDB	4.1905499e-05
5,994	Steering Query Optimizers: A Practical Take on Big Data Workloads	2021	SIGMOD	5.2367998e-05
9,643	Rockhopper: A Robust Optimizer for Spark Configuration Tuning in Production Environment	2025	SIGMOD	4.3067693e-05
6,265	Speedup Your Analytics: Automatic Parameter Tuning for Databases and Big Data Systems	2019	VLDB	5.1294788e-05
10,093	MCTuner: Spatial Decomposition-Enhanced Database Tuning via LLM-Guided Exploration	2026	SIGMOD	4.1905499e-05
10,872	LEAP: A Low-cost Spark SQL Query Optimizer using Pairwise Comparison	2025	VLDB	4.1905499e-05
4,799	Towards Dynamic and Safe Configuration Tuning for Cloud Databases	2022	SIGMOD	5.9082876e-05
8,585	A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning	2024	VLDB	4.4856045e-05
6,489	Towards General and Efficient Online Tuning for Spark	2023	VLDB	5.0373773e-05