LOCAT: Low-Overhead Online Configuration Auto-Tuning of Spark SQL Applications
Summary: LOCAT uses online Bayesian optimization to tune Spark SQL configs, with QCSA to drop insensitive queries, DAGP for data-size modeling, and IICP to tune only influential parameters. Low-overhead, data-size-adaptive tuning yields 4.1–9.7× faster optimization and 1.9–2.4× speedups on TPC-DS, TPC-H, and HiBench on ARM/x86. (summarized by gpt-5-nano on Feb 09 2026)
Incoming Non-self Citations Over Time
Authors
- 1. Jinhan Xin
- 2. Kai Hwang
- 3. Zhibin Yu
Incoming Citations (Sorted by Pagerank)
Showing 8 of 8 citing papers.
| Rank | Citing Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 6,871 | Towards General and Efficient Online Tuning for Spark | 2023 | VLDB | 4.8997004e-05 |
| 8,617 | A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning | 2024 | VLDB | 4.4846425e-05 |
| 9,155 | Towards Resource Efficiency: Practical Insights into Large-Scale Spark Workloads at ByteDance | 2024 | VLDB | 4.3849295e-05 |
| 9,956 | SCompression: Enhancing Database Knob Tuning Efficiency Through Slice-Based OLTP Workload Compression | 2025 | VLDB | 4.2373024e-05 |
| 10,370 | Centrum: Model-based Database Auto-tuning with Minimal Distributional Assumptions | 2025 | SIGMOD | 4.1945683e-05 |
| 10,414 | Rockhopper: A Robust Optimizer for Spark Configuration Tuning in Production Environment | 2025 | SIGMOD | 4.1945683e-05 |
| 10,859 | Graph Transformers for Query Plan Representation: Potentials and Challenges | 2025 | VLDB | 4.1945683e-05 |
| 10,868 | LEAP: A Low-cost Spark SQL Query Optimizer using Pairwise Comparison | 2025 | VLDB | 4.1945683e-05 |
Previous
Page 1 / 1
Next
Outgoing Citations (Sorted by Pagerank)
Showing 5 of 5 cited papers.
Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.
| Rank | Cited Paper | Year | Venue | Pagerank |
|---|---|---|---|---|
| 66 | Spark SQL: Relational Data Processing in Spark | 2015 | SIGMOD | 0.00061639801 |
| 70 | Hive - A Warehousing Solution Over a Map-Reduce Framework | 2009 | VLDB | 0.00059533166 |
| 514 | An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning | 2019 | SIGMOD | 0.0002124895 |
| 782 | QTune: A Query-Aware Database Tuning System with Deep Reinforcement Learning | 2019 | VLDB | 0.00016729063 |
| 1,902 | Black or White? How to Develop an AutoTuner for Memory-based Analytics | 2020 | SIGMOD | 0.00010157713 |
Previous
Page 1 / 1
Next