AutoComp: Automated Data Compaction for Log-Structured Tables in Data Lakes

Summary: Automates compaction for log-structured tables in data lakes to curb small files and metadata bloat. AutoComp is scalable, LinkedIn-informed, integrates with OpenHouse, enabling multi-objective data-layout optimizations. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 7094
Venue: SIGMOD
Year: 2025
Pagerank: 4.3648789e-05
Overall Rank: 9,236 | 35.81%
DOI: 10.1145/3722212.3724430

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
10,196	PTO: A Workload-driven Predictive Table Optimizer for Lakehouse Systems	2026	SIGMOD	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 19 of 19 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
32	Differential Files: Their Application To The Maintenance Of Large Data Bases	1976	SIGMOD	0.00077553033
87	Hekaton: SQL Server’s Memory-Optimized OLTP Engine	2013	SIGMOD	0.00052844656
379	bLSM: A General Purpose Log Structured Merge Tree	2012	SIGMOD	0.00024954332
659	The Making of TPC-DS	2006	VLDB	0.00018514913
739	Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores	2020	VLDB	0.00017365933
857	Efficient Transaction Processing in SAP HANA Database – The End of a Column Store Myth	2012	SIGMOD	0.00015840492
1,697	Bridging the Archipelago between Row-Stores and Column-Stores for Hybrid Workloads	2016	SIGMOD	0.00010859294
1,957	Compaction management in distributed key-value datastores	2015	VLDB	9.961151e-05
3,044	Azure Data Lake Store: A Hyperscale Distributed File Service for Big Data Analytics	2017	SIGMOD	7.6624689e-05
3,797	Constructing and Analyzing the LSM Compaction Design Space	2021	VLDB	6.7552936e-05
3,966	Apache Hive: From MapReduce to Enterprise-grade Big Data Warehousing	2019	SIGMOD	6.5782437e-05
4,424	Nova: Continuous Pig/Hadoop Workflows	2011	SIGMOD	6.19243e-05
4,681	Cloud Analytics Benchmark	2023	VLDB	5.9953512e-05
7,907	Petabyte-Scale Row-Level Operations in Data Lakehouses	2024	VLDB	4.6161532e-05
8,517	Extending Polaris to Support Transactions	2024	SIGMOD	4.4897788e-05
8,596	LST-Bench: Benchmarking Log-Structured Tables in the Cloud	2024	SIGMOD	4.4839589e-05
8,640	Automatic Workload Driven Index Defragmentation	2011	VLDB	4.4743572e-05
9,194	MLOS in Action: Bridging the Gap Between Experimentation and Auto-Tuning in the Cloud	2024	VLDB	4.3726269e-05
9,291	Fragmentation in Large Object Repositories	2007	CIDR	4.3581463e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
3,642	BtrBlocks: Efficient Columnar Compression for Data Lakes	2023	SIGMOD	6.8876984e-05
10,196	PTO: A Workload-driven Predictive Table Optimizer for Lakehouse Systems	2026	SIGMOD	4.1905499e-05
10,248	Active Data Lakes: Regaining Physical Data Independence Without Losing Interoperability	2026	VLDB	4.1905499e-05
9,700	Towards Functional Decomposition of Storage Formats	2025	CIDR	4.2967256e-05
8,596	LST-Bench: Benchmarking Log-Structured Tables in the Cloud	2024	SIGMOD	4.4839589e-05
6,683	Adaptive and Robust Query Execution for Lakehouses at Scale	2024	VLDB	4.9593505e-05
1,957	Compaction management in distributed key-value datastores	2015	VLDB	9.961151e-05
739	Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores	2020	VLDB	0.00017365933
7,907	Petabyte-Scale Row-Level Operations in Data Lakehouses	2024	VLDB	4.6161532e-05
5,105	Analyzing and Comparing Lakehouse Storage Systems	2023	CIDR	5.6916018e-05