DBScholar

Back to papers

AutoComp: Automated Data Compaction for Log-Structured Tables in Data Lakes

Summary: Automates compaction for log-structured tables in data lakes to curb small files and metadata bloat. AutoComp is scalable, LinkedIn-informed, integrates with OpenHouse, enabling multi-objective data-layout optimizations. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
7155
Venue
SIGMOD
Year
2025
Pagerank
5.2755515e-05
Overall Rank
9,378 | 35.66%
DOI
10.1145/3722212.3724430

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{gruenheid_sigmod25,
        title = {{AutoComp: Automated Data Compaction for Log-Structured Tables in Data Lakes}},
        author = {Gruenheid, Anja and Camacho-Rodríguez, Jesús and Curino, Carlo and Ramakrishnan, Raghu and Pak, Stanislav and Sakdeo, Sumedh and Gandhi, Lenisha and Singhal, Sandeep K. and Nilangekar, Pooja and Abadi, Daniel J.},
        series = {{SIGMOD} '25},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3722212.3724430},
        url = {https://dl.acm.org/doi/10.1145/3722212.3724430},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 1 of 1 citing papers.

Rank Citing Paper Year Venue Pagerank
10,485 PTO: A Workload-driven Predictive Table Optimizer for Lakehouse Systems 2026 SIGMOD 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 19 of 19 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
38 Hekaton: SQL Server’s Memory-Optimized OLTP Engine 2013 SIGMOD 0.00047648573
59 Differential Files: Their Application To The Maintenance Of Large Data Bases 1976 SIGMOD 0.00040060625
275 bLSM: A General Purpose Log Structured Merge Tree 2012 SIGMOD 0.00022630189
476 The Making of TPC-DS 2006 VLDB 0.00017860667
520 Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores 2020 VLDB 0.00017136828
575 Efficient Transaction Processing in SAP HANA Database – The End of a Column Store Myth 2012 SIGMOD 0.00016257033
1,199 Bridging the Archipelago between Row-Stores and Column-Stores for Hybrid Workloads 2016 SIGMOD 0.00011703966
1,580 Compaction management in distributed key-value datastores 2015 VLDB 0.00010299919
2,477 Azure Data Lake Store: A Hyperscale Distributed File Service for Big Data Analytics 2017 SIGMOD 8.5239378e-05
3,005 Constructing and Analyzing the LSM Compaction Design Space 2021 VLDB 7.8608206e-05
3,555 Apache Hive: From MapReduce to Enterprise-grade Big Data Warehousing 2019 SIGMOD 7.3115321e-05
3,838 Cloud Analytics Benchmark 2023 VLDB 7.0823175e-05
4,175 Nova: Continuous Pig/Hadoop Workflows 2011 SIGMOD 6.8511274e-05
7,780 Petabyte-Scale Row-Level Operations in Data Lakehouses 2024 VLDB 5.5457298e-05
8,467 LST-Bench: Benchmarking Log-Structured Tables in the Cloud 2024 SIGMOD 5.4187125e-05
8,641 Automatic Workload Driven Index Defragmentation 2011 VLDB 5.3942658e-05
8,708 Extending Polaris to Support Transactions 2024 SIGMOD 5.3794896e-05
9,257 MLOS in Action: Bridging the Gap Between Experimentation and Auto-Tuning in the Cloud 2024 VLDB 5.2972217e-05
9,434 Fragmentation in Large Object Repositories 2007 CIDR 5.2694877e-05
Previous Page 1 / 1 Next

Semantically Similar Papers