DBScholar

Back to papers

AutoComp: Automated Data Compaction for Log-Structured Tables in Data Lakes

Summary: Automates compaction for log-structured tables in data lakes to curb small files and metadata bloat. AutoComp is scalable, LinkedIn-informed, integrates with OpenHouse, enabling multi-objective data-layout optimizations. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
hdc60a941d92f4278
Venue
SIGMOD
Year
2025
Pagerank
5.2349846e-05
Overall Rank
9,021 | 39.35%
DOI
10.1145/3722212.3724430

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{gruenheid_sigmod25,
        title = {{AutoComp: Automated Data Compaction for Log-Structured Tables in Data Lakes}},
        author = {Gruenheid, Anja and Camacho-Rodríguez, Jesús and Curino, Carlo and Ramakrishnan, Raghu and Pak, Stanislav and Sakdeo, Sumedh and Gandhi, Lenisha and Singhal, Sandeep K. and Nilangekar, Pooja and Abadi, Daniel J.},
        series = {{SIGMOD} '25},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3722212.3724430},
        url = {https://dl.acm.org/doi/10.1145/3722212.3724430},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank Citing Paper Year Venue Pagerank
10,672 PTO: A Workload-driven Predictive Table Optimizer for Lakehouse Systems 2026 SIGMOD 4.9793485e-05
10,857 Interoperable ACID Transactions for Open Table Formats 2026 VLDB 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 19 of 19 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
35 Hekaton: SQL Server’s Memory-Optimized OLTP Engine 2013 SIGMOD 0.00048001919
59 Differential Files: Their Application To The Maintenance Of Large Data Bases 1976 SIGMOD 0.00039605949
258 bLSM: A General Purpose Log Structured Merge Tree 2012 SIGMOD 0.00022939599
459 Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores 2020 VLDB 0.00017856221
479 The Making of TPC-DS 2006 VLDB 0.00017622471
575 Efficient Transaction Processing in SAP HANA Database – The End of a Column Store Myth 2012 SIGMOD 0.00016132182
1,200 Bridging the Archipelago between Row-Stores and Column-Stores for Hybrid Workloads 2016 SIGMOD 0.00011563303
1,569 Compaction management in distributed key-value datastores 2015 VLDB 0.00010211433
2,446 Azure Data Lake Store: A Hyperscale Distributed File Service for Big Data Analytics 2017 SIGMOD 8.4547121e-05
2,770 Constructing and Analyzing the LSM Compaction Design Space 2021 VLDB 8.037607e-05
3,316 Cloud Analytics Benchmark 2023 VLDB 7.4373161e-05
3,446 Apache Hive: From MapReduce to Enterprise-grade Big Data Warehousing 2019 SIGMOD 7.2942885e-05
4,254 Nova: Continuous Pig/Hadoop Workflows 2011 SIGMOD 6.7011496e-05
6,920 Petabyte-Scale Row-Level Operations in Data Lakehouses 2024 VLDB 5.6441822e-05
8,208 LST-Bench: Benchmarking Log-Structured Tables in the Cloud 2024 SIGMOD 5.3775598e-05
8,784 Extending Polaris to Support Transactions 2024 SIGMOD 5.2771996e-05
8,785 Automatic Workload Driven Index Defragmentation 2011 VLDB 5.2769169e-05
9,431 MLOS in Action: Bridging the Gap Between Experimentation and Auto-Tuning in the Cloud 2024 VLDB 5.1783663e-05
9,603 Fragmentation in Large Object Repositories 2007 CIDR 5.1538479e-05
Previous Page 1 / 1 Next

Semantically Similar Papers