Compaction management in distributed key-value datastores

Summary: Offloads heavy LSM-tree compactions to a dedicated server; streams compacted data into the datastore cache to reduce read penalties. Smart warmup keeps reads from local cache during transition; HBase integration; scalable across multiple compaction servers with YCSB/TPC-C. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 11384
Venue: VLDB
Year: 2015
Pagerank: 0.00010299919
Overall Rank: 1,580 | 89.17%
DOI: 10.14778/2757807.2757810

Incoming Non-self Citations Over Time

Authors

1. Muhammad Yousuf Ahmad (McGill University)
2. Bettina Kemme (McGill University)

BibTeX Citation

@article{ahmad_vldb15,
        title = {{Compaction management in distributed key-value datastores}},
        author = {Ahmad, Muhammad Yousuf and Kemme, Bettina},
        journal = {PVLDB},
        series = {{VLDB} '15},
        volume = {8},
        number = {8},
        pages = {850--861},
        doi = {10.14778/2757807.2757810},
        url = {https://doi.org/10.14778/2757807.2757810},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 22 of 22 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
446	Monkey: Optimal Navigable Key-Value Store	2017	SIGMOD	0.00018332392
831	Dostoevsky: Better Space-Time Trade-Offs for LSM-Tree Based Key-Value Stores via Adaptive Removal of Superfluous Merging	2018	SIGMOD	0.00013748512
1,954	Chucky: A Succinct Cuckoo Filter for LSM-Tree	2021	SIGMOD	9.4208165e-05
3,054	Spooky: Granulating LSM-Tree Compactions Correctly	2022	VLDB	7.8090808e-05
3,758	Nova-LSM: A Distributed, Component-based LSM-tree Key-value Store	2021	SIGMOD	7.1471346e-05
3,802	Leaper: A Learned Prefetcher for Cache Invalidation in LSM-tree based Storage Engines	2020	VLDB	7.1115502e-05
4,200	Disaggregating RocksDB: A Production Experience	2023	SIGMOD	6.835902e-05
4,262	On Performance Stability in LSM-based Storage Systems	2020	VLDB	6.7965035e-05
6,843	Learning to Optimize LSM-trees: Towards A Reinforcement Learning based Key-Value Store for Dynamic Workloads	2023	SIGMOD	5.7573899e-05
7,459	Efficient Data Ingestion and Query Processing for LSM-Based Storage Systems	2019	VLDB	5.6119467e-05
7,693	CaaS-LSM: Compaction-as-a-Service for LSM-based Key-Value Stores in Storage Disaggregated Infrastructure	2024	SIGMOD	5.5663461e-05
7,757	CAMAL: Optimizing LSM-trees via Active Learning	2024	SIGMOD	5.5508469e-05
8,156	How to Grow an LSM-tree? Towards Bridging the Gap Between Theory and Practice	2025	SIGMOD	5.4765648e-05
8,682	Columnar Formats for Schemaless LSM-based Document Stores	2022	VLDB	5.3857524e-05
8,811	ArceKV: Towards Workload-driven LSM-compactions for Key-Value Store Under Dynamic Workloads	2026	VLDB	5.3652966e-05
9,021	Structural Designs Meet Optimality: Exploring Optimized LSM-tree Structures in A Colossal Configuration Space	2024	SIGMOD	5.3305499e-05
9,378	AutoComp: Automated Data Compaction for Log-Structured Tables in Data Lakes	2025	SIGMOD	5.2755515e-05
9,457	Rethinking The Compaction Policies in LSM-trees	2025	SIGMOD	5.2642945e-05
10,073	DFlush: DPU-Offloaded Flush for Disaggregated LSM-based Key-Value Stores	2025	SIGMOD	5.1624218e-05
10,274	O3-LSM: Maximizing Disaggregated LSM Write Performance via Three-Layer Offloading	2026	SIGMOD	5.093636e-05
10,458	From Learning to Recycling: A Log-Structured Learned-Less Index	2026	SIGMOD	5.093636e-05
11,282	KGFabric: A Scalable Knowledge Graph Warehouse for Enterprise Data Interconnection	2024	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
59	Differential Files: Their Application To The Maintenance Of Large Data Bases	1976	SIGMOD	0.00040060625
144	Megastore: Providing Scalable, Highly Available Storage for Interactive Services	2011	CIDR	0.00029554682
275	bLSM: A General Purpose Log Structured Merge Tree	2012	SIGMOD	0.00022630189
575	Efficient Transaction Processing in SAP HANA Database – The End of a Column Store Myth	2012	SIGMOD	0.00016257033
741	Zephyr: Live Migration in Shared Nothing Databases for Elastic Cloud Platforms	2011	SIGMOD	0.00014442062
902	Albatross: Lightweight Elasticity in Shared Storage Databases for the Cloud using Live Data Migration	2011	VLDB	0.00013328979
1,606	Mesa: Geo-Replicated, Near Real-Time, Scalable Data Warehousing	2014	VLDB	0.00010228576

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	60	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD
2	6,547	Optimal Splitters for Temporal and Multi-version Databases	2013	SIGMOD
3	10,067	Shared Load(ing): Efficient Bulk Loading into Optimized Storage	2020	CIDR
4	3,292	Compacting Transactional Data in Hybrid OLTP&OLAP Databases	2012	VLDB
5	5,780	Compactionary: A Dictionary for LSM Compactions	2022	SIGMOD
6	9,457	Rethinking The Compaction Policies in LSM-trees	2025	SIGMOD
7	8,919	MirrorKV: An Efficient Key-Value Store on Hybrid Cloud Storage with Balanced Performance of Compaction and Querying	2023	SIGMOD
8	7,693	CaaS-LSM: Compaction-as-a-Service for LSM-based Key-Value Stores in Storage Disaggregated Infrastructure	2024	SIGMOD
9	3,773	SplinterDB and Maplets: Improving the Tradeoffs in Key-Value Store Compaction Policy	2023	SIGMOD
10	3,005	Constructing and Analyzing the LSM Compaction Design Space	2021	VLDB