Compaction management in distributed key-value datastores

Summary: Offloads heavy LSM-tree compactions to a dedicated server; streams compacted data into the datastore cache to reduce read penalties. Smart warmup keeps reads from local cache during transition; HBase integration; scalable across multiple compaction servers with YCSB/TPC-C. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: h612cf282ca3bb7d5
Venue: VLDB
Year: 2015
Pagerank: 0.00010211433
Overall Rank: 1,569 | 89.46%
DOI: 10.14778/2757807.2757810

Incoming Non-self Citations Over Time

Authors

1. Muhammad Yousuf Ahmad (McGill University)
2. Bettina Kemme (McGill University)

BibTeX Citation

@article{ahmad_vldb15,
        title = {{Compaction management in distributed key-value datastores}},
        author = {Ahmad, Muhammad Yousuf and Kemme, Bettina},
        journal = {PVLDB},
        series = {{VLDB} '15},
        volume = {8},
        number = {8},
        pages = {850--861},
        doi = {10.14778/2757807.2757810},
        url = {https://doi.org/10.14778/2757807.2757810},
        year = {2015}
}

Incoming Citations (Sorted by Pagerank)

Showing 22 of 22 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
400	Monkey: Optimal Navigable Key-Value Store	2017	SIGMOD	0.00019129175
754	Dostoevsky: Better Space-Time Trade-Offs for LSM-Tree Based Key-Value Stores via Adaptive Removal of Superfluous Merging	2018	SIGMOD	0.00014236015
1,980	Chucky: A Succinct Cuckoo Filter for LSM-Tree	2021	SIGMOD	9.2595896e-05
2,868	Spooky: Granulating LSM-Tree Compactions Correctly	2022	VLDB	7.9241972e-05
3,641	Nova-LSM: A Distributed, Component-based LSM-tree Key-value Store	2021	SIGMOD	7.1439198e-05
3,671	Leaper: A Learned Prefetcher for Cache Invalidation in LSM-tree based Storage Engines	2020	VLDB	7.1100217e-05
4,041	Disaggregating RocksDB: A Production Experience	2023	SIGMOD	6.8371576e-05
4,121	On Performance Stability in LSM-based Storage Systems	2020	VLDB	6.7946812e-05
6,124	Learning to Optimize LSM-trees: Towards A Reinforcement Learning based Key-Value Store for Dynamic Workloads	2023	SIGMOD	5.8788211e-05
7,241	CaaS-LSM: Compaction-as-a-Service for LSM-based Key-Value Stores in Storage Disaggregated Infrastructure	2024	SIGMOD	5.5777445e-05
7,594	Efficient Data Ingestion and Query Processing for LSM-Based Storage Systems	2019	VLDB	5.4879453e-05
7,905	CAMAL: Optimizing LSM-trees via Active Learning	2024	SIGMOD	5.4291824e-05
8,221	ArceKV: Towards Workload-driven LSM-compactions for Key-Value Store Under Dynamic Workloads	2026	VLDB	5.3759492e-05
8,329	How to Grow an LSM-tree? Towards Bridging the Gap Between Theory and Practice	2025	SIGMOD	5.3536854e-05
8,840	Columnar Formats for Schemaless LSM-based Document Stores	2022	VLDB	5.2665183e-05
9,021	AutoComp: Automated Data Compaction for Log-Structured Tables in Data Lakes	2025	SIGMOD	5.2349846e-05
9,130	Rethinking The Compaction Policies in LSM-trees	2025	SIGMOD	5.2233025e-05
9,181	Structural Designs Meet Optimality: Exploring Optimized LSM-tree Structures in A Colossal Configuration Space	2024	SIGMOD	5.2118872e-05
9,464	DFlush: DPU-Offloaded Flush for Disaggregated LSM-based Key-Value Stores	2025	SIGMOD	5.1727546e-05
10,486	O3-LSM: Maximizing Disaggregated LSM Write Performance via Three-Layer Offloading	2026	SIGMOD	4.9793485e-05
10,645	From Learning to Recycling: A Log-Structured Learned-Less Index	2026	SIGMOD	4.9793485e-05
11,606	KGFabric: A Scalable Knowledge Graph Warehouse for Enterprise Data Interconnection	2024	VLDB	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 7 of 7 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
59	Differential Files: Their Application To The Maintenance Of Large Data Bases	1976	SIGMOD	0.00039605949
139	Megastore: Providing Scalable, Highly Available Storage for Interactive Services	2011	CIDR	0.00029480065
258	bLSM: A General Purpose Log Structured Merge Tree	2012	SIGMOD	0.00022939599
575	Efficient Transaction Processing in SAP HANA Database – The End of a Column Store Myth	2012	SIGMOD	0.00016132182
738	Zephyr: Live Migration in Shared Nothing Databases for Elastic Cloud Platforms	2011	SIGMOD	0.00014334201
893	Albatross: Lightweight Elasticity in Shared Storage Databases for the Cloud using Live Data Migration	2011	VLDB	0.00013220089
1,622	Mesa: Geo-Replicated, Near Real-Time, Scalable Data Warehousing	2014	VLDB	0.00010051462

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	61	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD
2	6,557	Optimal Splitters for Temporal and Multi-version Databases	2013	SIGMOD
3	10,266	Shared Load(ing): Efficient Bulk Loading into Optimized Storage	2020	CIDR
4	3,308	Compacting Transactional Data in Hybrid OLTP&OLAP Databases	2012	VLDB
5	5,879	Compactionary: A Dictionary for LSM Compactions	2022	SIGMOD
6	9,130	Rethinking The Compaction Policies in LSM-trees	2025	SIGMOD
7	9,081	MirrorKV: An Efficient Key-Value Store on Hybrid Cloud Storage with Balanced Performance of Compaction and Querying	2023	SIGMOD
8	7,241	CaaS-LSM: Compaction-as-a-Service for LSM-based Key-Value Stores in Storage Disaggregated Infrastructure	2024	SIGMOD
9	3,680	SplinterDB and Maplets: Improving the Tradeoffs in Key-Value Store Compaction Policy	2023	SIGMOD
10	2,770	Constructing and Analyzing the LSM Compaction Design Space	2021	VLDB