DBScholar

Back to papers

Spooky: Granulating LSM-Tree Compactions Correctly

Summary: Spooky exposes the opposing costs of LSM compaction granularity: Full Merge causes space amplification, while Partial Merge causes write amplification and SSD GC overhead. It aligns lower-level partitions to largest-level file boundaries, achieving >2× lower space and write amplification than either strategy. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
hb9e54de705162b42
Venue
VLDB
Year
2022
Pagerank
7.9241972e-05
Overall Rank
2,868 | 80.72%
DOI
10.14778/3551793.3551853

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{dayan_vldb22,
        title = {{Spooky: Granulating LSM-Tree Compactions Correctly}},
        author = {Dayan, Niv and Weiss, Tamar and Dashevsky, Shmuel and Pan, Michael and Bortnikov, Edward and Twitto, Moshe},
        journal = {PVLDB},
        series = {{VLDB} '22},
        volume = {15},
        number = {11},
        pages = {3071--3084},
        doi = {10.14778/3551793.3551853},
        url = {https://doi.org/10.14778/3551793.3551853},
        year = {2022}
}

Incoming Citations (Sorted by Pagerank)

Showing 25 of 25 citing papers.

Rank Citing Paper Year Venue Pagerank
4,750 GRF: A Global Range Filter for LSM-Trees with Shape Encoding 2024 SIGMOD 6.4354422e-05
5,081 InfiniFilter: Expanding Filters to Infinity and Beyond 2023 SIGMOD 6.2854372e-05
6,124 Learning to Optimize LSM-trees: Towards A Reinforcement Learning based Key-Value Store for Dynamic Workloads 2023 SIGMOD 5.8788211e-05
7,241 CaaS-LSM: Compaction-as-a-Service for LSM-based Key-Value Stores in Storage Disaggregated Infrastructure 2024 SIGMOD 5.5777445e-05
7,905 CAMAL: Optimizing LSM-trees via Active Learning 2024 SIGMOD 5.4291824e-05
8,221 ArceKV: Towards Workload-driven LSM-compactions for Key-Value Store Under Dynamic Workloads 2026 VLDB 5.3759492e-05
8,329 How to Grow an LSM-tree? Towards Bridging the Gap Between Theory and Practice 2025 SIGMOD 5.3536854e-05
8,640 Mnemosyne: Dynamic Workload-Aware BF Tuning via Accurate Statistics in LSM trees 2025 SIGMOD 5.2972383e-05
8,944 Practical Dynamic Extension for Sampling Indexes 2023 SIGMOD 5.2542285e-05
9,056 Aster: Enhancing LSM-structures for Scalable Graph Database 2025 SIGMOD 5.2295363e-05
9,081 MirrorKV: An Efficient Key-Value Store on Hybrid Cloud Storage with Balanced Performance of Compaction and Querying 2023 SIGMOD 5.2283159e-05
9,130 Rethinking The Compaction Policies in LSM-trees 2025 SIGMOD 5.2233025e-05
9,181 Structural Designs Meet Optimality: Exploring Optimized LSM-tree Structures in A Colossal Configuration Space 2024 SIGMOD 5.2118872e-05
9,646 Are Joins over LSM-trees Ready? Take RocksDB as an Example 2025 VLDB 5.1453267e-05
10,029 LavaStore: ByteDance's Purpose-built, High-performance, Cost-effective Local Storage Engine for Cloud Services 2024 VLDB 5.0925155e-05
10,228 From FASTER to F2: Evolving Concurrent Key-Value Store Designs for Large Skewed Workloads 2025 VLDB 5.0571508e-05
10,355 A Multi-tenant Relational OLTP Database at Salesforce 2026 CIDR 4.9793485e-05
10,486 O3-LSM: Maximizing Disaggregated LSM Write Performance via Three-Layer Offloading 2026 SIGMOD 4.9793485e-05
10,556 Counting Is All You Need for Instant Tuple Discovery: Enabling Real-Time HTAP in Standalone DBMSs 2026 SIGMOD 4.9793485e-05
10,658 Making LSM-Tree-based Key-Value Store Practical and Efficient for Multi-Tenant Serverless Cloud Databases 2026 SIGMOD 4.9793485e-05
10,667 PartitionKV: Redesigning LSM-tree KV Stores on NVMs with Adaptive Partitioning for Reducing Write Stalls and Amplification 2026 SIGMOD 4.9793485e-05
10,725 How to Write to SSDs 2026 VLDB 4.9793485e-05
10,764 Kirin: Efficient In-Storage Learned Compaction for LSM-Trees via System-Algorithm Co-Design 2026 VLDB 4.9793485e-05
10,844 Rethinking Learned Index and LSM-tree Integration 2026 VLDB 4.9793485e-05
11,586 On Reducing Space Amplification with Multi-Column Compaction in Apache IoTDB 2024 VLDB 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 27 of 27 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
258 bLSM: A General Purpose Log Structured Merge Tree 2012 SIGMOD 0.00022939599
400 Monkey: Optimal Navigable Key-Value Store 2017 SIGMOD 0.00019129175
436 Optimizing Space Amplification in RocksDB 2017 CIDR 0.00018319035
485 BLOCKBENCH: A Framework for Analyzing Private Blockchains 2017 SIGMOD 0.00017474502
754 Dostoevsky: Better Space-Time Trade-Offs for LSM-Tree Based Key-Value Stores via Adaptive Removal of Superfluous Merging 2018 SIGMOD 0.00014236015
816 SlimDB: A Space-Efficient Key-Value Storage Engine For Semi-Sorted Data 2017 VLDB 0.00013687311
891 SuRF: Practical Range Query Filtering with Fast Succinct Tries 2018 SIGMOD 0.00013245926
1,074 Cache-Oblivious String B-trees 2006 PODS 0.00012162592
1,147 MyRocks: LSM-Tree Database Storage Engine Serving Facebook's Social Graph 2020 VLDB 0.00011813751
1,303 Realtime Data Processing at Facebook 2016 SIGMOD 0.0001110427
1,313 X-Engine: An Optimized Storage Engine for Large-scale E-commerce Transaction Processing 2019 SIGMOD 0.00011060108
1,422 The Log-Structured Merge-Bush & the Wacky Continuum 2019 SIGMOD 0.00010725538
1,569 Compaction management in distributed key-value datastores 2015 VLDB 0.00010211433
1,605 The Data Calculator*: Data Structure Design and Cost Synthesis from First Principles and Learned Cost Models 2018 SIGMOD 0.00010093796
1,889 Design Continuums and the Path Toward Self-Designing Key-Value Stores that Know and Learn 2019 CIDR 9.4273689e-05
1,980 Chucky: A Succinct Cuckoo Filter for LSM-Tree 2021 SIGMOD 9.2595896e-05
2,770 Constructing and Analyzing the LSM Compaction Design Space 2021 VLDB 8.037607e-05
2,788 Lethe: A Tunable Delete-Aware LSM Engine 2020 SIGMOD 8.0133966e-05
2,995 Accordion: Better Memory Organization for LSM Key-Value Stores 2018 VLDB 7.7705434e-05
3,130 Improving Flash Write Performance by Using Update Frequency 2013 VLDB 7.6146434e-05
4,680 Coconut: A Scalable Bottom-Up Approach for Building Data Series Indexes 2018 VLDB 6.4722037e-05
5,955 The Necessary Death of the Block Device Interface 2013 CIDR 5.9357449e-05
6,238 Toward a Better Understanding and Evaluation of Tree Structures on Flash SSDs 2021 VLDB 5.8385618e-05
7,040 Coconut Palm: Static and Streaming Data Series Exploration Now in your Palm 2019 SIGMOD 5.6146574e-05
7,392 GeckoFTL: Scalable Flash Translation Techniques For Very Large Flash Devices 2016 SIGMOD 5.537378e-05
9,662 The End of Moore’s Law and the Rise of The Data Processor 2021 VLDB 5.1453267e-05
13,959 EagleTree: Exploring the Design Space of SSD-Based Algorithms 2013 VLDB -
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 11,586 On Reducing Space Amplification with Multi-Column Compaction in Apache IoTDB 2024 VLDB
2 816 SlimDB: A Space-Efficient Key-Value Storage Engine For Semi-Sorted Data 2017 VLDB
3 6,932 Breaking Down Memory Walls in LSM-based Storage Systems 2020 SIGMOD
4 10,183 DumpKV: Learning based lifetime aware garbage collection for key value separation in LSM-tree 2025 VLDB
5 1,422 The Log-Structured Merge-Bush & the Wacky Continuum 2019 SIGMOD
6 10,667 PartitionKV: Redesigning LSM-tree KV Stores on NVMs with Adaptive Partitioning for Reducing Write Stalls and Amplification 2026 SIGMOD
7 5,879 Compactionary: A Dictionary for LSM Compactions 2022 SIGMOD
8 12,208 Splaying Log-Structured Merge-Trees 2018 SIGMOD
9 9,130 Rethinking The Compaction Policies in LSM-trees 2025 SIGMOD
10 2,770 Constructing and Analyzing the LSM Compaction Design Space 2021 VLDB