On Reducing Space Amplification with Multi-Column Compaction in Apache IoTDB

Summary: Shows out‑of‑order inserts, updates and overlapping bitmaps in multi‑column time‑series worsen LSM-tree space amplification in Apache IoTDB and proves optimal compaction file selection is hard. Proposes Multi‑Column Compaction: a heuristic file‑selection with File Prefetcher and Compaction Cache, implemented in IoTDB, that significantly reduces space amplification in experiments. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 13517
Venue: VLDB
Year: 2024
Pagerank: 4.1905499e-05
Overall Rank: 11,052 | 23.19%
DOI: 10.14778/3681954.3681977

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
255	Efficient Management of Transitive Relationships in Large Data and Knowledge Bases	1989	SIGMOD	0.00030342925
486	TiDB: A Raft-based HTAP Database	2020	VLDB	0.00022039625
568	Optimizing Space Amplification in RocksDB	2017	CIDR	0.00019932335
1,309	Dostoevsky: Better Space-Time Trade-Offs for LSM-Tree Based Key-Value Stores via Adaptive Removal of Superfluous Merging	2018	SIGMOD	0.00012655712
1,368	SlimDB: A Space-Efficient Key-Value Storage Engine For Semi-Sorted Data	2017	VLDB	0.0001235708
1,614	MyRocks: LSM-Tree Database Storage Engine Serving Facebook's Social Graph	2020	VLDB	0.00011137963
1,925	Apache IoTDB: Time-series Database for Internet of Things	2020	VLDB	0.00010073156
1,932	X-Engine: An Optimized Storage Engine for Large-scale E-commerce Transaction Processing	2019	SIGMOD	0.00010050776
2,024	Storage Management in AsterixDB	2014	VLDB	9.7528344e-05
3,363	Lethe: A Tunable Delete-Aware LSM Engine	2020	SIGMOD	7.1680649e-05
3,797	Constructing and Analyzing the LSM Compaction Design Space	2021	VLDB	6.7552936e-05
3,970	Spooky: Granulating LSM-Tree Compactions Correctly	2022	VLDB	6.5756727e-05
3,971	Apache IoTDB: A Time Series Database for IoT Applications	2023	SIGMOD	6.5733348e-05
5,118	Design Tradeoffs of Data Access Methods	2016	SIGMOD	5.6781464e-05
5,801	Dissecting, Designing, and Optimizing LSM-based Data Stores	2022	SIGMOD	5.3217858e-05
11,178	Grouping Time Series for Efficient Columnar Storage	2023	SIGMOD	4.1905499e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
3,971	Apache IoTDB: A Time Series Database for IoT Applications	2023	SIGMOD	6.5733348e-05
10,391	In-Database Time Series Clustering	2025	SIGMOD	4.1905499e-05
9,390	Rethinking The Compaction Policies in LSM-trees	2025	SIGMOD	4.341433e-05
8,426	Time Series Representation for Visualization in Apache IoTDB	2024	SIGMOD	4.5098472e-05
10,584	Migration-Free Elastic Storage of Time Series in Apache IoTDB	2025	VLDB	4.1905499e-05
5,070	Time Series Data Encoding for Efficient Storage: A Comparative Analysis in Apache IoTDB	2022	VLDB	5.7133478e-05
3,797	Constructing and Analyzing the LSM Compaction Design Space	2021	VLDB	6.7552936e-05
9,797	Distance-based Outlier Query Optimization in Apache IoTDB	2024	VLDB	4.2777144e-05
11,178	Grouping Time Series for Efficient Columnar Storage	2023	SIGMOD	4.1905499e-05
10,682	Improving Time Series Data Compression in Apache IoTDB	2025	VLDB	4.1905499e-05