On Reducing Space Amplification with Multi-Column Compaction in Apache IoTDB

Summary: Shows out‑of‑order inserts, updates and overlapping bitmaps in multi‑column time‑series worsen LSM-tree space amplification in Apache IoTDB and proves optimal compaction file selection is hard. Proposes Multi‑Column Compaction: a heuristic file‑selection with File Prefetcher and Compaction Cache, implemented in IoTDB, that significantly reduces space amplification in experiments. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: 13516
Venue: VLDB
Year: 2024
Pagerank: 4.1945683e-05
Overall Rank: 11,049 | 23.14%
DOI: 10.14778/3681954.3681977

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

Incoming Citations (Sorted by Pagerank)

Showing 0 of 0 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank

Outgoing Citations (Sorted by Pagerank)

Showing 16 of 16 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
246	Efficient Management of Transitive Relationships in Large Data and Knowledge Bases	1989	SIGMOD	0.00030949575
488	TiDB: A Raft-based HTAP Database	2020	VLDB	0.000220409
569	Optimizing Space Amplification in RocksDB	2017	CIDR	0.00019924098
1,311	Dostoevsky: Better Space-Time Trade-Offs for LSM-Tree Based Key-Value Stores via Adaptive Removal of Superfluous Merging	2018	SIGMOD	0.00012657439
1,366	SlimDB: A Space-Efficient Key-Value Storage Engine For Semi-Sorted Data	2017	VLDB	0.00012357685
1,610	MyRocks: LSM-Tree Database Storage Engine Serving Facebook's Social Graph	2020	VLDB	0.00011148094
1,921	Apache IoTDB: Time-series Database for Internet of Things	2020	VLDB	0.00010082827
2,004	X-Engine: An Optimized Storage Engine for Large-scale E-commerce Transaction Processing	2019	SIGMOD	9.811707e-05
2,021	Storage Management in AsterixDB	2014	VLDB	9.7601304e-05
3,386	Lethe: A Tunable Delete-Aware LSM Engine	2020	SIGMOD	7.1577103e-05
3,793	Constructing and Analyzing the LSM Compaction Design Space	2021	VLDB	6.7617833e-05
3,965	Spooky: Granulating LSM-Tree Compactions Correctly	2022	VLDB	6.5820028e-05
3,967	Apache IoTDB: A Time Series Database for IoT Applications	2023	SIGMOD	6.5796647e-05
5,119	Design Tradeoffs of Data Access Methods	2016	SIGMOD	5.6807904e-05
5,791	Dissecting, Designing, and Optimizing LSM-based Data Stores	2022	SIGMOD	5.3268999e-05
11,175	Grouping Time Series for Efficient Columnar Storage	2023	SIGMOD	4.1945683e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
3,967	Apache IoTDB: A Time Series Database for IoT Applications	2023	SIGMOD	6.5796647e-05
10,379	In-Database Time Series Clustering	2025	SIGMOD	4.1945683e-05
9,386	Rethinking The Compaction Policies in LSM-trees	2025	SIGMOD	4.3455975e-05
8,434	Time Series Representation for Visualization in Apache IoTDB	2024	SIGMOD	4.5141748e-05
10,575	Migration-Free Elastic Storage of Time Series in Apache IoTDB	2025	VLDB	4.1945683e-05
5,071	Time Series Data Encoding for Efficient Storage: A Comparative Analysis in Apache IoTDB	2022	VLDB	5.7188461e-05
3,793	Constructing and Analyzing the LSM Compaction Design Space	2021	VLDB	6.7617833e-05
9,794	Distance-based Outlier Query Optimization in Apache IoTDB	2024	VLDB	4.2818172e-05
11,175	Grouping Time Series for Efficient Columnar Storage	2023	SIGMOD	4.1945683e-05
10,674	Improving Time Series Data Compression in Apache IoTDB	2025	VLDB	4.1945683e-05