Data Chunk Compaction in Vectorized Execution

Summary: Addresses data-chunk fragmentation in vectorized analytics caused by hash-join processing. Proposes a runtime-learning compaction threshold and hash-join-specific logical compaction to minimize movement, delivering up to 63% speedups in DuckDB on TPC-H/DS. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 7024
Venue: SIGMOD
Year: 2025
Pagerank: 4.1945683e-05
Overall Rank: 10,372 | 27.85%
DOI: 10.1145/3709676

Incoming Non-self Citations Over Time

No non-self incoming citations found for this paper in this database.

Authors

1. Yiming Qiao
2. Huanchen Zhang

Incoming Citations (Sorted by Pagerank)

Showing 2 of 2 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
7,126	Debunking the Myth of Join Ordering: Toward Robust SQL Analytics	2025	SIGMOD	4.8232367e-05
10,241	Robust Predicate Transfer with Dynamic Execution	2026	VLDB	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 31 of 31 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
35	MonetDB/X100: Hyper-Pipelining Query Execution	2005	CIDR	0.00076197749
71	How Good Are Query Optimizers, Really?	2016	VLDB	0.00059038975
81	Cache Conscious Algorithms for Relational Query Processing	1994	VLDB	0.00055548574
131	Integrating Compression and Execution in Column-Oriented Database Systems	2006	SIGMOD	0.0004370331
167	The Snowflake Elastic Data Warehouse	2016	SIGMOD	0.00039180521
185	DuckDB: an Embeddable Analytical Database	2019	SIGMOD	0.00036538405
241	DB2 with BLU Acceleration: So Much More than Just a Column Store	2013	VLDB	0.00031420034
351	Sort vs. Hash Revisited: Fast Join Implementation on Modern Multi-Core CPUs	2009	VLDB	0.0002636504
390	CockroachDB: The Resilient Geo-Distributed SQL Database	2020	SIGMOD	0.00024607299
418	Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age	2014	SIGMOD	0.00023729211
853	Everything You Always Wanted to Know About Compiled and Vectorized Queries But Were Afraid to Ask	2018	VLDB	0.00015940507
958	Rethinking SIMD Vectorization for In-Memory Databases	2015	SIGMOD	0.00015045316
1,263	Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation	2016	SIGMOD	0.00012982857
1,804	An Experimental Comparison of Thirteen Relational Equi-Joins in Main Memory	2016	SIGMOD	0.00010501185
1,864	Relaxed Operator Fusion for In-Memory Databases: Making Compilation, Vectorization, and Prefetching Work Together At Last	2018	VLDB	0.00010280966
1,943	Procella: Unifying serving and analytical data at YouTube	2019	VLDB	0.00010012569
2,062	Dremel: A Decade of Interactive SQL Analysis at Web Scale	2020	VLDB	9.6481955e-05
2,473	Photon: A Fast Query Engine for Lakehouse Systems	2022	SIGMOD	8.7237281e-05
2,528	Velox: Meta’s Unified Execution Engine	2022	VLDB	8.59454e-05
3,443	Distributed Join Algorithms on Thousands of Cores	2017	VLDB	7.0887214e-05
3,721	To Partition, or Not to Partition, That is the Join Question in a Real System	2021	SIGMOD	6.8179379e-05
3,882	Micro Adaptivity in Vectorwise	2013	SIGMOD	6.6690423e-05
4,495	ClickHouse - Lightning Fast Analytics for Everyone	2024	VLDB	6.1410277e-05
4,514	An Empirical Evaluation of Columnar Storage Formats	2024	VLDB	6.1204636e-05
6,221	Charting the Design Space of Query Execution using VOILA	2021	VLDB	5.1512158e-05
6,340	Apache Arrow DataFusion: A Fast, Embeddable, Modular Analytic Query Engine	2024	SIGMOD	5.1051018e-05
7,443	From X100 to Vectorwise: Opportunities, Challenges and Things Most Researchers do not Think About	2012	SIGMOD	4.7284745e-05
8,478	Analyzing Vectorized Hash Tables Across CPU Architectures	2023	VLDB	4.5015937e-05
9,662	Efficient Query Re-optimization with Judicious Subquery Selections	2023	SIGMOD	4.3097631e-05
9,857	Towards Unifying Query Interpretation and Compilation	2023	CIDR	4.269353e-05
11,036	Blitzcrank: Fast Semantic Compression for In-memory Online Transaction Processing	2024	VLDB	4.1945683e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
1,887	Caching Multidimensional Queries Using Chunks	1998	SIGMOD	0.00010204659
1,100	Query Optimization In Compressed Database Systems	2001	SIGMOD	0.00014072277
5,314	Can Learned Models Replace Hash Functions?	2023	VLDB	5.5724608e-05
540	Design and Evaluation of Main Memory Hash Join Algorithms for Multi-core CPUs	2011	SIGMOD	0.0002063443
1,263	Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation	2016	SIGMOD	0.00012982857
8,578	Robust and Budget-Constrained Encoding Configurations for In-Memory Database Systems	2022	VLDB	4.4923477e-05
1,191	Fast Computation of Sparse Datacubes	1997	VLDB	0.00013434201
5,670	Joins on Encoded and Partitioned Data	2014	VLDB	5.3804618e-05
8,275	Adaptive Factorization Using Linear-Chained Hash Tables	2025	CIDR	4.5439841e-05
10,635	Saving Private Hash Join	2025	VLDB	4.1945683e-05