Adaptive Factorization Using Linear-Chained Hash Tables

Summary: Adds adaptive factorized aggregations and runtime-chosen worst-case-optimal joins to DuckDB via a collision-free linear-chained hash table that enables efficient factorized/WCOJ execution. Decisions use on-the-fly sketches, heuristics, and ML to obtain stats from subqueries/Parquet, yielding near-optimal performance with explainable low-cost alternatives. (summarized by gpt-5-mini on Feb 09 2026)

Paper ID: heaabe90f06b0db6c
Venue: CIDR
Year: 2025
Pagerank: 5.4548741e-05
Overall Rank: 7,768 | 47.80%
DOI: -
PDF: Download (CC BY 4.0)

Incoming Non-self Citations Over Time

Authors

1. Paul Groß (Centrum Wiskunde & Informatica)
2. Daniel ten Wolde (Centrum Wiskunde & Informatica)
3. Peter Boncz (Centrum Wiskunde & Informatica)

BibTeX Citation

@inproceedings{gro_cidr25,
        address = {Amsterdam, Netherlands},
        series = {{CIDR} '25},
        title = {{Adaptive Factorization Using Linear-Chained Hash Tables}},
        booktitle = {Proceedings of the {Conference} on {Innovative} {Data} {Systems} {Research}},
        author = {Groß, Paul and Wolde, Daniel ten and Boncz, Peter},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 3 of 3 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
7,810	Parachute: Single-Pass Bi-Directional Information Passing	2025	VLDB	5.4477354e-05
9,362	ScaleCache: Scalable and Production-grade Buffer Management for Disk-based Database Systems	2025	VLDB	5.1855858e-05
10,852	The Data World Is Not Flat: Efficient Factorized Execution for Relational Systems	2026	VLDB	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 17 of 17 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
14	MonetDB/X100: Hyper-Pipelining Query Execution	2005	CIDR	0.00064013679
71	DuckDB: an Embeddable Analytical Database	2019	SIGMOD	0.00037724477
91	On the Propagation of Errors in the Size of Join Results	1991	SIGMOD	0.00034748721
215	Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age	2014	SIGMOD	0.00024589307
239	The Ubiquity of Large Graphs and Surprising Challenges of Graph Processing	2018	VLDB	0.00023499655
315	Worst-Case Optimal Join Algorithms: Techniques, Results, and Open Problems	2018	PODS	0.00021236408
373	Umbra: A Disk-Based System with In-Memory Performance	2020	CIDR	0.00019705706
1,596	Adopting Worst-Case Optimal Joins in Relational Database Systems	2020	VLDB	0.00010122962
1,753	Kuzu* Graph Database Management System	2023	CIDR	9.7244117e-05
2,293	FDB: A Query Engine for Factorised Relational Databases	2012	VLDB	8.685044e-05
2,975	Accurate Summary-based Cardinality Estimation Through the Lens of Cardinality Estimation Graphs	2022	VLDB	7.7905662e-05
3,058	The LDBC Social Network Benchmark: Business Intelligence Workload	2023	VLDB	7.6943418e-05
3,132	Every Row Counts: Combining Sketches and Sampling for Accurate Group-By Result Estimates	2019	CIDR	7.6107287e-05
3,154	Robust Join Processing with Diamond Hardened Joins	2024	VLDB	7.5849549e-05
3,206	Columnar Storage and List-based Processing for Graph Database Management Systems	2021	VLDB	7.5365348e-05
5,144	The 3D Hash Join: Building On Non-Unique Join Attributes	2022	CIDR	6.2542377e-05
5,244	DuckPGQ: Bringing SQL/PGQ to DuckDB	2023	VLDB	6.2127936e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	12,683	Efficient Rank Join with Aggregation Constraints	2011	VLDB
2	5,144	The 3D Hash Join: Building On Non-Unique Join Attributes	2022	CIDR
3	5,532	Generalized Hash Teams for Join and Group-by	1999	VLDB
4	853	Hash-Partitioned Join Method Using Dynamic Destaging Strategy	1988	VLDB
5	10,778	One Join Order Does Not Fit All: Reducing Intermediate Results with Per-Split Query Plans	2026	VLDB
6	7,438	Efficient Computation of Quantiles over Joins	2023	PODS
7	1,596	Adopting Worst-Case Optimal Joins in Relational Database Systems	2020	VLDB
8	4,890	Can Learned Models Replace Hash Functions?	2023	VLDB
9	9,574	Saving Private Hash Join	2025	VLDB
10	10,311	Data Chunk Compaction in Vectorized Execution	2025	SIGMOD