DBScholar

Back to papers

To Partition, or Not to Partition, That is the Join Question in a Real System

Summary: Assesses whether radix join should be integrated into a real code-generating DBMS (Umbra) with a Bloom-filter semi-join reducer. TPC-H/microbenchmarks show radix join helps only 1 of 59 joins; partitioning gains vanish outside tight settings, and late materialization rarely helps. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h9de2e905179e1c2d
Venue
SIGMOD
Year
2021
Pagerank
7.9703078e-05
Overall Rank
2,818 | 81.07%
DOI
10.1145/3448016.3452831

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{bandle_sigmod21,
        title = {{To Partition, or Not to Partition, That is the Join Question in a Real System}},
        author = {Bandle, Maximilian and Giceva, Jana and Neumann, Thomas},
        series = {{SIGMOD} '21},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3448016.3452831},
        url = {https://dl.acm.org/doi/10.1145/3448016.3452831},
        year = {2021}
}

Incoming Citations (Sorted by Pagerank)

Showing 29 of 29 citing papers.

Rank Citing Paper Year Venue Pagerank
3,628 Triton Join: Efficiently Scaling to a Large Join State on GPUs with Fast Interconnects 2022 SIGMOD 7.1490678e-05
5,144 The 3D Hash Join: Building On Non-Unique Join Attributes 2022 CIDR 6.2542377e-05
5,772 Database Technology for the Masses: Sub-Operators as First-Class Entities 2021 VLDB 5.9964298e-05
5,917 Diva: Making MVCC Systems HTAP-Friendly 2022 SIGMOD 5.9469335e-05
6,153 Efficiently Processing Joins and Grouped Aggregations on GPUs 2025 SIGMOD 5.8669913e-05
6,666 UPLIFT: Parallelization Strategies for Feature Transformations in Machine Learning Workloads 2022 VLDB 5.7144587e-05
7,099 Design and Analysis of a Processing-in-DIMM Join Algorithm: A Case Study with UPMEM DIMMs 2023 SIGMOD 5.5991152e-05
7,419 Is Perfect Hashing Practical for OLAP Systems? 2024 CIDR 5.5305461e-05
7,476 Fast Detection of Denial Constraint Violations 2022 VLDB 5.5150385e-05
7,808 Analyzing Vectorized Hash Tables Across CPU Architectures 2023 VLDB 5.448023e-05
7,871 Building Advanced SQL Analytics From Low-Level Plan Operators 2021 SIGMOD 5.434014e-05
7,911 A Practical Approach to Groupjoin and Nested Aggregates 2021 VLDB 5.4261869e-05
7,927 NOCAP: Near-Optimal Correlation-Aware Partitioning Joins 2023 SIGMOD 5.4234567e-05
7,932 Design Trade-offs for a Robust Dynamic Hybrid Hash Join 2022 VLDB 5.4230466e-05
8,402 The Case for Learned In-Memory Joins 2023 VLDB 5.3375308e-05
9,073 A Design Space Exploration and Evaluation for Main-Memory Hash Joins in Storage Class Memory 2023 VLDB 5.2258409e-05
9,438 Efficiently Joining Large Relations on Multi-GPU Systems 2025 VLDB 5.1761941e-05
9,569 Global Hash Tables Strike Back! An Analysis of Parallel GROUP BY Aggregation 2026 VLDB 5.154741e-05
9,574 Saving Private Hash Join 2025 VLDB 5.154741e-05
9,798 Hash Joins Meet CXL: A Fresh Look 2026 CIDR 5.1233734e-05
10,004 Selective Late Materialization in Modern Analytical Databases 2025 VLDB 5.0954911e-05
10,079 Databases in the Era of Memory-Centric Computing 2025 CIDR 5.0831474e-05
10,311 Data Chunk Compaction in Vectorized Execution 2025 SIGMOD 5.0376863e-05
10,567 Counting Is All You Need for Instant Tuple Discovery: Enabling Real-Time HTAP in Standalone DBMSs 2026 SIGMOD 4.9769913e-05
10,951 One Ring to Shuffle Them All: Scalable Intra-Process Data Redistribution with Ring-Buffer Shuffle in Redpanda Oxla 2026 VLDB 4.9769913e-05
11,200 Nested Parquet Is Flat, Why Not Use It? How To Scan Nested Data With On-the-Fly Key Generation and Joins 2025 SIGMOD 4.9769913e-05
11,548 High-Performance Query Processing with NVMe Arrays: Spilling without Killing Performance 2024 SIGMOD 4.9769913e-05
11,551 SPID-Join: A Skew-resistant Processing-in-DIMM Join Algorithm Exploiting the Bank- and Rank-level Parallelisms of DIMMs 2024 SIGMOD 4.9769913e-05
11,871 Scaling Equi-Joins 2022 SIGMOD 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 27 of 27 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061067652
27 Database Architecture Optimized for the New Bottleneck: Memory Access 1999 VLDB 0.00051576613
76 Cache Conscious Algorithms for Relational Query Processing 1994 VLDB 0.00036891569
210 Sort vs. Hash Revisited: Fast Join Implementation on Modern Multi-Core CPUs 2009 VLDB 0.00024844328
215 Morsel-Driven Parallelism: A NUMA-Aware Query Evaluation Framework for the Many-Core Age 2014 SIGMOD 0.00024589307
251 Multi-Core, Main-Memory Joins: Sort vs. Hash Revisited 2014 VLDB 0.00023136934
362 Design and Evaluation of Main Memory Hash Join Algorithms for Multi-core CPUs 2011 SIGMOD 0.00019999596
373 Umbra: A Disk-Based System with In-Memory Performance 2020 CIDR 0.00019705706
425 Massively Parallel Sort-Merge Joins in Main Memory Multi-Core Database Systems 2012 VLDB 0.00018485358
627 Rethinking SIMD Vectorization for In-Memory Databases 2015 SIGMOD 0.00015454197
663 Fast Sort on CPUs and GPUs: A Case for Bandwidth Oblivious SIMD Sort 2010 SIGMOD 0.00014997516
907 Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation 2016 SIGMOD 0.00013157412
963 Memory-Efficient Hash Joins 2015 VLDB 0.00012815832
997 What happens during a Join? Dissecting CPU and Memory Optimization Effects 2000 VLDB 0.00012628913
1,116 A Comprehensive Study of Main-Memory Partitioning and its Application to Large-Scale Comparison- and Radix-Sort 2014 SIGMOD 0.00011957053
1,212 A Seven-Dimensional Analysis of Hashing Methods and its Implications on Query Processing 2016 VLDB 0.00011521857
1,267 An Experimental Comparison of Thirteen Relational Equi-Joins in Main Memory 2016 SIGMOD 0.00011265987
1,341 Relaxed Operator Fusion for In-Memory Databases: Making Compilation, Vectorization, and Prefetching Work Together At Last 2018 VLDB 0.00010963427
1,473 Voodoo - A Vector Algebra for Portable Database Performance on Modern Hardware 2016 VLDB 0.00010552993
1,949 Quantifying TPC-H Choke Points and Their Optimizations 2020 VLDB 9.3172855e-05
3,285 Performance-Optimal Filtering: Bloom Overtakes Cuckoo at High Throughput 2019 VLDB 7.4525495e-05
3,432 Cache-Conscious Radix-Decluster Projections 2004 VLDB 7.300628e-05
4,209 Accelerating Queries with Group-By and Join by Groupjoin 2011 VLDB 6.7307652e-05
4,932 FPGA-based Data Partitioning 2017 SIGMOD 6.3455411e-05
5,180 On the Surprising Difficulty of Simple Things: the Case of Radix Partitioning 2015 VLDB 6.2379001e-05
6,216 Data Partitioning for In-Memory Systems: Myths, Challenges, and Opportunities 2019 CIDR 5.8451996e-05
9,561 Engineering High-Performance Database Engines 2014 VLDB 5.1561699e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 249 A Performance Evaluation of Four Parallel Join Algorithms in a Shared-Nothing Multiprocessor Environment 1989 SIGMOD
2 3,062 Design and Evaluation of Parallel Pipelined Join Algorithms 1987 SIGMOD
3 1,267 An Experimental Comparison of Thirteen Relational Equi-Joins in Main Memory 2016 SIGMOD
4 1,596 Adopting Worst-Case Optimal Joins in Relational Database Systems 2020 VLDB
5 963 Memory-Efficient Hash Joins 2015 VLDB
6 853 Hash-Partitioned Join Method Using Dynamic Destaging Strategy 1988 VLDB
7 362 Design and Evaluation of Main Memory Hash Join Algorithms for Multi-core CPUs 2011 SIGMOD
8 920 Tradeoffs in Processing Complex Join Queries via Hashing in Multiprocessor Database Machines 1990 VLDB
9 7,351 A Scalable and Generic Approach to Range Joins 2022 VLDB
10 251 Multi-Core, Main-Memory Joins: Sort vs. Hash Revisited 2014 VLDB