DBScholar

Back to papers

Distributed Join Algorithms on Thousands of Cores

Summary: MPI-based radix-hash and sort-merge joins scale to 4,096 cores and 4.8 TB, reaching 48.7B tuples/s with SIMD, one-sided operations, and RDMA. Communication scheduling and compute/network balance dominate scalability; sort-merge nears its model peak, unlike hashing. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
11736
Venue
VLDB
Year
2017
Pagerank
7.9549783e-05
Overall Rank
2,926 | 79.93%
DOI
10.14778/3055540.3055546

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{barthels_vldb17,
        title = {{Distributed Join Algorithms on Thousands of Cores}},
        author = {Barthels, Claude and Müller, Ingo and Schneider, Timo and Alonso, Gustavo and Hoefler, Torsten},
        journal = {PVLDB},
        series = {{VLDB} '17},
        volume = {10},
        number = {5},
        pages = {517--528},
        doi = {10.14778/3055540.3055546},
        url = {https://doi.org/10.14778/3055540.3055546},
        year = {2017}
}

Incoming Citations (Sorted by Pagerank)

Showing 22 of 22 citing papers.

Rank Citing Paper Year Venue Pagerank
1,238 BatchDB: Efficient Isolated Execution of Hybrid OLTP+OLAP Workloads for Interactive Applications 2017 SIGMOD 0.00011543368
1,342 Designing Distributed Tree-based Index Structures for Fast RDMA-capable Networks 2019 SIGMOD 0.00011098147
1,494 Procella: Unifying serving and analytical data at YouTube 2019 VLDB 0.00010577585
2,212 Sherman: A Write-Optimized Distributed B+Tree Index on Disaggregated Memory 2022 SIGMOD 8.9411432e-05
3,196 Farview: Disaggregated Memory with Operator Off-loading for Database Engines 2022 CIDR 7.6467469e-05
3,868 DFI: The Data Flow Interface for High-Speed Networks 2021 SIGMOD 7.0614899e-05
3,874 Tensors: An abstraction for general data processing 2021 VLDB 7.0561161e-05
4,535 Triton Join: Efficiently Scaling to a Large Join State on GPUs with Fast Interconnects 2022 SIGMOD 6.6419266e-05
4,829 Strong consistency is not hard to get: Two-Phase Locking and Two-Phase Commit on Thousands of Cores 2019 VLDB 6.4882686e-05
4,840 FPGA-based Data Partitioning 2017 SIGMOD 6.483442e-05
5,587 Distributed GPU Joins on Fast RDMA-capable Networks 2023 SIGMOD 6.1596139e-05
6,161 Data Partitioning for In-Memory Systems: Myths, Challenges, and Opportunities 2019 CIDR 5.9537202e-05
6,405 DPI: The Data Processing Interface for Modern Networks 2019 CIDR 5.8855242e-05
7,666 Hardware-Oblivious SIMD Parallelism for In-Memory Column-Stores 2020 CIDR 5.57179e-05
7,899 Modularis: Modular Relational Analytics over Heterogeneous Distributed Platforms 2021 VLDB 5.5195553e-05
8,234 The Case for Learned In-Memory Joins 2023 VLDB 5.460955e-05
8,721 Accelerate Distributed Joins with Predicate Transfer 2025 SIGMOD 5.3772617e-05
9,333 Efficiently Joining Large Relations on Multi-GPU Systems 2025 VLDB 5.2887551e-05
9,478 Parallel Query Processing: To Separate Communication from Computation 2022 SIGMOD 5.2634238e-05
10,662 Data Chunk Compaction in Vectorized Execution 2025 SIGMOD 5.093636e-05
11,273 OLAP on Modern Chiplet-Based Processors 2024 VLDB 5.093636e-05
11,556 Scaling Equi-Joins 2022 SIGMOD 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 11 of 11 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
209 Sort vs. Hash Revisited: Fast Join Implementation on Modern Multi-Core CPUs 2009 VLDB 0.00024932174
252 Multi-Core, Main-Memory Joins: Sort vs. Hash Revisited 2014 VLDB 0.00023242719
360 Design and Evaluation of Main Memory Hash Join Algorithms for Multi-core CPUs 2011 SIGMOD 0.00020182846
423 Massively Parallel Sort-Merge Joins in Main Memory Multi-Core Database Systems 2012 VLDB 0.00018725853
764 To Join or Not to Join? Thinking Twice about Joins before Feature Selection 2016 SIGMOD 0.00014226652
892 Rack-Scale In-Memory Join Processing using RDMA 2015 SIGMOD 0.00013376761
976 The End of Slow Networks: It's Time for a Redesign 2016 VLDB 0.00012864533
1,076 High-Speed Query Processing over High-Speed Networks 2016 VLDB 0.00012270109
1,117 Accelerating Relational Databases by Leveraging Remote Memory and RDMA 2016 SIGMOD 0.00012108907
1,974 Track Join: Distributed Joins with Minimal Network Traffic 2014 SIGMOD 9.3658402e-05
6,103 VectorH: Taking SQL-on-Hadoop to the Next Level 2016 SIGMOD 5.9755412e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 9,333 Efficiently Joining Large Relations on Multi-GPU Systems 2025 VLDB
2 242 A Performance Evaluation of Four Parallel Join Algorithms in a Shared-Nothing Multiprocessor Environment 1989 SIGMOD
3 892 Rack-Scale In-Memory Join Processing using RDMA 2015 SIGMOD
4 152 Multiprocessor Hash-Based Join Algorithms 1985 VLDB
5 423 Massively Parallel Sort-Merge Joins in Main Memory Multi-Core Database Systems 2012 VLDB
6 360 Design and Evaluation of Main Memory Hash Join Algorithms for Multi-core CPUs 2011 SIGMOD
7 12,090 Let's Rethink Join Optimization in Distributed Systems 2015 CIDR
8 3,011 Design and Evaluation of Parallel Pipelined Join Algorithms 1987 SIGMOD
9 209 Sort vs. Hash Revisited: Fast Join Implementation on Modern Multi-Core CPUs 2009 VLDB
10 252 Multi-Core, Main-Memory Joins: Sort vs. Hash Revisited 2014 VLDB