Accelerate Distributed Joins with Predicate Transfer

Summary: Extends predicate transfer to distributed joins with cost-based adaptive execution and Bloom-filter pre-filtering. Introduces pruning to drop non-contributory transfers; reports 3x speedup and 2.7x data-exchange reduction on TPC-H/DSB SF400 in a distributed analytics engine. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 7259
Venue: SIGMOD
Year: 2025
Pagerank: 5.3772617e-05
Overall Rank: 8,721 | 40.17%
DOI: 10.1145/3725259

Incoming Non-self Citations Over Time

Authors

1. Yifei Yang (University of Wisconsin)
2. Xiangyao Yu (University of Wisconsin)

BibTeX Citation

@inproceedings{yang_sigmod25,
        title = {{Accelerate Distributed Joins with Predicate Transfer}},
        author = {Yang, Yifei and Yu, Xiangyao},
        series = {{SIGMOD} '25},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3725259},
        url = {https://dl.acm.org/doi/10.1145/3725259},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 4 of 4 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
9,920	Still Asking: How Good Are Query Optimizers, Really?	2025	VLDB	5.1955087e-05
10,118	Rethinking Analytical Processing in the GPU Era	2026	CIDR	5.093636e-05
10,135	I Can't Believe It's Not Yannakakis: Pragmatic Bitmap Filters in Microsoft SQL Server	2026	CIDR	5.093636e-05
10,529	Robust Predicate Transfer with Dynamic Execution	2026	VLDB	5.093636e-05

Outgoing Citations (Sorted by Pagerank)

Showing 30 of 30 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
16	MAGIC SETS AND OTHER STRANGE WAYS TO IMPLEMENT LOGIC PROGRAMS (Extended Abstract)	1986	PODS	0.00060089598
24	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00054865648
80	Hashing Methods and Relational Algebra Operations	1984	VLDB	0.00036536643
132	Predicate Migration: Optimizing Queries with Expensive Predicates	1993	SIGMOD	0.00030378624
209	Sort vs. Hash Revisited: Fast Join Implementation on Modern Multi-Core CPUs	2009	VLDB	0.00024932174
344	On the Power of Magic	1987	PODS	0.00020659405
360	Design and Evaluation of Main Memory Hash Join Algorithms for Multi-core CPUs	2011	SIGMOD	0.00020182846
959	Memory-Efficient Hash Joins	2015	VLDB	0.00012953588
1,124	Query Optimization by Predicate Move-Around	1994	VLDB	0.00012087356
1,410	Magic is Relevant	1990	SIGMOD	0.00010853223
1,510	A Methodology For Interpreting Tree Queries Into Optimal Semi-Join Expressions	1980	SIGMOD	0.00010539169
1,651	On the Design of a Query Processing Strategy in a Distributed Database Environment	1983	SIGMOD	0.00010110141
1,832	DSB: A Decision Support Benchmark for Workload-Driven and Traditional Database Systems	2021	VLDB	9.6607418e-05
1,974	Track Join: Distributed Joins with Minimal Network Traffic	2014	SIGMOD	9.3658402e-05
2,156	Quickstep: A Data Platform Based on the Scaling-Up Approach	2018	VLDB	9.0635624e-05
2,926	Distributed Join Algorithms on Thousands of Cores	2017	VLDB	7.9549783e-05
3,035	Instance-Optimized Data Layouts for Cloud Analytics Workloads	2021	SIGMOD	7.8297746e-05
3,137	Pushing Data-Induced Predicates Through Joins in Big-Data Clusters	2020	VLDB	7.7204167e-05
3,307	Magic Conditions	1990	PODS	7.5385358e-05
3,571	Looking Ahead Makes Query Plans Robust: Making the Initial Case with In-Memory Star Schema Data Warehouse Workloads	2017	VLDB	7.2991953e-05
3,578	Advanced Join Strategies for Large-Scale Distributed Computation	2014	VLDB	7.2899943e-05
3,622	Robust Join Processing with Diamond Hardened Joins	2024	VLDB	7.2465862e-05
3,632	FlexPushdownDB: Hybrid Pushdown and Caching in a Cloud DBMS	2021	VLDB	7.2368817e-05
4,553	Predicate Transfer: Efficient Pre-Filtering on Multi-Join Queries	2024	CIDR	6.6346951e-05
4,705	Presto: A Decade of SQL Analytics at Meta	2023	SIGMOD	6.5529421e-05
4,849	Bitvector-aware Query Optimization for Decision Support Queries	2020	SIGMOD	6.4803828e-05
5,069	Query Processing For Distributed Databases Using Generalized Semi-Joins	1982	SIGMOD	6.3768665e-05
6,762	SquirrelJoin: Network-Aware Distributed Join Processing with Lazy Partitioning	2017	VLDB	5.7814194e-05
7,857	Semi-Join Algorithms For Multiprocessor Systems	1982	SIGMOD	5.5306397e-05
9,987	Optimal Semijoin Schedules For Query Processing In Local Distributed Database Systems	1981	SIGMOD	5.183257e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	2,597	The MemSQL Query Optimizer: A modern optimizer for real-time analytics in a distributed database	2016	VLDB
2	2,926	Distributed Join Algorithms on Thousands of Cores	2017	VLDB
3	1,320	From Theory to Practice: Efficient Join Query Evaluation in a Parallel Database System	2015	SIGMOD
4	3,200	Locality-aware Partitioning in Parallel Database Systems	2015	SIGMOD
5	10,529	Robust Predicate Transfer with Dynamic Execution	2026	VLDB
6	1,022	A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses	2009	VLDB
7	3,578	Advanced Join Strategies for Large-Scale Distributed Computation	2014	VLDB
8	12,090	Let's Rethink Join Optimization in Distributed Systems	2015	CIDR
9	3,137	Pushing Data-Induced Predicates Through Joins in Big-Data Clusters	2020	VLDB
10	4,553	Predicate Transfer: Efficient Pre-Filtering on Multi-Join Queries	2024	CIDR