Accelerate Distributed Joins with Predicate Transfer

Summary: Extends predicate transfer to distributed joins with cost-based adaptive execution and Bloom-filter pre-filtering. Introduces pruning to drop non-contributory transfers; reports 3x speedup and 2.7x data-exchange reduction on TPC-H/DSB SF400 in a distributed analytics engine. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hca68b65fb5bc864b
Venue: SIGMOD
Year: 2025
Pagerank: 5.3623175e-05
Overall Rank: 8,275 | 44.39%
DOI: 10.1145/3725259
PDF: Download (CC BY 4.0)

Incoming Non-self Citations Over Time

Authors

1. Yifei Yang (University of Wisconsin)
2. Xiangyao Yu (University of Wisconsin)

BibTeX Citation

@inproceedings{yang_sigmod25,
        title = {{Accelerate Distributed Joins with Predicate Transfer}},
        author = {Yang, Yifei and Yu, Xiangyao},
        series = {{SIGMOD} '25},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3725259},
        url = {https://dl.acm.org/doi/10.1145/3725259},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 6 of 6 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
9,055	Rethinking Analytical Processing in the GPU Era	2026	CIDR	5.2283545e-05
10,107	Still Asking: How Good Are Query Optimizers, Really?	2025	VLDB	5.0765311e-05
10,368	I Can't Believe It's Not Yannakakis: Pragmatic Bitmap Filters in Microsoft SQL Server	2026	CIDR	4.9769913e-05
10,723	Robust Predicate Transfer with Dynamic Execution	2026	VLDB	4.9769913e-05
10,778	One Join Order Does Not Fit All: Reducing Intermediate Results with Per-Split Query Plans	2026	VLDB	4.9769913e-05
10,926	No Silver Bullet: Boosting GaussDB Performance on the 30TB TPC-H Workload	2026	VLDB	4.9769913e-05

Outgoing Citations (Sorted by Pagerank)

Showing 30 of 30 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
18	MAGIC SETS AND OTHER STRANGE WAYS TO IMPLEMENT LOGIC PROGRAMS (Extended Abstract)	1986	PODS	0.00058997063
23	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00055384955
82	Hashing Methods and Relational Algebra Operations	1984	VLDB	0.00036042975
125	Predicate Migration: Optimizing Queries with Expensive Predicates	1993	SIGMOD	0.00030462671
210	Sort vs. Hash Revisited: Fast Join Implementation on Modern Multi-Core CPUs	2009	VLDB	0.00024844328
353	On the Power of Magic	1987	PODS	0.00020213935
362	Design and Evaluation of Main Memory Hash Join Algorithms for Multi-core CPUs	2011	SIGMOD	0.00019999596
963	Memory-Efficient Hash Joins	2015	VLDB	0.00012815832
1,119	Query Optimization by Predicate Move-Around	1994	VLDB	0.00011946162
1,439	Magic is Relevant	1990	SIGMOD	0.000106437
1,515	DSB: A Decision Support Benchmark for Workload-Driven and Traditional Database Systems	2021	VLDB	0.00010418766
1,541	A Methodology For Interpreting Tree Queries Into Optimal Semi-Join Expressions	1980	SIGMOD	0.00010310611
1,673	On the Design of a Query Processing Strategy in a Distributed Database Environment	1983	SIGMOD	9.9200011e-05
1,997	Track Join: Distributed Joins with Minimal Network Traffic	2014	SIGMOD	9.2126022e-05
2,139	Quickstep: A Data Platform Based on the Scaling-Up Approach	2018	VLDB	8.9735524e-05
2,765	Instance-Optimized Data Layouts for Cloud Analytics Workloads	2021	SIGMOD	8.0401855e-05
2,802	Distributed Join Algorithms on Thousands of Cores	2017	VLDB	7.9866934e-05
3,075	Pushing Data-Induced Predicates Through Joins in Big-Data Clusters	2020	VLDB	7.6742518e-05
3,154	Robust Join Processing with Diamond Hardened Joins	2024	VLDB	7.5849549e-05
3,366	Magic Conditions	1990	PODS	7.3696512e-05
3,520	FlexPushdownDB: Hybrid Pushdown and Caching in a Cloud DBMS	2021	VLDB	7.2326541e-05
3,593	Looking Ahead Makes Query Plans Robust: Making the Initial Case with In-Memory Star Schema Data Warehouse Workloads	2017	VLDB	7.1803217e-05
3,637	Advanced Join Strategies for Large-Scale Distributed Computation	2014	VLDB	7.1437959e-05
3,835	Presto: A Decade of SQL Analytics at Meta	2023	SIGMOD	6.9899256e-05
4,371	Predicate Transfer: Efficient Pre-Filtering on Multi-Join Queries	2024	CIDR	6.6284915e-05
4,394	Bitvector-aware Query Optimization for Decision Support Queries	2020	SIGMOD	6.6182964e-05
5,196	Query Processing For Distributed Databases Using Generalized Semi-Joins	1982	SIGMOD	6.2326544e-05
6,863	SquirrelJoin: Network-Aware Distributed Join Processing with Lazy Partitioning	2017	VLDB	5.6604842e-05
8,012	Semi-Join Algorithms For Multiprocessor Systems	1982	SIGMOD	5.4058261e-05
10,166	Optimal Semijoin Schedules For Query Processing In Local Distributed Database Systems	1981	SIGMOD	5.0663632e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	2,618	The MemSQL Query Optimizer: A modern optimizer for real-time analytics in a distributed database	2016	VLDB
2	2,802	Distributed Join Algorithms on Thousands of Cores	2017	VLDB
3	1,292	From Theory to Practice: Efficient Join Query Evaluation in a Parallel Database System	2015	SIGMOD
4	3,241	Locality-aware Partitioning in Parallel Database Systems	2015	SIGMOD
5	10,723	Robust Predicate Transfer with Dynamic Execution	2026	VLDB
6	1,034	A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses	2009	VLDB
7	3,637	Advanced Join Strategies for Large-Scale Distributed Computation	2014	VLDB
8	12,389	Let's Rethink Join Optimization in Distributed Systems	2015	CIDR
9	3,075	Pushing Data-Induced Predicates Through Joins in Big-Data Clusters	2020	VLDB
10	4,371	Predicate Transfer: Efficient Pre-Filtering on Multi-Join Queries	2024	CIDR