Accelerate Distributed Joins with Predicate Transfer

Summary: Extends predicate transfer to distributed joins with cost-based adaptive execution and Bloom-filter pre-filtering. Introduces pruning to drop non-contributory transfers; reports 3x speedup and 2.7x data-exchange reduction on TPC-H/DSB SF400 in a distributed analytics engine. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hca68b65fb5bc864b
Venue: SIGMOD
Year: 2025
Pagerank: 5.3445863e-05
Overall Rank: 8,291 | 44.43%
DOI: 10.1145/3725259
PDF: Download (CC BY 4.0)

Incoming Non-self Citations Over Time

Authors

1. Yifei Yang (University of Wisconsin)
2. Xiangyao Yu (University of Wisconsin)

BibTeX Citation

@inproceedings{yang_sigmod25,
        title = {{Accelerate Distributed Joins with Predicate Transfer}},
        author = {Yang, Yifei and Yu, Xiangyao},
        series = {{SIGMOD} '25},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3725259},
        url = {https://dl.acm.org/doi/10.1145/3725259},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 6 of 6 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
8,235	Rethinking Analytical Processing in the GPU Era	2026	CIDR	5.3569644e-05
10,143	Still Asking: How Good Are Query Optimizers, Really?	2025	VLDB	5.0597449e-05
10,435	I Can't Believe It's Not Yannakakis: Pragmatic Bitmap Filters in Microsoft SQL Server	2026	CIDR	4.9605343e-05
10,784	Robust Predicate Transfer with Dynamic Execution	2026	VLDB	4.9605343e-05
10,839	One Join Order Does Not Fit All: Reducing Intermediate Results with Per-Split Query Plans	2026	VLDB	4.9605343e-05
10,987	No Silver Bullet: Boosting GaussDB Performance on the 30TB TPC-H Workload	2026	VLDB	4.9605343e-05

Outgoing Citations (Sorted by Pagerank)

Showing 30 of 30 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
18	MAGIC SETS AND OTHER STRANGE WAYS TO IMPLEMENT LOGIC PROGRAMS (Extended Abstract)	1986	PODS	0.00058816744
23	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00055523999
83	Hashing Methods and Relational Algebra Operations	1984	VLDB	0.00035942723
125	Predicate Migration: Optimizing Queries with Expensive Predicates	1993	SIGMOD	0.00030398363
212	Sort vs. Hash Revisited: Fast Join Implementation on Modern Multi-Core CPUs	2009	VLDB	0.00024786576
353	On the Power of Magic	1987	PODS	0.0002014941
360	Design and Evaluation of Main Memory Hash Join Algorithms for Multi-core CPUs	2011	SIGMOD	0.00019959166
965	Memory-Efficient Hash Joins	2015	VLDB	0.00012778081
1,122	Query Optimization by Predicate Move-Around	1994	VLDB	0.00011915958
1,443	Magic is Relevant	1990	SIGMOD	0.00010618161
1,513	DSB: A Decision Support Benchmark for Workload-Driven and Traditional Database Systems	2021	VLDB	0.00010394557
1,536	A Methodology For Interpreting Tree Queries Into Optimal Semi-Join Expressions	1980	SIGMOD	0.00010297567
1,679	On the Design of a Query Processing Strategy in a Distributed Database Environment	1983	SIGMOD	9.8922561e-05
2,002	Track Join: Distributed Joins with Minimal Network Traffic	2014	SIGMOD	9.189062e-05
2,147	Quickstep: A Data Platform Based on the Scaling-Up Approach	2018	VLDB	8.9595129e-05
2,772	Instance-Optimized Data Layouts for Cloud Analytics Workloads	2021	SIGMOD	8.0148928e-05
2,806	Distributed Join Algorithms on Thousands of Cores	2017	VLDB	7.9657254e-05
3,081	Pushing Data-Induced Predicates Through Joins in Big-Data Clusters	2020	VLDB	7.6515625e-05
3,165	Robust Join Processing with Diamond Hardened Joins	2024	VLDB	7.5598778e-05
3,378	Magic Conditions	1990	PODS	7.3454229e-05
3,404	FlexPushdownDB: Hybrid Pushdown and Caching in a Cloud DBMS	2021	VLDB	7.3212594e-05
3,602	Looking Ahead Makes Query Plans Robust: Making the Initial Case with In-Memory Star Schema Data Warehouse Workloads	2017	VLDB	7.1572829e-05
3,638	Advanced Join Strategies for Large-Scale Distributed Computation	2014	VLDB	7.1248634e-05
3,847	Presto: A Decade of SQL Analytics at Meta	2023	SIGMOD	6.9668258e-05
4,396	Predicate Transfer: Efficient Pre-Filtering on Multi-Join Queries	2024	CIDR	6.6072577e-05
4,415	Bitvector-aware Query Optimization for Decision Support Queries	2020	SIGMOD	6.5965677e-05
5,220	Query Processing For Distributed Databases Using Generalized Semi-Joins	1982	SIGMOD	6.2120548e-05
6,880	SquirrelJoin: Network-Aware Distributed Join Processing with Lazy Partitioning	2017	VLDB	5.6423904e-05
8,028	Semi-Join Algorithms For Multiprocessor Systems	1982	SIGMOD	5.3879546e-05
9,393	Optimal Semijoin Schedules For Query Processing In Local Distributed Database Systems	1981	SIGMOD	5.1677187e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	2,622	The MemSQL Query Optimizer: A modern optimizer for real-time analytics in a distributed database	2016	VLDB
2	2,806	Distributed Join Algorithms on Thousands of Cores	2017	VLDB
3	1,296	From Theory to Practice: Efficient Join Query Evaluation in a Parallel Database System	2015	SIGMOD
4	3,258	Locality-aware Partitioning in Parallel Database Systems	2015	SIGMOD
5	10,784	Robust Predicate Transfer with Dynamic Execution	2026	VLDB
6	1,029	A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses	2009	VLDB
7	3,638	Advanced Join Strategies for Large-Scale Distributed Computation	2014	VLDB
8	12,432	Let's Rethink Join Optimization in Distributed Systems	2015	CIDR
9	3,081	Pushing Data-Induced Predicates Through Joins in Big-Data Clusters	2020	VLDB
10	4,396	Predicate Transfer: Efficient Pre-Filtering on Multi-Join Queries	2024	CIDR