Accelerate Distributed Joins with Predicate Transfer

Summary: Extends predicate transfer to distributed joins with cost-based adaptive execution and Bloom-filter pre-filtering. Introduces pruning to drop non-contributory transfers; reports 3x speedup and 2.7x data-exchange reduction on TPC-H/DSB SF400 in a distributed analytics engine. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: hca68b65fb5bc864b
Venue: SIGMOD
Year: 2025
Pagerank: 5.3648571e-05
Overall Rank: 8,269 | 44.41%
DOI: 10.1145/3725259

Incoming Non-self Citations Over Time

Authors

1. Yifei Yang (University of Wisconsin)
2. Xiangyao Yu (University of Wisconsin)

BibTeX Citation

@inproceedings{yang_sigmod25,
        title = {{Accelerate Distributed Joins with Predicate Transfer}},
        author = {Yang, Yifei and Yu, Xiangyao},
        series = {{SIGMOD} '25},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/3725259},
        url = {https://dl.acm.org/doi/10.1145/3725259},
        year = {2025}
}

Incoming Citations (Sorted by Pagerank)

Showing 6 of 6 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
9,047	Rethinking Analytical Processing in the GPU Era	2026	CIDR	5.2308307e-05
10,103	Still Asking: How Good Are Query Optimizers, Really?	2025	VLDB	5.0789354e-05
10,356	I Can't Believe It's Not Yannakakis: Pragmatic Bitmap Filters in Microsoft SQL Server	2026	CIDR	4.9793485e-05
10,713	Robust Predicate Transfer with Dynamic Execution	2026	VLDB	4.9793485e-05
10,768	One Join Order Does Not Fit All: Reducing Intermediate Results with Per-Split Query Plans	2026	VLDB	4.9793485e-05
10,917	No Silver Bullet: Boosting GaussDB Performance on the 30TB TPC-H Workload	2026	VLDB	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 30 of 30 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
18	MAGIC SETS AND OTHER STRANGE WAYS TO IMPLEMENT LOGIC PROGRAMS (Extended Abstract)	1986	PODS	0.00059023577
23	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00055406774
82	Hashing Methods and Relational Algebra Operations	1984	VLDB	0.00036053776
125	Predicate Migration: Optimizing Queries with Expensive Predicates	1993	SIGMOD	0.00030470848
210	Sort vs. Hash Revisited: Fast Join Implementation on Modern Multi-Core CPUs	2009	VLDB	0.00024851502
352	On the Power of Magic	1987	PODS	0.00020223279
361	Design and Evaluation of Main Memory Hash Join Algorithms for Multi-core CPUs	2011	SIGMOD	0.00020006406
969	Memory-Efficient Hash Joins	2015	VLDB	0.0001278184
1,119	Query Optimization by Predicate Move-Around	1994	VLDB	0.00011950395
1,438	Magic is Relevant	1990	SIGMOD	0.00010648031
1,515	DSB: A Decision Support Benchmark for Workload-Driven and Traditional Database Systems	2021	VLDB	0.00010417728
1,540	A Methodology For Interpreting Tree Queries Into Optimal Semi-Join Expressions	1980	SIGMOD	0.00010315359
1,673	On the Design of a Query Processing Strategy in a Distributed Database Environment	1983	SIGMOD	9.9240164e-05
1,995	Track Join: Distributed Joins with Minimal Network Traffic	2014	SIGMOD	9.2169073e-05
2,137	Quickstep: A Data Platform Based on the Scaling-Up Approach	2018	VLDB	8.9777553e-05
2,765	Instance-Optimized Data Layouts for Cloud Analytics Workloads	2021	SIGMOD	8.0439015e-05
2,802	Distributed Join Algorithms on Thousands of Cores	2017	VLDB	7.9903139e-05
3,073	Pushing Data-Induced Predicates Through Joins in Big-Data Clusters	2020	VLDB	7.6777283e-05
3,153	Robust Join Processing with Diamond Hardened Joins	2024	VLDB	7.5883271e-05
3,364	Magic Conditions	1990	PODS	7.3731362e-05
3,520	FlexPushdownDB: Hybrid Pushdown and Caching in a Cloud DBMS	2021	VLDB	7.2360022e-05
3,592	Looking Ahead Makes Query Plans Robust: Making the Initial Case with In-Memory Star Schema Data Warehouse Workloads	2017	VLDB	7.1835842e-05
3,636	Advanced Join Strategies for Large-Scale Distributed Computation	2014	VLDB	7.1471007e-05
3,835	Presto: A Decade of SQL Analytics at Meta	2023	SIGMOD	6.9931698e-05
4,369	Predicate Transfer: Efficient Pre-Filtering on Multi-Join Queries	2024	CIDR	6.6315141e-05
4,391	Bitvector-aware Query Optimization for Decision Support Queries	2020	SIGMOD	6.6214093e-05
5,192	Query Processing For Distributed Databases Using Generalized Semi-Joins	1982	SIGMOD	6.2356063e-05
6,858	SquirrelJoin: Network-Aware Distributed Join Processing with Lazy Partitioning	2017	VLDB	5.6631651e-05
8,007	Semi-Join Algorithms For Multiprocessor Systems	1982	SIGMOD	5.4083863e-05
10,162	Optimal Semijoin Schedules For Query Processing In Local Distributed Database Systems	1981	SIGMOD	5.0687627e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	2,618	The MemSQL Query Optimizer: A modern optimizer for real-time analytics in a distributed database	2016	VLDB
2	2,802	Distributed Join Algorithms on Thousands of Cores	2017	VLDB
3	1,292	From Theory to Practice: Efficient Join Query Evaluation in a Parallel Database System	2015	SIGMOD
4	3,239	Locality-aware Partitioning in Parallel Database Systems	2015	SIGMOD
5	10,713	Robust Predicate Transfer with Dynamic Execution	2026	VLDB
6	1,034	A Scalable, Predictable Join Operator for Highly Concurrent Data Warehouses	2009	VLDB
7	3,636	Advanced Join Strategies for Large-Scale Distributed Computation	2014	VLDB
8	12,383	Let's Rethink Join Optimization in Distributed Systems	2015	CIDR
9	3,073	Pushing Data-Induced Predicates Through Joins in Big-Data Clusters	2020	VLDB
10	4,369	Predicate Transfer: Efficient Pre-Filtering on Multi-Join Queries	2024	CIDR