Pushing Data-Induced Predicates Through Joins in Big-Data Clusters

Summary: Data-induced predicates (diPs) translate table predicates into joining-table predicates via data statistics to extend predicate pushdown across joins. Zone-maps with a slightly larger statistic enable plan-time data skipping, with ~50% of queries skipping ≥33% of input and median query time ~2× faster on TPC-H, TPC-DS, and JoinOrder. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 12131
Venue: VLDB
Year: 2020
Pagerank: 6.6232068e-05
Overall Rank: 3,923 | 72.74%
DOI: 10.14778/3368289.3368292

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 21 of 21 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
2,914	Quantifying TPC-H Choke Points and Their Optimizations	2020	VLDB	7.9197583e-05
3,409	End-to-end Optimization of Machine Learning Prediction Queries	2022	SIGMOD	7.1240791e-05
3,777	Instance-Optimized Data Layouts for Cloud Analytics Workloads	2021	SIGMOD	6.7713324e-05
5,772	Predicate Transfer: Efficient Pre-Filtering on Multi-Join Queries	2024	CIDR	5.3313794e-05
6,152	Crystal: A Unified Cache Storage System for Analytical Databases	2021	VLDB	5.1802666e-05
6,278	The Cosmos Big Data Platform at Microsoft: Over a Decade of Progress and a Decade to Look Forward	2021	VLDB	5.1241654e-05
6,461	Pando: Enhanced Data Skipping with Logical Data Partitioning	2023	VLDB	5.0479786e-05
7,011	Simple Adaptive Query Processing vs. Learned Query Optimizers: Observations and Analysis	2023	VLDB	4.8583284e-05
7,278	Sia: Optimizing Queries using Learned Predicates	2021	SIGMOD	4.7720613e-05
7,427	Selection Pushdown in Column Stores using Bit Manipulation Instructions	2023	SIGMOD	4.7282014e-05
7,842	NOCAP: Near-Optimal Correlation-Aware Partitioning Joins	2023	SIGMOD	4.6336361e-05
8,221	Sieve: A Learned Data-Skipping Index for Data Analytics	2023	VLDB	4.5511941e-05
8,410	Pruning in Snowflake: Working Smarter, Not Harder	2025	SIGMOD	4.5154358e-05
8,499	Conditional Cuckoo Filters	2021	SIGMOD	4.4929219e-05
8,625	Predicate Pushdown for Data Science Pipelines	2023	SIGMOD	4.4784651e-05
8,754	Hyperspace: The Indexing Subsystem of Azure Synapse	2021	VLDB	4.4520434e-05
8,777	Accelerate Distributed Joins with Predicate Transfer	2025	SIGMOD	4.4492064e-05
9,801	Threshold Queries in Theory and in the Wild	2022	VLDB	4.2777144e-05
10,415	Dynamic Pruning for Recursive Joins	2025	SIGMOD	4.1905499e-05
10,953	PLAQUE: Automated Predicate Learning at Query Time	2024	SIGMOD	4.1905499e-05
11,214	SH2O: Efficient Data Access for Work-Sharing Databases	2023	SIGMOD	4.1905499e-05

Outgoing Citations (Sorted by Pagerank)

Showing 41 of 41 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
3	Pig Latin: A Not-So-Foreign Language for Data Processing	2008	SIGMOD	0.0024217964
16	MAGIC SETS AND OTHER STRANGE WAYS TO IMPLEMENT LOGIC PROGRAMS (Extended Abstract)	1986	PODS	0.00099936325
22	SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets	2008	VLDB	0.00084679526
66	Spark SQL: Relational Data Processing in Spark	2015	SIGMOD	0.00061707583
70	Hive - A Warehousing Solution Over a Map-Reduce Framework	2009	VLDB	0.00059744625
71	How Good Are Query Optimizers, Really?	2016	VLDB	0.00059446482
160	Automated Selection of Materialized Views and Indexes for SQL Databases	2000	VLDB	0.00040053897
224	CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies	2004	SIGMOD	0.00032743209
270	Fast Incremental Maintenance of Approximate Histograms	1997	VLDB	0.00029648047
310	The Vertica Analytic Database: C-Store 7 Years Later	2012	VLDB	0.0002815547
398	Mergeable Summaries	2012	PODS	0.00024383201
407	Database Cracking	2007	CIDR	0.00023941779
527	Self-tuning Histograms: Building Histograms Without Looking at Data	1999	SIGMOD	0.00020862475
662	Database Tuning Advisor for Microsoft SQL Server 2005	2004	VLDB	0.00018478597
775	Materialized View Maintenance and Integrity Constraint Checking: Trading Space for Time	1996	SIGMOD	0.00016775051
900	F1: A Distributed SQL Database That Scales	2013	VLDB	0.00015466804
1,169	SuRF: Practical Range Query Filtering with Fast Succinct Tries	2018	SIGMOD	0.00013530267
1,303	Query Optimization by Predicate Move-Around	1994	VLDB	0.00012692678
1,313	Cost-Based Optimization for Magic: Algebra and Implementation	1996	SIGMOD	0.00012629432
1,473	Fine-grained Partitioning for Aggressive Data Skipping	2014	SIGMOD	0.00011786148
1,497	Apache Hadoop Goes Realtime at Facebook	2011	SIGMOD	0.00011668393
1,581	Execution Strategies for SQL Subqueries	2007	SIGMOD	0.00011262795
1,938	From Theory to Practice: Efficient Join Query Evaluation in a Parallel Database System	2015	SIGMOD	0.00010025547
1,976	BHUNT: Automatic Discovery of Fuzzy Algebraic Constraints in Relational Data	2003	VLDB	9.8784644e-05
2,300	Efficient View Maintenance at Data Warehouses	1997	SIGMOD	9.0703913e-05
2,441	CoHadoop: Flexible Data Placement and Its Exploitation in Hadoop	2011	VLDB	8.8106295e-05
2,442	Brighthouse: An Analytic Data Warehouse for Ad-hoc Queries	2008	VLDB	8.8067249e-05
2,777	Quickstep: A Data Platform Based on the Scaling-Up Approach	2018	VLDB	8.1346418e-05
2,841	Correlation Maps: A Compressed Access Method for Exploiting Soft Functional Dependencies	2009	VLDB	8.0396876e-05
2,979	The Uncracked Pieces in Database Cracking	2014	VLDB	7.7833926e-05
3,611	Column Sketches: A Scan Accelerator for Rapid and Robust Predicate Evaluation	2018	SIGMOD	6.9178844e-05
3,731	Skipping-oriented Partitioning for Columnar Layouts	2017	VLDB	6.8074069e-05
3,825	Locality-aware Partitioning in Parallel Database Systems	2015	SIGMOD	6.7225803e-05
3,893	Slalom: Coasting Through Raw Data via Adaptive Partitioning and Indexing	2017	VLDB	6.653922e-05
3,906	Two Birds, One Stone: A Fast, yet Lightweight, Indexing Scheme for Modern Database Systems	2017	VLDB	6.6413008e-05
4,198	Implementation of Magic-sets in a Relational Database System	1994	SIGMOD	6.361961e-05
5,116	AdaptDB: Adaptive Partitioning for Distributed Joins	2017	VLDB	5.6805476e-05
7,049	Statisticum: Data Statistics Management in SAP HANA	2017	VLDB	4.8454978e-05
8,070	Optimizing Iceberg Queries with Complex Joins	2017	SIGMOD	4.5893281e-05
8,986	High Performance Stream Query Processing With Correlation-Aware Partitioning	2014	VLDB	4.4128163e-05
9,804	Amoeba: A Shape changing Storage System for Big Data	2016	VLDB	4.2774538e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
5,012	Dynamically Optimizing Queries over Large Scale Data Platforms	2014	SIGMOD	5.7543101e-05
4,128	Advanced Join Strategies for Large-Scale Distributed Computation	2014	VLDB	6.4214449e-05
6,372	Optimization of Conjunctive Predicates for Main Memory Column Stores	2016	VLDB	5.0878306e-05
9,625	Optimization of Disjunctive Predicates for Main Memory Column Stores	2017	SIGMOD	4.3115918e-05
4,466	Robust Join Processing with Diamond Hardened Joins	2024	VLDB	6.1545841e-05
6,060	Efficient Massively Parallel Join Optimization for Large Queries*	2022	SIGMOD	5.2271244e-05
1,344	Dynamic Programming Strikes Back	2008	SIGMOD	0.00012477274
212	Join Synopses for Approximate Query Answering	1999	SIGMOD	0.00033997204
5,772	Predicate Transfer: Efficient Pre-Filtering on Multi-Join Queries	2024	CIDR	5.3313794e-05
8,777	Accelerate Distributed Joins with Predicate Transfer	2025	SIGMOD	4.4492064e-05