DBScholar

Back to papers

Pushing Data-Induced Predicates Through Joins in Big-Data Clusters

Summary: Introduces data-induced predicates that propagate filters across joins, enabling optimizer-only data skipping without execution overhead. Using existing zone maps—and modestly richer statistics—substantially reduces input and roughly doubles median production-cluster query speed. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID
he9c9b372d221fd91
Venue
VLDB
Year
2020
Pagerank
7.6515625e-05
Overall Rank
3,081 | 79.35%
DOI
10.14778/3368289.3368292
PDF
Download (CC BY-NC-ND 4.0)

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@article{kandula_vldb20,
        title = {{Pushing Data-Induced Predicates Through Joins in Big-Data Clusters}},
        author = {Kandula, Srikanth and Orr, Laurel and Chaudhuri, Surajit},
        journal = {PVLDB},
        series = {{VLDB} '20},
        volume = {13},
        number = {3},
        pages = {252--265},
        doi = {10.14778/3368289.3368292},
        url = {https://doi.org/10.14778/3368289.3368292},
        year = {2020}
}

Incoming Citations (Sorted by Pagerank)

Showing 22 of 22 citing papers.

Rank Citing Paper Year Venue Pagerank
1,958 Quantifying TPC-H Choke Points and Their Optimizations 2020 VLDB 9.2894133e-05
2,672 End-to-end Optimization of Machine Learning Prediction Queries 2022 SIGMOD 8.1301225e-05
2,772 Instance-Optimized Data Layouts for Cloud Analytics Workloads 2021 SIGMOD 8.0148928e-05
4,396 Predicate Transfer: Efficient Pre-Filtering on Multi-Join Queries 2024 CIDR 6.6072577e-05
5,210 Crystal: A Unified Cache Storage System for Analytical Databases 2021 VLDB 6.2142008e-05
5,856 Pando: Enhanced Data Skipping with Logical Data Partitioning 2023 VLDB 5.9514226e-05
6,155 Sia: Optimizing Queries using Learned Predicates 2021 SIGMOD 5.8540214e-05
6,260 The Cosmos Big Data Platform at Microsoft: Over a Decade of Progress and a Decade to Look Forward 2021 VLDB 5.815273e-05
6,400 Selection Pushdown in Column Stores using Bit Manipulation Instructions 2023 SIGMOD 5.7811299e-05
6,725 Simple Adaptive Query Processing vs. Learned Query Optimizers: Observations and Analysis 2023 VLDB 5.6826988e-05
7,264 Pruning in Snowflake: Working Smarter, Not Harder 2025 SIGMOD 5.5557256e-05
7,942 NOCAP: Near-Optimal Correlation-Aware Partitioning Joins 2023 SIGMOD 5.4055234e-05
8,176 Predicate Pushdown for Data Science Pipelines 2023 SIGMOD 5.3688159e-05
8,222 Sieve: A Learned Data-Skipping Index for Data Analytics 2023 VLDB 5.3585489e-05
8,291 Accelerate Distributed Joins with Predicate Transfer 2025 SIGMOD 5.3445863e-05
8,604 Conditional Cuckoo Filters 2021 SIGMOD 5.2899825e-05
9,117 Hyperspace: The Indexing Subsystem of Azure Synapse 2021 VLDB 5.208561e-05
10,192 Threshold Queries in Theory and in the Wild 2022 VLDB 5.052396e-05
10,914 I-Rex: An Interactive Debugger for SQL 2026 VLDB 4.9605343e-05
11,195 Dynamic Pruning for Recursive Joins 2025 SIGMOD 4.9605343e-05
11,568 PLAQUE: Automated Predicate Learning at Query Time 2024 SIGMOD 4.9605343e-05
11,777 SH2O: Efficient Data Access for Work-Sharing Databases 2023 SIGMOD 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 41 of 41 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
6 Pig Latin: A Not-So-Foreign Language for Data Processing 2008 SIGMOD 0.0010494385
15 How Good Are Query Optimizers, Really? 2016 VLDB 0.00061463175
18 MAGIC SETS AND OTHER STRANGE WAYS TO IMPLEMENT LOGIC PROGRAMS (Extended Abstract) 1986 PODS 0.00058816744
23 Spark SQL: Relational Data Processing in Spark 2015 SIGMOD 0.00055523999
30 SCOPE: Easy and Efficient Parallel Processing of Massive Data Sets 2008 VLDB 0.00050364918
31 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00049707539
89 Automated Selection of Materialized Views and Indexes for SQL Databases 2000 VLDB 0.00035265687
160 CORDS: Automatic Discovery of Correlations and Soft Functional Dependencies 2004 SIGMOD 0.00027775994
177 The Vertica Analytic Database: C-Store 7 Years Later 2012 VLDB 0.00026571747
242 Fast Incremental Maintenance of Approximate Histograms 1997 VLDB 0.00023327437
253 Database Cracking 2007 CIDR 0.00023037921
452 Mergeable Summaries 2012 PODS 0.00018032092
457 Self-tuning Histograms: Building Histograms Without Looking at Data 1999 SIGMOD 0.00017915659
493 Database Tuning Advisor for Microsoft SQL Server 2005 2004 VLDB 0.0001735831
617 F1: A Distributed SQL Database That Scales 2013 VLDB 0.00015511217
746 Materialized View Maintenance and Integrity Constraint Checking: Trading Space for Time 1996 SIGMOD 0.0001426147
892 SuRF: Practical Range Query Filtering with Fast Succinct Tries 2018 SIGMOD 0.00013207671
1,032 Cost-Based Optimization for Magic: Algebra and Implementation 1996 SIGMOD 0.00012376627
1,039 Fine-grained Partitioning for Aggressive Data Skipping 2014 SIGMOD 0.00012349128
1,122 Query Optimization by Predicate Move-Around 1994 VLDB 0.00011915958
1,296 From Theory to Practice: Efficient Join Query Evaluation in a Parallel Database System 2015 SIGMOD 0.00011119184
1,308 Apache Hadoop Goes Realtime at Facebook 2011 SIGMOD 0.0001107127
1,381 Execution Strategies for SQL Subqueries 2007 SIGMOD 0.00010832197
1,670 BHUNT: Automatic Discovery of Fuzzy Algebraic Constraints in Relational Data 2003 VLDB 9.9124313e-05
2,147 Quickstep: A Data Platform Based on the Scaling-Up Approach 2018 VLDB 8.9595129e-05
2,168 Brighthouse: An Analytic Data Warehouse for Ad-hoc Queries 2008 VLDB 8.9159881e-05
2,337 Correlation Maps: A Compressed Access Method for Exploiting Soft Functional Dependencies 2009 VLDB 8.6002736e-05
2,392 The Uncracked Pieces in Database Cracking 2014 VLDB 8.5172189e-05
2,699 CoHadoop: Flexible Data Placement and Its Exploitation in Hadoop 2011 VLDB 8.100024e-05
2,753 Efficient View Maintenance at Data Warehouses 1997 SIGMOD 8.0386655e-05
2,965 Column Sketches: A Scan Accelerator for Rapid and Robust Predicate Evaluation 2018 SIGMOD 7.7894987e-05
3,094 Skipping-oriented Partitioning for Columnar Layouts 2017 VLDB 7.637515e-05
3,258 Locality-aware Partitioning in Parallel Database Systems 2015 SIGMOD 7.4730157e-05
3,456 Slalom: Coasting Through Raw Data via Adaptive Partitioning and Indexing 2017 VLDB 7.2673968e-05
3,601 Two Birds, One Stone: A Fast, yet Lightweight, Indexing Scheme for Modern Database Systems 2017 VLDB 7.1582591e-05
3,702 Implementation of Magic-sets in a Relational Database System 1994 SIGMOD 7.0617354e-05
4,550 AdaptDB: Adaptive Partitioning for Distributed Joins 2017 VLDB 6.5327021e-05
7,019 Statisticum: Data Statistics Management in SAP HANA 2017 VLDB 5.6041386e-05
8,042 Optimizing Iceberg Queries with Complex Joins 2017 SIGMOD 5.3852464e-05
9,185 High Performance Stream Query Processing With Correlation-Aware Partitioning 2014 VLDB 5.1980027e-05
10,165 Amoeba: A Shape changing Storage System for Big Data 2016 VLDB 5.0561788e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

# Overall Rank Paper Year Venue
1 4,088 Dynamically Optimizing Queries over Large Scale Data Platforms 2014 SIGMOD
2 3,638 Advanced Join Strategies for Large-Scale Distributed Computation 2014 VLDB
3 6,122 Optimization of Conjunctive Predicates for Main Memory Column Stores 2016 VLDB
4 9,972 Optimization of Disjunctive Predicates for Main Memory Column Stores 2017 SIGMOD
5 3,165 Robust Join Processing with Diamond Hardened Joins 2024 VLDB
6 5,446 Efficient Massively Parallel Join Optimization for Large Queries* 2022 SIGMOD
7 881 Dynamic Programming Strikes Back 2008 SIGMOD
8 138 Join Synopses for Approximate Query Answering 1999 SIGMOD
9 4,396 Predicate Transfer: Efficient Pre-Filtering on Multi-Join Queries 2024 CIDR
10 8,291 Accelerate Distributed Joins with Predicate Transfer 2025 SIGMOD