Predicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses

Summary: Predicate caching is a query-driven secondary index for cloud data warehouses, speeding repetitive scans and joins. Lightweight, on-the-fly index built online; implemented in Redshift, delivering up to 10x query speed with minimal build cost. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID: 6803
Venue: SIGMOD
Year: 2024
Pagerank: 4.8785237e-05
Overall Rank: 6,972 | 51.50%
DOI: 10.1145/3626246.3653395

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 11 of 11 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
3,178	Why TPC Is Not Enough: An Analysis of the Amazon Redshift Fleet	2024	VLDB	7.4325992e-05
7,876	Two Birds With One Stone: Designing a Hybrid Cloud Storage Engine for HTAP	2024	VLDB	4.6298182e-05
8,415	Pruning in Snowflake: Working Smarter, Not Harder	2025	SIGMOD	4.5197687e-05
8,659	Learned Offline Query Planning via Bayesian Optimization	2025	SIGMOD	4.4722928e-05
8,718	Parachute: Single-Pass Bi-Directional Information Passing	2025	VLDB	4.4612599e-05
8,945	The Five-Minute Rule for the Cloud: Caching in Analytics Systems	2025	CIDR	4.4254423e-05
9,587	Low Rank Learning for Offline Query Optimization	2025	SIGMOD	4.3215645e-05
9,981	Survivorship Bias in Industrial Database Workloads	2026	CIDR	4.1945683e-05
10,172	HIRE: A Hybrid Learned Index for Robust and Efficient Performance under Mixed Workloads	2026	SIGMOD	4.1945683e-05
10,767	The HANA Native Query Engine for Lakehouse Systems	2025	VLDB	4.1945683e-05
10,987	DPconv: Super-Polynomially Faster Join Ordering	2024	SIGMOD	4.1945683e-05

Outgoing Citations (Sorted by Pagerank)

Showing 17 of 17 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
35	MonetDB/X100: Hyper-Pipelining Query Execution	2005	CIDR	0.00076197749
167	The Snowflake Elastic Data Warehouse	2016	SIGMOD	0.00039180521
368	Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing	1998	VLDB	0.000254931
408	Database Cracking	2007	CIDR	0.00023953844
426	Amazon Redshift and the Case for Simpler Data Warehouses	2015	SIGMOD	0.00023594359
746	Delta Lake: High-Performance ACID Table Storage over Cloud Object Stores	2020	VLDB	0.00017326979
1,263	Data Blocks: Hybrid OLTP and OLAP on Compressed Storage using both Vectorization and Compilation	2016	SIGMOD	0.00012982857
1,284	Amazon Redshift Re-invented	2022	SIGMOD	0.00012837822
1,477	Fine-grained Partitioning for Aggressive Data Skipping	2014	SIGMOD	0.00011770865
1,611	Qd-tree: Learning Data Layouts for Big Data Analytics	2020	SIGMOD	0.00011147324
1,889	Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads	2021	VLDB	0.00010200865
1,989	Column Imprints: A Secondary Index Structure	2013	SIGMOD	9.8478437e-05
3,608	Column Sketches: A Scan Accelerator for Rapid and Robust Predicate Evaluation	2018	SIGMOD	6.924272e-05
3,779	Instance-Optimized Data Layouts for Cloud Analytics Workloads	2021	SIGMOD	6.7747205e-05
5,315	Cuckoo Index: A Lightweight Secondary Index Structure	2020	VLDB	5.5723424e-05
5,749	BinDex: A Two-Layered Index for Fast and Robust Scans	2020	SIGMOD	5.3418923e-05
6,149	Crystal: A Unified Cache Storage System for Analytical Databases	2021	VLDB	5.1847534e-05

Semantically Similar Papers

Overall Rank	Paper	Year	Venue	Pagerank
7,923	Efficient B-tree Based Indexing for Cloud Data Processing	2010	VLDB	4.6155204e-05
3,844	The evolution of Amazon Redshift (extended abstract)	2021	VLDB	6.7076451e-05
329	Accelerating Machine Learning Inference with Probabilistic Predicates	2018	SIGMOD	0.00027249545
4,455	Generalized Scale Independence Through Incremental Precomputation	2013	SIGMOD	6.171182e-05
5,301	ReCache: Reactive Caching for Fast Analytics over Heterogeneous Data	2018	VLDB	5.5790928e-05
10,847	Sampling-based Predictive Database Buffer Management	2025	VLDB	4.1945683e-05
1,989	Column Imprints: A Secondary Index Structure	2013	SIGMOD	9.8478437e-05
7,693	Processing and Optimizing Main Memory Spatial-Keyword Queries	2016	VLDB	4.6759281e-05
8,781	Accelerate Distributed Joins with Predicate Transfer	2025	SIGMOD	4.4534753e-05
5,832	Stage: Query Execution Time Prediction in Amazon Redshift	2024	SIGMOD	5.3111109e-05