Database Paper Browser

Back to papers

Fine-grained Partitioning for Aggressive Data Skipping

Summary: Fine-grained blocking with per-block skip metadata enables aggressive data skipping. Tuples map to feature vectors from frequent-itemset filters; Balanced MaxSkip Partitioning is NP-hard and solved by bottom-up clustering, yielding 2–5x speedups over range-based blocking in Shark on TPC-H and real workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
4887
Venue
SIGMOD
Year
2014
Pagerank
0.00011786148
Overall Rank
1,473 | 89.77%
DOI
10.1145/2588555.2610515

Incoming Non-self Citations Over Time

Authors

Incoming Citations (Sorted by Pagerank)

Showing 41 of 41 citing papers.

Rank Citing Paper Year Venue Pagerank
167 The Snowflake Elastic Data Warehouse 2016 SIGMOD 0.00039408116
1,608 Qd-tree: Learning Data Layouts for Big Data Analytics 2020 SIGMOD 0.00011169837
2,080 Towards a Learning Optimizer for Shared Clouds 2019 VLDB 9.5954034e-05
2,321 High-Throughput Vector Similarity Search in Knowledge Graphs 2023 SIGMOD 9.0359336e-05
3,482 Optimal Column Layout for Hybrid Workloads 2019 VLDB 7.0514808e-05
3,611 Column Sketches: A Scan Accelerator for Rapid and Robust Predicate Evaluation 2018 SIGMOD 6.9178844e-05
3,731 Skipping-oriented Partitioning for Columnar Layouts 2017 VLDB 6.8074069e-05
3,777 Instance-Optimized Data Layouts for Cloud Analytics Workloads 2021 SIGMOD 6.7713324e-05
3,893 Slalom: Coasting Through Raw Data via Adaptive Partitioning and Indexing 2017 VLDB 6.653922e-05
3,923 Pushing Data-Induced Predicates Through Joins in Big-Data Clusters 2020 VLDB 6.6232068e-05
4,160 Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe? 2017 SIGMOD 6.3886736e-05
5,116 AdaptDB: Adaptive Partitioning for Distributed Joins 2017 VLDB 5.6805476e-05
5,118 Design Tradeoffs of Data Access Methods 2016 SIGMOD 5.6781464e-05
5,541 A Padded Encoding Scheme to Accelerate Scans by Leveraging Skew 2015 SIGMOD 5.4501856e-05
5,762 BinDex: A Two-Layered Index for Fast and Robust Scans 2020 SIGMOD 5.3367636e-05
6,152 Crystal: A Unified Cache Storage System for Analytical Databases 2021 VLDB 5.1802666e-05
6,394 Endure: A Robust Tuning Paradigm for LSM Trees Under Workload Uncertainty 2022 VLDB 5.0770427e-05
6,461 Pando: Enhanced Data Skipping with Logical Data Partitioning 2023 VLDB 5.0479786e-05
6,693 QUILTS: Multidimensional Partitioning Framework Based on Query-Aware and Skew-Tolerant Space-Filling Curves 2017 SIGMOD 4.9557363e-05
6,724 Combining Aggregation and Sampling (Nearly) Optimally for Approximate Query Processing 2021 SIGMOD 4.9449472e-05
6,962 Replicated Layout for In-Memory Database Systems 2022 VLDB 4.8771234e-05
6,971 Predicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses 2024 SIGMOD 4.8738633e-05
7,049 Statisticum: Data Statistics Management in SAP HANA 2017 VLDB 4.8454978e-05
7,110 Wide Table Layout Optimization based on Column Ordering and Duplication 2017 SIGMOD 4.8228761e-05
7,127 Jigsaw: A Data Storage and Query Processing Engine for Irregular Table Partitioning 2021 SIGMOD 4.8184276e-05
7,482 RTScan: Efficient Scan with Ray Tracing Cores 2024 VLDB 4.7135369e-05
7,662 Optimizing Collections of Bloom Filters within a Space Budget 2024 VLDB 4.6812878e-05
8,089 Towards Designing and Learning Piecewise Space-Filling Curves 2023 VLDB 4.5855593e-05
8,095 Grep: A Graph Learning Based Database Partitioning System 2023 SIGMOD 4.5837691e-05
8,410 Pruning in Snowflake: Working Smarter, Not Harder 2025 SIGMOD 4.5154358e-05
8,439 Cabin: a Compressed Adaptive Binned Scan Index 2024 SIGMOD 4.5058812e-05
8,594 Prompt: Dynamic Data-Partitioning for Distributed Micro-batch Stream Processing Systems 2020 SIGMOD 4.4844961e-05
8,636 WISK: A Workload-aware Learned Index for Spatial Keyword Queries 2023 SIGMOD 4.4758336e-05
9,804 Amoeba: A Shape changing Storage System for Big Data 2016 VLDB 4.2774538e-05
10,179 LiveBin: A Localized and Version-Aware Binned Scan Index 2026 SIGMOD 4.1905499e-05
10,396 Optimizing Block Skipping for High-Dimensional Data with Learned Adaptive Curve 2025 SIGMOD 4.1905499e-05
10,415 Dynamic Pruning for Recursive Joins 2025 SIGMOD 4.1905499e-05
10,767 SIEVE: Effective Filtered Vector Search with Collection of Indexes 2025 VLDB 4.1905499e-05
11,214 SH2O: Efficient Data Access for Work-Sharing Databases 2023 SIGMOD 4.1905499e-05
11,576 Workload-Aware Column Imprints 2020 SIGMOD 4.1905499e-05
12,001 A Partitioning Framework for Aggressive Data Skipping 2014 VLDB 4.1905499e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 19 of 19 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
11 Implementing Data Cubes Efficiently 1996 SIGMOD 0.0011695087
33 BIRCH: An Efficient Data Clustering Method for Very Large Databases 1996 SIGMOD 0.00077399244
70 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00059744625
109 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.00048217028
160 Automated Selection of Materialized Views and Indexes for SQL Databases 2000 VLDB 0.00040053897
208 Schism: a Workload-Driven Approach to Database Replication and Partitioning 2010 VLDB 0.00034478612
241 DB2 with BLU Acceleration: So Much More than Just a Column Store 2013 VLDB 0.00031314629
283 Integrating Vertical and Horizontal Partitioning into Automated Physical Database Design 2004 SIGMOD 0.00029024583
285 Automating Physical Database Design in a Parallel Database 2002 SIGMOD 0.00028978423
310 The Vertica Analytic Database: C-Store 7 Years Later 2012 VLDB 0.0002815547
367 Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing 1998 VLDB 0.00025518228
407 Database Cracking 2007 CIDR 0.00023941779
539 Shark: SQL and Rich Analytics at Scale 2013 SIGMOD 0.00020615453
681 Materialized View Selection in a Multidimensional Database 1997 VLDB 0.0001818285
1,468 Adaptive Range Filters for Cold Data: Avoiding Trips to Siberia 2013 VLDB 0.00011831457
1,470 Processing a Trillion Cells per Mouse Click 2012 VLDB 0.00011827274
2,442 Brighthouse: An Analytic Data Warehouse for Ad-hoc Queries 2008 VLDB 8.8067249e-05
3,031 Efficient Query Processing for Multi-Dimensionally Clustered Tables in DB2 2003 VLDB 7.675808e-05
4,068 Advanced Partitioning Techniques for Massively Distributed Computation 2012 SIGMOD 6.4748133e-05
Previous Page 1 / 1 Next

Semantically Similar Papers

Overall Rank Paper Year Venue Pagerank
10,349 Efficient Approximate Query Processing with Block Sampling 2025 CIDR 4.1905499e-05
8,704 Incremental Partitioning for Efficient Spatial Data Analytics 2022 VLDB 4.4596039e-05
8,022 Scaling Package Queries to a Billion Tuples via Hierarchical Partitioning and Customized Optimization 2024 VLDB 4.599539e-05
6,697 Optimal Splitters for Temporal and Multi-version Databases 2013 SIGMOD 4.9538866e-05
9,312 Parallelizing Query Optimization on Shared-Nothing Architectures 2016 VLDB 4.353536e-05
7,713 Query Centric Partitioning and Allocation for Partially Replicated Database Systems 2017 SIGMOD 4.6662571e-05
2,928 Shared Workload Optimization 2014 VLDB 7.881485e-05
679 Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems 2012 SIGMOD 0.00018211621
3,731 Skipping-oriented Partitioning for Columnar Layouts 2017 VLDB 6.8074069e-05
12,001 A Partitioning Framework for Aggressive Data Skipping 2014 VLDB 4.1905499e-05