DBScholar

Back to papers

Fine-grained Partitioning for Aggressive Data Skipping

Summary: Fine-grained blocking with per-block skip metadata enables aggressive data skipping. Tuples map to feature vectors from frequent-itemset filters; Balanced MaxSkip Partitioning is NP-hard and solved by bottom-up clustering, yielding 2–5x speedups over range-based blocking in Shark on TPC-H and real workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h6811c196acb94d96
Venue
SIGMOD
Year
2014
Pagerank
0.00012377471
Overall Rank
1,036 | 93.04%
DOI
10.1145/2588555.2610515

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{sun_sigmod14,
        title = {{Fine-grained Partitioning for Aggressive Data Skipping}},
        author = {Sun, Liwen and Franklin, Michael J. and Krishnan, Sanjay and Xin, Reynold S.},
        series = {{SIGMOD} '14},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2588555.2610515},
        url = {https://dl.acm.org/doi/10.1145/2588555.2610515},
        year = {2014}
}

Incoming Citations (Sorted by Pagerank)

Showing 41 of 41 citing papers.

Rank Citing Paper Year Venue Pagerank
52 The Snowflake Elastic Data Warehouse 2016 SIGMOD 0.00041219077
1,132 Qd-tree: Learning Data Layouts for Big Data Analytics 2020 SIGMOD 0.00011898257
1,373 High-Throughput Vector Similarity Search in Knowledge Graphs 2023 SIGMOD 0.0001088854
1,433 Towards a Learning Optimizer for Shared Clouds 2019 VLDB 0.00010677711
2,765 Instance-Optimized Data Layouts for Cloud Analytics Workloads 2021 SIGMOD 8.0439015e-05
2,882 Optimal Column Layout for Hybrid Workloads 2019 VLDB 7.9116043e-05
2,952 Column Sketches: A Scan Accelerator for Rapid and Robust Predicate Evaluation 2018 SIGMOD 7.8153507e-05
3,073 Pushing Data-Induced Predicates Through Joins in Big-Data Clusters 2020 VLDB 7.6777283e-05
3,081 Skipping-oriented Partitioning for Columnar Layouts 2017 VLDB 7.6653727e-05
3,445 Slalom: Coasting Through Raw Data via Adaptive Partitioning and Indexing 2017 VLDB 7.2943981e-05
3,599 Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe? 2017 SIGMOD 7.1773938e-05
4,533 AdaptDB: Adaptive Partitioning for Distributed Joins 2017 VLDB 6.5565658e-05
4,885 Design Tradeoffs of Data Access Methods 2016 SIGMOD 6.3706825e-05
5,213 A Padded Encoding Scheme to Accelerate Scans by Leveraging Skew 2015 SIGMOD 6.2250048e-05
5,248 Endure: A Robust Tuning Paradigm for LSM Trees Under Workload Uncertainty 2022 VLDB 6.211056e-05
5,446 Crystal: A Unified Cache Storage System for Analytical Databases 2021 VLDB 6.1266228e-05
5,618 BinDex: A Two-Layered Index for Fast and Robust Scans 2020 SIGMOD 6.0630987e-05
5,854 Pando: Enhanced Data Skipping with Logical Data Partitioning 2023 VLDB 5.9708829e-05
6,221 Combining Aggregation and Sampling (Nearly) Optimally for Approximate Query Processing 2021 SIGMOD 5.8463347e-05
6,240 Predicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses 2024 SIGMOD 5.8382355e-05
6,444 RTScan: Efficient Scan with Ray Tracing Cores 2024 VLDB 5.7825648e-05
6,468 QUILTS: Multidimensional Partitioning Framework Based on Query-Aware and Skew-Tolerant Space-Filling Curves 2017 SIGMOD 5.7745756e-05
6,719 Replicated Layout for In-Memory Database Systems 2022 VLDB 5.6985717e-05
6,970 Jigsaw: A Data Storage and Query Processing Engine for Irregular Table Partitioning 2021 SIGMOD 5.6311067e-05
6,999 Statisticum: Data Statistics Management in SAP HANA 2017 VLDB 5.6252486e-05
7,034 Wide Table Layout Optimization based on Column Ordering and Duplication 2017 SIGMOD 5.6167737e-05
7,245 Pruning in Snowflake: Working Smarter, Not Harder 2025 SIGMOD 5.5761132e-05
7,358 Optimizing Collections of Bloom Filters within a Space Budget 2024 VLDB 5.5431911e-05
7,564 SIEVE: Effective Filtered Vector Search with Collection of Indexes 2025 VLDB 5.4955249e-05
8,179 Towards Designing and Learning Piecewise Space-Filling Curves 2023 VLDB 5.3826446e-05
8,196 WISK: A Workload-aware Learned Index for Spatial Keyword Queries 2023 SIGMOD 5.3794981e-05
8,202 Grep: A Graph Learning Based Database Partitioning System 2023 SIGMOD 5.378708e-05
8,533 Cabin: a Compressed Adaptive Binned Scan Index 2024 SIGMOD 5.3215439e-05
8,678 Prompt: Dynamic Data-Partitioning for Distributed Micro-batch Stream Processing Systems 2020 SIGMOD 5.2907845e-05
10,124 Amoeba: A Shape changing Storage System for Big Data 2016 VLDB 5.0753201e-05
10,655 LiveBin: A Localized and Version-Aware Binned Scan Index 2026 SIGMOD 4.9793485e-05
11,113 Optimizing Block Skipping for High-Dimensional Data with Learned Adaptive Curve 2025 SIGMOD 4.9793485e-05
11,126 Dynamic Pruning for Recursive Joins 2025 SIGMOD 4.9793485e-05
11,727 SH2O: Efficient Data Access for Work-Sharing Databases 2023 SIGMOD 4.9793485e-05
12,070 Workload-Aware Column Imprints 2020 SIGMOD 4.9793485e-05
12,482 A Partitioning Framework for Aggressive Data Skipping 2014 VLDB 4.9793485e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 19 of 19 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
11 Implementing Data Cubes Efficiently 1996 SIGMOD 0.00071084324
31 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00049839909
32 BIRCH: An Efficient Data Clustering Method for Very Large Databases 1996 SIGMOD 0.00049737458
49 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.00043160717
88 Automated Selection of Materialized Views and Indexes for SQL Databases 2000 VLDB 0.00035351639
123 Schism: a Workload-Driven Approach to Database Replication and Partitioning 2010 VLDB 0.00030762995
163 DB2 with BLU Acceleration: So Much More than Just a Column Store 2013 VLDB 0.0002749118
179 The Vertica Analytic Database: C-Store 7 Years Later 2012 VLDB 0.00026611886
195 Integrating Vertical and Horizontal Partitioning into Automated Physical Database Design 2004 SIGMOD 0.00025628849
216 Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing 1998 VLDB 0.00024485024
243 Automating Physical Database Design in a Parallel Database 2002 SIGMOD 0.00023358891
253 Database Cracking 2007 CIDR 0.00023042111
432 Shark: SQL and Rich Analytics at Scale 2013 SIGMOD 0.00018339357
644 Materialized View Selection in a Multidimensional Database 1997 VLDB 0.00015213935
1,117 Adaptive Range Filters for Cold Data: Avoiding Trips to Siberia 2013 VLDB 0.00011953704
1,210 Processing a Trillion Cells per Mouse Click 2012 VLDB 0.00011527605
2,155 Brighthouse: An Analytic Data Warehouse for Ad-hoc Queries 2008 VLDB 8.9456729e-05
3,440 Advanced Partitioning Techniques for Massively Distributed Computation 2012 SIGMOD 7.2986853e-05
3,856 Efficient Query Processing for Multi-Dimensionally Clustered Tables in DB2 2003 VLDB 6.96934e-05
Previous Page 1 / 1 Next

Semantically Similar Papers