DBScholar

Back to papers

Fine-grained Partitioning for Aggressive Data Skipping

Summary: Fine-grained blocking with per-block skip metadata enables aggressive data skipping. Tuples map to feature vectors from frequent-itemset filters; Balanced MaxSkip Partitioning is NP-hard and solved by bottom-up clustering, yielding 2–5x speedups over range-based blocking in Shark on TPC-H and real workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h6811c196acb94d96
Venue
SIGMOD
Year
2014
Pagerank
0.00012372946
Overall Rank
1,036 | 93.04%
DOI
10.1145/2588555.2610515

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{sun_sigmod14,
        title = {{Fine-grained Partitioning for Aggressive Data Skipping}},
        author = {Sun, Liwen and Franklin, Michael J. and Krishnan, Sanjay and Xin, Reynold S.},
        series = {{SIGMOD} '14},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2588555.2610515},
        url = {https://dl.acm.org/doi/10.1145/2588555.2610515},
        year = {2014}
}

Incoming Citations (Sorted by Pagerank)

Showing 41 of 41 citing papers.

Rank Citing Paper Year Venue Pagerank
52 The Snowflake Elastic Data Warehouse 2016 SIGMOD 0.00041210636
1,128 Qd-tree: Learning Data Layouts for Big Data Analytics 2020 SIGMOD 0.00011901941
1,373 High-Throughput Vector Similarity Search in Knowledge Graphs 2023 SIGMOD 0.00010891169
1,432 Towards a Learning Optimizer for Shared Clouds 2019 VLDB 0.00010676754
2,765 Instance-Optimized Data Layouts for Cloud Analytics Workloads 2021 SIGMOD 8.0401855e-05
2,880 Optimal Column Layout for Hybrid Workloads 2019 VLDB 7.9118308e-05
2,954 Column Sketches: A Scan Accelerator for Rapid and Robust Predicate Evaluation 2018 SIGMOD 7.8119682e-05
3,075 Pushing Data-Induced Predicates Through Joins in Big-Data Clusters 2020 VLDB 7.6742518e-05
3,083 Skipping-oriented Partitioning for Columnar Layouts 2017 VLDB 7.6620866e-05
3,445 Slalom: Coasting Through Raw Data via Adaptive Partitioning and Indexing 2017 VLDB 7.2911896e-05
3,597 Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe? 2017 SIGMOD 7.1759026e-05
4,534 AdaptDB: Adaptive Partitioning for Distributed Joins 2017 VLDB 6.5535468e-05
4,875 Design Tradeoffs of Data Access Methods 2016 SIGMOD 6.3699172e-05
5,213 A Padded Encoding Scheme to Accelerate Scans by Leveraging Skew 2015 SIGMOD 6.222614e-05
5,250 Endure: A Robust Tuning Paradigm for LSM Trees Under Workload Uncertainty 2022 VLDB 6.2092552e-05
5,451 Crystal: A Unified Cache Storage System for Analytical Databases 2021 VLDB 6.1238308e-05
5,619 BinDex: A Two-Layered Index for Fast and Robust Scans 2020 SIGMOD 6.0602908e-05
5,842 Pando: Enhanced Data Skipping with Logical Data Partitioning 2023 VLDB 5.971167e-05
6,202 Combining Aggregation and Sampling (Nearly) Optimally for Approximate Query Processing 2021 SIGMOD 5.8494367e-05
6,240 Predicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses 2024 SIGMOD 5.8373399e-05
6,447 RTScan: Efficient Scan with Ray Tracing Cores 2024 VLDB 5.7798274e-05
6,470 QUILTS: Multidimensional Partitioning Framework Based on Query-Aware and Skew-Tolerant Space-Filling Curves 2017 SIGMOD 5.7718975e-05
6,715 Replicated Layout for In-Memory Database Systems 2022 VLDB 5.6989853e-05
6,971 Jigsaw: A Data Storage and Query Processing Engine for Irregular Table Partitioning 2021 SIGMOD 5.628441e-05
7,000 Statisticum: Data Statistics Management in SAP HANA 2017 VLDB 5.6226404e-05
7,035 Wide Table Layout Optimization based on Column Ordering and Duplication 2017 SIGMOD 5.6141148e-05
7,247 Pruning in Snowflake: Working Smarter, Not Harder 2025 SIGMOD 5.5734736e-05
7,362 Optimizing Collections of Bloom Filters within a Space Budget 2024 VLDB 5.540567e-05
7,570 SIEVE: Effective Filtered Vector Search with Collection of Indexes 2025 VLDB 5.4929234e-05
8,186 Towards Designing and Learning Piecewise Space-Filling Curves 2023 VLDB 5.3800965e-05
8,204 WISK: A Workload-aware Learned Index for Spatial Keyword Queries 2023 SIGMOD 5.3769515e-05
8,210 Grep: A Graph Learning Based Database Partitioning System 2023 SIGMOD 5.3761621e-05
8,541 Cabin: a Compressed Adaptive Binned Scan Index 2024 SIGMOD 5.3190248e-05
8,686 Prompt: Dynamic Data-Partitioning for Distributed Micro-batch Stream Processing Systems 2020 SIGMOD 5.2882799e-05
10,128 Amoeba: A Shape changing Storage System for Big Data 2016 VLDB 5.0729194e-05
10,666 LiveBin: A Localized and Version-Aware Binned Scan Index 2026 SIGMOD 4.9769913e-05
11,122 Optimizing Block Skipping for High-Dimensional Data with Learned Adaptive Curve 2025 SIGMOD 4.9769913e-05
11,135 Dynamic Pruning for Recursive Joins 2025 SIGMOD 4.9769913e-05
11,733 SH2O: Efficient Data Access for Work-Sharing Databases 2023 SIGMOD 4.9769913e-05
12,076 Workload-Aware Column Imprints 2020 SIGMOD 4.9769913e-05
12,488 A Partitioning Framework for Aggressive Data Skipping 2014 VLDB 4.9769913e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 19 of 19 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
11 Implementing Data Cubes Efficiently 1996 SIGMOD 0.00071056708
31 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00049821554
32 BIRCH: An Efficient Data Clustering Method for Very Large Databases 1996 SIGMOD 0.00049714561
49 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.0004314366
88 Automated Selection of Materialized Views and Indexes for SQL Databases 2000 VLDB 0.00035340164
123 Schism: a Workload-Driven Approach to Database Replication and Partitioning 2010 VLDB 0.00030749898
163 DB2 with BLU Acceleration: So Much More than Just a Column Store 2013 VLDB 0.00027480091
178 The Vertica Analytic Database: C-Store 7 Years Later 2012 VLDB 0.00026620521
195 Integrating Vertical and Horizontal Partitioning into Automated Physical Database Design 2004 SIGMOD 0.00025619089
216 Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing 1998 VLDB 0.00024485637
243 Automating Physical Database Design in a Parallel Database 2002 SIGMOD 0.00023349603
252 Database Cracking 2007 CIDR 0.00023101361
432 Shark: SQL and Rich Analytics at Scale 2013 SIGMOD 0.00018331051
646 Materialized View Selection in a Multidimensional Database 1997 VLDB 0.00015207197
1,117 Adaptive Range Filters for Cold Data: Avoiding Trips to Siberia 2013 VLDB 0.00011952597
1,210 Processing a Trillion Cells per Mouse Click 2012 VLDB 0.0001152237
2,157 Brighthouse: An Analytic Data Warehouse for Ad-hoc Queries 2008 VLDB 8.9425625e-05
3,440 Advanced Partitioning Techniques for Massively Distributed Computation 2012 SIGMOD 7.2954357e-05
3,857 Efficient Query Processing for Multi-Dimensionally Clustered Tables in DB2 2003 VLDB 6.9662462e-05
Previous Page 1 / 1 Next

Semantically Similar Papers