DBScholar

Back to papers

Fine-grained Partitioning for Aggressive Data Skipping

Summary: Fine-grained blocking with per-block skip metadata enables aggressive data skipping. Tuples map to feature vectors from frequent-itemset filters; Balanced MaxSkip Partitioning is NP-hard and solved by bottom-up clustering, yielding 2–5x speedups over range-based blocking in Shark on TPC-H and real workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
4948
Venue
SIGMOD
Year
2014
Pagerank
0.0001244236
Overall Rank
1,044 | 92.84%
DOI
10.1145/2588555.2610515

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{sun_sigmod14,
        title = {{Fine-grained Partitioning for Aggressive Data Skipping}},
        author = {Sun, Liwen and Franklin, Michael J. and Krishnan, Sanjay and Xin, Reynold S.},
        series = {{SIGMOD} '14},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2588555.2610515},
        url = {https://dl.acm.org/doi/10.1145/2588555.2610515},
        year = {2014}
}

Incoming Citations (Sorted by Pagerank)

Showing 41 of 41 citing papers.

Rank Citing Paper Year Venue Pagerank
66 The Snowflake Elastic Data Warehouse 2016 SIGMOD 0.00038561587
1,135 Qd-tree: Learning Data Layouts for Big Data Analytics 2020 SIGMOD 0.00012032847
1,468 Towards a Learning Optimizer for Shared Clouds 2019 VLDB 0.00010686496
1,631 High-Throughput Vector Similarity Search in Knowledge Graphs 2023 SIGMOD 0.00010174628
2,866 Optimal Column Layout for Hybrid Workloads 2019 VLDB 8.0175489e-05
2,937 Column Sketches: A Scan Accelerator for Rapid and Robust Predicate Evaluation 2018 SIGMOD 7.9435581e-05
3,035 Instance-Optimized Data Layouts for Cloud Analytics Workloads 2021 SIGMOD 7.8297746e-05
3,106 Skipping-oriented Partitioning for Columnar Layouts 2017 VLDB 7.7515666e-05
3,137 Pushing Data-Induced Predicates Through Joins in Big-Data Clusters 2020 VLDB 7.7204167e-05
3,413 Slalom: Coasting Through Raw Data via Adaptive Partitioning and Indexing 2017 VLDB 7.4326381e-05
3,598 Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe? 2017 SIGMOD 7.2718988e-05
4,456 AdaptDB: Adaptive Partitioning for Distributed Joins 2017 VLDB 6.692321e-05
4,826 Design Tradeoffs of Data Access Methods 2016 SIGMOD 6.4904836e-05
5,122 A Padded Encoding Scheme to Accelerate Scans by Leveraging Skew 2015 SIGMOD 6.3573169e-05
5,348 Crystal: A Unified Cache Storage System for Analytical Databases 2021 VLDB 6.2562688e-05
5,512 BinDex: A Two-Layered Index for Fast and Robust Scans 2020 SIGMOD 6.1913331e-05
5,766 Endure: A Robust Tuning Paradigm for LSM Trees Under Workload Uncertainty 2022 VLDB 6.094771e-05
6,042 Pando: Enhanced Data Skipping with Logical Data Partitioning 2023 VLDB 5.9970052e-05
6,206 Combining Aggregation and Sampling (Nearly) Optimally for Approximate Query Processing 2021 SIGMOD 5.9443409e-05
6,335 QUILTS: Multidimensional Partitioning Framework Based on Query-Aware and Skew-Tolerant Space-Filling Curves 2017 SIGMOD 5.9090498e-05
6,602 Predicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses 2024 SIGMOD 5.8246665e-05
6,670 Replicated Layout for In-Memory Database Systems 2022 VLDB 5.8074043e-05
6,848 Jigsaw: A Data Storage and Query Processing Engine for Irregular Table Partitioning 2021 SIGMOD 5.7550624e-05
6,896 Wide Table Layout Optimization based on Column Ordering and Duplication 2017 SIGMOD 5.7440611e-05
6,907 Statisticum: Data Statistics Management in SAP HANA 2017 VLDB 5.7417459e-05
7,412 RTScan: Efficient Scan with Ray Tracing Cores 2024 VLDB 5.624223e-05
7,469 Optimizing Collections of Bloom Filters within a Space Budget 2024 VLDB 5.609743e-05
7,660 Pruning in Snowflake: Working Smarter, Not Harder 2025 SIGMOD 5.5736132e-05
8,003 Towards Designing and Learning Piecewise Space-Filling Curves 2023 VLDB 5.5084586e-05
8,042 Grep: A Graph Learning Based Database Partitioning System 2023 SIGMOD 5.5015896e-05
8,048 WISK: A Workload-aware Learned Index for Spatial Keyword Queries 2023 SIGMOD 5.5003171e-05
8,370 Cabin: a Compressed Adaptive Binned Scan Index 2024 SIGMOD 5.4409293e-05
8,568 Prompt: Dynamic Data-Partitioning for Distributed Micro-batch Stream Processing Systems 2020 SIGMOD 5.4118703e-05
9,145 SIEVE: Effective Filtered Vector Search with Collection of Indexes 2025 VLDB 5.3150984e-05
9,953 Amoeba: A Shape changing Storage System for Big Data 2016 VLDB 5.1901412e-05
10,468 LiveBin: A Localized and Version-Aware Binned Scan Index 2026 SIGMOD 5.093636e-05
10,672 Optimizing Block Skipping for High-Dimensional Data with Learned Adaptive Curve 2025 SIGMOD 5.093636e-05
10,690 Dynamic Pruning for Recursive Joins 2025 SIGMOD 5.093636e-05
11,413 SH2O: Efficient Data Access for Work-Sharing Databases 2023 SIGMOD 5.093636e-05
11,768 Workload-Aware Column Imprints 2020 SIGMOD 5.093636e-05
12,191 A Partitioning Framework for Aggressive Data Skipping 2014 VLDB 5.093636e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 19 of 19 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
11 Implementing Data Cubes Efficiently 1996 SIGMOD 0.00071822821
31 BIRCH: An Efficient Data Clustering Method for Very Large Databases 1996 SIGMOD 0.00050347119
32 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00050111008
51 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.0004291425
87 Automated Selection of Materialized Views and Indexes for SQL Databases 2000 VLDB 0.00035281619
126 Schism: a Workload-Driven Approach to Database Replication and Partitioning 2010 VLDB 0.00030779127
165 DB2 with BLU Acceleration: So Much More than Just a Column Store 2013 VLDB 0.00027693424
186 The Vertica Analytic Database: C-Store 7 Years Later 2012 VLDB 0.00026182534
199 Integrating Vertical and Horizontal Partitioning into Automated Physical Database Design 2004 SIGMOD 0.00025612088
227 Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing 1998 VLDB 0.00023958508
246 Automating Physical Database Design in a Parallel Database 2002 SIGMOD 0.00023457421
259 Database Cracking 2007 CIDR 0.00023119313
425 Shark: SQL and Rich Analytics at Scale 2013 SIGMOD 0.00018704491
638 Materialized View Selection in a Multidimensional Database 1997 VLDB 0.000154719
1,126 Adaptive Range Filters for Cold Data: Avoiding Trips to Siberia 2013 VLDB 0.00012078607
1,225 Processing a Trillion Cells per Mouse Click 2012 VLDB 0.00011590013
2,150 Brighthouse: An Analytic Data Warehouse for Ad-hoc Queries 2008 VLDB 9.081101e-05
3,466 Advanced Partitioning Techniques for Massively Distributed Computation 2012 SIGMOD 7.3909785e-05
3,796 Efficient Query Processing for Multi-Dimensionally Clustered Tables in DB2 2003 VLDB 7.1198446e-05
Previous Page 1 / 1 Next

Semantically Similar Papers