DBScholar

Back to papers

Fine-grained Partitioning for Aggressive Data Skipping

Summary: Fine-grained blocking with per-block skip metadata enables aggressive data skipping. Tuples map to feature vectors from frequent-itemset filters; Balanced MaxSkip Partitioning is NP-hard and solved by bottom-up clustering, yielding 2–5x speedups over range-based blocking in Shark on TPC-H and real workloads. (summarized by gpt-5-nano on Feb 09 2026)

Paper ID
h6811c196acb94d96
Venue
SIGMOD
Year
2014
Pagerank
0.00012349128
Overall Rank
1,039 | 93.04%
DOI
10.1145/2588555.2610515

Incoming Non-self Citations Over Time

Authors

BibTeX Citation

@inproceedings{sun_sigmod14,
        title = {{Fine-grained Partitioning for Aggressive Data Skipping}},
        author = {Sun, Liwen and Franklin, Michael J. and Krishnan, Sanjay and Xin, Reynold S.},
        series = {{SIGMOD} '14},
        booktitle = {Proceedings of the {ACM} {SIGMOD} International Conference on Management of Data},
        publisher = {Association for Computing Machinery},
        doi = {10.1145/2588555.2610515},
        url = {https://dl.acm.org/doi/10.1145/2588555.2610515},
        year = {2014}
}

Incoming Citations (Sorted by Pagerank)

Showing 41 of 41 citing papers.

Rank Citing Paper Year Venue Pagerank
52 The Snowflake Elastic Data Warehouse 2016 SIGMOD 0.00041439488
1,132 Qd-tree: Learning Data Layouts for Big Data Analytics 2020 SIGMOD 0.00011873466
1,371 High-Throughput Vector Similarity Search in Knowledge Graphs 2023 SIGMOD 0.00010874981
1,436 Towards a Learning Optimizer for Shared Clouds 2019 VLDB 0.00010658836
2,772 Instance-Optimized Data Layouts for Cloud Analytics Workloads 2021 SIGMOD 8.0148928e-05
2,891 Optimal Column Layout for Hybrid Workloads 2019 VLDB 7.887378e-05
2,965 Column Sketches: A Scan Accelerator for Rapid and Robust Predicate Evaluation 2018 SIGMOD 7.7894987e-05
3,081 Pushing Data-Induced Predicates Through Joins in Big-Data Clusters 2020 VLDB 7.6515625e-05
3,094 Skipping-oriented Partitioning for Columnar Layouts 2017 VLDB 7.637515e-05
3,456 Slalom: Coasting Through Raw Data via Adaptive Partitioning and Indexing 2017 VLDB 7.2673968e-05
3,606 Access Path Selection in Main-Memory Optimized Data Systems: Should I Scan or Should I Probe? 2017 SIGMOD 7.1528863e-05
4,550 AdaptDB: Adaptive Partitioning for Distributed Joins 2017 VLDB 6.5327021e-05
4,897 Design Tradeoffs of Data Access Methods 2016 SIGMOD 6.3489205e-05
5,210 Crystal: A Unified Cache Storage System for Analytical Databases 2021 VLDB 6.2142008e-05
5,236 A Padded Encoding Scheme to Accelerate Scans by Leveraging Skew 2015 SIGMOD 6.2037372e-05
5,272 Endure: A Robust Tuning Paradigm for LSM Trees Under Workload Uncertainty 2022 VLDB 6.1887235e-05
5,632 BinDex: A Two-Layered Index for Fast and Robust Scans 2020 SIGMOD 6.0402517e-05
5,856 Pando: Enhanced Data Skipping with Logical Data Partitioning 2023 VLDB 5.9514226e-05
6,198 Combining Aggregation and Sampling (Nearly) Optimally for Approximate Query Processing 2021 SIGMOD 5.8362492e-05
6,250 Predicate Caching: Query-Driven Secondary Indexing for Cloud Data Warehouses 2024 SIGMOD 5.818039e-05
6,459 RTScan: Efficient Scan with Ray Tracing Cores 2024 VLDB 5.7607157e-05
6,484 QUILTS: Multidimensional Partitioning Framework Based on Query-Aware and Skew-Tolerant Space-Filling Curves 2017 SIGMOD 5.752812e-05
6,730 Replicated Layout for In-Memory Database Systems 2022 VLDB 5.6801409e-05
6,977 Jigsaw: A Data Storage and Query Processing Engine for Irregular Table Partitioning 2021 SIGMOD 5.6135617e-05
7,019 Statisticum: Data Statistics Management in SAP HANA 2017 VLDB 5.6041386e-05
7,054 Wide Table Layout Optimization based on Column Ordering and Duplication 2017 SIGMOD 5.5956321e-05
7,264 Pruning in Snowflake: Working Smarter, Not Harder 2025 SIGMOD 5.5557256e-05
7,383 Optimizing Collections of Bloom Filters within a Space Budget 2024 VLDB 5.5222465e-05
7,585 SIEVE: Effective Filtered Vector Search with Collection of Indexes 2025 VLDB 5.4747603e-05
8,201 Towards Designing and Learning Piecewise Space-Filling Curves 2023 VLDB 5.3623066e-05
8,219 WISK: A Workload-aware Learned Index for Spatial Keyword Queries 2023 SIGMOD 5.359172e-05
8,225 Grep: A Graph Learning Based Database Partitioning System 2023 SIGMOD 5.3583852e-05
8,560 Cabin: a Compressed Adaptive Binned Scan Index 2024 SIGMOD 5.3014368e-05
8,705 Prompt: Dynamic Data-Partitioning for Distributed Micro-batch Stream Processing Systems 2020 SIGMOD 5.2707935e-05
10,165 Amoeba: A Shape changing Storage System for Big Data 2016 VLDB 5.0561788e-05
10,727 LiveBin: A Localized and Version-Aware Binned Scan Index 2026 SIGMOD 4.9605343e-05
11,183 Optimizing Block Skipping for High-Dimensional Data with Learned Adaptive Curve 2025 SIGMOD 4.9605343e-05
11,195 Dynamic Pruning for Recursive Joins 2025 SIGMOD 4.9605343e-05
11,777 SH2O: Efficient Data Access for Work-Sharing Databases 2023 SIGMOD 4.9605343e-05
12,120 Workload-Aware Column Imprints 2020 SIGMOD 4.9605343e-05
12,531 A Partitioning Framework for Aggressive Data Skipping 2014 VLDB 4.9605343e-05
Previous Page 1 / 1 Next

Outgoing Citations (Sorted by Pagerank)

Showing 19 of 19 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank Cited Paper Year Venue Pagerank
11 Implementing Data Cubes Efficiently 1996 SIGMOD 0.00070860346
31 Hive - A Warehousing Solution Over a Map-Reduce Framework 2009 VLDB 0.00049707539
32 BIRCH: An Efficient Data Clustering Method for Very Large Databases 1996 SIGMOD 0.00049559562
49 Dremel: Interactive Analysis of Web-Scale Datasets 2010 VLDB 0.00043085722
89 Automated Selection of Materialized Views and Indexes for SQL Databases 2000 VLDB 0.00035265687
122 Schism: a Workload-Driven Approach to Database Replication and Partitioning 2010 VLDB 0.00030701814
161 DB2 with BLU Acceleration: So Much More than Just a Column Store 2013 VLDB 0.00027629724
177 The Vertica Analytic Database: C-Store 7 Years Later 2012 VLDB 0.00026571747
196 Integrating Vertical and Horizontal Partitioning into Automated Physical Database Design 2004 SIGMOD 0.00025581936
216 Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing 1998 VLDB 0.00024446892
243 Automating Physical Database Design in a Parallel Database 2002 SIGMOD 0.00023296011
253 Database Cracking 2007 CIDR 0.00023037921
436 Shark: SQL and Rich Analytics at Scale 2013 SIGMOD 0.00018274105
648 Materialized View Selection in a Multidimensional Database 1997 VLDB 0.00015161755
1,117 Adaptive Range Filters for Cold Data: Avoiding Trips to Siberia 2013 VLDB 0.00011928965
1,212 Processing a Trillion Cells per Mouse Click 2012 VLDB 0.00011493478
2,168 Brighthouse: An Analytic Data Warehouse for Ad-hoc Queries 2008 VLDB 8.9159881e-05
3,453 Advanced Partitioning Techniques for Massively Distributed Computation 2012 SIGMOD 7.2720027e-05
3,867 Efficient Query Processing for Multi-Dimensionally Clustered Tables in DB2 2003 VLDB 6.9438458e-05
Previous Page 1 / 1 Next

Semantically Similar Papers