Pando: Enhanced Data Skipping with Logical Data Partitioning

Summary: Pando improves automatic physical layout design by exploiting correlations among workload predicates through logical, correlation-aware partitioning. It enables up to 2.8× fewer blocks scanned and 2.3× faster queries than state-of-the-art skipping methods. (summarized by gpt-5.6-luna on Jul 24 2026)

Paper ID: h3895df094cd03506
Venue: VLDB
Year: 2023
Pagerank: 5.9708829e-05
Overall Rank: 5,854 | 60.65%
DOI: 10.14778/3598581.3598601

Incoming Non-self Citations Over Time

Authors

1. Sivaprasad Sudhir (Massachusetts Institute of Technology; Meta)
2. Wenbo Tao (Meta)
3. Nikolay Laptev (Meta)
4. Cyrille Habis (Meta)
5. Michael Cafarella (Massachusetts Institute of Technology)
6. Samuel Madden (Massachusetts Institute of Technology)

BibTeX Citation

@article{sudhir_vldb23,
        title = {{Pando: Enhanced Data Skipping with Logical Data Partitioning}},
        author = {Sudhir, Sivaprasad and Tao, Wenbo and Laptev, Nikolay and Habis, Cyrille and Cafarella, Michael and Madden, Samuel},
        journal = {PVLDB},
        series = {{VLDB} '23},
        volume = {16},
        number = {9},
        pages = {2316--2329},
        doi = {10.14778/3598581.3598601},
        url = {https://doi.org/10.14778/3598581.3598601},
        year = {2023}
}

Incoming Citations (Sorted by Pagerank)

Showing 7 of 7 citing papers.

Rank	Citing Paper	Year	Venue	Pagerank
6,209	Automated Multidimensional Data Layouts in Amazon Redshift	2024	SIGMOD	5.8495489e-05
7,358	Optimizing Collections of Bloom Filters within a Space Budget	2024	VLDB	5.5431911e-05
10,100	Adaptive data transformations for QaaS	2025	CIDR	5.0789354e-05
10,556	Counting Is All You Need for Instant Tuple Discovery: Enabling Real-Time HTAP in Standalone DBMSs	2026	SIGMOD	4.9793485e-05
10,619	Honeybee: Efficient Role-based Access Control for Vector Databases via Dynamic Partitioning	2026	SIGMOD	4.9793485e-05
10,843	I-Rex: An Interactive Debugger for SQL	2026	VLDB	4.9793485e-05
11,601	Partition, Don’t Sort! Compression Boosters for Cloud Data Ingestion Pipelines	2024	VLDB	4.9793485e-05

Outgoing Citations (Sorted by Pagerank)

Showing 27 of 27 cited papers.

Citations counted here include only citations to other VLDB/SIGMOD/CIDR/PODS papers in this database.

Rank	Cited Paper	Year	Venue	Pagerank
12	C-Store: A Column-oriented DBMS	2005	VLDB	0.00068998927
15	How Good Are Query Optimizers, Really?	2016	VLDB	0.00061066921
88	Automated Selection of Materialized Views and Indexes for SQL Databases	2000	VLDB	0.00035351639
123	Schism: a Workload-Driven Approach to Database Replication and Partitioning	2010	VLDB	0.00030762995
151	An Efficient, Cost-Driven Index Selection Tool for Microsoft SQL Server	1997	VLDB	0.00028672526
195	Integrating Vertical and Horizontal Partitioning into Automated Physical Database Design	2004	SIGMOD	0.00025628849
216	Small Materialized Aggregates: A Light Weight Index Structure for Data Warehousing	1998	VLDB	0.00024485024
243	Automating Physical Database Design in a Parallel Database	2002	SIGMOD	0.00023358891
555	SageDB: A Learned Database System	2019	CIDR	0.00016506678
944	Enhancements to SQL Server Column Stores	2013	SIGMOD	0.00012939697
1,036	Fine-grained Partitioning for Aggressive Data Skipping	2014	SIGMOD	0.00012377471
1,132	Qd-tree: Learning Data Layouts for Big Data Analytics	2020	SIGMOD	0.00011898257
1,191	Tsunami: A Learned Multi-dimensional Index for Correlated Data and Skewed Workloads	2021	VLDB	0.00011590153
1,488	Efficient Discovery of Approximate Dependencies	2018	VLDB	0.00010517437
1,662	BHUNT: Automatic Discovery of Fuzzy Algebraic Constraints in Relational Data	2003	VLDB	9.9465656e-05
2,238	Designing Succinct Secondary Indexing Mechanism by Exploiting Column Correlations	2019	SIGMOD	8.7751619e-05
2,329	Correlation Maps: A Compressed Access Method for Exploiting Soft Functional Dependencies	2009	VLDB	8.6292256e-05
2,478	Learning a Partitioning Advisor for Cloud Databases	2020	SIGMOD	8.4079121e-05
2,765	Instance-Optimized Data Layouts for Cloud Analytics Workloads	2021	SIGMOD	8.0439015e-05
2,882	Optimal Column Layout for Hybrid Workloads	2019	VLDB	7.9116043e-05
3,073	Pushing Data-Induced Predicates Through Joins in Big-Data Clusters	2020	VLDB	7.6777283e-05
3,081	Skipping-oriented Partitioning for Columnar Layouts	2017	VLDB	7.6653727e-05
3,445	Slalom: Coasting Through Raw Data via Adaptive Partitioning and Indexing	2017	VLDB	7.2943981e-05
3,500	CORADD: Correlation Aware Database Designer for Materialized Views and Indexes	2010	VLDB	7.2534237e-05
4,022	STAR: Scaling Transactions through Asymmetric Replication	2019	VLDB	6.8496651e-05
5,929	Self-Organizing Data Containers	2022	CIDR	5.9439349e-05
6,719	Replicated Layout for In-Memory Database Systems	2022	VLDB	5.6985717e-05

Semantically Similar Papers

#	Overall Rank	Paper	Year	Venue
1	7,706	Query Centric Partitioning and Allocation for Partially Replicated Database Systems	2017	SIGMOD
2	10,022	Towards Functional Decomposition of Storage Formats	2025	CIDR
3	472	Skew-Aware Automatic Database Partitioning in Shared-Nothing, Parallel OLTP Systems	2012	SIGMOD
4	6,782	Adaptive Data Skipping in Main-Memory Systems	2016	SIGMOD
5	243	Automating Physical Database Design in a Parallel Database	2002	SIGMOD
6	3,239	Locality-aware Partitioning in Parallel Database Systems	2015	SIGMOD
7	1,036	Fine-grained Partitioning for Aggressive Data Skipping	2014	SIGMOD
8	8,495	Provenance-based Data Skipping	2022	VLDB
9	3,081	Skipping-oriented Partitioning for Columnar Layouts	2017	VLDB
10	12,482	A Partitioning Framework for Aggressive Data Skipping	2014	VLDB